!eWOErHSaiddIbsUNsJ:nixos.org

NixOS CUDA

326 Members
CUDA packages maintenance and support in nixpkgs | https://github.com/orgs/NixOS/projects/27/ | https://nixos.org/manual/nixpkgs/unstable/#cuda64 Servers

Load older messages


SenderMessageTime
2 May 2026
@glepage:matrix.orgGaétan LepageMerged, thanks!22:43:36
5 May 2026
@gdesforges:matrix.org@gdesforges:matrix.org left the room.10:45:13
7 May 2026
@unk1ndled:matrix.orgAmine joined the room.14:01:25
9 May 2026
@tfc:matrix.orgtfc joined the room.20:55:50
10 May 2026
@neobrain:matrix.orgneobrainCUDA-enabled firefox/thunderbird builds are normally supposed to be part of the flox cache, right?17:55:51
@hexa:lossy.networkhexa we lack introspection into the flox cache 18:07:38
@hexa:lossy.networkhexaI doubt it's getting much use18:07:44
@hexa:lossy.networkhexanixos-cuda.org otoh works fairly well18:08:00
@hexa:lossy.networkhexathe primary question around nixos-cuda.org is sustainability18:09:04
@neobrain:matrix.orgneobrainnice, I'll try moving to that later: https://hydra.nixos-cuda.org/build/369104#tabs-buildinputs18:11:33
@neobrain:matrix.orgneobrainit's surprising to me how difficult most nix caches are to use effectively when you're not able to see which packages are cached to begin with (and in which specific versions)18:13:37
@hexa:lossy.networkhexayeah, I mean you don't know whether they're trackin the branch you are using18:14:23
@hexa:lossy.networkhexaor if they are uptodate on that branch18:14:29
@hexa:lossy.networkhexafor the flox cache they are trracking their nixpkgs fork, not upstream nixpkgs18:14:55
@hexa:lossy.networkhexaand they have their own branches and rules how they propagate from branch to branch18:15:18
@neobrain:matrix.orgneobrainyeah I already tried changing my nixpkgs input to follow flox's, so who knows what's wrong 🤷18:16:13
@tomberek:matrix.orgtomberekThis has been a long-standing problem, how to track what is cached and the pins. The underlying issue is that it makes the caches a critical component of the publishing process, not just an optimization. One approach is to encode this into "fake derivations" that promise to be substitutable (eg: via fetchClosure or similar mechanisms). The issue with your attempt on the flox cache is using the wrong nixpkgs. Are you tracking one of the "stable"/"unstable" branches at https://github.com/flox/nixpkgs/tree/stable ?18:23:30
@glepage:matrix.orgGaétan Lepage We (nixos-cuda.org) build all nixpkgs packages with cudaSupport = true (as long as the hash differs from the non-cudaSupport version).
Our jobsets are publicly available here.
19:26:07
@glepage:matrix.orgGaétan Lepage

Having said that, the cache.nixos-cuda.org binary cache is not meant to be consumed by the general public. NVIDIA restricts how certains packages should not be distributed after being patched. This cache is a development resource for the cuda team members.
Flox is the only nix-related entity allowed to redistribute those packages.

https://github.com/nixos-cuda/infra?tab=readme-ov-file#binary-cache

19:28:17
@glepage:matrix.orgGaétan Lepage *

Having said that, the cache.nixos-cuda.org binary cache is not meant to be consumed by the general public. NVIDIA restricts the redistribution of certain packages after having been patched. This cache is a development resource for the cuda team members.
Flox is the only nix-related entity allowed to redistribute those packages.

https://github.com/nixos-cuda/infra?tab=readme-ov-file#binary-cache

19:29:14
@glepage:matrix.orgGaétan Lepage *

Having said that, the cache.nixos-cuda.org binary cache is not meant to be consumed by the general public. NVIDIA restricts the redistribution of certain packages after having been patched. This cache is a development resource for the nix cuda team members.
Flox is the only nix-related entity allowed to redistribute those packages.

https://github.com/nixos-cuda/infra?tab=readme-ov-file#binary-cache

19:29:55
@neobrain:matrix.orgneobrain yes, I'm using nixpkgs.url = "github:flox/nixpkgs/unstable" in my flake inputs 20:24:10
@neobrain:matrix.orgneobrainI just remembered that nixos-cuda.org doesn't do aarch64 yet, so I can't give it a try after all :(20:25:01
@hexa:lossy.networkhexadoes flox do aarch64-linux??/20:48:54
@hexa:lossy.networkhexaRedacted or Malformed Event20:48:56
@hexa:lossy.networkhexaI'd say right now the problem is that renting aarch64-linux for cheap is not really possible20:49:27
@neobrain:matrix.orgneobrainAh! nixos-dgx-spark overrides nixpkgs.config.cudaCapabilities in an attempt to improve compile times, but then the side effect of it is that the slim configuration isn't cached by flox. Resetting the variable gives me cache hits again20:50:21
@neobrain:matrix.orgneobrainYup they do20:50:34
@neobrain:matrix.orgneobrainyeah that makes sense :(20:51:39
@sporeray:matrix.orgRobbie Buxton
In reply to @hexa:lossy.network
I'd say right now the problem is that renting aarch64-linux for cheap is not really possible
I don’t think it’s too bad in hyper scalers (graviton isn’t bad) not sure about other places tho
20:54:26

Show newer messages


Back to Room ListRoom Version: 9