!eWOErHSaiddIbsUNsJ:nixos.org

NixOS CUDA

332 Members
CUDA packages maintenance and support in nixpkgs | https://github.com/orgs/NixOS/projects/27/ | https://nixos.org/manual/nixpkgs/unstable/#cuda63 Servers

Load older messages


SenderMessageTime
10 May 2026
@hexa:lossy.networkhexadoes flox do aarch64-linux??/20:48:54
@hexa:lossy.networkhexaRedacted or Malformed Event20:48:56
@hexa:lossy.networkhexaI'd say right now the problem is that renting aarch64-linux for cheap is not really possible20:49:27
@neobrain:matrix.orgneobrainAh! nixos-dgx-spark overrides nixpkgs.config.cudaCapabilities in an attempt to improve compile times, but then the side effect of it is that the slim configuration isn't cached by flox. Resetting the variable gives me cache hits again20:50:21
@neobrain:matrix.orgneobrainYup they do20:50:34
@neobrain:matrix.orgneobrainyeah that makes sense :(20:51:39
@sporeray:matrix.orgRobbie Buxton
In reply to @hexa:lossy.network
I'd say right now the problem is that renting aarch64-linux for cheap is not really possible
I don’t think it’s too bad in hyper scalers (graviton isn’t bad) not sure about other places tho
20:54:26
@hexa:lossy.networkhexayeah, but cheap :D20:57:14
@sporeray:matrix.orgRobbie Buxton Last time I checked graviton was similar if not cheaper 20:58:00
@neobrain:matrix.orgneobrainI'm guessing self-hosting has been considered but isn't an option? nvidia has a pretty generous marketing budget for free hardware21:01:09
@glepage:matrix.orgGaétan Lepage aarch64-linux support is definitely on our roadmap. For now, the critical blocker is getting access to relevant hardware. I'll give updates in this channel as soon as we get new opportunities in this regard. 21:01:46
@mjolnir:nixos.orgNixOS Moderation Botchanged room power levels.21:07:38
11 May 2026
@glepage:matrix.orgGaétan Lepage Looking for an approval on https://github.com/NixOS/nixpkgs/pull/517764 (cudaPackages.cudnn update).
connor (burnt/out) (UTC-8) maybe?
15:52:02
@smudgebun:matrix.orgsmudge (she/her)Redacted or Malformed Event19:34:06
@smudgebun:matrix.orgsmudge (she/her) should the nixos wiki cuda page's cache section be corrected? it recommends the cache.nixos-cuda.org cache and doesn't mention others which lead me to assume it was the one for public use. is nix-community.cachix.org (per this announcement) the one that should be primarily recommended on the wiki? as well as information about using flox's nixpkgs repo and its cache? Or, if the nix-community.cachix.org isn't actually allowed to distribute should flox be the primary suggested cache?

also should the information for cache.nixos-cuda.org be retained, just with a proper disclaimer that it is for internal use only, or how would you like that to be handled?
19:40:10
@smudgebun:matrix.orgsmudge (she/her) should the nixos wiki cuda page's cache section be corrected? it recommends the cache.nixos-cuda.org cache and doesn't mention others which lead me to assume it was the one for public use. is nix-community.cachix.org (per this announcement) the one that should be primarily recommended on the wiki? as well as information about using flox's nixpkgs repo and its cache? Or, if the nix-community.cachix.org isn't actually allowed to distribute should flox be the primary suggested way to access a cuda cache?

also should the information for cache.nixos-cuda.org be retained, just with a proper disclaimer that it is for internal use only, or how would you like that to be handled?
19:44:22
@smudgebun:matrix.orgsmudge (she/her) should the nixos wiki cuda page's cache section be corrected? it recommends the cache.nixos-cuda.org cache and doesn't mention others which lead me to assume it was the one for public use. is nix-community.cachix.org (per this announcement) the one that should be primarily recommended on the wiki? as well as information about using flox's nixpkgs repo and its cache? Or, if the nix-community.cachix.org isn't technically allowed to distribute should flox be the primary suggested way to access a cuda cache?

also should the information for cache.nixos-cuda.org be retained, just with a proper disclaimer that it is for internal use only, or how would you like that to be handled?
20:10:58
@smudgebun:matrix.orgsmudge (she/her) should the nixos wiki cuda page's cache section be corrected? it recommends the cache.nixos-cuda.org cache and doesn't mention others which lead me to assume it was the one for public use. is nix-community.cachix.org (per this announcement) the one that should be primarily recommended on the wiki? as well as information about using flox's nixpkgs repo and its cache? Or, if the nix-community.cachix.org isn't technically allowed to distribute should flox be the primary suggested way to access a cuda cache?

also should the information for cache.nixos-cuda.org be retained, just with a disclaimer that it is for internal use only?
20:14:14
13 May 2026
@smudgebun:matrix.orgsmudge (she/her) changed their display name from smudge to smudge (she/her).08:48:06
14 May 2026
@weriomat:matrix.orgweriomat joined the room.21:11:04
15 May 2026
@graysontinker:matrix.orgGrayson Tinker changed their display name from graysontinker to Grayson Tinker.03:47:21
@ccicnce113424:matrix.orgccicnce113424

I'm currently working on improving the packaging of the NVIDIA driver. My plan, is to first split the namespace and driver extraction into two separate files without changing semantics with the assistance of LLM, and then switch from the current passthru pattern to using scope.

The first step is now complete. Semantics should be unchanged. I'm not sure how to verify semantic equivalence (suggestions welcome!), but this PR works fine with my current NixOS configuration.

As a side note, I also moved nvidia-modprobe into the nvidiaPackages namespace.

Since these changes are mostly structural and don't alter semantics, could they be merged separately, with the scope migration and further work happening in a new PR?

09:07:14
@ccicnce113424:matrix.orgccicnce113424 https://github.com/NixOS/nixpkgs/pull/519313 09:07:25
16 May 2026
@asp345:matrix.orgasp345 joined the room.13:24:37
18 May 2026
@yorik.sar:matrix.orgyorik.sar Gaétan Lepage: Here's a different fix for the libcusolvermp issue that we had: let's add all of cudaPackages that change by PR to the PR check. https://github.com/nixos-cuda/hydra-jobsets/pull/29 - wdyt? 14:26:40
19 May 2026
@hilorioze:matrix.orghilorioze changed their display name from Yan Hilorioze to hilorioze.16:41:32
@81reap:matrix.orgPrayag Bhakar joined the room.20:15:25
@81reap:matrix.orgPrayag Bhakarhey folks, I'm looking for feedback on this PR :: https://github.com/NixOS/nixpkgs/pull/515928 My goal with these changes is to speed up my NVIDIA Jetson Orin Nano builds by adding dGPU architectures targets for Jetson Xavier (sm_72), Jetson Orin (sm_87), Jetson Thor (sm_110). I'm happy to iterate more on the changes if there is feedback :) 20:22:59
@81reap:matrix.orgPrayag Bhakarif/when this gets merged, I was planning on raising a follow-up fix to the nixos-cuda inference package to support these new params. https://github.com/nixos-cuda/infra20:25:01
@glepage:matrix.orgGaétan Lepage Hi! Just so you know, aarch64-linux is not supported in our current CI. 21:24:45

Show newer messages


Back to Room ListRoom Version: 9