!eWOErHSaiddIbsUNsJ:nixos.org

NixOS CUDA

323 Members
CUDA packages maintenance and support in nixpkgs | https://github.com/orgs/NixOS/projects/27/ | https://nixos.org/manual/nixpkgs/unstable/#cuda64 Servers

Load older messages


SenderMessageTime
10 May 2026
@hexa:lossy.networkhexaI'd say right now the problem is that renting aarch64-linux for cheap is not really possible20:49:27
@neobrain:matrix.orgneobrainAh! nixos-dgx-spark overrides nixpkgs.config.cudaCapabilities in an attempt to improve compile times, but then the side effect of it is that the slim configuration isn't cached by flox. Resetting the variable gives me cache hits again20:50:21
@neobrain:matrix.orgneobrainYup they do20:50:34
@neobrain:matrix.orgneobrainyeah that makes sense :(20:51:39
@sporeray:matrix.orgRobbie Buxton
In reply to @hexa:lossy.network
I'd say right now the problem is that renting aarch64-linux for cheap is not really possible
I don’t think it’s too bad in hyper scalers (graviton isn’t bad) not sure about other places tho
20:54:26
@hexa:lossy.networkhexayeah, but cheap :D20:57:14
@sporeray:matrix.orgRobbie Buxton Last time I checked graviton was similar if not cheaper 20:58:00
@neobrain:matrix.orgneobrainI'm guessing self-hosting has been considered but isn't an option? nvidia has a pretty generous marketing budget for free hardware21:01:09
@glepage:matrix.orgGaétan Lepage aarch64-linux support is definitely on our roadmap. For now, the critical blocker is getting access to relevant hardware. I'll give updates in this channel as soon as we get new opportunities in this regard. 21:01:46
@mjolnir:nixos.orgNixOS Moderation Botchanged room power levels.21:07:38
11 May 2026
@glepage:matrix.orgGaétan Lepage Looking for an approval on https://github.com/NixOS/nixpkgs/pull/517764 (cudaPackages.cudnn update).
connor (burnt/out) (UTC-8) maybe?
15:52:02
@smudgebun:matrix.orgsmudge (she/her)Redacted or Malformed Event19:34:06
@smudgebun:matrix.orgsmudge (she/her) should the nixos wiki cuda page's cache section be corrected? it recommends the cache.nixos-cuda.org cache and doesn't mention others which lead me to assume it was the one for public use. is nix-community.cachix.org (per this announcement) the one that should be primarily recommended on the wiki? as well as information about using flox's nixpkgs repo and its cache? Or, if the nix-community.cachix.org isn't actually allowed to distribute should flox be the primary suggested cache?

also should the information for cache.nixos-cuda.org be retained, just with a proper disclaimer that it is for internal use only, or how would you like that to be handled?
19:40:10
@smudgebun:matrix.orgsmudge (she/her) should the nixos wiki cuda page's cache section be corrected? it recommends the cache.nixos-cuda.org cache and doesn't mention others which lead me to assume it was the one for public use. is nix-community.cachix.org (per this announcement) the one that should be primarily recommended on the wiki? as well as information about using flox's nixpkgs repo and its cache? Or, if the nix-community.cachix.org isn't actually allowed to distribute should flox be the primary suggested way to access a cuda cache?

also should the information for cache.nixos-cuda.org be retained, just with a proper disclaimer that it is for internal use only, or how would you like that to be handled?
19:44:22
@smudgebun:matrix.orgsmudge (she/her) should the nixos wiki cuda page's cache section be corrected? it recommends the cache.nixos-cuda.org cache and doesn't mention others which lead me to assume it was the one for public use. is nix-community.cachix.org (per this announcement) the one that should be primarily recommended on the wiki? as well as information about using flox's nixpkgs repo and its cache? Or, if the nix-community.cachix.org isn't technically allowed to distribute should flox be the primary suggested way to access a cuda cache?

also should the information for cache.nixos-cuda.org be retained, just with a proper disclaimer that it is for internal use only, or how would you like that to be handled?
20:10:58
@smudgebun:matrix.orgsmudge (she/her) should the nixos wiki cuda page's cache section be corrected? it recommends the cache.nixos-cuda.org cache and doesn't mention others which lead me to assume it was the one for public use. is nix-community.cachix.org (per this announcement) the one that should be primarily recommended on the wiki? as well as information about using flox's nixpkgs repo and its cache? Or, if the nix-community.cachix.org isn't technically allowed to distribute should flox be the primary suggested way to access a cuda cache?

also should the information for cache.nixos-cuda.org be retained, just with a disclaimer that it is for internal use only?
20:14:14
13 May 2026
@smudgebun:matrix.orgsmudge (she/her) changed their display name from smudge to smudge (she/her).08:48:06
14 May 2026
@weriomat:matrix.orgweriomat joined the room.21:11:04
15 May 2026
@graysontinker:matrix.orgGrayson Tinker changed their display name from graysontinker to Grayson Tinker.03:47:21
4 Aug 2022
@winterqt:nixos.devWinter (she/her) joined the room.03:26:42
@winterqt:nixos.devWinter (she/her)(hi, just came here to read + respond to this.)03:28:52
@tpw_rules:matrix.orgtpw_ruleshey. i had previously sympathzied with samuela and like i said before had some of the same frustrations. i just edited my github comment to add "[CUDA] packages are universally complicated, fragile to package, and critical to daily operations. Nix being able to manage them is unbelievably helpful to those of us who work with them regularly, even if support is downgraded to only having an expectation of function on stable branches."03:29:14
@winterqt:nixos.devWinter (she/her)
In reply to @tpw_rules:matrix.org
i'm mildly peeved about a recent merging of something i maintain where i'm pretty sure the merger does not own the expensive hardware required to properly test the package. i don't think it broke anything but i was given precisely 45 minutes to see the notification before somebody merged it
ugh, 45 minutes? that's... not great. not to air dirty laundry but did you do what samuela did in the wandb PR and at least say that that wasn't a great thing to do? (not sure how else to word that, you get what i mean)
03:30:23
@tpw_rules:matrix.orgtpw_rulesno, i haven't yet, but i probably will03:31:03
@winterqt:nixos.devWinter (she/her) i admittedly did that with a PR once, i forget how long the maintainer was requested for but i merged it because multiple people reported it fixed the issue. the maintainer said "hey, don't do that" after and now i do think twice before merging. so it could help, is what i'm saying. 03:31:50
@tpw_rules:matrix.orgtpw_rulesi'm not sure what went wrong with the wandb PR anyway, i think it was just a boneheaded move on the maintainer's part03:32:10
@winterqt:nixos.devWinter (she/her)(it was also simple enough that it was fine and the maintainer said it looked good after)03:32:15
@tpw_rules:matrix.orgtpw_rules * i'm not sure what went wrong with the wandb PR anyway, i think it was just a boneheaded move on the merger's part03:32:19
@tpw_rules:matrix.orgtpw_rulesbut i thought most of the frustration was around packages which don't really involve CUDA breaking the fragile CUDA packages, and i'm not sure how the warning helps in this case. it's not like nixpkgs-review prints out the comments. maybe i'm wrong. but it is a legitimate problem03:34:19
@winterqt:nixos.devWinter (she/her)the frustration that i see is that people are touching packages that he maintains, am i missing further context here?03:35:09

Show newer messages


Back to Room ListRoom Version: 9