!eWOErHSaiddIbsUNsJ:nixos.org

NixOS CUDA

336 Members
CUDA packages maintenance and support in nixpkgs | https://github.com/orgs/NixOS/projects/27/ | https://nixos.org/manual/nixpkgs/unstable/#cuda64 Servers

Load older messages


SenderMessageTime
16 Jun 2026
@diamo.dev:matrix.orgDiamoim still using torch-bin 2.11 and it requires cudNN 9.19.0 but i have 9.13.0 (from 25.11?) issue being that theres no nixpkgs commit where I can fix the 2.11 issue10:57:58
18 Jun 2026
@seudonym:matrix.orgWahid Khan does torch-bin 2.12 require that cudaPackages be cudaPackages13x? 06:06:55
@seudonym:matrix.orgWahid Khan when I try to add torch-bin it complains that cudaPackages is 12.9 and 13+ is required. even if my flake uses cudaPackages132 06:07:34
@seudonym:matrix.orgWahid Khan working around it with an overlay to set cudaPackages = cudaPackages132 06:08:04
@seudonym:matrix.orgWahid Khan* does torch-bin 2.12 require that cudaPackages be cudaPackages_13_x?06:08:13
@seudonym:matrix.orgWahid Khan* working around it with an overlay to set cudaPackages = cudaPackages_13_206:08:20
@seudonym:matrix.orgWahid Khan* when I try to add torch-bin it complains that cudaPackages is 12.9 and 13+ is required. even if my flake uses cudaPackages_13_206:08:28
@glepage:matrix.orgGaétan Lepage

Here is the overlay you need:

  (final: prev: {
    cudaPackages = prev.lib.recurseIntoAttrs prev."cudaPackages_13_2";
    })
07:14:40
@seudonym:matrix.orgWahid Khanyep, doing something similar07:22:02
@diamo.dev:matrix.orgDiamooh yeah i figured it out too, using cues packages_13_1 with nixpkgs pinned to commit 461de5c011cdf1015d26f7a5c9f4a25404e6d90e (not using flakes)15:02:02
@diamo.dev:matrix.orgDiamo* oh yeah i figured it out too, using cudaPackages_13_1 with nixpkgs pinned to commit 461de5c011cdf1015d26f7a5c9f4a25404e6d90e (not using flakes)15:02:21
@diamo.dev:matrix.orgDiamousing torch-bin15:02:40
@ethancedwards8:matrix.orgethancedwards8are there some tasks that just need manpower/time/hours in nixpkgs cuda right now? my company is paying for me to have gpu access to an nvidia t4 so i have proper hardware access. is this a good place to start? https://github.com/NixOS/nixpkgs/issues/23250120:26:09
19 Jun 2026
@connorbaker:matrix.orgconnor (he/him)I mean maybe? Aside from difficulties with the package ecosystems as a whole for the ML stack and the absurd amount of domain knowledge required to be productive in contributing fixes or improvements, a lot of the packaging woes are caused by foundational components of Nixpkgs which need to be generalized or fixed. That’s what I’ve been thinking about most; there’s a bunch of old tickets that need to be updated and general housekeeping we need to do; if you have the bandwidth to find and make a comment on the ticket about any other users that haven’t migrated, I’d appreciate it!04:25:14
@glepage:matrix.orgGaétan LepageI have a gigantic todo list too, mostly around DL and/or Python stuff. We can chat about things you would be interested in helping with if you want :)05:51:48
@glepage:matrix.orgGaétan Lepage* I have a gigantic todo list too, mostly around DL, robotics and/or Python stuff. We can chat about things you would be interested in helping with if you want :)05:52:09
20 Jun 2026
@ethancedwards8:matrix.orgethancedwards8 Yes! I would love to. Definitely interesting in helping package whatever CUDA libraries are needed + improving Python support. 03:00:26
@ethancedwards8:matrix.orgethancedwards8 But yes I’ll try to look through all the CUDA tickets and see what I can get up to :) always looking for more Nixpkgs projects 03:01:13
4 Aug 2022
@winterqt:nixos.devWinter (she/her) joined the room.03:26:42
@winterqt:nixos.devWinter (she/her)(hi, just came here to read + respond to this.)03:28:52
@tpw_rules:matrix.orgtpw_ruleshey. i had previously sympathzied with samuela and like i said before had some of the same frustrations. i just edited my github comment to add "[CUDA] packages are universally complicated, fragile to package, and critical to daily operations. Nix being able to manage them is unbelievably helpful to those of us who work with them regularly, even if support is downgraded to only having an expectation of function on stable branches."03:29:14
@winterqt:nixos.devWinter (she/her)
In reply to @tpw_rules:matrix.org
i'm mildly peeved about a recent merging of something i maintain where i'm pretty sure the merger does not own the expensive hardware required to properly test the package. i don't think it broke anything but i was given precisely 45 minutes to see the notification before somebody merged it
ugh, 45 minutes? that's... not great. not to air dirty laundry but did you do what samuela did in the wandb PR and at least say that that wasn't a great thing to do? (not sure how else to word that, you get what i mean)
03:30:23
@tpw_rules:matrix.orgtpw_rulesno, i haven't yet, but i probably will03:31:03
@winterqt:nixos.devWinter (she/her) i admittedly did that with a PR once, i forget how long the maintainer was requested for but i merged it because multiple people reported it fixed the issue. the maintainer said "hey, don't do that" after and now i do think twice before merging. so it could help, is what i'm saying. 03:31:50
@tpw_rules:matrix.orgtpw_rulesi'm not sure what went wrong with the wandb PR anyway, i think it was just a boneheaded move on the maintainer's part03:32:10
@winterqt:nixos.devWinter (she/her)(it was also simple enough that it was fine and the maintainer said it looked good after)03:32:15
@tpw_rules:matrix.orgtpw_rules * i'm not sure what went wrong with the wandb PR anyway, i think it was just a boneheaded move on the merger's part03:32:19
@tpw_rules:matrix.orgtpw_rulesbut i thought most of the frustration was around packages which don't really involve CUDA breaking the fragile CUDA packages, and i'm not sure how the warning helps in this case. it's not like nixpkgs-review prints out the comments. maybe i'm wrong. but it is a legitimate problem03:34:19
@winterqt:nixos.devWinter (she/her)the frustration that i see is that people are touching packages that he maintains, am i missing further context here?03:35:09
@tpw_rules:matrix.orgtpw_rulesdid you ever see this? https://discourse.nixos.org/t/nixpkgss-current-development-workflow-is-not-sustainable/1874103:35:43

Show newer messages


Back to Room ListRoom Version: 9