!eWOErHSaiddIbsUNsJ:nixos.org

NixOS CUDA

337 Members
CUDA packages maintenance and support in nixpkgs | https://github.com/orgs/NixOS/projects/27/ | https://nixos.org/manual/nixpkgs/unstable/#cuda64 Servers

Load older messages


SenderMessageTime
12 Jun 2026
@sporeray:matrix.orgRobbie Buxton * Oh you can definitely get something on a neocloud then, the best/cheapest one to changes month to month so probably worth having a bit of a Google. 15:58:40
@sporeray:matrix.orgRobbie Buxton Amazon is fine but more expensive 15:58:47
@sporeray:matrix.orgRobbie Buxton I think nvidia brev is also pretty good and cloud agnostic 15:59:14
@ethancedwards8:matrix.orgethancedwards8Cool, thanks! I appreciate the help16:21:09
13 Jun 2026
@ijouw:matrix.orgijouw joined the room.13:21:35
16 Jun 2026
@diamo.dev:matrix.orgDiamo joined the room.01:13:25
@diamo.dev:matrix.orgDiamotorch-bin 2.11 doesn't come with cudnn 9.19.0???01:14:20
@humblefool2005:matrix.orgDarshan Thakare set a profile picture.09:51:11
@glepage:matrix.orgGaétan Lepage We just bumped torch-bin to 2.12 (but it requires CUDA>=13.0). What issue are you facing exactly 10:28:47
@glepage:matrix.orgGaétan Lepage * We just bumped torch-bin to 2.12 (but it requires CUDA>=13.0). What issue are you facing exactly? 10:28:50
@diamo.dev:matrix.orgDiamoim still using torch-bin 2.11 and it requires cudNN 9.19.0 but i have 9.13.0 (from 25.11?) issue being that theres no nixpkgs commit where I can fix the 2.11 issue10:57:58
18 Jun 2026
@seudonym:matrix.orgWahid Khan does torch-bin 2.12 require that cudaPackages be cudaPackages13x? 06:06:55
@seudonym:matrix.orgWahid Khan when I try to add torch-bin it complains that cudaPackages is 12.9 and 13+ is required. even if my flake uses cudaPackages132 06:07:34
@seudonym:matrix.orgWahid Khan working around it with an overlay to set cudaPackages = cudaPackages132 06:08:04
@seudonym:matrix.orgWahid Khan* does torch-bin 2.12 require that cudaPackages be cudaPackages_13_x?06:08:13
@seudonym:matrix.orgWahid Khan* working around it with an overlay to set cudaPackages = cudaPackages_13_206:08:20
@seudonym:matrix.orgWahid Khan* when I try to add torch-bin it complains that cudaPackages is 12.9 and 13+ is required. even if my flake uses cudaPackages_13_206:08:28
@glepage:matrix.orgGaétan Lepage

Here is the overlay you need:

  (final: prev: {
    cudaPackages = prev.lib.recurseIntoAttrs prev."cudaPackages_13_2";
    })
07:14:40
@seudonym:matrix.orgWahid Khanyep, doing something similar07:22:02
@diamo.dev:matrix.orgDiamooh yeah i figured it out too, using cues packages_13_1 with nixpkgs pinned to commit 461de5c011cdf1015d26f7a5c9f4a25404e6d90e (not using flakes)15:02:02
@diamo.dev:matrix.orgDiamo* oh yeah i figured it out too, using cudaPackages_13_1 with nixpkgs pinned to commit 461de5c011cdf1015d26f7a5c9f4a25404e6d90e (not using flakes)15:02:21
@diamo.dev:matrix.orgDiamousing torch-bin15:02:40
@ethancedwards8:matrix.orgethancedwards8are there some tasks that just need manpower/time/hours in nixpkgs cuda right now? my company is paying for me to have gpu access to an nvidia t4 so i have proper hardware access. is this a good place to start? https://github.com/NixOS/nixpkgs/issues/23250120:26:09
19 Jun 2026
@connorbaker:matrix.orgconnor (he/him)I mean maybe? Aside from difficulties with the package ecosystems as a whole for the ML stack and the absurd amount of domain knowledge required to be productive in contributing fixes or improvements, a lot of the packaging woes are caused by foundational components of Nixpkgs which need to be generalized or fixed. That’s what I’ve been thinking about most; there’s a bunch of old tickets that need to be updated and general housekeeping we need to do; if you have the bandwidth to find and make a comment on the ticket about any other users that haven’t migrated, I’d appreciate it!04:25:14
@glepage:matrix.orgGaétan LepageI have a gigantic todo list too, mostly around DL and/or Python stuff. We can chat about things you would be interested in helping with if you want :)05:51:48
@glepage:matrix.orgGaétan Lepage* I have a gigantic todo list too, mostly around DL, robotics and/or Python stuff. We can chat about things you would be interested in helping with if you want :)05:52:09
20 Jun 2026
@ethancedwards8:matrix.orgethancedwards8 Yes! I would love to. Definitely interesting in helping package whatever CUDA libraries are needed + improving Python support. 03:00:26
@ethancedwards8:matrix.orgethancedwards8 But yes I’ll try to look through all the CUDA tickets and see what I can get up to :) always looking for more Nixpkgs projects 03:01:13
@glepage:matrix.orgGaétan LepageGYT: https://github.com/numba/numba/blob/main/docs/source/cuda/overview.rst#built-in-cuda-target-deprecation-and-maintenance-status21:41:16
@glepage:matrix.orgGaétan Lepage* FYIGYT: https://github.com/numba/numba/blob/main/docs/source/cuda/overview.rst#built-in-cuda-target-deprecation-and-maintenance-status21:41:26

Show newer messages


Back to Room ListRoom Version: 9