!eWOErHSaiddIbsUNsJ:nixos.org

NixOS CUDA

294 Members
CUDA packages maintenance and support in nixpkgs | https://github.com/orgs/NixOS/projects/27/ | https://nixos.org/manual/nixpkgs/unstable/#cuda59 Servers

Load older messages


SenderMessageTime
8 Feb 2026
@hexa:lossy.networkhexa (UTC+1)addDriverRunpath.driverLink is the relevant attribute03:40:24
@kaya:catnip.eekaya 𖤐 changed their profile picture.22:50:15
@glepage:matrix.orgGaƩtan Lepage

After some testing, our current torch version (2.9.0) does build against cuda 13.0, but not cuda 13.1:

/nix/store/42f8i6v4gfkvdimy9aczwqik3scl6dpw-cuda13.1-cuda_cccl-13.1.115/include/cub/device/dispatch/dispatch_radix_sort.cuh(1425): error: no operator "+=" matches these operands
            operand types are: at::native::<unnamed>::offset_t += const int64_t
          end_offsets_current_it += num_current_segments;

Context: https://github.com/NixOS/nixpkgs/pull/486717

23:01:20
@glepage:matrix.orgGaƩtan LepageI'll try to ship torch 2.10.0 ASAP, hoping that it is compatible with cuda 13.1 (which should unfortunately *23:02:38
@glepage:matrix.orgGaƩtan Lepage * I'll try to ship torch 2.10.0 ASAP, hoping that it is compatible with cuda 13.1 (which should unfortunately not be the case). 23:02:57
@niten:fudo.im@niten:fudo.im left the room.23:07:13
9 Feb 2026
@benesim:benesim.orgBenjamin IsbarnI'm not using any overlay for that purpose right now. Good point regarding the global override, will do that ;). So the cudaCapabilities would affect packages like the cudart, cublas etc. I guess i.e. what features it will consider available and thus use? the in theory this should yield better performance for the aforementioned libraries? 07:03:05
@connorbaker:matrix.orgconnor (burnt/out) (UTC-8) Read https://nixos.org/manual/nixpkgs/stable/#cuda -- Jetson isn't built by default and pre-thor uses different binaries so you need to make sure cudaCapabilities is set correctly; you'll get faster builds, smaller closures, and (possibly) better performance if you specify the exact capability 07:36:40
@solitudealma:matrix.orgSolitudeAlma joined the room.07:49:25
@glepage:matrix.orgGaƩtan Lepage VLLM is now 0.15.1 (latest version) 11:11:17
@cameronraysmith:matrix.orgcameronraysmith SomeoneSerge (back on matrix): let me know if the updates to https://github.com/NixOS/nixpkgs/pull/488199 captured what you suggested. No rush: thanks! 21:03:44
@glepage:matrix.orgGaƩtan Lepage

connor (burnt/out) (UTC-8) SomeoneSerge (back on matrix)
This PR should fix the last failing gpuCheck instance, i.e. python3Packages.triton.gpuCheck: https://github.com/NixOS/nixpkgs/pull/488887

I discovered one of our beloved dlopen instance in triton. We didn't know about it since then... This PR fixes it too.

23:39:42
@glepage:matrix.orgGaƩtan Lepage *

connor (burnt/out) (UTC-8) SomeoneSerge (back on matrix)
This PR should fix the last failing gpuCheck instance, i.e. python3Packages.triton.gpuCheck: https://github.com/NixOS/nixpkgs/pull/488887

I discovered one of our beloved dlopen instances in triton. We didn't know about it since then... This PR fixes it too.

23:55:34
10 Feb 2026
@connorbaker:matrix.orgconnor (burnt/out) (UTC-8)Don't think I linked it here, maybe interesting for people with heavy eval jobs: https://github.com/ConnorBaker/nix-optimization01:41:36
11 Feb 2026
@connorbaker:matrix.orgconnor (burnt/out) (UTC-8) GaƩtan Lepage: there's a merge conflict and I need to rebase, but IIRC something like https://github.com/NixOS/nixpkgs/pull/485208 is necessary to make CUDA 13 the default.
I still need to do the same for the PyCuda PR I have: https://github.com/NixOS/nixpkgs/pull/465047. Apologies that's taking me so long.
18:56:11
4 Aug 2022
@winterqt:nixos.devWinter (she/her) joined the room.03:26:42
@winterqt:nixos.devWinter (she/her)(hi, just came here to read + respond to this.)03:28:52
@tpw_rules:matrix.orgtpw_ruleshey. i had previously sympathzied with samuela and like i said before had some of the same frustrations. i just edited my github comment to add "[CUDA] packages are universally complicated, fragile to package, and critical to daily operations. Nix being able to manage them is unbelievably helpful to those of us who work with them regularly, even if support is downgraded to only having an expectation of function on stable branches."03:29:14
@winterqt:nixos.devWinter (she/her)
In reply to @tpw_rules:matrix.org
i'm mildly peeved about a recent merging of something i maintain where i'm pretty sure the merger does not own the expensive hardware required to properly test the package. i don't think it broke anything but i was given precisely 45 minutes to see the notification before somebody merged it
ugh, 45 minutes? that's... not great. not to air dirty laundry but did you do what samuela did in the wandb PR and at least say that that wasn't a great thing to do? (not sure how else to word that, you get what i mean)
03:30:23
@tpw_rules:matrix.orgtpw_rulesno, i haven't yet, but i probably will03:31:03
@winterqt:nixos.devWinter (she/her) i admittedly did that with a PR once, i forget how long the maintainer was requested for but i merged it because multiple people reported it fixed the issue. the maintainer said "hey, don't do that" after and now i do think twice before merging. so it could help, is what i'm saying. 03:31:50
@tpw_rules:matrix.orgtpw_rulesi'm not sure what went wrong with the wandb PR anyway, i think it was just a boneheaded move on the maintainer's part03:32:10
@winterqt:nixos.devWinter (she/her)(it was also simple enough that it was fine and the maintainer said it looked good after)03:32:15
@tpw_rules:matrix.orgtpw_rules * i'm not sure what went wrong with the wandb PR anyway, i think it was just a boneheaded move on the merger's part03:32:19
@tpw_rules:matrix.orgtpw_rulesbut i thought most of the frustration was around packages which don't really involve CUDA breaking the fragile CUDA packages, and i'm not sure how the warning helps in this case. it's not like nixpkgs-review prints out the comments. maybe i'm wrong. but it is a legitimate problem03:34:19
@winterqt:nixos.devWinter (she/her)the frustration that i see is that people are touching packages that he maintains, am i missing further context here?03:35:09
@tpw_rules:matrix.orgtpw_rulesdid you ever see this? https://discourse.nixos.org/t/nixpkgss-current-development-workflow-is-not-sustainable/1874103:35:43
@winterqt:nixos.devWinter (she/her)oh yes i did03:35:49
@winterqt:nixos.devWinter (she/her)but that's not what the topic of this PR/the notice is, though?03:36:11
@winterqt:nixos.devWinter (she/her)this wouldn't help that03:36:14

Show newer messages


Back to Room ListRoom Version: 9