!eWOErHSaiddIbsUNsJ:nixos.org

NixOS CUDA

292 Members
CUDA packages maintenance and support in nixpkgs | https://github.com/orgs/NixOS/projects/27/ | https://nixos.org/manual/nixpkgs/unstable/#cuda57 Servers

Load older messages


SenderMessageTime
8 Feb 2026
@hexa:lossy.networkhexa (UTC+1)it is below the driverLink path03:38:20
@sporeray:matrix.orgRobbie Buxton Yeah on nixos iirc it’s symlinked into /run/opengl-driver/lib if I’m not mistaken 03:39:39
@hexa:lossy.networkhexa (UTC+1)correct03:40:14
@hexa:lossy.networkhexa (UTC+1)addDriverRunpath.driverLink is the relevant attribute03:40:24
@kaya:catnip.eekaya 𖤐 changed their profile picture.22:50:15
@glepage:matrix.orgGaétan Lepage

After some testing, our current torch version (2.9.0) does build against cuda 13.0, but not cuda 13.1:

/nix/store/42f8i6v4gfkvdimy9aczwqik3scl6dpw-cuda13.1-cuda_cccl-13.1.115/include/cub/device/dispatch/dispatch_radix_sort.cuh(1425): error: no operator "+=" matches these operands
            operand types are: at::native::<unnamed>::offset_t += const int64_t
          end_offsets_current_it += num_current_segments;

Context: https://github.com/NixOS/nixpkgs/pull/486717

23:01:20
@glepage:matrix.orgGaétan LepageI'll try to ship torch 2.10.0 ASAP, hoping that it is compatible with cuda 13.1 (which should unfortunately *23:02:38
@glepage:matrix.orgGaétan Lepage * I'll try to ship torch 2.10.0 ASAP, hoping that it is compatible with cuda 13.1 (which should unfortunately not be the case). 23:02:57
@niten:fudo.im@niten:fudo.im left the room.23:07:13
9 Feb 2026
@benesim:benesim.orgBenjamin IsbarnI'm not using any overlay for that purpose right now. Good point regarding the global override, will do that ;). So the cudaCapabilities would affect packages like the cudart, cublas etc. I guess i.e. what features it will consider available and thus use? the in theory this should yield better performance for the aforementioned libraries? 07:03:05
@connorbaker:matrix.orgconnor (burnt/out) (UTC-8) Read https://nixos.org/manual/nixpkgs/stable/#cuda -- Jetson isn't built by default and pre-thor uses different binaries so you need to make sure cudaCapabilities is set correctly; you'll get faster builds, smaller closures, and (possibly) better performance if you specify the exact capability 07:36:40
@solitudealma:matrix.orgSolitudeAlma joined the room.07:49:25
@glepage:matrix.orgGaétan Lepage VLLM is now 0.15.1 (latest version) 11:11:17
@cameronraysmith:matrix.orgcameronraysmith SomeoneSerge (back on matrix): let me know if the updates to https://github.com/NixOS/nixpkgs/pull/488199 captured what you suggested. No rush: thanks! 21:03:44
@glepage:matrix.orgGaétan Lepage

connor (burnt/out) (UTC-8) SomeoneSerge (back on matrix)
This PR should fix the last failing gpuCheck instance, i.e. python3Packages.triton.gpuCheck: https://github.com/NixOS/nixpkgs/pull/488887

I discovered one of our beloved dlopen instance in triton. We didn't know about it since then... This PR fixes it too.

23:39:42
@glepage:matrix.orgGaétan Lepage *

connor (burnt/out) (UTC-8) SomeoneSerge (back on matrix)
This PR should fix the last failing gpuCheck instance, i.e. python3Packages.triton.gpuCheck: https://github.com/NixOS/nixpkgs/pull/488887

I discovered one of our beloved dlopen instances in triton. We didn't know about it since then... This PR fixes it too.

23:55:34
10 Feb 2026
@connorbaker:matrix.orgconnor (burnt/out) (UTC-8)Don't think I linked it here, maybe interesting for people with heavy eval jobs: https://github.com/ConnorBaker/nix-optimization01:41:36
11 Feb 2026
@connorbaker:matrix.orgconnor (burnt/out) (UTC-8) Gaétan Lepage: there's a merge conflict and I need to rebase, but IIRC something like https://github.com/NixOS/nixpkgs/pull/485208 is necessary to make CUDA 13 the default.
I still need to do the same for the PyCuda PR I have: https://github.com/NixOS/nixpkgs/pull/465047. Apologies that's taking me so long.
18:56:11
12 Feb 2026
@glepage:matrix.orgGaétan LepageOk thanks! I should get a notification when you'll have rebased.07:52:34

There are no newer messages yet.


Back to Room ListRoom Version: 9