!eWOErHSaiddIbsUNsJ:nixos.org

NixOS CUDA

294 Members
CUDA packages maintenance and support in nixpkgs | https://github.com/orgs/NixOS/projects/27/ | https://nixos.org/manual/nixpkgs/unstable/#cuda58 Servers

Load older messages


SenderMessageTime
6 Feb 2026
@connorbaker:matrix.orgconnor (burnt/out) (UTC-8) Gaétan LepageI’d like to merge https://github.com/NixOS/nixpkgs/pull/484031 but I’m still concerned about whether the patch needs to be guarded by something — it shouldn’t since the compiler NVCC uses should always use the GLIBC from the default stdenv which should be the newest GLIBC, right? 16:35:17
@ss:someonex.netSomeoneSerge (back on matrix)Mind waiting until tomorrow, I'd like to take a look?17:20:39
@glepage:matrix.orgGaétan Lepage Sure SomeoneSerge (back on matrix), feel free to double check. 22:35:32
@glepage:matrix.orgGaétan LepageIndeed, I don't think so.22:35:43
8 Feb 2026
@hexa:lossy.networkhexa (UTC+1)where can I find libnvidia-ml.so.1?03:09:43
@hexa:lossy.networkhexa (UTC+1)* where can I find libnvidia-ml.so.1 used by py3nvml?03:09:50
@hexa:lossy.networkhexa (UTC+1) nvm … /nix/store/9g9zb0r0hk63fm1xq8582bgjd8d69k0k-nvidia-x11-580.119.02-6.12.68/lib/libnvidia-ml.so.1
03:10:49
@sporeray:matrix.orgRobbie Buxton
In reply to @hexa:lossy.network
where can I find libnvidia-ml.so.1?
This is a nvidia kernel library so if you aren’t on nixos you need to get it from where you install it on the host
03:37:00
@sporeray:matrix.orgRobbie BuxtonBut looks like you found it!03:37:12
@hexa:lossy.networkhexa (UTC+1)it is below the driverLink path03:38:20
@sporeray:matrix.orgRobbie Buxton Yeah on nixos iirc it’s symlinked into /run/opengl-driver/lib if I’m not mistaken 03:39:39
@hexa:lossy.networkhexa (UTC+1)correct03:40:14
@hexa:lossy.networkhexa (UTC+1)addDriverRunpath.driverLink is the relevant attribute03:40:24
@kaya:catnip.eekaya 𖤐 changed their profile picture.22:50:15
@glepage:matrix.orgGaétan Lepage

After some testing, our current torch version (2.9.0) does build against cuda 13.0, but not cuda 13.1:

/nix/store/42f8i6v4gfkvdimy9aczwqik3scl6dpw-cuda13.1-cuda_cccl-13.1.115/include/cub/device/dispatch/dispatch_radix_sort.cuh(1425): error: no operator "+=" matches these operands
            operand types are: at::native::<unnamed>::offset_t += const int64_t
          end_offsets_current_it += num_current_segments;

Context: https://github.com/NixOS/nixpkgs/pull/486717

23:01:20
@glepage:matrix.orgGaétan LepageI'll try to ship torch 2.10.0 ASAP, hoping that it is compatible with cuda 13.1 (which should unfortunately *23:02:38
@glepage:matrix.orgGaétan Lepage * I'll try to ship torch 2.10.0 ASAP, hoping that it is compatible with cuda 13.1 (which should unfortunately not be the case). 23:02:57
@niten:fudo.im@niten:fudo.im left the room.23:07:13
9 Feb 2026
@benesim:benesim.orgBenjamin IsbarnI'm not using any overlay for that purpose right now. Good point regarding the global override, will do that ;). So the cudaCapabilities would affect packages like the cudart, cublas etc. I guess i.e. what features it will consider available and thus use? the in theory this should yield better performance for the aforementioned libraries? 07:03:05
@connorbaker:matrix.orgconnor (burnt/out) (UTC-8) Read https://nixos.org/manual/nixpkgs/stable/#cuda -- Jetson isn't built by default and pre-thor uses different binaries so you need to make sure cudaCapabilities is set correctly; you'll get faster builds, smaller closures, and (possibly) better performance if you specify the exact capability 07:36:40
@solitudealma:matrix.orgSolitudeAlma joined the room.07:49:25
@glepage:matrix.orgGaétan Lepage VLLM is now 0.15.1 (latest version) 11:11:17
@cameronraysmith:matrix.orgcameronraysmith SomeoneSerge (back on matrix): let me know if the updates to https://github.com/NixOS/nixpkgs/pull/488199 captured what you suggested. No rush: thanks! 21:03:44
@glepage:matrix.orgGaétan Lepage

connor (burnt/out) (UTC-8) SomeoneSerge (back on matrix)
This PR should fix the last failing gpuCheck instance, i.e. python3Packages.triton.gpuCheck: https://github.com/NixOS/nixpkgs/pull/488887

I discovered one of our beloved dlopen instance in triton. We didn't know about it since then... This PR fixes it too.

23:39:42
@glepage:matrix.orgGaétan Lepage *

connor (burnt/out) (UTC-8) SomeoneSerge (back on matrix)
This PR should fix the last failing gpuCheck instance, i.e. python3Packages.triton.gpuCheck: https://github.com/NixOS/nixpkgs/pull/488887

I discovered one of our beloved dlopen instances in triton. We didn't know about it since then... This PR fixes it too.

23:55:34
10 Feb 2026
@connorbaker:matrix.orgconnor (burnt/out) (UTC-8)Don't think I linked it here, maybe interesting for people with heavy eval jobs: https://github.com/ConnorBaker/nix-optimization01:41:36
11 Feb 2026
@connorbaker:matrix.orgconnor (burnt/out) (UTC-8) Gaétan Lepage: there's a merge conflict and I need to rebase, but IIRC something like https://github.com/NixOS/nixpkgs/pull/485208 is necessary to make CUDA 13 the default.
I still need to do the same for the PyCuda PR I have: https://github.com/NixOS/nixpkgs/pull/465047. Apologies that's taking me so long.
18:56:11
12 Feb 2026
@glepage:matrix.orgGaétan LepageOk thanks! I should get a notification when you'll have rebased.07:52:34
13 Feb 2026
@hoplophfeil:matrix.orghoplopf joined the room.10:21:48
4 Aug 2022
@winterqt:nixos.devWinter (she/her) joined the room.03:26:42

Show newer messages


Back to Room ListRoom Version: 9