!eWOErHSaiddIbsUNsJ:nixos.org

NixOS CUDA

291 Members
CUDA packages maintenance and support in nixpkgs | https://github.com/orgs/NixOS/projects/27/ | https://nixos.org/manual/nixpkgs/unstable/#cuda57 Servers

Load older messages


SenderMessageTime
15 Jan 2026
@connorbaker:matrix.orgconnor (he/him)Goddamn stubs and transitive symbol resolution17:33:35
* @connorbaker:matrix.orgconnor (he/him) grumbles17:33:39
16 Jan 2026
@connorbaker:matrix.orgconnor (he/him)PR to avoid rebuilding Nix itself whenever CUDA support is enabled: https://github.com/NixOS/nixpkgs/pull/48052400:01:13
@hexa:lossy.networkhexanix depends on onetbb?00:09:53
@connorbaker:matrix.orgconnor (he/him)Yes, IIRC at least through blake302:23:54
@connorbaker:matrix.orgconnor (he/him) hexa (UTC+1): any additional thoughts on merging https://github.com/NixOS/nixpkgs/pull/480524? 18:16:50
@hexa:lossy.networkhexanone18:30:44
@hexa:lossy.networkhexadidn't test anything18:30:47
@hexa:lossy.networkhexajust disables cuda support18:30:55
@hexa:lossy.networkhexawhat could go wrong?18:31:03
@ss:someonex.netSomeoneSerge (back on matrix)Wait, globally?20:00:50
@ss:someonex.netSomeoneSerge (back on matrix)This probably affects MPI and SLURM, and might be one of those libraries you're actually supposed to link dynamically and not how we do it20:26:15
@connorbaker:matrix.orgconnor (he/him)I don't follow; IIRC hwloc is pulled in by those directly and would use it untouched22:48:00
17 Jan 2026
@glepage:matrix.orgGaĆ©tan Lepage FYI, the onnxruntime bump was merged! šŸŽ‰
https://github.com/NixOS/nixpkgs/pull/450587
09:33:45
@kaya:catnip.eekaya 𖤐Hey. Im working on upstreaming packages for exllama & tabbyapi. I would appreciate if somebody from here could review the PR :) https://github.com/NixOS/nixpkgs/pull/48112119:11:25
18 Jan 2026
@glepage:matrix.orgGaƩtan Lepage Anyone could give a second opinion on https://github.com/NixOS/nixpkgs/pull/474676 please? 09:48:06
@ss:someonex.netSomeoneSerge (back on matrix)This particular regression could've been avoided with autopatchelf. Maybe switch to that?12:08:40
@glepage:matrix.orgGaƩtan Lepage Just adding autoPatchelfHook you mean? 22:29:11
@ss:someonex.netSomeoneSerge (back on matrix)And removing --set-rpath23:40:44
20 Jan 2026
@kaya:catnip.eekaya 𖤐 GaĆ©tan Lepage: Thank you for the through PR review, much appreciated! 19:03:45
@glepage:matrix.orgGaƩtan LepageYou're welcome! I'll probably wait for a second committer to double check, but we should be able to merge it soon :)19:26:32
21 Jan 2026
@connorbaker:matrix.orgconnor (he/him) GaĆ©tan Lepageif you haven’t already, can you link any of the additional work you’ve had to do for the OpenCV version bump in the PR description? I remember yesterday you had mentioned needing to fix protobuf, but that might have been about ONNX Runtime. 17:20:11
@glepage:matrix.orgGaƩtan Lepage Indeed, this was for protobuf. The opencv effort is all contained in https://github.com/NixOS/nixpkgs/pull/479136 21:33:06
@glepage:matrix.orgGaƩtan Lepage The protobuf patching related to onnxruntime was merged into staging.
-> https://github.com/NixOS/nixpkgs/pull/480716
21:33:34
22 Jan 2026
@glepage:matrix.orgGaƩtan Lepage

Sadness.

I had to package the 12.8 version of cuda-bindings, because we're on cuda 12.8.
However, it dlopens libcuda.so and the driver (on my system at least) tells it that it uses cuda 13.1.
Hence, it errors out :/

https://github.com/NixOS/nixpkgs/pull/482638

(cuda-bindings is supposed to be required in the new torch update, not sure how critical it is though)

12:06:42
@justbrowsing:matrix.orgKevin Mittman (UTC-8) Hmm a bit confused about that issue, as nvidia-smi shows the maximum CUDA version supported and with "backwards compat" should always be able to use a newer NVIDIA driver than a CUDA Toolkit was released with 20:14:30
@glepage:matrix.orgGaƩtan Lepage The version detection logic happens here and errors out here. 20:48:39
@glepage:matrix.orgGaƩtan Lepage

Here's the stack trace when I re-enable the failing test:

______________________ ERROR collecting test_nvjitlink.py ______________________
tests/test_nvjitlink.py:62: in <module>
    not check_nvjitlink_usable(), reason="nvJitLink not usable, maybe not installed or too old (<12.3)"
        ^^^^^^^^^^^^^^^^^^^^^^^^
tests/test_nvjitlink.py:58: in check_nvjitlink_usable
    return inner_nvjitlink._inspect_function_pointer("__nvJitLinkVersion") != 0
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
cuda/bindings/_internal/nvjitlink.pyx:254: in cuda.bindings._internal.nvjitlink._inspect_function_pointer
    ???
cuda/bindings/_internal/nvjitlink.pyx:257: in cuda.bindings._internal.nvjitlink._inspect_function_pointer
    ???
cuda/bindings/_internal/nvjitlink.pyx:205: in cuda.bindings._internal.nvjitlink._inspect_function_pointers
    ???
cuda/bindings/_internal/nvjitlink.pyx:99: in cuda.bindings._internal.nvjitlink._check_or_init_nvjitlink
    ???
cuda/bindings/_internal/nvjitlink.pyx:57: in cuda.bindings._internal.nvjitlink.load_library
    ???
cuda/bindings/_internal/utils.pyx:137: in cuda.bindings._internal.utils.get_nvjitlink_dso_version_suffix
    ???
E   cuda.bindings._internal.utils.NotSupportedError: only CUDA 12 driver is supported
------------------------------- Captured stdout --------------------------------
+++++++++++++++ 13010
22:27:19
@glepage:matrix.orgGaƩtan Lepage The code block mentionned above returns 13010 which fails the 12000 <= driver_ver < 13000 check in cuda/bindings/_internal/utils.pyx. 22:28:37
23 Jan 2026
@glepage:matrix.orgGaƩtan Lepage Weird regression following the merge of staging-next... 10:42:06

Show newer messages


Back to Room ListRoom Version: 9