!eWOErHSaiddIbsUNsJ:nixos.org

NixOS CUDA

279 Members
CUDA packages maintenance and support in nixpkgs | https://github.com/orgs/NixOS/projects/27/ | https://nixos.org/manual/nixpkgs/unstable/#cuda57 Servers

Load older messages


SenderMessageTime
20 Nov 2025
@ser:sergevictor.euser(ial)does it mean that i need full libraries in nixos container which are with identical version as on debian host?13:32:26
@connorbaker:matrix.orgconnor (burnt/out) (UTC-8) GaƩtan Lepage: I've got to package ONNX/ONNX Runtime/ONNX TensorRT for C++; if I upstream the PR do you think you'd have the bandwidth to look at it? I'd likely follow what I did here: https://github.com/ConnorBaker/cuda-packages/tree/8a317116a07717b13e0608f47b78bd6d75f8bb99/pkgs/development/libraries
That is, the sort of cursed double-build in a single derivation which produces both the C++ binaries and a python wheel, so the python3Packages entry essentially turns into installing a wheel.
14:04:07
@keiichi:matrix.orgtetoare there differences between https://nix-community.cachix.org and https://cache.nixos-cuda.org . My goal is to gain access to cuda-enable packages for unstable14:24:20
@connorbaker:matrix.orgconnor (burnt/out) (UTC-8)community cache is no longer being populated, use the latter14:27:28
@connorbaker:matrix.orgconnor (burnt/out) (UTC-8)* community cache is no longer being populated with CUDA packages, use the latter14:27:35
@connorbaker:matrix.orgconnor (burnt/out) (UTC-8)note to self whenever I find the time (🫠) update cudnn-frontend; looks like the version I made here https://github.com/ConnorBaker/cuda-packages/blob/8a317116a07717b13e0608f47b78bd6d75f8bb99/pkgs/development/cuda-modules/packages/cudnn-frontend.nix is newer than what we have in master and requires fewer patches. Also should add brokenAssertions since IIRC cudnn-frontend has docs about the versions of cuDNN it supports14:30:28
@ss:someonex.netSomeoneSerge (back on matrix)Yeah you can have the CDI hook mount the driver to /run/opengl-driver/lib, or, IIRC, the hook on NixOS even adds the driver to LD_LIBRARY_PATH14:31:39
@glepage:matrix.orgGaƩtan Lepage Yes connor (burnt/out) (UTC-8), I can look at it. But don't we already have onnxruntime and onnx? 15:33:58
@connorbaker:matrix.orgconnor (burnt/out) (UTC-8)IIRC only onnxruntime is available as both a C++ and Python library, ONNX is only available as a python package15:34:30
@glepage:matrix.orgGaƩtan LepageYes true.15:35:04
21 Nov 2025
@jfly:matrix.orgJeremy Fleischman (jfly) i'm trying out programs.nix-required-mounts.presets.nvidia-gpu.enable, and am running into https://github.com/NixOS/nix/issues/9272 with remote builds. is this the best workaround? https://github.com/nix-community/infra/pull/1807#discussion_r2458816021 20:03:32
@connorbaker:matrix.orgconnor (burnt/out) (UTC-8)Yikes I mean I guess that would work?20:17:04
@jfly:matrix.orgJeremy Fleischman (jfly)i'd love to hear a better one!20:17:37
@jfly:matrix.orgJeremy Fleischman (jfly) (btw, this programs.nix-required-mounts.presets.nvidia-gpu.enable stuff is super cool. seems to be 99% of the way there) 20:18:35
@jfly:matrix.orgJeremy Fleischman (jfly)

also, i'd like to buy a beer for whoever wrote this error message:

nix-daemon[1095980]: ERROR:root:/nix/store/z3x5h5yagw94mcxj73jjkmwddlrms2si-saxdemo.drv doesn't exist. Cf. https://github.com/NixOS/nix/issues/9272 Exiting the hook

20:19:44
@jfly:matrix.orgJeremy Fleischman (jfly) Ah, SomeoneSerge (back on matrix), looks like I owe you a beer: https://github.com/nixos/nixpkgs/commit/3a0d777486191cbdd2ffc7e31f25156da94c4831 20:22:04
22 Nov 2025
@connorbaker:matrix.orgconnor (burnt/out) (UTC-8) I'm going to revisit https://github.com/NixOS/nixpkgs/pull/459416 today and do some final fixups; I'd really like if we could merge it soon SomeoneSerge (back on matrix) GaƩtan Lepage given its absence is making my life more difficult 14:07:58
@glepage:matrix.orgGaƩtan LepageI'm in a call with Serge. We'll have a look at it now.14:20:00
@ss:someonex.netSomeoneSerge (back on matrix)Let's have a look14:20:23
@ss:someonex.netSomeoneSerge (back on matrix)I'm still unconvinced by the approach...14:20:41
@ss:someonex.netSomeoneSerge (back on matrix)But since we're not actively benefitting form the stubs right now, maybe we at least merge it for now (without promises to keep)14:21:01
23 Nov 2025
@ss:someonex.netSomeoneSerge (back on matrix)We've had a peek with Gaetan yesterday and LOL turns out the messages aren't even defined in the stubs, but in downstream libraries like in cudart07:49:49
@jaredmontoya:matrix.orgjaredmontoya

Recently firefox and thunderbird started being rebuilt with cudaSupport enabled because they depend on some other package that now has cuda support. For my laptop with 32GB of ram it takes ages to compile either of them and it eventually runs out of RAM when it's time to link the binary. It seems that they were added to release-cuda in https://github.com/NixOS/nixpkgs/pull/437809 so they should be cached by the nix-community cache. Yet even after waiting for the new commit to be cached nix still tries to build thunderbird and firefox.
Today I found out about hydra.nixos-cuda.org and decided to try the nixpkgs commit that was built by it https://hydra.nixos-cuda.org/eval/2348 that seems to have thunderbird and firefox cached. Yet nix still tried to build firefox and thunderbird.

This seems to only be possible if hydra.nixos-cuda.org doesn't push to nix-community or if it signs things with a key I don't trust.

Here is my configuration:

          substituters = [
            "https://nix-community.cachix.org"
          ];
          trusted-public-keys = [
            "nix-community.cachix.org-1:mB9FSh9qf2dCimDSUo8Zy7bkq5CX+/rkCWyvRCYg3Fs="
          ];

Does anyone know what I have to do to get build outputs from the cuda hydra?

10:05:21
@jaredmontoya:matrix.orgjaredmontoya *

Recently firefox and thunderbird started being rebuilt with cudaSupport enabled because they depend on some other package that now has cuda support. For my laptop with 32GB of ram it takes ages to compile either of them and it eventually runs out of RAM when it's time to link the binary. It seems that they were added to release-cuda in https://github.com/NixOS/nixpkgs/pull/437809 so they should be cached by the nix-community cache. Yet even after I waited for half a week for the new commit to be cached nix still tries to build thunderbird and firefox.
Today I found out about hydra.nixos-cuda.org and decided to try the nixpkgs commit that was built by it https://hydra.nixos-cuda.org/eval/2348 that seems to have thunderbird and firefox cached. Yet nix still tried to build firefox and thunderbird.

This seems to only be possible if hydra.nixos-cuda.org doesn't push to nix-community or if it signs things with a key I don't trust.

Here is my configuration:

          substituters = [
            "https://nix-community.cachix.org"
          ];
          trusted-public-keys = [
            "nix-community.cachix.org-1:mB9FSh9qf2dCimDSUo8Zy7bkq5CX+/rkCWyvRCYg3Fs="
          ];

Does anyone know what I have to do to get build outputs from the cuda hydra?

10:07:38
@jaredmontoya:matrix.orgjaredmontoya *

Recently firefox and thunderbird started being rebuilt with cudaSupport enabled because they depend on some other package that now has cuda support. For my laptop with 32GB of ram it takes ages to compile either of them and it eventually runs out of RAM when it's time to link the binary. It seems that they were added to release-cuda in https://github.com/NixOS/nixpkgs/pull/437809 so they should be cached by the nix-community cache. Yet even after I waited for half a week or more for the new commit to be cached nix still tries to build thunderbird and firefox.
Today I found out about hydra.nixos-cuda.org and decided to try the nixpkgs commit that was built by it https://hydra.nixos-cuda.org/eval/2348 that seems to have thunderbird and firefox cached. Yet nix still tried to build firefox and thunderbird.

This seems to only be possible if hydra.nixos-cuda.org doesn't push to nix-community or if it signs things with a key I don't trust.

Here is my configuration:

          substituters = [
            "https://nix-community.cachix.org"
          ];
          trusted-public-keys = [
            "nix-community.cachix.org-1:mB9FSh9qf2dCimDSUo8Zy7bkq5CX+/rkCWyvRCYg3Fs="
          ];

Does anyone know what I have to do to get build outputs from the cuda hydra?

10:07:55
@jaredmontoya:matrix.orgjaredmontoya *

Recently firefox and thunderbird started being rebuilt with cudaSupport enabled because they depend on some other package that now has cuda support. For my laptop with 32GB of ram it takes ages to compile either of them and it eventually runs out of RAM when it's time to link the binary even with --max-jobs 1. It seems that they were added to release-cuda in https://github.com/NixOS/nixpkgs/pull/437809 so they should be cached by the nix-community cache. Yet even after I waited for half a week or more for the new commit to be cached nix still tries to build thunderbird and firefox.
Today I found out about hydra.nixos-cuda.org and decided to try the nixpkgs commit that was built by it https://hydra.nixos-cuda.org/eval/2348 that seems to have thunderbird and firefox cached. Yet nix still tried to build firefox and thunderbird.

This seems to only be possible if hydra.nixos-cuda.org doesn't push to nix-community or if it signs things with a key I don't trust.

Here is my configuration:

          substituters = [
            "https://nix-community.cachix.org"
          ];
          trusted-public-keys = [
            "nix-community.cachix.org-1:mB9FSh9qf2dCimDSUo8Zy7bkq5CX+/rkCWyvRCYg3Fs="
          ];

Does anyone know what I have to do to get build outputs from the cuda hydra?

10:16:54
@glepage:matrix.orgGaƩtan Lepage Indeed, it does not push to the nix-community Cachix instance.
You can use our new cache instead.
10:51:20
@jaredmontoya:matrix.orgjaredmontoyaThank you!10:54:45
@jaredmontoya:matrix.orgjaredmontoya * 10:55:02
@ss:someonex.netSomeoneSerge (back on matrix) connor (burnt/out) (UTC-8): {isDeclared{Array,Map},sortArray}.bash very nice 11:57:04

There are no newer messages yet.


Back to Room ListRoom Version: 9