!eWOErHSaiddIbsUNsJ:nixos.org

NixOS CUDA

292 Members
CUDA packages maintenance and support in nixpkgs | https://github.com/orgs/NixOS/projects/27/ | https://nixos.org/manual/nixpkgs/unstable/#cuda57 Servers

You have reached the beginning of time (for this room).


SenderMessageTime
29 Nov 2025
@matthewcroughan:defenestrate.itmatthewcroughan @fosdemIs there anybody that knows how you add cuda stuff to a rust build?01:54:22
@matthewcroughan:defenestrate.itmatthewcroughan @fosdemI have a rust build that is silently doing nothing when cuda isn't present, and not indicating in logs when it is being used or isn't01:54:37
@matthewcroughan:defenestrate.itmatthewcroughan @fosdemLeads to https://github.com/alvr-org/ALVR/issues/279201:55:02
@ss:someonex.netSomeoneSerge (back on matrix) idk is it even about cuda? Any failing dlopens? @matthewcroughan:defenestrate.it: 04:30:26
@matthewcroughan:defenestrate.itmatthewcroughan @fosdemI'm not sure, what do you think based on the issue?16:12:46
@matthewcroughan:defenestrate.itmatthewcroughan @fosdem Apparently people can get it to work by steam-run'ing the stuff they provide via github releases 16:13:09
@ss:someonex.netSomeoneSerge (back on matrix)Id_debuuuuuuuuuuuug16:49:33
@matthewcroughan:defenestrate.itmatthewcroughan @fosdemYeah I can also get it working by steam-run'ing the github release17:01:30
@matthewcroughan:defenestrate.itmatthewcroughan @fosdemcompiling onnxruntime takes forever though17:01:35
@matthewcroughan:defenestrate.itmatthewcroughan @fosdemso I'm doing that whilst compiling what I think could be a fix17:01:42
1 Dec 2025
@connorbaker:matrix.orgconnor (he/him)Make sure you’re setting config.cudaCapabilities explicitly to speed up compilation12:39:34
@connorbaker:matrix.orgconnor (he/him)

Packaging onnx/onnx-tensorrt/onnxruntime and getting them working for a range of cuda/cudnn/tensorrt releases is maddening oh my god:

  • Fix for GCC 11/NVCC's template processing https://github.com/nixos-cuda/cuda-legacy/commit/79c3026f1a761125b6faa609c5f9e56e723a4568
  • https://github.com/nixos-cuda/cuda-legacy/issues/6 since ONNX Runtime needs GCC > 11.1 and I need it to build with 11.4
  • I'm fairly certain I managed to get a build failure from ONNX Runtime with CUDA 11.8 because a reference to cuda_nvcc was held onto, so ONNX Runtime failed the build
21:32:54
2 Dec 2025
@connorbaker:matrix.orgconnor (he/him)Okay NVCC from CUDA 11.4 still dies horrifically when using newer versions of glibc with GCC 11 so that’ll stay on GCC 10. Also it seems onnxruntime 1.22.2 needs CCCL newer than what 11.4 provides, so supporting onnxruntime on 11.4 means finding an older version which works :l01:21:58
@glepage:matrix.orgGaétan Lepage connor (burnt/out) (UTC-8) I approved your onnx PR 08:14:41
@glepage:matrix.orgGaétan LepageI can tackle the bump to 1.20.0 after it's merged08:14:56
@keiichi:matrix.orgtetois caching disabled for unstable ? I have to build onnxruntime and then I read this https://discourse.nixos.org/t/cuda-cache-for-nix-community/56038/3 11:45:21
@hexa:lossy.networkhexabuilding cuda packages on nix-community was discontinued12:07:37
@hexa:lossy.networkhexathere is now the flox cache, which builds for their versions of nixpkgs12:08:00
@hexa:lossy.networkhexa* there is now the flox cache, which builds for their versions of nixpkgs, which don't really align with our channels12:08:09
@hexa:lossy.networkhexaand possibly the build results from nixos-cuda.org12:08:32
@keiichi:matrix.orgtetoI had totally missed that. The discourse comment made it sound like it is retaliation against flox actions ?12:11:30
@hexa:lossy.networkhexaRedacted or Malformed Event12:45:08
@connorbaker:matrix.orgconnor (he/him)I am 🔪23:20:33
@connorbaker:matrix.orgconnor (he/him)

okay how the hell did you all manage to debug this on master:

error: output '/nix/store/pb5lmj07b9vs4awlxrga9s6wkfzzrk1i-onnxruntime-1.22.2-dev' is not allowed to refer to the following paths:
         /nix/store/rf7a79c1a73ny3j6jw77nza4wd5z40i1-cuda11.4-cuda_nvcc-11.4.152
23:20:49
@connorbaker:matrix.orgconnor (he/him)(I am building ONNX Runtime for CUDA 11.4 for a single architecture)23:21:13

Show newer messages


Back to Room ListRoom Version: 9