!eWOErHSaiddIbsUNsJ:nixos.org

NixOS CUDA

283 Members
CUDA packages maintenance and support in nixpkgs | https://github.com/orgs/NixOS/projects/27/ | https://nixos.org/manual/nixpkgs/unstable/#cuda58 Servers

Load older messages


SenderMessageTime
26 Nov 2025
@connorbaker:matrix.orgconnor (he/him):F18:51:53
@connorbaker:matrix.orgconnor (he/him)https://github.com/NixOS/nixpkgs/pull/46532918:57:02
28 Nov 2025
@yorik.sar:matrix.orgyorik.sar Finally got around to doing this: https://github.com/NixOS/nixos-homepage/pull/1903 - connor (burnt/out) (UTC-8) SomeoneSerge (back on matrix)Gaétan Lepage feel free to approve :) 15:01:30
@yorik.sar:matrix.orgyorik.sarI guess I’ll make another one for nixos-cuda.org :)15:05:22
@yorik.sar:matrix.orgyorik.sarHere it is: https://github.com/nixos-cuda/nixos-cuda.org/pull/215:12:12
29 Nov 2025
@matthewcroughan:defenestrate.itmatthewcroughanIs there anybody that knows how you add cuda stuff to a rust build?01:54:22
@matthewcroughan:defenestrate.itmatthewcroughanI have a rust build that is silently doing nothing when cuda isn't present, and not indicating in logs when it is being used or isn't01:54:37
@matthewcroughan:defenestrate.itmatthewcroughanLeads to https://github.com/alvr-org/ALVR/issues/279201:55:02
@ss:someonex.netSomeoneSerge (back on matrix) idk is it even about cuda? Any failing dlopens? @matthewcroughan:defenestrate.it: 04:30:26
@matthewcroughan:defenestrate.itmatthewcroughanI'm not sure, what do you think based on the issue?16:12:46
@matthewcroughan:defenestrate.itmatthewcroughan Apparently people can get it to work by steam-run'ing the stuff they provide via github releases 16:13:09
@ss:someonex.netSomeoneSerge (back on matrix)Id_debuuuuuuuuuuuug16:49:33
@matthewcroughan:defenestrate.itmatthewcroughanYeah I can also get it working by steam-run'ing the github release17:01:30
@matthewcroughan:defenestrate.itmatthewcroughancompiling onnxruntime takes forever though17:01:35
@matthewcroughan:defenestrate.itmatthewcroughanso I'm doing that whilst compiling what I think could be a fix17:01:42
1 Dec 2025
@connorbaker:matrix.orgconnor (he/him)Make sure you’re setting config.cudaCapabilities explicitly to speed up compilation12:39:34
@connorbaker:matrix.orgconnor (he/him)

Packaging onnx/onnx-tensorrt/onnxruntime and getting them working for a range of cuda/cudnn/tensorrt releases is maddening oh my god:

  • Fix for GCC 11/NVCC's template processing https://github.com/nixos-cuda/cuda-legacy/commit/79c3026f1a761125b6faa609c5f9e56e723a4568
  • https://github.com/nixos-cuda/cuda-legacy/issues/6 since ONNX Runtime needs GCC > 11.1 and I need it to build with 11.4
  • I'm fairly certain I managed to get a build failure from ONNX Runtime with CUDA 11.8 because a reference to cuda_nvcc was held onto, so ONNX Runtime failed the build
21:32:54
2 Dec 2025
@connorbaker:matrix.orgconnor (he/him)Okay NVCC from CUDA 11.4 still dies horrifically when using newer versions of glibc with GCC 11 so that’ll stay on GCC 10. Also it seems onnxruntime 1.22.2 needs CCCL newer than what 11.4 provides, so supporting onnxruntime on 11.4 means finding an older version which works :l01:21:58
@glepage:matrix.orgGaétan Lepage connor (burnt/out) (UTC-8) I approved your onnx PR 08:14:41
@glepage:matrix.orgGaétan LepageI can tackle the bump to 1.20.0 after it's merged08:14:56
@keiichi:matrix.orgtetois caching disabled for unstable ? I have to build onnxruntime and then I read this https://discourse.nixos.org/t/cuda-cache-for-nix-community/56038/3 11:45:21
@hexa:lossy.networkhexabuilding cuda packages on nix-community was discontinued12:07:37
@hexa:lossy.networkhexathere is now the flox cache, which builds for their versions of nixpkgs12:08:00
@hexa:lossy.networkhexa* there is now the flox cache, which builds for their versions of nixpkgs, which don't really align with our channels12:08:09
@hexa:lossy.networkhexaand possibly the build results from nixos-cuda.org12:08:32
@keiichi:matrix.orgtetoI had totally missed that. The discourse comment made it sound like it is retaliation against flox actions ?12:11:30
@hexa:lossy.networkhexaRedacted or Malformed Event12:45:08
@connorbaker:matrix.orgconnor (he/him)I am 🔪23:20:33
@connorbaker:matrix.orgconnor (he/him)

okay how the hell did you all manage to debug this on master:

error: output '/nix/store/pb5lmj07b9vs4awlxrga9s6wkfzzrk1i-onnxruntime-1.22.2-dev' is not allowed to refer to the following paths:
         /nix/store/rf7a79c1a73ny3j6jw77nza4wd5z40i1-cuda11.4-cuda_nvcc-11.4.152
23:20:49
@connorbaker:matrix.orgconnor (he/him)(I am building ONNX Runtime for CUDA 11.4 for a single architecture)23:21:13

Show newer messages


Back to Room ListRoom Version: 9