| 28 Nov 2025 |
yorik.sar | Here it is: https://github.com/nixos-cuda/nixos-cuda.org/pull/2 | 15:12:12 |
| 29 Nov 2025 |
matthewcroughan | Is there anybody that knows how you add cuda stuff to a rust build? | 01:54:22 |
matthewcroughan | I have a rust build that is silently doing nothing when cuda isn't present, and not indicating in logs when it is being used or isn't | 01:54:37 |
matthewcroughan | Leads to https://github.com/alvr-org/ALVR/issues/2792 | 01:55:02 |
SomeoneSerge (back on matrix) | idk is it even about cuda? Any failing dlopens? @matthewcroughan:defenestrate.it: | 04:30:26 |
matthewcroughan | I'm not sure, what do you think based on the issue? | 16:12:46 |
matthewcroughan | Apparently people can get it to work by steam-run'ing the stuff they provide via github releases | 16:13:09 |
SomeoneSerge (back on matrix) | Id_debuuuuuuuuuuuug | 16:49:33 |
matthewcroughan | Yeah I can also get it working by steam-run'ing the github release | 17:01:30 |
matthewcroughan | compiling onnxruntime takes forever though | 17:01:35 |
matthewcroughan | so I'm doing that whilst compiling what I think could be a fix | 17:01:42 |
| 1 Dec 2025 |
connor (he/him) | Make sure you’re setting config.cudaCapabilities explicitly to speed up compilation | 12:39:34 |
connor (he/him) | Packaging onnx/onnx-tensorrt/onnxruntime and getting them working for a range of cuda/cudnn/tensorrt releases is maddening oh my god:
- Fix for GCC 11/NVCC's template processing https://github.com/nixos-cuda/cuda-legacy/commit/79c3026f1a761125b6faa609c5f9e56e723a4568
- https://github.com/nixos-cuda/cuda-legacy/issues/6 since ONNX Runtime needs GCC > 11.1 and I need it to build with 11.4
- I'm fairly certain I managed to get a build failure from ONNX Runtime with CUDA 11.8 because a reference to
cuda_nvcc was held onto, so ONNX Runtime failed the build
| 21:32:54 |
| 2 Dec 2025 |
connor (he/him) | Okay NVCC from CUDA 11.4 still dies horrifically when using newer versions of glibc with GCC 11 so that’ll stay on GCC 10.
Also it seems onnxruntime 1.22.2 needs CCCL newer than what 11.4 provides, so supporting onnxruntime on 11.4 means finding an older version which works :l | 01:21:58 |
Gaétan Lepage | connor (burnt/out) (UTC-8) I approved your onnx PR | 08:14:41 |
Gaétan Lepage | I can tackle the bump to 1.20.0 after it's merged | 08:14:56 |
teto | is caching disabled for unstable ? I have to build onnxruntime and then I read this https://discourse.nixos.org/t/cuda-cache-for-nix-community/56038/3 | 11:45:21 |
hexa | building cuda packages on nix-community was discontinued | 12:07:37 |
hexa | there is now the flox cache, which builds for their versions of nixpkgs | 12:08:00 |
hexa | * there is now the flox cache, which builds for their versions of nixpkgs, which don't really align with our channels | 12:08:09 |
hexa | and possibly the build results from nixos-cuda.org | 12:08:32 |
teto | I had totally missed that. The discourse comment made it sound like it is retaliation against flox actions ? | 12:11:30 |
hexa | Redacted or Malformed Event | 12:45:08 |
connor (he/him) | I am 🔪 | 23:20:33 |
connor (he/him) | okay how the hell did you all manage to debug this on master:
error: output '/nix/store/pb5lmj07b9vs4awlxrga9s6wkfzzrk1i-onnxruntime-1.22.2-dev' is not allowed to refer to the following paths:
/nix/store/rf7a79c1a73ny3j6jw77nza4wd5z40i1-cuda11.4-cuda_nvcc-11.4.152
| 23:20:49 |
connor (he/him) | (I am building ONNX Runtime for CUDA 11.4 for a single architecture) | 23:21:13 |
connor (he/him) | CC Gaétan Lepage SomeoneSerge (back on matrix) | 23:21:23 |
| 3 Dec 2025 |
connor (he/him) | ugh it's through cudnn-frontend because https://github.com/NVIDIA/cudnn-frontend/blob/0258951d4d512f4714eb1574496f4d57669b1b93/CMakeLists.txt#L43 means the generate cmake target has the include directory of NVCC and since I made NVCC a single-output derivation, the output containing include and bin are one and the same so ONNX Runtime's disallowedRequisites = lib.optionals cudaSupport [ (lib.getBin cuda_nvcc) ]; is tripped because of the cmake config from cudnn-frontend so I guess I'm trying to split up NVCC again fml | 00:09:44 |
Gaétan Lepage | FYI, https://hydra.nixos-cuda.org is now building nixos-25.11-small too :) | 09:50:51 |
Gaétan Lepage | * FYI (for stable channel users), https://hydra.nixos-cuda.org is now building nixos-25.11-small too :) | 09:51:06 |