!eWOErHSaiddIbsUNsJ:nixos.org

NixOS CUDA

283 Members
CUDA packages maintenance and support in nixpkgs | https://github.com/orgs/NixOS/projects/27/ | https://nixos.org/manual/nixpkgs/unstable/#cuda58 Servers

Load older messages


SenderMessageTime
25 Nov 2025
@connorbaker:matrix.orgconnor (he/him) while building every combination of TensorRT 10.x and CUDA release on x86_64-linux to verify I could remove cudnn and nvrtc as buildInputs I prodded Claude to make the optuna+helion thing I mentioned earlier: https://github.com/ConnorBaker/helion/blob/claude/enhance-helion-autotuner-01V2JcV61tYZPi7y6cuZpE54/helion/autotuner/optuna_search.py
It doesn't work with the version of Helion we have in Nixpkgs because of some API changes to parallel_benchmarking but it seems like what I wanted. Haven't had the chance to mess with it though :l
04:50:08
@connorbaker:matrix.orgconnor (he/him)https://github.com/NixOS/nixpkgs/pull/46494715:01:41
@connorbaker:matrix.orgconnor (he/him)https://github.com/NixOS/nixpkgs/pull/46495715:52:14
@connorbaker:matrix.orgconnor (he/him)https://github.com/NixOS/nixpkgs/pull/46504720:23:29
@glepage:matrix.orgGaétan Lepage https://github.com/NixOS/nixpkgs/pull/450587 20:24:55
26 Nov 2025
@connorbaker:matrix.orgconnor (he/him) SomeoneSerge (back on matrix) I updated https://github.com/NixOS/nixpkgs/pull/459416 please merge 🫩 02:57:01
@connorbaker:matrix.orgconnor (he/him)🤦‍♂️15:37:52
@connorbaker:matrix.orgconnor (he/him) https://github.com/onnx/onnx-tensorrt/pull/1043 moved from the pycuda to cuda python package and documented it nowhere I've been able to find 15:38:34
@connorbaker:matrix.orgconnor (he/him) Kevin Mittman (UTC-7): the entry for --verbose seems to be for --no-dry-run, which doesn't have an entry: https://docs.nvidia.com/cuda/cuda-compiler-driver-nvcc/#verbose-v 18:12:52
@connorbaker:matrix.orgconnor (he/him) well, pycuda's tests exposed a few issues with how NVCC works
notably that it dies if GCC isn't on the path -- it doesn't even use the path modifications from nvcc.profile
18:38:12
@connorbaker:matrix.orgconnor (he/him)so this is now a larger PR https://github.com/NixOS/nixpkgs/pull/46504718:38:20
@connorbaker:matrix.orgconnor (he/him)I'm going to split out the NVCC changes to a different PR and make pycuda a stacked PR18:51:51
@connorbaker:matrix.orgconnor (he/him):F18:51:53
@connorbaker:matrix.orgconnor (he/him)https://github.com/NixOS/nixpkgs/pull/46532918:57:02
28 Nov 2025
@yorik.sar:matrix.orgyorik.sar Finally got around to doing this: https://github.com/NixOS/nixos-homepage/pull/1903 - connor (burnt/out) (UTC-8) SomeoneSerge (back on matrix)Gaétan Lepage feel free to approve :) 15:01:30
@yorik.sar:matrix.orgyorik.sarI guess I’ll make another one for nixos-cuda.org :)15:05:22
@yorik.sar:matrix.orgyorik.sarHere it is: https://github.com/nixos-cuda/nixos-cuda.org/pull/215:12:12
29 Nov 2025
@matthewcroughan:defenestrate.itmatthewcroughanIs there anybody that knows how you add cuda stuff to a rust build?01:54:22
@matthewcroughan:defenestrate.itmatthewcroughanI have a rust build that is silently doing nothing when cuda isn't present, and not indicating in logs when it is being used or isn't01:54:37
@matthewcroughan:defenestrate.itmatthewcroughanLeads to https://github.com/alvr-org/ALVR/issues/279201:55:02
@ss:someonex.netSomeoneSerge (back on matrix) idk is it even about cuda? Any failing dlopens? @matthewcroughan:defenestrate.it: 04:30:26
@matthewcroughan:defenestrate.itmatthewcroughanI'm not sure, what do you think based on the issue?16:12:46
@matthewcroughan:defenestrate.itmatthewcroughan Apparently people can get it to work by steam-run'ing the stuff they provide via github releases 16:13:09
@ss:someonex.netSomeoneSerge (back on matrix)Id_debuuuuuuuuuuuug16:49:33
@matthewcroughan:defenestrate.itmatthewcroughanYeah I can also get it working by steam-run'ing the github release17:01:30
@matthewcroughan:defenestrate.itmatthewcroughancompiling onnxruntime takes forever though17:01:35
@matthewcroughan:defenestrate.itmatthewcroughanso I'm doing that whilst compiling what I think could be a fix17:01:42
1 Dec 2025
@connorbaker:matrix.orgconnor (he/him)Make sure you’re setting config.cudaCapabilities explicitly to speed up compilation12:39:34
@connorbaker:matrix.orgconnor (he/him)

Packaging onnx/onnx-tensorrt/onnxruntime and getting them working for a range of cuda/cudnn/tensorrt releases is maddening oh my god:

  • Fix for GCC 11/NVCC's template processing https://github.com/nixos-cuda/cuda-legacy/commit/79c3026f1a761125b6faa609c5f9e56e723a4568
  • https://github.com/nixos-cuda/cuda-legacy/issues/6 since ONNX Runtime needs GCC > 11.1 and I need it to build with 11.4
  • I'm fairly certain I managed to get a build failure from ONNX Runtime with CUDA 11.8 because a reference to cuda_nvcc was held onto, so ONNX Runtime failed the build
21:32:54
2 Dec 2025
@connorbaker:matrix.orgconnor (he/him)Okay NVCC from CUDA 11.4 still dies horrifically when using newer versions of glibc with GCC 11 so that’ll stay on GCC 10. Also it seems onnxruntime 1.22.2 needs CCCL newer than what 11.4 provides, so supporting onnxruntime on 11.4 means finding an older version which works :l01:21:58

Show newer messages


Back to Room ListRoom Version: 9