!eWOErHSaiddIbsUNsJ:nixos.org

NixOS CUDA

274 Members
CUDA packages maintenance and support in nixpkgs | https://github.com/orgs/NixOS/projects/27/ | https://nixos.org/manual/nixpkgs/unstable/#cuda55 Servers

Load older messages


SenderMessageTime
20 Oct 2025
@connorbaker:matrix.orgconnor (burnt/out) (UTC-8)This was also a great way to find out that on master the wrong version of cuDNN is selected when building for Jetson (we get the x86 binary) — that’s mostly why the flake is using my PR with CUDA 13 and the packaging refactor14:29:02
21 Oct 2025
@connorbaker:matrix.orgconnor (burnt/out) (UTC-8)Started work on CUDA-legacy for everyone who needs support for older versions of CUDA https://github.com/nixos-cuda/cuda-legacy/pull/100:33:26
@connorbaker:matrix.orgconnor (burnt/out) (UTC-8)There might be interesting stuff in the second commit if you’re unfamiliar with flake-part’s partitions functionality06:22:13
@connorbaker:matrix.orgconnor (burnt/out) (UTC-8) SomeoneSerge (back on matrix)
what if 👉👈
you merged my CUDA 13 PR 🥺
06:23:32
@ss:someonex.netSomeoneSerge (back on matrix)
In reply to @connorbaker:matrix.org
SomeoneSerge (back on matrix)
what if 👉👈
you merged my CUDA 13 PR 🥺
'most there
22:00:59
22 Oct 2025
@niclas:overby.meNiclas Overby ⓃAre there any good resources for getting CUDA projects, built with CUDA packages from Nixpkgs, running with libcuda.so provided by a non-NixOS host? Can it be done with LD_LIBRARY_PATH or LD_PRELOAD?08:08:09
@hacker1024:matrix.orghacker1024nixGL has worked for me in the past08:56:54
@hacker1024:matrix.orghacker1024Technically that finds a kernel-compatible libcuda.so in Nixpkgs08:57:24
@sporeray:matrix.orgRobbie Buxton
In reply to @niclas:overby.me
Are there any good resources for getting CUDA projects, built with CUDA packages from Nixpkgs, running with libcuda.so provided by a non-NixOS host?
Can it be done with LD_LIBRARY_PATH or LD_PRELOAD?
If you create a /run/opengl-driver/lib (it might be called something slightly different) folder and symlink all the cuda kernel mode drivers in there. It should work out of the box
14:40:53
@sporeray:matrix.orgRobbie Buxton * If you create a /run/opengl-driver/lib (it might be called something slightly different) folder and symlink all the cuda kernel mode drivers into there. It should work out of the box 14:41:06
@sporeray:matrix.orgRobbie Buxton You need to add this folder to the rpaths of those drivers too others they can’t find each other 14:41:38
@sporeray:matrix.orgRobbie Buxton I.e libcuda.so tries to load something else with nix linker 14:42:05
@sporeray:matrix.orgRobbie Buxton * I.e libcuda.so tries to load something else with the nix linker 14:45:15
@connorbaker:matrix.orgconnor (burnt/out) (UTC-8)Both nixGL and nixglhost should work I’ve also had success doing what Robbie outlined I’ve also been able to export LD_LIBRARY_PATH and that’s worked as well15:02:28
@sporeray:matrix.orgRobbie Buxton * You need to add this folder to the rpaths of those drivers too otherwise they can’t find each other 15:13:26
23 Oct 2025
@connorbaker:matrix.orgconnor (burnt/out) (UTC-8)Got the majority of redists in https://github.com/nixos-cuda/cuda-legacy/pull/1; still need to verify stuff builds and add more redists to the older package sets Everything being as-is is nice, I don’t have to care nsight_systems uses an old version of Qt with known vulnerabilities01:28:19
@hacker1024:matrix.orghacker1024If anyone happens to be using datacenter drivers, be aware the the GSP firmware is not loading. This might lead to unexpected performance problems. https://github.com/NixOS/nixpkgs/issues/45477204:58:50
@prince213:matrix.orgprince213 joined the room.13:13:15
24 Oct 2025
@daniel-fahey:matrix.orgDaniel FaheyAnyone with a phat rig (16+ cores 100+ GB RAM) able to test building this fix? https://github.com/NixOS/nixpkgs/pull/45536420:57:01
@glepage:matrix.orgGaétan LepageYes22:26:21
@glepage:matrix.orgGaétan Lepage python313Packages.vllm built successfully with cudaSupport! 23:13:09
@glepage:matrix.orgGaétan Lepage I started an extensive nixpkgs-review with cudaSupport = true but it will take a while to complete. 23:15:33
25 Oct 2025
@washort:greyface.org@washort:greyface.org left the room.02:21:45
@daniel-fahey:matrix.orgDaniel FaheyThanks! I think it's ready to merge then, I've marked the PR ready to review12:43:44
@glepage:matrix.orgGaétan Lepage I was away from my computer, but I managed to run nixpkgs-review successfully. Good job Daniel Fahey!
I've seen that happysalade merged the PR.
18:17:00
@daniel-fahey:matrix.orgDaniel Fahey No problem, thanks for running nixpkgs-review and good to know TorchRL and KServe are OK 18:24:42
@daniel-fahey:matrix.orgDaniel Faheybtw I'm having a quick look into https://hydra.nixos-cuda.org/build/1784 18:29:42
@glepage:matrix.orgGaétan LepageOh good!18:48:06
@angleangleside:matrix.orgasa is there a reason packages like tensorrt require a manual installation and then running nix-store --add-fixed sha256 TensorRT-10.9.0.34.Linux.x86_64-gnu.cuda-12.8.tar.gz to put them in the nix store? 21:41:07
@angleangleside:matrix.orgasaas opposed to directly downloading the tarball (eg. from https://developer.nvidia.com/downloads/compute/machine-learning/tensorrt/10.9.0/tars/TensorRT-10.9.0.34.Linux.x86_64-gnu.cuda-12.8.tar.gz) under the relevant license21:41:45

Show newer messages


Back to Room ListRoom Version: 9