!eWOErHSaiddIbsUNsJ:nixos.org

NixOS CUDA

274 Members
CUDA packages maintenance and support in nixpkgs | https://github.com/orgs/NixOS/projects/27/ | https://nixos.org/manual/nixpkgs/unstable/#cuda55 Servers

You have reached the beginning of time (for this room).


SenderMessageTime
23 Oct 2025
@connorbaker:matrix.orgconnor (burnt/out) (UTC-8)Got the majority of redists in https://github.com/nixos-cuda/cuda-legacy/pull/1; still need to verify stuff builds and add more redists to the older package sets Everything being as-is is nice, I don’t have to care nsight_systems uses an old version of Qt with known vulnerabilities01:28:19
@hacker1024:matrix.orghacker1024If anyone happens to be using datacenter drivers, be aware the the GSP firmware is not loading. This might lead to unexpected performance problems. https://github.com/NixOS/nixpkgs/issues/45477204:58:50
@prince213:matrix.orgprince213 joined the room.13:13:15
24 Oct 2025
@daniel-fahey:matrix.orgDaniel FaheyAnyone with a phat rig (16+ cores 100+ GB RAM) able to test building this fix? https://github.com/NixOS/nixpkgs/pull/45536420:57:01
@glepage:matrix.orgGaétan LepageYes22:26:21
@glepage:matrix.orgGaétan Lepage python313Packages.vllm built successfully with cudaSupport! 23:13:09
@glepage:matrix.orgGaétan Lepage I started an extensive nixpkgs-review with cudaSupport = true but it will take a while to complete. 23:15:33
25 Oct 2025
@washort:greyface.org@washort:greyface.org left the room.02:21:45
@daniel-fahey:matrix.orgDaniel FaheyThanks! I think it's ready to merge then, I've marked the PR ready to review12:43:44
@glepage:matrix.orgGaétan Lepage I was away from my computer, but I managed to run nixpkgs-review successfully. Good job Daniel Fahey!
I've seen that happysalade merged the PR.
18:17:00
@daniel-fahey:matrix.orgDaniel Fahey No problem, thanks for running nixpkgs-review and good to know TorchRL and KServe are OK 18:24:42
@daniel-fahey:matrix.orgDaniel Faheybtw I'm having a quick look into https://hydra.nixos-cuda.org/build/1784 18:29:42
@glepage:matrix.orgGaétan LepageOh good!18:48:06
@angleangleside:matrix.orgasa is there a reason packages like tensorrt require a manual installation and then running nix-store --add-fixed sha256 TensorRT-10.9.0.34.Linux.x86_64-gnu.cuda-12.8.tar.gz to put them in the nix store? 21:41:07
@angleangleside:matrix.orgasaas opposed to directly downloading the tarball (eg. from https://developer.nvidia.com/downloads/compute/machine-learning/tensorrt/10.9.0/tars/TensorRT-10.9.0.34.Linux.x86_64-gnu.cuda-12.8.tar.gz) under the relevant license21:41:45
@daniel-fahey:matrix.orgDaniel FaheyIDK I'm just guessing licensing?21:42:17
@angleangleside:matrix.orgasayeah it seems like a weird "nvidia requires you to sign in and agree to their eula" thing21:42:41
@angleangleside:matrix.orgasabut i don't think(?) it violates their license if private groups that already have agreed to the eula override the tensorrt package to fetch from the url anyway21:43:18
@daniel-fahey:matrix.orgDaniel FaheyThey relaxed a lot of their law fare bullshit recently21:43:38
@angleangleside:matrix.orgasaa related question - it appears the tensorrt in nixpkgs is labelled only for x86_64 (possibly because nvidia only offers generic linux binaries for x64), but they offer a tarball for ubuntu 24, would i just be able to override the source for the arm build and let patchelf handle the rest?21:44:53
@angleangleside:matrix.orgasa * a related question - it appears the tensorrt in nixpkgs is labelled only for x86_64 (possibly because nvidia only offers generic linux binaries for x64), but they only offer a tarball for arm targeting ubuntu 24, would i just be able to override the source for the arm build and let patchelf handle the rest? 21:45:20
@angleangleside:matrix.orgasa * a related question - it appears the tensorrt in nixpkgs is labelled only for x86_64 (possibly because nvidia only offers generic linux binaries for x64), but they only offer a tarball for arm targeting ubuntu 24. would i just be able to override the source for the arm build and let patchelf handle the rest? 21:45:38
@daniel-fahey:matrix.orgDaniel FaheyTry it out, looks like it needs a new maintainer anyway. I nominate you https://github.com/NixOS/nixpkgs/blob/master/pkgs/development/python-modules/tensorrt/default.nix21:46:58
@angleangleside:matrix.orgasasounds good, perhaps i'll try to figure out how to use nixpkgs' cuda infra first21:49:07

Show newer messages


Back to Room ListRoom Version: 9