| 23 Oct 2025 |
|  prince213 joined the room. | 13:13:15 |
| 24 Oct 2025 |
 Daniel Fahey | Anyone with a phat rig (16+ cores 100+ GB RAM) able to test building this fix? https://github.com/NixOS/nixpkgs/pull/455364 | 20:57:01 |
 Gaétan Lepage | Yes | 22:26:21 |
| Gaétan Lepage | python313Packages.vllm built successfully with cudaSupport! | 23:13:09 |
| Gaétan Lepage | I started an extensive nixpkgs-review with cudaSupport = true but it will take a while to complete. | 23:15:33 |
| 25 Oct 2025 |
|  @washort:greyface.org left the room. | 02:21:45 |
| Daniel Fahey | Thanks! I think it's ready to merge then, I've marked the PR ready to review | 12:43:44 |
| Gaétan Lepage | I was away from my computer, but I managed to run nixpkgs-review successfully. Good job Daniel Fahey!
I've seen that happysalade merged the PR. | 18:17:00 |
| Daniel Fahey | No problem, thanks for running nixpkgs-review and good to know TorchRL and KServe are OK | 18:24:42 |
| Daniel Fahey | btw I'm having a quick look into https://hydra.nixos-cuda.org/build/1784 | 18:29:42 |
| Gaétan Lepage | Oh good! | 18:48:06 |
 asa | is there a reason packages like tensorrt require a manual installation and then running nix-store --add-fixed sha256 TensorRT-10.9.0.34.Linux.x86_64-gnu.cuda-12.8.tar.gz to put them in the nix store? | 21:41:07 |
| asa | as opposed to directly downloading the tarball (eg. from https://developer.nvidia.com/downloads/compute/machine-learning/tensorrt/10.9.0/tars/TensorRT-10.9.0.34.Linux.x86_64-gnu.cuda-12.8.tar.gz) under the relevant license | 21:41:45 |
| Daniel Fahey | IDK I'm just guessing licensing? | 21:42:17 |
| asa | yeah it seems like a weird "nvidia requires you to sign in and agree to their eula" thing | 21:42:41 |
| asa | but i don't think(?) it violates their license if private groups that already have agreed to the eula override the tensorrt package to fetch from the url anyway | 21:43:18 |
| Daniel Fahey | They relaxed a lot of their law fare bullshit recently | 21:43:38 |
| asa | a related question - it appears the tensorrt in nixpkgs is labelled only for x86_64 (possibly because nvidia only offers generic linux binaries for x64), but they offer a tarball for ubuntu 24, would i just be able to override the source for the arm build and let patchelf handle the rest? | 21:44:53 |
| asa | * a related question - it appears the tensorrt in nixpkgs is labelled only for x86_64 (possibly because nvidia only offers generic linux binaries for x64), but they only offer a tarball for arm targeting ubuntu 24, would i just be able to override the source for the arm build and let patchelf handle the rest? | 21:45:20 |
| asa | * a related question - it appears the tensorrt in nixpkgs is labelled only for x86_64 (possibly because nvidia only offers generic linux binaries for x64), but they only offer a tarball for arm targeting ubuntu 24. would i just be able to override the source for the arm build and let patchelf handle the rest? | 21:45:38 |
| Daniel Fahey | Try it out, looks like it needs a new maintainer anyway. I nominate you https://github.com/NixOS/nixpkgs/blob/master/pkgs/development/python-modules/tensorrt/default.nix | 21:46:58 |
| asa | sounds good, perhaps i'll try to figure out how to use nixpkgs' cuda infra first | 21:49:07 |
| asa | also for anyone with possibly more knowledge on this, tensorrt downloads are public endpoints (https://developer.nvidia.com/downloads/compute/machine-learning/tensorrt/10.9.0/tars/TensorRT-10.9.0.34.Linux.x86_64-gnu.cuda-12.8.tar.gz) that you can get without authenticating
would it be a license violation to directly include that in nixpkgs with the relevant package license instead of via separately joining their developer program? | 22:24:21 |
| Daniel Fahey | Can't remember where I saw this link, I though it was in here, anyone know of any other discussion / context re: Nix? It reports Flox are signed up? https://developer.nvidia.com/blog/developers-can-now-get-cuda-directly-from-their-favorite-third-party-platforms/ | 22:59:54 |
| Daniel Fahey | DuckDuckGo was better at searching the Discouse, heh, https://discourse.nixos.org/t/nix-flox-nvidia-opening-up-cuda-redistribution-on-nix/69189 | 23:02:41 |
 connor (burnt/out) (UTC-8) | asa: only the 10-series are available without a login.
They also don't publish the URLs anywhere public except on their TensorRT OSS repo (only for current releases). You can see the URLs for previous releases assuming you log in to NVIDIA's website.
See https://github.com/NixOS/nixpkgs/pull/437723; I've got a helper bash script which can be used to generate a manifest file similar to what NVIDIA provides for their other binary archives. | 23:03:12 |
