!eWOErHSaiddIbsUNsJ:nixos.org

NixOS CUDA

287 Members
CUDA packages maintenance and support in nixpkgs | https://github.com/orgs/NixOS/projects/27/ | https://nixos.org/manual/nixpkgs/unstable/#cuda58 Servers

You have reached the beginning of time (for this room).


SenderMessageTime
25 Oct 2025
@daniel-fahey:matrix.orgDaniel Fahey* https://discourse.nixos.org/t/nix-flox-nvidia-opening-up-cuda-redistribution-on-nix/6918923:07:01
@angleangleside:matrix.orgasaalso this is very useful thanks, i didn't know something like cuda-legacy existed23:08:50
@connorbaker:matrix.orgconnor (burnt/out) (UTC-8) NVIDIA has historically published two "arm" builds: linux-sbsa and linux-aarch64. These both map to Nixpkgs' aarch64-linux platform, but linux-sbsa is for server-grade ARM and linux-aarch64 for Jetsons.
Going forward, it seems new Jetson devices will also use linux-sbsa (e.g., the Jetson Thor). It remains to be seen whether older Jetson devices will be supported on CUDA 13.
23:09:20
@connorbaker:matrix.orgconnor (burnt/out) (UTC-8)It's still very much a work in progress and best-effort, so beware 👻23:10:04
@daniel-fahey:matrix.orgDaniel Fahey

After diffing the inputDrvs

diff <(nix derivation show --impure -I nixpkgs=https://github.com/daniel-fahey/nixpkgs/archive/3d2db9755e7815937fb7b8f089fad9b44bc416d8.tar.gz --expr 'with import <nixpkgs> { }; python313Packages.vllm' | jq -r '.[] | .inputDrvs | keys[]' | sort -t'-' -k2) <(nix derivation show --impure -I nixpkgs=https://github.com/daniel-fahey/nixpkgs/archive/6a08e6bb4e46ff7fcbb53d409b253f6bad8a28ce.tar.gz --expr 'with import <nixpkgs> { }; python313Packages.vllm' | jq -r '.[] | .inputDrvs | keys[]' | sort -t'-' -k2)
37c37
< zv7b6x3i1k6vgmlx4ll74a676znpp19l-python3.13-outlines-1.2.3.drv
---
> b0yp229czgvgsxay9vw8mq0xraa0w94l-python3.13-outlines-1.2.3.drv
23:17:03
@daniel-fahey:matrix.orgDaniel Fahey *

After diffing the inputDrvs

$ diff <(nix derivation show --impure -I nixpkgs=https://github.com/NixOS/nixpkgs/archive/3d2db9755e7815937fb7b8f089fad9b44bc416d8.tar.gz --expr 'with import <nixpkgs> { }; python313Packages.vllm' | jq -r '.[] | .inputDrvs | keys[]' | sort -t'-' -k2) <(nix derivation show --impure -I nixpkgs=https://github.com/NixOS/nixpkgs/archive/6a08e6bb4e46ff7fcbb53d409b253f6bad8a28ce.tar.gz --expr 'with import <nixpkgs> { }; python313Packages.vllm' | jq -r '.[] | .inputDrvs | keys[]' | sort -t'-' -k2)
37c37
< zv7b6x3i1k6vgmlx4ll74a676znpp19l-python3.13-outlines-1.2.3.drv
---
> b0yp229czgvgsxay9vw8mq0xraa0w94l-python3.13-outlines-1.2.3.drv
$ diff <(nix derivation show --impure -I nixpkgs=https://github.com/NixOS/nixpkgs/archive/3d2db9755e7815937fb7b8f089fad9b44bc416d8.tar.gz --expr 'with import <nixpkgs> { }; python313Packages.outlines' | jq -r '.[] | .inputDrvs | keys[]' | sort -t'-' -k2) <(nix derivation show --impure -I nixpkgs=https://github.com/NixOS/nixpkgs/archive/6a08e6bb4e46ff7fcbb53d409b253f6bad8a28ce.tar.gz --expr 'with import <nixpkgs> { }; python313Packages.outlines' | jq -r '.[] | .inputDrvs | keys[]' | sort -t'-' -k2)
15c15
< fcsb1iizwb50wiag876xzj9kpd8vpa9s-python3.13-jax-0.8.0.drv
---
> 2vxlyjm486swfp89iwsacyx52rslq4xj-python3.13-jax-0.8.0.drv
$ diff <(nix derivation show --impure -I nixpkgs=https://github.com/NixOS/nixpkgs/archive/3d2db9755e7815937fb7b8f089fad9b44bc416d8.tar.gz --expr 'with import <nixpkgs> { }; python313Packages.jax' | jq -r '.[] | .inputDrvs | keys[]' | sort -t'-' -k2) <(nix derivation show --impure -I nixpkgs=https://github.com/NixOS/nixpkgs/archive/6a08e6bb4e46ff7fcbb53d409b253f6bad8a28ce.tar.gz --expr 'with import <nixpkgs> { }; python313Packages.jax' | jq -r '.[] | .inputDrvs | keys[]' | sort -t'-' -k2)
0a1
> 521737jxrb1akanvm7df9zmx3236rwc6-af5c211d49f3b99447db2252d2cc2b8e0fb54d1c.patch?full_index=1.drv

That last patch is the latest fix to JAX. Maybe a red herring, but I'm running a fresh build of vLLM to see if the new JAX version (and hence Outlines) breaks vLLM.

23:21:15

Show newer messages


Back to Room ListRoom Version: 9