| 25 Oct 2025 |
 connor (burnt/out) (UTC-8) | As for having only x86_64-linux releases -- that's mostly been because releases for Jetson were few and far in between and I don't have access to hopper or blackwell to verify ARM releases function correctly | 23:04:10 |
| connor (burnt/out) (UTC-8) | As I'm working on https://github.com/nixos-cuda/cuda-legacy/pull/1 I'll be making manifests for older versions of TensorRT available publicly | 23:06:27 |
 asa | oh i see
do the arm builds only run on jetsons? | 23:06:38 |
 Daniel Fahey | * https://developer.nvidia.com/blog/developers-can-now-get-cuda-directly-from-their-favorite-third-party-platforms/ | 23:06:55 |
| Daniel Fahey | * https://discourse.nixos.org/t/nix-flox-nvidia-opening-up-cuda-redistribution-on-nix/69189 | 23:07:01 |
| asa | also this is very useful thanks, i didn't know something like cuda-legacy existed | 23:08:50 |
| connor (burnt/out) (UTC-8) | NVIDIA has historically published two "arm" builds: linux-sbsa and linux-aarch64. These both map to Nixpkgs' aarch64-linux platform, but linux-sbsa is for server-grade ARM and linux-aarch64 for Jetsons.
Going forward, it seems new Jetson devices will also use linux-sbsa (e.g., the Jetson Thor). It remains to be seen whether older Jetson devices will be supported on CUDA 13. | 23:09:20 |
| connor (burnt/out) (UTC-8) | It's still very much a work in progress and best-effort, so beware 👻 | 23:10:04 |
| Daniel Fahey | After diffing the inputDrvs
diff <(nix derivation show --impure -I nixpkgs=https://github.com/daniel-fahey/nixpkgs/archive/3d2db9755e7815937fb7b8f089fad9b44bc416d8.tar.gz --expr 'with import <nixpkgs> { }; python313Packages.vllm' | jq -r '.[] | .inputDrvs | keys[]' | sort -t'-' -k2) <(nix derivation show --impure -I nixpkgs=https://github.com/daniel-fahey/nixpkgs/archive/6a08e6bb4e46ff7fcbb53d409b253f6bad8a28ce.tar.gz --expr 'with import <nixpkgs> { }; python313Packages.vllm' | jq -r '.[] | .inputDrvs | keys[]' | sort -t'-' -k2)
37c37
< zv7b6x3i1k6vgmlx4ll74a676znpp19l-python3.13-outlines-1.2.3.drv
---
> b0yp229czgvgsxay9vw8mq0xraa0w94l-python3.13-outlines-1.2.3.drv
| 23:17:03 |
| Daniel Fahey | * After diffing the inputDrvs
$ diff <(nix derivation show --impure -I nixpkgs=https://github.com/NixOS/nixpkgs/archive/3d2db9755e7815937fb7b8f089fad9b44bc416d8.tar.gz --expr 'with import <nixpkgs> { }; python313Packages.vllm' | jq -r '.[] | .inputDrvs | keys[]' | sort -t'-' -k2) <(nix derivation show --impure -I nixpkgs=https://github.com/NixOS/nixpkgs/archive/6a08e6bb4e46ff7fcbb53d409b253f6bad8a28ce.tar.gz --expr 'with import <nixpkgs> { }; python313Packages.vllm' | jq -r '.[] | .inputDrvs | keys[]' | sort -t'-' -k2)
37c37
< zv7b6x3i1k6vgmlx4ll74a676znpp19l-python3.13-outlines-1.2.3.drv
---
> b0yp229czgvgsxay9vw8mq0xraa0w94l-python3.13-outlines-1.2.3.drv
$ diff <(nix derivation show --impure -I nixpkgs=https://github.com/NixOS/nixpkgs/archive/3d2db9755e7815937fb7b8f089fad9b44bc416d8.tar.gz --expr 'with import <nixpkgs> { }; python313Packages.outlines' | jq -r '.[] | .inputDrvs | keys[]' | sort -t'-' -k2) <(nix derivation show --impure -I nixpkgs=https://github.com/NixOS/nixpkgs/archive/6a08e6bb4e46ff7fcbb53d409b253f6bad8a28ce.tar.gz --expr 'with import <nixpkgs> { }; python313Packages.outlines' | jq -r '.[] | .inputDrvs | keys[]' | sort -t'-' -k2)
15c15
< fcsb1iizwb50wiag876xzj9kpd8vpa9s-python3.13-jax-0.8.0.drv
---
> 2vxlyjm486swfp89iwsacyx52rslq4xj-python3.13-jax-0.8.0.drv
$ diff <(nix derivation show --impure -I nixpkgs=https://github.com/NixOS/nixpkgs/archive/3d2db9755e7815937fb7b8f089fad9b44bc416d8.tar.gz --expr 'with import <nixpkgs> { }; python313Packages.jax' | jq -r '.[] | .inputDrvs | keys[]' | sort -t'-' -k2) <(nix derivation show --impure -I nixpkgs=https://github.com/NixOS/nixpkgs/archive/6a08e6bb4e46ff7fcbb53d409b253f6bad8a28ce.tar.gz --expr 'with import <nixpkgs> { }; python313Packages.jax' | jq -r '.[] | .inputDrvs | keys[]' | sort -t'-' -k2)
0a1
> 521737jxrb1akanvm7df9zmx3236rwc6-af5c211d49f3b99447db2252d2cc2b8e0fb54d1c.patch?full_index=1.drv
That last patch is the latest fix to JAX. Maybe a red herring, but I'm running a fresh build of vLLM to see if the new JAX version (and hence Outlines) breaks vLLM.
| 23:21:15 |
| Daniel Fahey | * After diffing the inputDrvs
$ diff <(nix derivation show --impure -I nixpkgs=https://github.com/NixOS/nixpkgs/archive/3d2db9755e7815937fb7b8f089fad9b44bc416d8.tar.gz --expr 'with import <nixpkgs> { }; python313Packages.vllm' | jq -r '.[] | .inputDrvs | keys[]' | sort -t'-' -k2) <(nix derivation show --impure -I nixpkgs=https://github.com/NixOS/nixpkgs/archive/6a08e6bb4e46ff7fcbb53d409b253f6bad8a28ce.tar.gz --expr 'with import <nixpkgs> { }; python313Packages.vllm' | jq -r '.[] | .inputDrvs | keys[]' | sort -t'-' -k2)
37c37
< zv7b6x3i1k6vgmlx4ll74a676znpp19l-python3.13-outlines-1.2.3.drv
---
> b0yp229czgvgsxay9vw8mq0xraa0w94l-python3.13-outlines-1.2.3.drv
$ diff <(nix derivation show --impure -I nixpkgs=https://github.com/NixOS/nixpkgs/archive/3d2db9755e7815937fb7b8f089fad9b44bc416d8.tar.gz --expr 'with import <nixpkgs> { }; python313Packages.outlines' | jq -r '.[] | .inputDrvs | keys[]' | sort -t'-' -k2) <(nix derivation show --impure -I nixpkgs=https://github.com/NixOS/nixpkgs/archive/6a08e6bb4e46ff7fcbb53d409b253f6bad8a28ce.tar.gz --expr 'with import <nixpkgs> { }; python313Packages.outlines' | jq -r '.[] | .inputDrvs | keys[]' | sort -t'-' -k2)
15c15
< fcsb1iizwb50wiag876xzj9kpd8vpa9s-python3.13-jax-0.8.0.drv
---
> 2vxlyjm486swfp89iwsacyx52rslq4xj-python3.13-jax-0.8.0.drv
$ diff <(nix derivation show --impure -I nixpkgs=https://github.com/NixOS/nixpkgs/archive/3d2db9755e7815937fb7b8f089fad9b44bc416d8.tar.gz --expr 'with import <nixpkgs> { }; python313Packages.jax' | jq -r '.[] | .inputDrvs | keys[]' | sort -t'-' -k2) <(nix derivation show --impure -I nixpkgs=https://github.com/NixOS/nixpkgs/archive/6a08e6bb4e46ff7fcbb53d409b253f6bad8a28ce.tar.gz --expr 'with import <nixpkgs> { }; python313Packages.jax' | jq -r '.[] | .inputDrvs | keys[]' | sort -t'-' -k2)
0a1
> 521737jxrb1akanvm7df9zmx3236rwc6-af5c211d49f3b99447db2252d2cc2b8e0fb54d1c.patch?full_index=1.drv
That last patch is the latest fix to JAX. Maybe a red herring, but I'm running a fresh build of vLLM to see if the new JAX version (and hence Outlines) breaks the build.
| 23:22:25 |
| Daniel Fahey | * After diffing the inputDrvs
$ diff <(nix derivation show --impure -I nixpkgs=https://github.com/NixOS/nixpkgs/archive/3d2db9755e7815937fb7b8f089fad9b44bc416d8.tar.gz --expr 'with import <nixpkgs> { }; python313Packages.vllm' | jq -r '.[] | .inputDrvs | keys[]' | sort -t'-' -k2) <(nix derivation show --impure -I nixpkgs=https://github.com/NixOS/nixpkgs/archive/6a08e6bb4e46ff7fcbb53d409b253f6bad8a28ce.tar.gz --expr 'with import <nixpkgs> { }; python313Packages.vllm' | jq -r '.[] | .inputDrvs | keys[]' | sort -t'-' -k2)
37c37
< zv7b6x3i1k6vgmlx4ll74a676znpp19l-python3.13-outlines-1.2.3.drv
---
> b0yp229czgvgsxay9vw8mq0xraa0w94l-python3.13-outlines-1.2.3.drv
$ diff <(nix derivation show --impure -I nixpkgs=https://github.com/NixOS/nixpkgs/archive/3d2db9755e7815937fb7b8f089fad9b44bc416d8.tar.gz --expr 'with import <nixpkgs> { }; python313Packages.outlines' | jq -r '.[] | .inputDrvs | keys[]' | sort -t'-' -k2) <(nix derivation show --impure -I nixpkgs=https://github.com/NixOS/nixpkgs/archive/6a08e6bb4e46ff7fcbb53d409b253f6bad8a28ce.tar.gz --expr 'with import <nixpkgs> { }; python313Packages.outlines' | jq -r '.[] | .inputDrvs | keys[]' | sort -t'-' -k2)
15c15
< fcsb1iizwb50wiag876xzj9kpd8vpa9s-python3.13-jax-0.8.0.drv
---
> 2vxlyjm486swfp89iwsacyx52rslq4xj-python3.13-jax-0.8.0.drv
$ diff <(nix derivation show --impure -I nixpkgs=https://github.com/NixOS/nixpkgs/archive/3d2db9755e7815937fb7b8f089fad9b44bc416d8.tar.gz --expr 'with import <nixpkgs> { }; python313Packages.jax' | jq -r '.[] | .inputDrvs | keys[]' | sort -t'-' -k2) <(nix derivation show --impure -I nixpkgs=https://github.com/NixOS/nixpkgs/archive/6a08e6bb4e46ff7fcbb53d409b253f6bad8a28ce.tar.gz --expr 'with import <nixpkgs> { }; python313Packages.jax' | jq -r '.[] | .inputDrvs | keys[]' | sort -t'-' -k2)
0a1
> 521737jxrb1akanvm7df9zmx3236rwc6-af5c211d49f3b99447db2252d2cc2b8e0fb54d1c.patch?full_index=1.drv
That last patch is the latest fix to JAX. Might be a red herring, but I'm running a fresh build of vLLM to see if the new JAX version (and hence Outlines) breaks the build.
| 23:23:44 |
