| 25 Oct 2025 |
 Daniel Fahey | * https://discourse.nixos.org/t/nix-flox-nvidia-opening-up-cuda-redistribution-on-nix/69189 | 23:07:01 |
 asa | also this is very useful thanks, i didn't know something like cuda-legacy existed | 23:08:50 |
 connor (burnt/out) (UTC-8) | NVIDIA has historically published two "arm" builds: linux-sbsa and linux-aarch64. These both map to Nixpkgs' aarch64-linux platform, but linux-sbsa is for server-grade ARM and linux-aarch64 for Jetsons.
Going forward, it seems new Jetson devices will also use linux-sbsa (e.g., the Jetson Thor). It remains to be seen whether older Jetson devices will be supported on CUDA 13. | 23:09:20 |
| connor (burnt/out) (UTC-8) | It's still very much a work in progress and best-effort, so beware 👻 | 23:10:04 |
| Daniel Fahey | After diffing the inputDrvs
diff <(nix derivation show --impure -I nixpkgs=https://github.com/daniel-fahey/nixpkgs/archive/3d2db9755e7815937fb7b8f089fad9b44bc416d8.tar.gz --expr 'with import <nixpkgs> { }; python313Packages.vllm' | jq -r '.[] | .inputDrvs | keys[]' | sort -t'-' -k2) <(nix derivation show --impure -I nixpkgs=https://github.com/daniel-fahey/nixpkgs/archive/6a08e6bb4e46ff7fcbb53d409b253f6bad8a28ce.tar.gz --expr 'with import <nixpkgs> { }; python313Packages.vllm' | jq -r '.[] | .inputDrvs | keys[]' | sort -t'-' -k2)
37c37
< zv7b6x3i1k6vgmlx4ll74a676znpp19l-python3.13-outlines-1.2.3.drv
---
> b0yp229czgvgsxay9vw8mq0xraa0w94l-python3.13-outlines-1.2.3.drv
| 23:17:03 |
| Daniel Fahey | * After diffing the inputDrvs
$ diff <(nix derivation show --impure -I nixpkgs=https://github.com/NixOS/nixpkgs/archive/3d2db9755e7815937fb7b8f089fad9b44bc416d8.tar.gz --expr 'with import <nixpkgs> { }; python313Packages.vllm' | jq -r '.[] | .inputDrvs | keys[]' | sort -t'-' -k2) <(nix derivation show --impure -I nixpkgs=https://github.com/NixOS/nixpkgs/archive/6a08e6bb4e46ff7fcbb53d409b253f6bad8a28ce.tar.gz --expr 'with import <nixpkgs> { }; python313Packages.vllm' | jq -r '.[] | .inputDrvs | keys[]' | sort -t'-' -k2)
37c37
< zv7b6x3i1k6vgmlx4ll74a676znpp19l-python3.13-outlines-1.2.3.drv
---
> b0yp229czgvgsxay9vw8mq0xraa0w94l-python3.13-outlines-1.2.3.drv
$ diff <(nix derivation show --impure -I nixpkgs=https://github.com/NixOS/nixpkgs/archive/3d2db9755e7815937fb7b8f089fad9b44bc416d8.tar.gz --expr 'with import <nixpkgs> { }; python313Packages.outlines' | jq -r '.[] | .inputDrvs | keys[]' | sort -t'-' -k2) <(nix derivation show --impure -I nixpkgs=https://github.com/NixOS/nixpkgs/archive/6a08e6bb4e46ff7fcbb53d409b253f6bad8a28ce.tar.gz --expr 'with import <nixpkgs> { }; python313Packages.outlines' | jq -r '.[] | .inputDrvs | keys[]' | sort -t'-' -k2)
15c15
< fcsb1iizwb50wiag876xzj9kpd8vpa9s-python3.13-jax-0.8.0.drv
---
> 2vxlyjm486swfp89iwsacyx52rslq4xj-python3.13-jax-0.8.0.drv
$ diff <(nix derivation show --impure -I nixpkgs=https://github.com/NixOS/nixpkgs/archive/3d2db9755e7815937fb7b8f089fad9b44bc416d8.tar.gz --expr 'with import <nixpkgs> { }; python313Packages.jax' | jq -r '.[] | .inputDrvs | keys[]' | sort -t'-' -k2) <(nix derivation show --impure -I nixpkgs=https://github.com/NixOS/nixpkgs/archive/6a08e6bb4e46ff7fcbb53d409b253f6bad8a28ce.tar.gz --expr 'with import <nixpkgs> { }; python313Packages.jax' | jq -r '.[] | .inputDrvs | keys[]' | sort -t'-' -k2)
0a1
> 521737jxrb1akanvm7df9zmx3236rwc6-af5c211d49f3b99447db2252d2cc2b8e0fb54d1c.patch?full_index=1.drv
That last patch is the latest fix to JAX. Maybe a red herring, but I'm running a fresh build of vLLM to see if the new JAX version (and hence Outlines) breaks vLLM.
| 23:21:15 |
| Daniel Fahey | * After diffing the inputDrvs
$ diff <(nix derivation show --impure -I nixpkgs=https://github.com/NixOS/nixpkgs/archive/3d2db9755e7815937fb7b8f089fad9b44bc416d8.tar.gz --expr 'with import <nixpkgs> { }; python313Packages.vllm' | jq -r '.[] | .inputDrvs | keys[]' | sort -t'-' -k2) <(nix derivation show --impure -I nixpkgs=https://github.com/NixOS/nixpkgs/archive/6a08e6bb4e46ff7fcbb53d409b253f6bad8a28ce.tar.gz --expr 'with import <nixpkgs> { }; python313Packages.vllm' | jq -r '.[] | .inputDrvs | keys[]' | sort -t'-' -k2)
37c37
< zv7b6x3i1k6vgmlx4ll74a676znpp19l-python3.13-outlines-1.2.3.drv
---
> b0yp229czgvgsxay9vw8mq0xraa0w94l-python3.13-outlines-1.2.3.drv
$ diff <(nix derivation show --impure -I nixpkgs=https://github.com/NixOS/nixpkgs/archive/3d2db9755e7815937fb7b8f089fad9b44bc416d8.tar.gz --expr 'with import <nixpkgs> { }; python313Packages.outlines' | jq -r '.[] | .inputDrvs | keys[]' | sort -t'-' -k2) <(nix derivation show --impure -I nixpkgs=https://github.com/NixOS/nixpkgs/archive/6a08e6bb4e46ff7fcbb53d409b253f6bad8a28ce.tar.gz --expr 'with import <nixpkgs> { }; python313Packages.outlines' | jq -r '.[] | .inputDrvs | keys[]' | sort -t'-' -k2)
15c15
< fcsb1iizwb50wiag876xzj9kpd8vpa9s-python3.13-jax-0.8.0.drv
---
> 2vxlyjm486swfp89iwsacyx52rslq4xj-python3.13-jax-0.8.0.drv
$ diff <(nix derivation show --impure -I nixpkgs=https://github.com/NixOS/nixpkgs/archive/3d2db9755e7815937fb7b8f089fad9b44bc416d8.tar.gz --expr 'with import <nixpkgs> { }; python313Packages.jax' | jq -r '.[] | .inputDrvs | keys[]' | sort -t'-' -k2) <(nix derivation show --impure -I nixpkgs=https://github.com/NixOS/nixpkgs/archive/6a08e6bb4e46ff7fcbb53d409b253f6bad8a28ce.tar.gz --expr 'with import <nixpkgs> { }; python313Packages.jax' | jq -r '.[] | .inputDrvs | keys[]' | sort -t'-' -k2)
0a1
> 521737jxrb1akanvm7df9zmx3236rwc6-af5c211d49f3b99447db2252d2cc2b8e0fb54d1c.patch?full_index=1.drv
That last patch is the latest fix to JAX. Maybe a red herring, but I'm running a fresh build of vLLM to see if the new JAX version (and hence Outlines) breaks the build.
| 23:22:25 |
| Daniel Fahey | * After diffing the inputDrvs
$ diff <(nix derivation show --impure -I nixpkgs=https://github.com/NixOS/nixpkgs/archive/3d2db9755e7815937fb7b8f089fad9b44bc416d8.tar.gz --expr 'with import <nixpkgs> { }; python313Packages.vllm' | jq -r '.[] | .inputDrvs | keys[]' | sort -t'-' -k2) <(nix derivation show --impure -I nixpkgs=https://github.com/NixOS/nixpkgs/archive/6a08e6bb4e46ff7fcbb53d409b253f6bad8a28ce.tar.gz --expr 'with import <nixpkgs> { }; python313Packages.vllm' | jq -r '.[] | .inputDrvs | keys[]' | sort -t'-' -k2)
37c37
< zv7b6x3i1k6vgmlx4ll74a676znpp19l-python3.13-outlines-1.2.3.drv
---
> b0yp229czgvgsxay9vw8mq0xraa0w94l-python3.13-outlines-1.2.3.drv
$ diff <(nix derivation show --impure -I nixpkgs=https://github.com/NixOS/nixpkgs/archive/3d2db9755e7815937fb7b8f089fad9b44bc416d8.tar.gz --expr 'with import <nixpkgs> { }; python313Packages.outlines' | jq -r '.[] | .inputDrvs | keys[]' | sort -t'-' -k2) <(nix derivation show --impure -I nixpkgs=https://github.com/NixOS/nixpkgs/archive/6a08e6bb4e46ff7fcbb53d409b253f6bad8a28ce.tar.gz --expr 'with import <nixpkgs> { }; python313Packages.outlines' | jq -r '.[] | .inputDrvs | keys[]' | sort -t'-' -k2)
15c15
< fcsb1iizwb50wiag876xzj9kpd8vpa9s-python3.13-jax-0.8.0.drv
---
> 2vxlyjm486swfp89iwsacyx52rslq4xj-python3.13-jax-0.8.0.drv
$ diff <(nix derivation show --impure -I nixpkgs=https://github.com/NixOS/nixpkgs/archive/3d2db9755e7815937fb7b8f089fad9b44bc416d8.tar.gz --expr 'with import <nixpkgs> { }; python313Packages.jax' | jq -r '.[] | .inputDrvs | keys[]' | sort -t'-' -k2) <(nix derivation show --impure -I nixpkgs=https://github.com/NixOS/nixpkgs/archive/6a08e6bb4e46ff7fcbb53d409b253f6bad8a28ce.tar.gz --expr 'with import <nixpkgs> { }; python313Packages.jax' | jq -r '.[] | .inputDrvs | keys[]' | sort -t'-' -k2)
0a1
> 521737jxrb1akanvm7df9zmx3236rwc6-af5c211d49f3b99447db2252d2cc2b8e0fb54d1c.patch?full_index=1.drv
That last patch is the latest fix to JAX. Might be a red herring, but I'm running a fresh build of vLLM to see if the new JAX version (and hence Outlines) breaks the build.
| 23:23:44 |
| Daniel Fahey | * After diffing the inputDrvs
$ diff <(nix derivation show --impure -I nixpkgs=https://github.com/NixOS/nixpkgs/archive/3d2db9755e7815937fb7b8f089fad9b44bc416d8.tar.gz --expr 'with import <nixpkgs> { }; python313Packages.vllm' | jq -r '.[] | .inputDrvs | keys[]' | sort -t'-' -k2) <(nix derivation show --impure -I nixpkgs=https://github.com/NixOS/nixpkgs/archive/6a08e6bb4e46ff7fcbb53d409b253f6bad8a28ce.tar.gz --expr 'with import <nixpkgs> { }; python313Packages.vllm' | jq -r '.[] | .inputDrvs | keys[]' | sort -t'-' -k2)
37c37
< zv7b6x3i1k6vgmlx4ll74a676znpp19l-python3.13-outlines-1.2.3.drv
---
> b0yp229czgvgsxay9vw8mq0xraa0w94l-python3.13-outlines-1.2.3.drv
$ diff <(nix derivation show --impure -I nixpkgs=https://github.com/NixOS/nixpkgs/archive/3d2db9755e7815937fb7b8f089fad9b44bc416d8.tar.gz --expr 'with import <nixpkgs> { }; python313Packages.outlines' | jq -r '.[] | .inputDrvs | keys[]' | sort -t'-' -k2) <(nix derivation show --impure -I nixpkgs=https://github.com/NixOS/nixpkgs/archive/6a08e6bb4e46ff7fcbb53d409b253f6bad8a28ce.tar.gz --expr 'with import <nixpkgs> { }; python313Packages.outlines' | jq -r '.[] | .inputDrvs | keys[]' | sort -t'-' -k2)
15c15
< fcsb1iizwb50wiag876xzj9kpd8vpa9s-python3.13-jax-0.8.0.drv
---
> 2vxlyjm486swfp89iwsacyx52rslq4xj-python3.13-jax-0.8.0.drv
$ diff <(nix derivation show --impure -I nixpkgs=https://github.com/NixOS/nixpkgs/archive/3d2db9755e7815937fb7b8f089fad9b44bc416d8.tar.gz --expr 'with import <nixpkgs> { }; python313Packages.jax' | jq -r '.[] | .inputDrvs | keys[]' | sort -t'-' -k2) <(nix derivation show --impure -I nixpkgs=https://github.com/NixOS/nixpkgs/archive/6a08e6bb4e46ff7fcbb53d409b253f6bad8a28ce.tar.gz --expr 'with import <nixpkgs> { }; python313Packages.jax' | jq -r '.[] | .inputDrvs | keys[]' | sort -t'-' -k2)
0a1
> 521737jxrb1akanvm7df9zmx3236rwc6-af5c211d49f3b99447db2252d2cc2b8e0fb54d1c.patch?full_index=1.drv
That last patch is the latest fix to JAX. Might be a red herring, but I'm running a fresh build of vLLM to see if the new JAX fix (and hence Outlines derivation) breaks the build.
| 23:26:34 |
| 26 Oct 2025 |
| Daniel Fahey | The above is just why the hash changed. The nvcc error : '"$CICC_PATH/cicc"' died due to signal 9 (Kill signal) means the process was forcibly killed, probably by the out-of-memory killer, Hydra should really restart these, possibly with fewer CPU cores dynamically. | 00:28:50 |
| Daniel Fahey | * The above is just why the hash changed. The nvcc error : '"$CICC_PATH/cicc"' died due to signal 9 (Kill signal) means the process was forcibly killed, probably by the out-of-memory (OOM) killer, Hydra should really restart these, possibly with fewer CPU cores dynamically. | 00:29:10 |
| Daniel Fahey | built, lol https://nixbuild.net/builds/4745574?t=EtkBCm8KBWJ1aWxkCgpidWlsZDpyZWFkGAMiCQoHCAcSAxD5BSINCgsIBBIHOgUKAxiBCDImCiQKAggbEgYIBRICCAUaFgoECgIIBQoICgYg-OSj1AYKBBoCCAAyFgoUCgIIGxIOCAISAxiACBIFEObSoQISJAgAEiBakpZI6g3gNTHtwvNqaB3b4-Rv07_-fD8p_DmOt4YJvhpAjaEDvlgwE_0ZXUm23Ey-3fjcQrW_Ss6bRdz-G3HAoFRMVKlpSYx-cvq0vAJ_HuUdirLhAo9KMjHP4aJ50uxSBCIiCiAwUUMo9gXtYC6TYvCVyceuEvf91HzzfSXG_wyt6NV4oA== | 01:00:33 |
