NixOS CUDA | 286 Members | |
| CUDA packages maintenance and support in nixpkgs | https://github.com/orgs/NixOS/projects/27/ | https://nixos.org/manual/nixpkgs/unstable/#cuda | 57 Servers |
| Sender | Message | Time |
|---|---|---|
| 4 Oct 2025 | ||
| lon: oh you deleted, (hehe), I actually didn't even think about it and had completely forgotten nixpkgs didn't have CUDA 13 yet (https://github.com/NixOS/nixpkgs/pull/437723) Thanks for looking into it all the same | 22:29:03 | |
Daniel Fahey FYI vllm is broken on master as my PR was merged slightly too soon. | 23:12:03 | |
| If you have a bit of time to investigate, please go on :) | 23:12:12 | |
| Yes, sorry I deleted because I saw your commit and is the same as mine (save for the update script! I didn't know that was a pattern people in nixpkgs used, TIL) | 23:13:31 | |
| the nvidia/cutlass dependency can also be updated fwiw, with the update script | 23:18:40 | |
Download image.png | 23:18:43 | |
| yeah, just started rewriting it | 23:23:25 | |
| How can you tell? Hydra? Got a link? | 23:27:58 | |
| Looks okay for me, some other problem? CUDA build?
| 23:45:17 | |
| 5 Oct 2025 | ||
| I ended up rewriting the whole thing if you want to give it a spin and leave a review? https://github.com/NixOS/nixpkgs/pull/448828 | 12:26:53 | |
| I've been using this one-liner while cobbling it together
cc6098112333e5ac645aa14f2ea9f70878d8fe22 being the Nixpkgs revision with vLLM v0.10.2, you can also test it with other revisions corresponding to other semantic versions. I almost went to town writing tests, but I'd have enough fun by then | 12:29:44 | |
| yeah, see https://wiki.nixos.org/wiki/Nixpkgs/Update_Scripts and you use e.g. (apparently), it's my first time writing one, will have to wait and see if @r-ryantm uses it | 12:50:30 | |
| one could also automate updating e.g. https://github.com/NixOS/nixpkgs/blob/107f8b572eb41058b610f99aba21b9a1b5925cf8/pkgs/development/python-modules/vllm/default.nix#L183-216, but I thought what I'd done was try-hard over-engineering enough already I really wanted to try and make a reference implementation that could easily be adapted to other complicated Python packages that have multiple git deps | 12:54:29 | |
| https://www.explainxkcd.com/wiki/index.php/1319:_Automation | 12:55:42 | |