| 4 Jun 2026 |
 connor (he/him) | It’s the prebuilt binaries (is it source available?) | 20:52:18 |
| 5 Jun 2026 |
 Kevin Mittman (UTC-7) | Uhh it's complicated
https://github.com/conda-forge/cuda-gdb-feedstock/pull/31 | 00:50:42 |
 Elliot Berman | I'm starting to look at getting Orin SBSA support up. I've hacked up the linux-sbsa/linux-aarch64 getRedistSystem logic so that Orin goes through linux-sbsa and it works! But, I think that the logic for deciding linux-sbsa vs linux-aarch64 in getRedistSystem might not be enough? I think we'd rather know the CUDA driver version (i.e. 540.5.0 vs 595.78) + capabilities to know which system to use? Using cudaMajorMinorVersion could be sad: if someone is on SBSA Orin, they might want to use SBSA CUDA 12? I don't personally care for this usecase, so if y'all think it's not something to worry about
I've uploaded a PR since code is probably easier to read: https://github.com/NixOS/nixpkgs/pull/528562/changes
| 20:29:24 |
| Elliot Berman | * I'm starting to look at getting Orin SBSA support up. I've hacked up the linux-sbsa/linux-aarch64 getRedistSystem logic so that Orin goes through linux-sbsa and it works! But, I think that the logic for deciding linux-sbsa vs linux-aarch64 in getRedistSystem might not be enough? I think we'd rather know the CUDA driver version (i.e. 540.5.0 vs 595.78) + capabilities to know which system to use? Using cudaMajorMinorVersion could be sad: if someone is on SBSA Orin, they might want to use SBSA CUDA 12? I don't personally care for this usecase, so if y'all think it's not something to worry about
I've uploaded a PR since code is probably easier to read: https://github.com/NixOS/nixpkgs/pull/528562
| 20:29:37 |
| Elliot Berman | * I'm starting to look at getting Orin SBSA 1 support up. I've hacked up the linux-sbsa/linux-aarch64 getRedistSystem logic so that Orin goes through linux-sbsa and it works! But, I think that the logic for deciding linux-sbsa vs linux-aarch64 in getRedistSystem might not be enough? I think we'd rather know the CUDA driver version (i.e. 540.5.0 vs 595.78) + capabilities to know which system to use? Using cudaMajorMinorVersion could be sad: if someone is on SBSA Orin, they might want to use SBSA CUDA 12? I don't personally care for this usecase, so if y'all think it's not something to worry about
I've uploaded a PR since code is probably easier to read: https://github.com/NixOS/nixpkgs/pull/528562
| 20:42:18 |
| Elliot Berman | * I'm starting to look at getting Orin SBSA 1 support up. I've hacked up the linux-sbsa/linux-aarch64 getRedistSystem logic so that Orin goes through linux-sbsa and it works! But, I think that the logic for deciding linux-sbsa vs linux-aarch64 in getRedistSystem might not be enough? I think we'd rather know the CUDA driver version (i.e. 540.5.0 vs 595.78) + capabilities to know which system to use? Using cudaMajorMinorVersion could be sad: if someone is on SBSA Orin, they might want to use SBSA CUDA 12? I don't personally care for this usecase, so if y'all think it's not something to worry about, then we don't have to worry about it
I've uploaded a PR since code is probably easier to read: https://github.com/NixOS/nixpkgs/pull/528562
| 20:48:55 |
| Elliot Berman | * I'm starting to look at getting Orin SBSA support up. I've hacked up the linux-sbsa/linux-aarch64 getRedistSystem logic so that Orin goes through linux-sbsa and it works! But, I think that the logic for deciding linux-sbsa vs linux-aarch64 in getRedistSystem might not be enough? I think we'd rather know the CUDA driver version (i.e. 540.5.0 vs 595.78) + capabilities to know which system to use? Using cudaMajorMinorVersion could be sad: if someone is on SBSA Orin, they might want to use SBSA CUDA 12? I don't personally care for this usecase, so if y'all think it's not something to worry about, then we don't have to worry about it
I've uploaded a PR since code is probably easier to read: https://github.com/NixOS/nixpkgs/pull/528562
| 20:57:01 |
| 6 Jun 2026 |
| connor (he/him) | Yeah and driver version would be generally helpful, but it tells us about what code could/would run, not usually what to build.
Although if we know the driver version we know whether or not we need to use cuda_compat…
And I suppose there’s a separate Orin cuda_compat package now too… | 04:54:52 |
|  Pratham Patel joined the room. | 09:42:06 |
| Pratham Patel | I just purchased 3x GB10s and slapped NixOS on it. Already made a patch to the kernel's derivation to get IOMMU working on NixOS. I'm following your SGLang PR and approved the ones that I found. Please ping me if you need a review on related PRs. | 09:49:53 |
| Pratham Patel | Is there documentation when the nvidia OSS kmod gets promoted from new_feature to latest? | 09:51:17 |
 prince213 | Thanks, that’d be very helpful. | 10:13:12 |
| prince213 | Also it would be nice if you have sparse GPU resources to run those gpuCheck | 10:14:21 |
| Pratham Patel | What do you mean by "sparse GPU resources?" | 10:24:20 |
| prince213 | Typo I think, meant to say spare | 11:37:19 |
 Gaétan Lepage | https://github.com/NixOS/nixpkgs/pull/528773
cc Kevin Mittman (UTC-7) Bryan Honof connor (burnt/out) (UTC-8)
| 12:07:13 |
 Wahid Khan | kind of a noob question maybe but i switched my project over to use pyproject.nix and i have torch, torchaudio as deps. and the setup-cuda-hook is compiling nccl 🙃 | 12:51:55 |
| Wahid Khan | is there a cachix for this | 12:52:03 |
| Pratham Patel | Flox has a cache exactly for this | 12:52:35 |
| Wahid Khan | oh | 12:52:44 |
| Pratham Patel | https://flox.dev/blog/the-flox-catalog-now-contains-nvidia-cuda/ | 12:53:52 |
| Wahid Khan | thanks trying this | 12:54:24 |
| Wahid Khan | thanks that helped | 13:21:12 |
| Wahid Khan | its still building magma from source tho lol | 13:21:19 |
| Pratham Patel | What's magma? | 13:21:34 |
| Wahid Khan | idk i have faster-whisper in my pyproject.toml | 13:23:04 |
| Wahid Khan | and i guess magma is its dependency? | 13:23:14 |
| Wahid Khan | this is my first time using pyproject.nix, i switched to it to test something else i was trying to package.
is there anything i could be improving here:
| 13:24:25 |
| Wahid Khan | ` | 13:24:27 |
| Wahid Khan | `python
` | 13:25:17 |
