| 6 Jun 2026 |
Wahid Khan | ohh okay | 19:32:40 |
Wahid Khan | thank you, i'll look into this | 19:33:33 |
| 7 Jun 2026 |
Wahid Khan | looks like the cache doesnt have torchaudio or torch 🥹 | 06:48:11 |
Wahid Khan | okay its probably bc i have nixpkgs url set to a local repo. | 07:02:50 |
Wahid Khan | im trying to package something and wanted to test if it works with an existing project which was using uv before | 07:03:21 |
Wahid Khan | https://github.com/NixOS/nixpkgs/pull/528868 | 07:04:01 |
| WorldsGoneMad joined the room. | 20:34:47 |
| 11 Jun 2026 |
| ethancedwards8 joined the room. | 18:53:30 |
ethancedwards8 | Hello folks! My name is Ethan and I've been using Nix/NixOS and have been a contributor to Nixpkgs for almost 6 years. I'm now working for an MLOps Infrastructure company working on their Nix setup. I don't know a lot about CUDA, so I'm here to learn more/hopefully contribute where I can :)\ | 23:19:27 |
| 12 Jun 2026 |
| lav joined the room. | 00:04:24 |
hacker1024 | Hi all, I'm a little confused why cuda_cudart 13.x won't evaluate on AArch64? 12.9 is fine, and I think jetpack-nixos uses 13 through cuda-legacy - but the manifest seems similar to the one in Nixpkgs anyway?
$ nix-instantiate -I nixpkgs=channel:nixos-unstable -E 'with import <nixpkgs> { localSystem = "aarch64-linux"; config = { allowUnfree = true; cudaForwardCompat = false; cudaCapabilities = [ "8.7" ]; }; }; cudaPackages_13_2.cuda_cudart'
error: Refusing to evaluate package 'cuda13.2-cuda_cudart-13.2.75' in /nix/store/5nf8c4ail3r7sshsjl5bshwylyi57iyc-source/pkgs/development/cuda-modules/packages/cuda_cudart.nix:98 because it is not available on the requested hostPlatform:
hostPlatform.system = "aarch64-linux"
package.meta.platforms = [
"aarch64-linux"
"x86_64-linux"
]
package.meta.badPlatforms = [
"aarch64-linux"
]
| 04:01:46 |
Pratham Patel | It works when I bump cudaCapabilities to 12.1. Weird.
$ nix-instantiate -E 'with import <nixpkgs> { localSystem = "aarch64-linux"; config = { allowUnfree = true; cudaForwardCompat = false; cudaCapabilities = [ "12.1" ]; }; }; cudaPackages_13_2.cuda_cudart'
warning: you did not specify '--add-root'; the result might be removed by the garbage collector
/nix/store/4dqyz4cicqfhdq131g2vrhbvxvbz2w9g-cuda13.2-cuda_cudart-13.2.75.drv
| 04:49:48 |
Pratham Patel | I'm not familiar with the cuda ecosystem to know if this is normal or not. | 04:50:25 |
hacker1024 | Ah yes, I think the assumption made here no longer holds with JetPack 7.2 on Orin (presumably they also use the SBSA packages)
https://github.com/NixOS/nixpkgs/blob/173d0ad7a974f8543a9ab01d2271b2e290341b33/pkgs/development/cuda-modules/_cuda/lib/redist.nix#L192-L202 | 04:59:55 |
hacker1024 | I think the heuristic can basically be changed to Jetson and >= 13 -> SBSA rather than thinking about the exact Jetson model | 05:00:59 |
hacker1024 | Created https://github.com/NixOS/nixpkgs/issues/530931 | 05:17:28 |
ethancedwards8 | Does anyone have any suggestions/recommended platforms for me to rent a GPU with a full linux system that I can put nixos on so that I can start learning cuda on nixos? Unfortunately I do not have an NVIDIA gpu to learn on, but was hoping it would be possible to rent | 06:55:24 |
Robbie Buxton | In reply to @ethancedwards8:matrix.org Does anyone have any suggestions/recommended platforms for me to rent a GPU with a full linux system that I can put nixos on so that I can start learning cuda on nixos? Unfortunately I do not have an NVIDIA gpu to learn on, but was hoping it would be possible to rent What’s your budget? Hezner has some pretty good options but it may still be cheaper to just buy something. Otherwise ec2/neo cloud offerings will also be good! | 08:26:38 |
connor (he/him) | That’s correct — iirc Elliot Berman has a PR to resolve this, just haven’t had a chance to make sure the semantics are okay (started a new job this week) | 13:17:31 |
hacker1024 | Ah yep I see that, sorry I thought I searched the PRs 😅
Thanks and congrats on the new job!
| 13:19:49 |
ethancedwards8 | Preferably less than like $2/hour for compute. I am okay with spinning it up/down when using it if I can keep a persistent block device | 15:44:18 |
Robbie Buxton | In reply to @ethancedwards8:matrix.org Preferably less than like $2/hour for compute. I am okay with spinning it up/down when using it if I can keep a persistent block device Oh you can definitely get something on a neocloud then, the best/cheapest one to changes so probably worth having a bit of a Google. | 15:58:24 |
Robbie Buxton | * Oh you can definitely get something on a neocloud then, the best/cheapest one to changes month to month so probably worth having a bit of a Google. | 15:58:40 |
Robbie Buxton | Amazon is fine but more expensive | 15:58:47 |
Robbie Buxton | I think nvidia brev is also pretty good and cloud agnostic | 15:59:14 |
ethancedwards8 | Cool, thanks! I appreciate the help | 16:21:09 |
| 13 Jun 2026 |
| ijouw joined the room. | 13:21:35 |
| 16 Jun 2026 |
| Diamo joined the room. | 01:13:25 |
Diamo | torch-bin 2.11 doesn't come with cudnn 9.19.0??? | 01:14:20 |
| Darshan Thakare set a profile picture. | 09:51:11 |