!eWOErHSaiddIbsUNsJ:nixos.org

NixOS CUDA

337 Members
CUDA packages maintenance and support in nixpkgs | https://github.com/orgs/NixOS/projects/27/ | https://nixos.org/manual/nixpkgs/unstable/#cuda64 Servers

Load older messages


SenderMessageTime
6 Jun 2026
@seudonym:matrix.orgWahid Khanohh okay19:32:40
@seudonym:matrix.orgWahid Khanthank you, i'll look into this19:33:33
7 Jun 2026
@seudonym:matrix.orgWahid Khanlooks like the cache doesnt have torchaudio or torch 🥹06:48:11
@seudonym:matrix.orgWahid Khanokay its probably bc i have nixpkgs url set to a local repo.07:02:50
@seudonym:matrix.orgWahid Khanim trying to package something and wanted to test if it works with an existing project which was using uv before07:03:21
@seudonym:matrix.orgWahid Khanhttps://github.com/NixOS/nixpkgs/pull/52886807:04:01
@worldsgonemad:matrix.orgWorldsGoneMad joined the room.20:34:47
11 Jun 2026
@ethancedwards8:matrix.orgethancedwards8 joined the room.18:53:30
@ethancedwards8:matrix.orgethancedwards8 Hello folks! My name is Ethan and I've been using Nix/NixOS and have been a contributor to Nixpkgs for almost 6 years. I'm now working for an MLOps Infrastructure company working on their Nix setup. I don't know a lot about CUDA, so I'm here to learn more/hopefully contribute where I can :)\ 23:19:27
12 Jun 2026
@lav:xmr.selav joined the room.00:04:24
@hacker1024:matrix.orghacker1024

Hi all, I'm a little confused why cuda_cudart 13.x won't evaluate on AArch64? 12.9 is fine, and I think jetpack-nixos uses 13 through cuda-legacy - but the manifest seems similar to the one in Nixpkgs anyway?

$ nix-instantiate -I nixpkgs=channel:nixos-unstable -E 'with import <nixpkgs> { localSystem = "aarch64-linux"; config = { allowUnfree = true; cudaForwardCompat = false; cudaCapabilities = [ "8.7" ]; }; }; cudaPackages_13_2.cuda_cudart'

       error: Refusing to evaluate package 'cuda13.2-cuda_cudart-13.2.75' in /nix/store/5nf8c4ail3r7sshsjl5bshwylyi57iyc-source/pkgs/development/cuda-modules/packages/cuda_cudart.nix:98 because it is not available on the requested hostPlatform:
         hostPlatform.system = "aarch64-linux"
         package.meta.platforms = [
           "aarch64-linux"
           "x86_64-linux"
         ]
         package.meta.badPlatforms = [
           "aarch64-linux"
         ]
04:01:46
@thefossguy:matrix.orgPratham Patel

It works when I bump cudaCapabilities to 12.1. Weird.

$ nix-instantiate -E 'with import <nixpkgs> { localSystem = "aarch64-linux"; config = { allowUnfree = true; cudaForwardCompat = false; cudaCapabilities = [ "12.1" ]; }; }; cudaPackages_13_2.cuda_cudart'
warning: you did not specify '--add-root'; the result might be removed by the garbage collector
/nix/store/4dqyz4cicqfhdq131g2vrhbvxvbz2w9g-cuda13.2-cuda_cudart-13.2.75.drv
04:49:48
@thefossguy:matrix.orgPratham PatelI'm not familiar with the cuda ecosystem to know if this is normal or not.04:50:25
@hacker1024:matrix.orghacker1024Ah yes, I think the assumption made here no longer holds with JetPack 7.2 on Orin (presumably they also use the SBSA packages) https://github.com/NixOS/nixpkgs/blob/173d0ad7a974f8543a9ab01d2271b2e290341b33/pkgs/development/cuda-modules/_cuda/lib/redist.nix#L192-L20204:59:55
@hacker1024:matrix.orghacker1024I think the heuristic can basically be changed to Jetson and >= 13 -> SBSA rather than thinking about the exact Jetson model05:00:59
@hacker1024:matrix.orghacker1024Created https://github.com/NixOS/nixpkgs/issues/53093105:17:28
@ethancedwards8:matrix.orgethancedwards8Does anyone have any suggestions/recommended platforms for me to rent a GPU with a full linux system that I can put nixos on so that I can start learning cuda on nixos? Unfortunately I do not have an NVIDIA gpu to learn on, but was hoping it would be possible to rent 06:55:24
@sporeray:matrix.orgRobbie Buxton
In reply to @ethancedwards8:matrix.org
Does anyone have any suggestions/recommended platforms for me to rent a GPU with a full linux system that I can put nixos on so that I can start learning cuda on nixos? Unfortunately I do not have an NVIDIA gpu to learn on, but was hoping it would be possible to rent
What’s your budget? Hezner has some pretty good options but it may still be cheaper to just buy something. Otherwise ec2/neo cloud offerings will also be good!
08:26:38
@connorbaker:matrix.orgconnor (he/him) That’s correct — iirc Elliot Berman has a PR to resolve this, just haven’t had a chance to make sure the semantics are okay (started a new job this week) 13:17:31
@hacker1024:matrix.orghacker1024

Ah yep I see that, sorry I thought I searched the PRs 😅

Thanks and congrats on the new job!

13:19:49
@ethancedwards8:matrix.orgethancedwards8 Preferably less than like $2/hour for compute. I am okay with spinning it up/down when using it if I can keep a persistent block device 15:44:18
@sporeray:matrix.orgRobbie Buxton
In reply to @ethancedwards8:matrix.org
Preferably less than like $2/hour for compute. I am okay with spinning it up/down when using it if I can keep a persistent block device
Oh you can definitely get something on a neocloud then, the best/cheapest one to changes so probably worth having a bit of a Google.
15:58:24
@sporeray:matrix.orgRobbie Buxton * Oh you can definitely get something on a neocloud then, the best/cheapest one to changes month to month so probably worth having a bit of a Google. 15:58:40
@sporeray:matrix.orgRobbie Buxton Amazon is fine but more expensive 15:58:47
@sporeray:matrix.orgRobbie Buxton I think nvidia brev is also pretty good and cloud agnostic 15:59:14
@ethancedwards8:matrix.orgethancedwards8Cool, thanks! I appreciate the help16:21:09
13 Jun 2026
@ijouw:matrix.orgijouw joined the room.13:21:35
16 Jun 2026
@diamo.dev:matrix.orgDiamo joined the room.01:13:25
@diamo.dev:matrix.orgDiamotorch-bin 2.11 doesn't come with cudnn 9.19.0???01:14:20
@humblefool2005:matrix.orgDarshan Thakare set a profile picture.09:51:11

Show newer messages


Back to Room ListRoom Version: 9