!eWOErHSaiddIbsUNsJ:nixos.org

NixOS CUDA

335 Members
CUDA packages maintenance and support in nixpkgs | https://github.com/orgs/NixOS/projects/27/ | https://nixos.org/manual/nixpkgs/unstable/#cuda64 Servers

Load older messages


SenderMessageTime
5 Jun 2026
@elliotberman:matrix.orgElliot Berman *

I'm starting to look at getting Orin SBSA 1 support up. I've hacked up the linux-sbsa/linux-aarch64 getRedistSystem logic so that Orin goes through linux-sbsa and it works! But, I think that the logic for deciding linux-sbsa vs linux-aarch64 in getRedistSystem might not be enough? I think we'd rather know the CUDA driver version (i.e. 540.5.0 vs 595.78) + capabilities to know which system to use? Using cudaMajorMinorVersion could be sad: if someone is on SBSA Orin, they might want to use SBSA CUDA 12? I don't personally care for this usecase, so if y'all think it's not something to worry about

I've uploaded a PR since code is probably easier to read: https://github.com/NixOS/nixpkgs/pull/528562

20:42:18
@elliotberman:matrix.orgElliot Berman *

I'm starting to look at getting Orin SBSA 1 support up. I've hacked up the linux-sbsa/linux-aarch64 getRedistSystem logic so that Orin goes through linux-sbsa and it works! But, I think that the logic for deciding linux-sbsa vs linux-aarch64 in getRedistSystem might not be enough? I think we'd rather know the CUDA driver version (i.e. 540.5.0 vs 595.78) + capabilities to know which system to use? Using cudaMajorMinorVersion could be sad: if someone is on SBSA Orin, they might want to use SBSA CUDA 12? I don't personally care for this usecase, so if y'all think it's not something to worry about, then we don't have to worry about it

I've uploaded a PR since code is probably easier to read: https://github.com/NixOS/nixpkgs/pull/528562

20:48:55
@elliotberman:matrix.orgElliot Berman *

I'm starting to look at getting Orin SBSA support up. I've hacked up the linux-sbsa/linux-aarch64 getRedistSystem logic so that Orin goes through linux-sbsa and it works! But, I think that the logic for deciding linux-sbsa vs linux-aarch64 in getRedistSystem might not be enough? I think we'd rather know the CUDA driver version (i.e. 540.5.0 vs 595.78) + capabilities to know which system to use? Using cudaMajorMinorVersion could be sad: if someone is on SBSA Orin, they might want to use SBSA CUDA 12? I don't personally care for this usecase, so if y'all think it's not something to worry about, then we don't have to worry about it

I've uploaded a PR since code is probably easier to read: https://github.com/NixOS/nixpkgs/pull/528562

20:57:01
6 Jun 2026
@connorbaker:matrix.orgconnor (burnt/out) (UTC-8)Yeah and driver version would be generally helpful, but it tells us about what code could/would run, not usually what to build. Although if we know the driver version we know whether or not we need to use cuda_compat… And I suppose there’s a separate Orin cuda_compat package now too…04:54:52
@thefossguy:matrix.orgPratham Patel joined the room.09:42:06
@thefossguy:matrix.orgPratham PatelI just purchased 3x GB10s and slapped NixOS on it. Already made a patch to the kernel's derivation to get IOMMU working on NixOS. I'm following your SGLang PR and approved the ones that I found. Please ping me if you need a review on related PRs.09:49:53
@thefossguy:matrix.orgPratham Patel Is there documentation when the nvidia OSS kmod gets promoted from new_feature to latest? 09:51:17
@prince213:matrix.orgprince213Thanks, that’d be very helpful.10:13:12
@prince213:matrix.orgprince213Also it would be nice if you have sparse GPU resources to run those gpuCheck10:14:21
@thefossguy:matrix.orgPratham Patel What do you mean by "sparse GPU resources?" 10:24:20
@prince213:matrix.orgprince213Typo I think, meant to say spare11:37:19
@glepage:matrix.orgGaétan Lepage

https://github.com/NixOS/nixpkgs/pull/528773

cc Kevin Mittman (UTC-7) Bryan Honof connor (burnt/out) (UTC-8)

12:07:13
@seudonym:matrix.orgWahid Khankind of a noob question maybe but i switched my project over to use pyproject.nix and i have torch, torchaudio as deps. and the setup-cuda-hook is compiling nccl 🙃12:51:55
@seudonym:matrix.orgWahid Khanis there a cachix for this12:52:03
@thefossguy:matrix.orgPratham Patel Flox has a cache exactly for this 12:52:35
@seudonym:matrix.orgWahid Khanoh12:52:44
@thefossguy:matrix.orgPratham Patelhttps://flox.dev/blog/the-flox-catalog-now-contains-nvidia-cuda/12:53:52
@seudonym:matrix.orgWahid Khanthanks trying this12:54:24
@seudonym:matrix.orgWahid Khanthanks that helped13:21:12
@seudonym:matrix.orgWahid Khanits still building magma from source tho lol13:21:19
@thefossguy:matrix.orgPratham Patel What's magma? 13:21:34
@seudonym:matrix.orgWahid Khanidk i have faster-whisper in my pyproject.toml13:23:04
@seudonym:matrix.orgWahid Khanand i guess magma is its dependency?13:23:14
@seudonym:matrix.orgWahid Khan this is my first time using pyproject.nix, i switched to it to test something else i was trying to package.
is there anything i could be improving here:
13:24:25
@seudonym:matrix.orgWahid Khan ` 13:24:27
@seudonym:matrix.orgWahid Khan `python
`
13:25:17
@seudonym:matrix.orgWahid Khan* uhh why dont backticks work how do i send a code blcok13:25:31
@seudonym:matrix.orgWahid Khan
{
  description = "DAWG Flake";

  inputs = {
    pyproject-nix.url = "github:pyproject-nix/pyproject.nix";
    pyproject-nix.inputs.nixpkgs.follows = "nixpkgs";
  };
  outputs = {
    nixpkgs,
    pyproject-nix,
    ...
  }: let
    system = "x86_64-linux";
    project = pyproject-nix.lib.project.loadPyproject {
      projectRoot = ./.;
    };
    pkgs = import nixpkgs {
      inherit system;
      config = {
        allowUnfree = true;
        cudaSupport = true;
      };
    };

    python = pkgs.python3;
    cudaPackages = pkgs.cudaPackages;
  in {
    devShells.x86_64-linux.default = let
      arg = project.renderers.withPackages {inherit python;};
      pythonEnv = python.withPackages arg;
    in
      pkgs.mkShell {
        packages =
          [pythonEnv]
          ++ (with pkgs; [
            basedpyright
            black

            ffmpeg
            playerctl
            portaudio
            ripgrep

            gcc
            stdenv.cc.cc.lib

            cudaPackages.cudatoolkit
          ]);

        shellHook = ''
          export CUDA_HOME=${cudaPackages.cudatoolkit}
          export CUDA_PATH=${cudaPackages.cudatoolkit}
          export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/run/opengl-driver/lib:/run/opengl-driver-32/lib
        '';
      };

    packages.x86_64-linux.default = let
      attrs = project.renderers.buildPythonPackage {inherit python;};
    in
      python.pkgs.buildPythonPackage attrs;
  };
}

13:25:53
@seudonym:matrix.orgWahid Khani actually have no idea why magma is being built13:34:13
@thefossguy:matrix.orgPratham Patel Use nom to figure that out quickly 13:34:58

Show newer messages


Back to Room ListRoom Version: 9