!eWOErHSaiddIbsUNsJ:nixos.org

NixOS CUDA

308 Members
CUDA packages maintenance and support in nixpkgs | https://github.com/orgs/NixOS/projects/27/ | https://nixos.org/manual/nixpkgs/unstable/#cuda59 Servers

Load older messages


SenderMessageTime
3 Apr 2026
@justbrowsing:matrix.orgKevin Mittman (UTC-7)
In reply to @connorbaker:matrix.org
Also, can someone explain https://developer.download.nvidia.com/compute/cuda/redist/cuda_compat_orin/ to me? If I had to hazard a guess, it would be that it would allow using CUDA 13.1/13.2 on a Jetson based on JetPack 7 (since support for Orin is added in JetPack 7.2, but that hasn't been released yet as far as I can tell, though it is talked about in the CUDA 13.2 blog post: https://developer.nvidia.com/blog/cuda-13-2-introduces-enhanced-cuda-tile-support-and-new-python-features/#embedded_devices). Is that correct? Or does it allow forward compat across major versions and can be used with JetPack 6, similar to how cuda_compat for Orins on JetPack 5 allows support for up to CUDA 12.2 despite shipping with CUDA 11.4.
This one is specific to Jetson Orin, the other cuda_compat provides forward compatibility for x86_64 server, arm64 server, Jetson Thor, etc
17:48:59
@justbrowsing:matrix.orgKevin Mittman (UTC-7) changed their display name from Kevin Mittman (jetlagged/UTC-7) to Kevin Mittman (UTC-7).17:50:31
@neobrain:matrix.orgneobrain joined the room.18:31:27
@glepage:matrix.orgGaétan Lepage

Neat project!
https://www.youtube.com/watch?v=AvK_gi_snJE

Some quotes from the conclusions:

"Nixpkgs CUDA aarch64 ecosystem is quite healthy"
Thanks to nix-community's 80 core ampere system

"Flakes make a good user interface"
This one is for you SomeoneSerge (matrix works sometimes)

"Lack of cached aarch64 CUDA builds"
👀💸

"Uneven freshness of packages"
Until we unlock core and maintainer cloning, that's going to be tough to change (especially reagrding how fast the whole space is moving).

"Community lacks GPU hardware"
Yes. And CPU too 😅

23:11:35
@glepage:matrix.orgGaétan Lepage *

Neat project!
https://www.youtube.com/watch?v=AvK_gi_snJE

Some quotes from the conclusion:

"Nixpkgs CUDA aarch64 ecosystem is quite healthy"
Thanks to nix-community's 80 core ampere system

"Flakes make a good user interface"
This one is for you SomeoneSerge (matrix works sometimes)

"Lack of cached aarch64 CUDA builds"
👀💸

"Uneven freshness of packages"
Until we unlock core and maintainer cloning, that's going to be tough to change (especially reagrding how fast the whole space is moving).

"Community lacks GPU hardware"
Yes. And CPU too 😅

23:12:17
@glepage:matrix.orgGaétan Lepage *

Neat project!
https://www.youtube.com/watch?v=AvK_gi_snJE

Some quotes from the conclusion:

"Nixpkgs CUDA aarch64 ecosystem is quite healthy"

Thanks to nix-community's 80 core ampere system

"Flakes make a good user interface"
This one is for you SomeoneSerge (matrix works sometimes)

"Lack of cached aarch64 CUDA builds"
👀💸

"Uneven freshness of packages"
Until we unlock core and maintainer cloning, that's going to be tough to change (especially reagrding how fast the whole space is moving).

"Community lacks GPU hardware"
Yes. And CPU too 😅

23:16:51
@glepage:matrix.orgGaétan Lepage *

Neat project!
https://www.youtube.com/watch?v=AvK_gi_snJE

Some quotes from the conclusion:

"Nixpkgs CUDA aarch64 ecosystem is quite healthy"

Thanks to nix-community's 80 core ampere system

"Flakes make a good user interface"

This one is for you SomeoneSerge (matrix works sometimes)

"Lack of cached aarch64 CUDA builds"

👀💸

"Uneven freshness of packages"

Until we unlock core and maintainer cloning, that's going to be tough to change (especially reagrding how fast the whole space is moving).

"Community lacks GPU hardware"

Yes. And CPU too 😅

23:17:20
@glepage:matrix.orgGaétan Lepage *

Neat project!
https://www.youtube.com/watch?v=AvK_gi_snJE

Some quotes from the conclusion:

"Nixpkgs CUDA aarch64 ecosystem is quite healthy"

Thanks to nix-community's 80 core ampere system

"Flakes make a good user interface"

This one is for you SomeoneSerge (matrix works sometimes)

"Lack of cached aarch64 CUDA builds"

👀💸

"Uneven freshness of packages"

Until we unlock core and maintainer cloning, that's going to be tough to change (especially reagrding how fast the whole space is moving).

"Community lacks GPU hardware"

Yes. And CPU too 😅

23:17:45
@glepage:matrix.orgGaétan Lepage *

Neat project!
https://www.youtube.com/watch?v=AvK_gi_snJE

Some quotes from the conclusion:

  • "Nixpkgs CUDA aarch64 ecosystem is quite healthy"
    Thanks to nix-community's 80 core ampere system

  • "Flakes make a good user interface"
    This one is for you SomeoneSerge (matrix works sometimes)

  • "Lack of cached aarch64 CUDA builds"
    👀💸

  • "Uneven freshness of packages"
    Until we unlock core and maintainer cloning, that's going to be tough to change (especially reagrding how fast the whole space is moving).

  • "Community lacks GPU hardware"
    Yes. And CPU too 😅

23:18:57
@glepage:matrix.orgGaétan Lepage *

Neat project!
https://www.youtube.com/watch?v=AvK_gi_snJE
I find it really cool that someone wrote a convenient flake to make the DGX spark work OOTB.

Some quotes from the conclusion:

  • "Nixpkgs CUDA aarch64 ecosystem is quite healthy"
    Thanks to nix-community's 80 core ampere system
  • "Flakes make a good user interface"
    This one is for you SomeoneSerge (matrix works sometimes)
  • "Lack of cached aarch64 CUDA builds"
    👀💸
  • "Uneven freshness of packages"
    Until we unlock core and maintainer cloning, that's going to be tough to change (especially reagrding how fast the whole space is moving).
  • "Community lacks GPU hardware"
    Yes. And CPU too 😅
23:20:11
4 Apr 2026
@neobrain:matrix.orgneobrainIt's working really nicely on mine too, but the lack of cache definitely hurts 😭07:07:44
@connorbaker:matrix.orgconnor (burnt/out) (UTC-8)Oh yikes a 1.0 release from the Helion team: https://github.com/pytorch/helion/releases/tag/v1.0.017:34:57
6 Apr 2026
@glepage:matrix.orgGaétan Lepage On it: https://github.com/NixOS/nixpkgs/pull/507373 20:57:31
@elliotberman:matrix.orgElliot Berman joined the room.21:51:37
@glepage:matrix.orgGaétan Lepage

🆕 transformer-engine added!

https://github.com/NixOS/nixpkgs/pull/473703

That was not a trivial one!

23:42:59
@glepage:matrix.orgGaétan Lepage *

🆕 transformer-engine added!

https://github.com/NixOS/nixpkgs/pull/473703

That was not a trivial one!

23:43:17
@glepage:matrix.orgGaétan Lepage *

🆕 transformer-engine added!

https://github.com/NixOS/nixpkgs/pull/473703

That was not a trivial one! Thanks to connor (burnt/out) (UTC-8) and @NickCao for the review.

23:43:41
9 Apr 2026
@connorbaker:matrix.orgconnor (burnt/out) (UTC-8)https://github.com/NixOS/nixpkgs/pull/50799006:41:09
@connorbaker:matrix.orgconnor (burnt/out) (UTC-8)🫩06:42:04
10 Apr 2026
@glepage:matrix.orgGaétan Lepage Thanks a lot SomeoneSerge (matrix works sometimes), https://github.com/NixOS/nixpkgs/pull/500971 indeed fixed the issue! 22:34:03
12 Apr 2026
@kaya:catnip.eekaya 𖤐 changed their profile picture.05:53:35
@leona:leona.isleona changed their profile picture.12:15:52
14 Apr 2026
@danielrf:matrix.orgdanielrf connor (burnt/out) (UTC-8): TensorRT support in onnxruntime. It pretty much just works if you turn on support for it: https://github.com/NixOS/nixpkgs/pull/509976 13:40:27
15 Apr 2026
@jonathandekhtiar:matrix.orgJohn D joined the room.22:22:58
16 Apr 2026
@ccicnce113424:matrix.orgccicnce113424Redacted or Malformed Event01:14:52
@ccicnce113424:matrix.orgccicnce113424 * I'm using the latest version of nixos-unstable and noticed that Firefox isn't being cached. I checked your Hydra and found that the last successful evaluation for cuda-packages-unstable occurred on April 1; the most recent evaluation processes all ended prematurely. 01:29:07
@ccicnce113424:matrix.orgccicnce113424* I checked your Hydra and found that the last successful evaluation for cuda-packages-unstable occurred on April 1; the most recent evaluation processes all ended prematurely.01:29:34
@jaredmontoya:matrix.orgjaredmontoyaI tried to update to the latest nixos-unstable but thunderbird seems to not be in cache.nixos-cuda.org (and I can't build it because it sems to need more than 64GB RAM to build) did anyone else experience this?13:33:23
@hexa:lossy.networkhexa (UTC+1)

more than 64 GB

13:34:23
@hexa:lossy.networkhexa (UTC+1)that seems unlikely13:34:26

Show newer messages


Back to Room ListRoom Version: 9