!eWOErHSaiddIbsUNsJ:nixos.org

NixOS CUDA

310 Members
CUDA packages maintenance and support in nixpkgs | https://github.com/orgs/NixOS/projects/27/ | https://nixos.org/manual/nixpkgs/unstable/#cuda60 Servers

Load older messages


SenderMessageTime
3 Apr 2026
@connorbaker:matrix.orgconnor (he/him)Also, can someone explain https://developer.download.nvidia.com/compute/cuda/redist/cuda_compat_orin/ to me? If I had to hazard a guess, it would be that it would allow using CUDA 13.1/13.2 on a Jetson based on JetPack 7 (since support for Orin is added in JetPack 7.2, but that hasn't been released yet as far as I can tell, though it is talked about in the CUDA 13.2 blog post: https://developer.nvidia.com/blog/cuda-13-2-introduces-enhanced-cuda-tile-support-and-new-python-features/#embedded_devices). Is that correct? Or does it allow forward compat across major versions and can be used with JetPack 6, similar to how cuda_compat for Orins on JetPack 5 allows support for up to CUDA 12.2 despite shipping with CUDA 11.4.15:19:07
@connorbaker:matrix.orgconnor (he/him)

Unrelated, but I'm getting errors with the nix-required-mounts hook, maybe I'm just on a bad commit:

$ /nix/store/kgcbq3ablba98myqn8j4sq7yla6nzs3m-nix-required-mounts-0.0.1/bin/nix-required-mounts /nix/store/5i5w8byychlxjbrjnvfl4rwbi9wqr66d-nix-shell-env.drv
Traceback (most recent call last):
  File "/nix/store/kgcbq3ablba98myqn8j4sq7yla6nzs3m-nix-required-mounts-0.0.1/bin/.nix-required-mounts-wrapped", line 9, in <module>
    sys.exit(entrypoint())
             ~~~~~~~~~~^^
  File "/nix/store/kgcbq3ablba98myqn8j4sq7yla6nzs3m-nix-required-mounts-0.0.1/lib/python3.13/site-packages/nix_required_mounts.py", line 142, in entrypoint
    [canon_drv_path] = parsed_drv.keys()
    ^^^^^^^^^^^^^^^^
ValueError: too many values to unpack (expected 1)

Using commit https://github.com/NixOS/nixpkgs/commits/8110df5ad7abf5d4c0f6fb0f8f978390e77f9685 of Nixpkgs. I remember something about JSON derivation format change but I can't remember for the life of me if we already fixed that. Previous commit was https://github.com/NixOS/nixpkgs/commits/a6531044f6d0bef691ea18d4d4ce44d0daa6e816.

15:49:56
@glepage:matrix.orgGaétan Lepage

Interesting, I'm facing another error:

error:
       … while setting up the build environment

       error: getting attributes of path '/nix/store/02wkfkv635277dyq176lw5dcqpxlpsl0-kmod-31/sbin/bin': No such file or directory
15:56:06
@justbrowsing:matrix.orgKevin Mittman (UTC-7)
In reply to @connorbaker:matrix.org
Also, can someone explain https://developer.download.nvidia.com/compute/cuda/redist/cuda_compat_orin/ to me? If I had to hazard a guess, it would be that it would allow using CUDA 13.1/13.2 on a Jetson based on JetPack 7 (since support for Orin is added in JetPack 7.2, but that hasn't been released yet as far as I can tell, though it is talked about in the CUDA 13.2 blog post: https://developer.nvidia.com/blog/cuda-13-2-introduces-enhanced-cuda-tile-support-and-new-python-features/#embedded_devices). Is that correct? Or does it allow forward compat across major versions and can be used with JetPack 6, similar to how cuda_compat for Orins on JetPack 5 allows support for up to CUDA 12.2 despite shipping with CUDA 11.4.
I don't deal with Jetpack but the general idea is it allows using a newer CUDA Toolkit, than the driver in the BSP would otherwise support - that mapping is a bit fuzzy though.
17:46:54
@justbrowsing:matrix.orgKevin Mittman (UTC-7)
In reply to @connorbaker:matrix.org
Also, can someone explain https://developer.download.nvidia.com/compute/cuda/redist/cuda_compat_orin/ to me? If I had to hazard a guess, it would be that it would allow using CUDA 13.1/13.2 on a Jetson based on JetPack 7 (since support for Orin is added in JetPack 7.2, but that hasn't been released yet as far as I can tell, though it is talked about in the CUDA 13.2 blog post: https://developer.nvidia.com/blog/cuda-13-2-introduces-enhanced-cuda-tile-support-and-new-python-features/#embedded_devices). Is that correct? Or does it allow forward compat across major versions and can be used with JetPack 6, similar to how cuda_compat for Orins on JetPack 5 allows support for up to CUDA 12.2 despite shipping with CUDA 11.4.
This one is specific to Jetson Orin, the other cuda_compat provides forward compatibility for x86_64 server, arm64 server, Jetson Thor, etc
17:48:59
@justbrowsing:matrix.orgKevin Mittman (UTC-7) changed their display name from Kevin Mittman (jetlagged/UTC-7) to Kevin Mittman (UTC-7).17:50:31
@neobrain:matrix.orgneobrain joined the room.18:31:27
@glepage:matrix.orgGaétan Lepage

Neat project!
https://www.youtube.com/watch?v=AvK_gi_snJE

Some quotes from the conclusions:

"Nixpkgs CUDA aarch64 ecosystem is quite healthy"
Thanks to nix-community's 80 core ampere system

"Flakes make a good user interface"
This one is for you SomeoneSerge (matrix works sometimes)

"Lack of cached aarch64 CUDA builds"
👀💸

"Uneven freshness of packages"
Until we unlock core and maintainer cloning, that's going to be tough to change (especially reagrding how fast the whole space is moving).

"Community lacks GPU hardware"
Yes. And CPU too 😅

23:11:35
@glepage:matrix.orgGaétan Lepage *

Neat project!
https://www.youtube.com/watch?v=AvK_gi_snJE

Some quotes from the conclusion:

"Nixpkgs CUDA aarch64 ecosystem is quite healthy"
Thanks to nix-community's 80 core ampere system

"Flakes make a good user interface"
This one is for you SomeoneSerge (matrix works sometimes)

"Lack of cached aarch64 CUDA builds"
👀💸

"Uneven freshness of packages"
Until we unlock core and maintainer cloning, that's going to be tough to change (especially reagrding how fast the whole space is moving).

"Community lacks GPU hardware"
Yes. And CPU too 😅

23:12:17
@glepage:matrix.orgGaétan Lepage *

Neat project!
https://www.youtube.com/watch?v=AvK_gi_snJE

Some quotes from the conclusion:

"Nixpkgs CUDA aarch64 ecosystem is quite healthy"

Thanks to nix-community's 80 core ampere system

"Flakes make a good user interface"
This one is for you SomeoneSerge (matrix works sometimes)

"Lack of cached aarch64 CUDA builds"
👀💸

"Uneven freshness of packages"
Until we unlock core and maintainer cloning, that's going to be tough to change (especially reagrding how fast the whole space is moving).

"Community lacks GPU hardware"
Yes. And CPU too 😅

23:16:51
@glepage:matrix.orgGaétan Lepage *

Neat project!
https://www.youtube.com/watch?v=AvK_gi_snJE

Some quotes from the conclusion:

"Nixpkgs CUDA aarch64 ecosystem is quite healthy"

Thanks to nix-community's 80 core ampere system

"Flakes make a good user interface"

This one is for you SomeoneSerge (matrix works sometimes)

"Lack of cached aarch64 CUDA builds"

👀💸

"Uneven freshness of packages"

Until we unlock core and maintainer cloning, that's going to be tough to change (especially reagrding how fast the whole space is moving).

"Community lacks GPU hardware"

Yes. And CPU too 😅

23:17:20
@glepage:matrix.orgGaétan Lepage *

Neat project!
https://www.youtube.com/watch?v=AvK_gi_snJE

Some quotes from the conclusion:

"Nixpkgs CUDA aarch64 ecosystem is quite healthy"

Thanks to nix-community's 80 core ampere system

"Flakes make a good user interface"

This one is for you SomeoneSerge (matrix works sometimes)

"Lack of cached aarch64 CUDA builds"

👀💸

"Uneven freshness of packages"

Until we unlock core and maintainer cloning, that's going to be tough to change (especially reagrding how fast the whole space is moving).

"Community lacks GPU hardware"

Yes. And CPU too 😅

23:17:45
@glepage:matrix.orgGaétan Lepage *

Neat project!
https://www.youtube.com/watch?v=AvK_gi_snJE

Some quotes from the conclusion:

  • "Nixpkgs CUDA aarch64 ecosystem is quite healthy"
    Thanks to nix-community's 80 core ampere system

  • "Flakes make a good user interface"
    This one is for you SomeoneSerge (matrix works sometimes)

  • "Lack of cached aarch64 CUDA builds"
    👀💸

  • "Uneven freshness of packages"
    Until we unlock core and maintainer cloning, that's going to be tough to change (especially reagrding how fast the whole space is moving).

  • "Community lacks GPU hardware"
    Yes. And CPU too 😅

23:18:57
@glepage:matrix.orgGaétan Lepage *

Neat project!
https://www.youtube.com/watch?v=AvK_gi_snJE
I find it really cool that someone wrote a convenient flake to make the DGX spark work OOTB.

Some quotes from the conclusion:

  • "Nixpkgs CUDA aarch64 ecosystem is quite healthy"
    Thanks to nix-community's 80 core ampere system
  • "Flakes make a good user interface"
    This one is for you SomeoneSerge (matrix works sometimes)
  • "Lack of cached aarch64 CUDA builds"
    👀💸
  • "Uneven freshness of packages"
    Until we unlock core and maintainer cloning, that's going to be tough to change (especially reagrding how fast the whole space is moving).
  • "Community lacks GPU hardware"
    Yes. And CPU too 😅
23:20:11
4 Apr 2026
@neobrain:matrix.orgneobrainIt's working really nicely on mine too, but the lack of cache definitely hurts 😭07:07:44
@connorbaker:matrix.orgconnor (he/him)Oh yikes a 1.0 release from the Helion team: https://github.com/pytorch/helion/releases/tag/v1.0.017:34:57
6 Apr 2026
@glepage:matrix.orgGaétan Lepage On it: https://github.com/NixOS/nixpkgs/pull/507373 20:57:31
@elliotberman:matrix.orgElliot Berman joined the room.21:51:37
@glepage:matrix.orgGaétan Lepage

🆕 transformer-engine added!

https://github.com/NixOS/nixpkgs/pull/473703

That was not a trivial one!

23:42:59
@glepage:matrix.orgGaétan Lepage *

🆕 transformer-engine added!

https://github.com/NixOS/nixpkgs/pull/473703

That was not a trivial one!

23:43:17
@glepage:matrix.orgGaétan Lepage *

🆕 transformer-engine added!

https://github.com/NixOS/nixpkgs/pull/473703

That was not a trivial one! Thanks to connor (burnt/out) (UTC-8) and @NickCao for the review.

23:43:41
9 Apr 2026
@connorbaker:matrix.orgconnor (he/him)https://github.com/NixOS/nixpkgs/pull/50799006:41:09
@connorbaker:matrix.orgconnor (he/him)🫩06:42:04
4 Aug 2022
@winterqt:nixos.devWinter (she/her) joined the room.03:26:42
@winterqt:nixos.devWinter (she/her)(hi, just came here to read + respond to this.)03:28:52
@tpw_rules:matrix.orgtpw_ruleshey. i had previously sympathzied with samuela and like i said before had some of the same frustrations. i just edited my github comment to add "[CUDA] packages are universally complicated, fragile to package, and critical to daily operations. Nix being able to manage them is unbelievably helpful to those of us who work with them regularly, even if support is downgraded to only having an expectation of function on stable branches."03:29:14
@winterqt:nixos.devWinter (she/her)
In reply to @tpw_rules:matrix.org
i'm mildly peeved about a recent merging of something i maintain where i'm pretty sure the merger does not own the expensive hardware required to properly test the package. i don't think it broke anything but i was given precisely 45 minutes to see the notification before somebody merged it
ugh, 45 minutes? that's... not great. not to air dirty laundry but did you do what samuela did in the wandb PR and at least say that that wasn't a great thing to do? (not sure how else to word that, you get what i mean)
03:30:23
@tpw_rules:matrix.orgtpw_rulesno, i haven't yet, but i probably will03:31:03
@winterqt:nixos.devWinter (she/her) i admittedly did that with a PR once, i forget how long the maintainer was requested for but i merged it because multiple people reported it fixed the issue. the maintainer said "hey, don't do that" after and now i do think twice before merging. so it could help, is what i'm saying. 03:31:50
@tpw_rules:matrix.orgtpw_rulesi'm not sure what went wrong with the wandb PR anyway, i think it was just a boneheaded move on the maintainer's part03:32:10

Show newer messages


Back to Room ListRoom Version: 9