!eWOErHSaiddIbsUNsJ:nixos.org

NixOS CUDA

281 Members
CUDA packages maintenance and support in nixpkgs | https://github.com/orgs/NixOS/projects/27/ | https://nixos.org/manual/nixpkgs/unstable/#cuda58 Servers

Load older messages


SenderMessageTime
16 Aug 2025
@connorbaker:matrix.orgconnor (burnt/out) (UTC-8)You can try doing something similar to the steps listed here: https://github.com/NixOS/nixpkgs/blob/master/doc/languages-frameworks/cuda.section.md#updating-cutensor-cuda-updating-cutensor I've not had a chance to update that script in a while, so not sure how well/if it still works Generally we use the script from the docs to take the manfiest provided by NVIDIA (dubbed the redist or redistrib manifest) and create a feature manifest which tells us things relevant to the Nix packaging Then create a fixup function (https://github.com/NixOS/nixpkgs/tree/master/pkgs/development/cuda-modules/_cuda/fixups) for the packages from the manifest Lastly add it to the package sets by creating and importing an extension, like https://github.com/NixOS/nixpkgs/blob/3b0feaf8c2160a10a974c890e93f5f5387728784/pkgs/top-level/cuda-packages.nix#L20105:48:12
@connorbaker:matrix.orgconnor (burnt/out) (UTC-8)It's fairly involved and I've been trying to automate away the entirety of it for the better part of the last year, but there are many sharp edges in many domains :l05:49:30
17 Aug 2025
@kallestrup-mastratisi:matrix.orgmastratisi joined the room.10:05:31
21 Aug 2025
@luke-skywalker:matrix.orgluke-skywalker

I ran into this issue with the latest nvidia driver (580.76.05) crashing gtk apps and GPU accelerated apps like zed editor on latest linux kernel (6.16.1) on wayland.

Im kind of overwhelmed by all the available packages. Can someone give me a quick hint on which of all the available packages I can safely revert back to?

13:23:10
@luke-skywalker:matrix.orgluke-skywalker *

I ran into this issue with the latest nvidia driver (580.76.05) crashing gtk apps and GPU accelerated apps like zed editor with latest linux kernel (6.16.1) on wayland.

Im kind of overwhelmed by all the available packages. Can someone give me a quick hint on which of all the available packages I can safely revert back to?

13:23:27
@luke-skywalker:matrix.orgluke-skywalker *

I ran into this issue with the latest nvidia driver (580.76.05) crashing gtk apps and GPU accelerated apps like zed editor with latest linux kernel (6.16.1) on wayland.

I am installing the nvidia drivers from the nvidia-container-toolkit.

Im kind of overwhelmed by all the available packages. Can someone give me a quick hint on which of all the available packages I can safely revert back to?

13:25:20
@luke-skywalker:matrix.orgluke-skywalker *

I ran into this issue with the latest nvidia driver (580.76.05) crashing gtk apps and GPU accelerated apps like zed editor with latest linux kernel (6.16.1) on wayland.

I am installing the nvidia drivers from the nvidia-container-toolkit.

Can someone give me a quick hint on which of all the available packages I can safely revert back to? I'm kind of overwhelmed by all the available packages.

13:40:31
@connorbaker:matrix.orgconnor (burnt/out) (UTC-8)What do you mean the drivers from nvidia-container-toolkit? Your NixOS config should have something like this, right? https://github.com/ConnorBaker/nixos-configs/blob/5b9fe63698ee14a52a8187cd34ba769203fae24e/modules/nvidia.nix#L18 You should be able to select the version of the driver you want to use by changing that.14:45:00
@infinisil:matrix.orginfinisil joined the room.23:36:59
@infinisil:matrix.orginfinisil Does the CUDA team want to add a slide for NixCon's state of the union? The board and SC are reaching out to various teams to prepare a shared slide deck here, and I reserved a slot for the CUDA team :) https://docs.google.com/presentation/d/191-Bgwv6Bdb4KBzIfyAyZBftI0rSuCBo-_tSPrTSrtE/edit?slide=id.g376eb5e3048_2_152#slide=id.g376eb5e3048_2_152
23:38:14
@infinisil:matrix.orginfinisil @connor (he/him) (UTC-7) @SomeoneSerge (Ever OOMed by Element) @Samuel Ainsworth ^ 23:38:31
@infinisil:matrix.orginfinisilYou can PM me your google email to get permissions to edit23:38:39
22 Aug 2025
@connorbaker:matrix.orgconnor (burnt/out) (UTC-8)Sure! I’ll let Serge know as well since I have him on Signal00:52:56
@stick:matrix.orgstick connor (he/him) (UTC-7): jfyi i tried to update cusparselt to 0.8.0 using your redist scripts, but it failed - it seems the scripts need to be adjusted somehow 09:42:02
23 Aug 2025
@stick:matrix.orgstick

Found the issue

New releases contain files to cuda12 and cuda13, introducing another level in json

See

https://developer.download.nvidia.com/compute/cusparselt/redist/redistrib_0.7.1.json

vs

https://developer.download.nvidia.com/compute/cusparselt/redist/redistrib_0.8.0.json

12:18:03
@stick:matrix.orgstickI manually edited the json to adhere to the old scheme and will create a cusparselt update PR although it is not ideal and i suspect the upcoming cuda releases will use the newer scheme too12:23:03
@stick:matrix.orgstickcusparselt PR in https://github.com/NixOS/nixpkgs/pull/43618612:42:56
@lt1379:matrix.orgLun joined the room.21:07:38
@lt1379:matrix.orgLun

TODO: 2. We should probably abandon attributes such as torchWithCuda (etc.)

as they routinely end up consuming the wrong arguments\

(dependencies without cuda support).

Instead we should rely on overlays and nixpkgsFun.

(@SomeoneSerge)

_tritonEffective ?

Is there an issue tracking dropping WithCuda aliases/a discussion thread about this somewhere?

21:43:20
@lt1379:matrix.orgLun *
# TODO: 2. We should probably abandon attributes such as `torchWithCuda` (etc.)
# as they routinely end up consuming the wrong arguments\\
# (dependencies without cuda support).
# Instead we should rely on overlays and nixpkgsFun.
# (@SomeoneSerge)
\_tritonEffective ?

Is there an issue tracking dropping WithCuda aliases/a discussion thread about this somewhere?

21:43:40
24 Aug 2025
@connorbaker:matrix.orgconnor (burnt/out) (UTC-8)Not that I know of; probably hasn’t been made due to lack of time. Feel free to make one, I can add the CUDA tag to it so it doesn’t get lost. (Well, it’ll be lost in our giant backlog, but whatever.)18:31:36
@connorbaker:matrix.orgconnor (burnt/out) (UTC-8) Kevin MittmanSomeoneSerge (Ever OOMed by Element)I don’t think I ever set something up but Kevin we should definitely talk about the database application Serge has been building to track changes and information about CUDA binaries/releases 18:34:00
@justbrowsing:matrix.orgKevin Mittman (UTC-7) stick: https://github.com/NVIDIA/build-system-archive-import-examples/issues/4 18:44:39
@justbrowsing:matrix.orgKevin Mittman (UTC-7) * stick: https://github.com/NVIDIA/build-system-archive-import-examples/issues/6 18:45:27
25 Aug 2025
@connorbaker:matrix.orgconnor (burnt/out) (UTC-8)

If someone could clear up what the goals are of the following projects and if/how they relate to each other I’d appreciate it:

  • warp (https://github.com/NVIDIA/warp)
  • CuTe (https://docs.nvidia.com/cutlass/media/docs/cpp/cute/00_quickstart.html)
  • tilus (https://github.com/NVIDIA/tilus)
  • CCCL Python libraries (https://nvidia.github.io/cccl/python/index.html)

Also, was cuTile released as CuTe, or is that something else?

14:34:19
@apyh:matrix.orgapyh quick question for y'all - since 427a439 was merged, setuptools is now at v80, but from my understanding Torch only builds at <80... how does anything torch-related still work in nixpkgs, and how does cuda torch work at all? 22:23:24
26 Aug 2025
@bjth:matrix.orgBryan Honof joined the room.11:45:34
@bjth:matrix.orgBryan HonofHey all, I have created this tracking issue for bumping CUDA to version 13 https://github.com/NixOS/nixpkgs/issues/437087, not sure if that's the right way to do it. :)11:46:39
@connorbaker:matrix.orgconnor (burnt/out) (UTC-8)I mean if it builds on master I don’t think the CUDA variant should fail. Idk what’s built currently through nix-community.16:51:05
@connorbaker:matrix.orgconnor (burnt/out) (UTC-8)Will try to take a look later Bryan. Not sure how well the scripts work with 13.16:51:06

Show newer messages


Back to Room ListRoom Version: 9