!eWOErHSaiddIbsUNsJ:nixos.org

NixOS CUDA

289 Members
CUDA packages maintenance and support in nixpkgs | https://github.com/orgs/NixOS/projects/27/ | https://nixos.org/manual/nixpkgs/unstable/#cuda57 Servers

Load older messages


SenderMessageTime
21 Aug 2025
@infinisil:matrix.orginfinisil joined the room.23:36:59
@infinisil:matrix.orginfinisil Does the CUDA team want to add a slide for NixCon's state of the union? The board and SC are reaching out to various teams to prepare a shared slide deck here, and I reserved a slot for the CUDA team :) https://docs.google.com/presentation/d/191-Bgwv6Bdb4KBzIfyAyZBftI0rSuCBo-_tSPrTSrtE/edit?slide=id.g376eb5e3048_2_152#slide=id.g376eb5e3048_2_152
23:38:14
@infinisil:matrix.orginfinisil @connor (he/him) (UTC-7) @SomeoneSerge (Ever OOMed by Element) @Samuel Ainsworth ^ 23:38:31
@infinisil:matrix.orginfinisilYou can PM me your google email to get permissions to edit23:38:39
22 Aug 2025
@connorbaker:matrix.orgconnor (burnt/out) (UTC-8)Sure! I’ll let Serge know as well since I have him on Signal00:52:56
@stick:matrix.orgstick connor (he/him) (UTC-7): jfyi i tried to update cusparselt to 0.8.0 using your redist scripts, but it failed - it seems the scripts need to be adjusted somehow 09:42:02
23 Aug 2025
@stick:matrix.orgstick

Found the issue

New releases contain files to cuda12 and cuda13, introducing another level in json

See

https://developer.download.nvidia.com/compute/cusparselt/redist/redistrib_0.7.1.json

vs

https://developer.download.nvidia.com/compute/cusparselt/redist/redistrib_0.8.0.json

12:18:03
@stick:matrix.orgstickI manually edited the json to adhere to the old scheme and will create a cusparselt update PR although it is not ideal and i suspect the upcoming cuda releases will use the newer scheme too12:23:03
@stick:matrix.orgstickcusparselt PR in https://github.com/NixOS/nixpkgs/pull/43618612:42:56
@lt1379:matrix.orgLun joined the room.21:07:38
@lt1379:matrix.orgLun

TODO: 2. We should probably abandon attributes such as torchWithCuda (etc.)

as they routinely end up consuming the wrong arguments\

(dependencies without cuda support).

Instead we should rely on overlays and nixpkgsFun.

(@SomeoneSerge)

_tritonEffective ?

Is there an issue tracking dropping WithCuda aliases/a discussion thread about this somewhere?

21:43:20
@lt1379:matrix.orgLun *
# TODO: 2. We should probably abandon attributes such as `torchWithCuda` (etc.)
# as they routinely end up consuming the wrong arguments\\
# (dependencies without cuda support).
# Instead we should rely on overlays and nixpkgsFun.
# (@SomeoneSerge)
\_tritonEffective ?

Is there an issue tracking dropping WithCuda aliases/a discussion thread about this somewhere?

21:43:40
24 Aug 2025
@connorbaker:matrix.orgconnor (burnt/out) (UTC-8)Not that I know of; probably hasn’t been made due to lack of time. Feel free to make one, I can add the CUDA tag to it so it doesn’t get lost. (Well, it’ll be lost in our giant backlog, but whatever.)18:31:36
@connorbaker:matrix.orgconnor (burnt/out) (UTC-8) Kevin MittmanSomeoneSerge (Ever OOMed by Element)I don’t think I ever set something up but Kevin we should definitely talk about the database application Serge has been building to track changes and information about CUDA binaries/releases 18:34:00
@justbrowsing:matrix.orgKevin Mittman (UTC-8) stick: https://github.com/NVIDIA/build-system-archive-import-examples/issues/4 18:44:39
@justbrowsing:matrix.orgKevin Mittman (UTC-8) * stick: https://github.com/NVIDIA/build-system-archive-import-examples/issues/6 18:45:27
25 Aug 2025
@connorbaker:matrix.orgconnor (burnt/out) (UTC-8)

If someone could clear up what the goals are of the following projects and if/how they relate to each other I’d appreciate it:

  • warp (https://github.com/NVIDIA/warp)
  • CuTe (https://docs.nvidia.com/cutlass/media/docs/cpp/cute/00_quickstart.html)
  • tilus (https://github.com/NVIDIA/tilus)
  • CCCL Python libraries (https://nvidia.github.io/cccl/python/index.html)

Also, was cuTile released as CuTe, or is that something else?

14:34:19
@apyh:matrix.orgapyh quick question for y'all - since 427a439 was merged, setuptools is now at v80, but from my understanding Torch only builds at <80... how does anything torch-related still work in nixpkgs, and how does cuda torch work at all? 22:23:24
26 Aug 2025
@bjth:matrix.orgBryan Honof joined the room.11:45:34
@bjth:matrix.orgBryan HonofHey all, I have created this tracking issue for bumping CUDA to version 13 https://github.com/NixOS/nixpkgs/issues/437087, not sure if that's the right way to do it. :)11:46:39
@connorbaker:matrix.orgconnor (burnt/out) (UTC-8)I mean if it builds on master I don’t think the CUDA variant should fail. Idk what’s built currently through nix-community.16:51:05
@connorbaker:matrix.orgconnor (burnt/out) (UTC-8)Will try to take a look later Bryan. Not sure how well the scripts work with 13.16:51:06
@apyh:matrix.orgapyhi'm trying to build master but yaknow, gotta build the world, starting with llvm21:23:25
27 Aug 2025
@justbrowsing:matrix.orgKevin Mittman (UTC-8)There are a fair amount of changes in 13.0, is there already a thread?01:45:33
@hexa:lossy.networkhexa (UTC+1)torch is cached, setuptools upgrades are rarely an issue02:11:52
@hexa:lossy.networkhexa (UTC+1)projects tend to pin it proactively and we tend to unpin it02:12:11
@apyh:matrix.orgapyh
In reply to @hexa:lossy.network
torch is cached, setuptools upgrades are rarely an issue
im not super experienced with this - i ask because I'm trying to build torch 2.9 nightly myself, and i can't just bump all versions with the submodule unroll thing, because it fails to build with a newer setuptools. how is torch "cached" such that it doesn't need to build with the setuptools in nixpkgs?
02:20:20
@hexa:lossy.networkhexa (UTC+1)https://hydra.nix-community.org/job/nixpkgs/cuda/python3Packages.torch.x86_64-linux02:20:54
@hexa:lossy.networkhexa (UTC+1)but yeah, that version is outdated02:21:14
@hexa:lossy.networkhexa (UTC+1)why newer versions wouldn't work with a newer setuptools but older versions do is beyond me 🙂 02:21:31

Show newer messages


Back to Room ListRoom Version: 9