!eWOErHSaiddIbsUNsJ:nixos.org

NixOS CUDA

283 Members
CUDA packages maintenance and support in nixpkgs | https://github.com/orgs/NixOS/projects/27/ | https://nixos.org/manual/nixpkgs/unstable/#cuda58 Servers

Load older messages


SenderMessageTime
25 Aug 2025
@apyh:matrix.orgapyh quick question for y'all - since 427a439 was merged, setuptools is now at v80, but from my understanding Torch only builds at <80... how does anything torch-related still work in nixpkgs, and how does cuda torch work at all? 22:23:24
26 Aug 2025
@bjth:matrix.orgBryan Honof joined the room.11:45:34
@bjth:matrix.orgBryan HonofHey all, I have created this tracking issue for bumping CUDA to version 13 https://github.com/NixOS/nixpkgs/issues/437087, not sure if that's the right way to do it. :)11:46:39
@connorbaker:matrix.orgconnor (he/him)I mean if it builds on master I don’t think the CUDA variant should fail. Idk what’s built currently through nix-community.16:51:05
@connorbaker:matrix.orgconnor (he/him)Will try to take a look later Bryan. Not sure how well the scripts work with 13.16:51:06
@apyh:matrix.orgapyhi'm trying to build master but yaknow, gotta build the world, starting with llvm21:23:25
27 Aug 2025
@justbrowsing:matrix.orgKevin Mittman (UTC-7)There are a fair amount of changes in 13.0, is there already a thread?01:45:33
@hexa:lossy.networkhexatorch is cached, setuptools upgrades are rarely an issue02:11:52
@hexa:lossy.networkhexaprojects tend to pin it proactively and we tend to unpin it02:12:11
@apyh:matrix.orgapyh
In reply to @hexa:lossy.network
torch is cached, setuptools upgrades are rarely an issue
im not super experienced with this - i ask because I'm trying to build torch 2.9 nightly myself, and i can't just bump all versions with the submodule unroll thing, because it fails to build with a newer setuptools. how is torch "cached" such that it doesn't need to build with the setuptools in nixpkgs?
02:20:20
@hexa:lossy.networkhexahttps://hydra.nix-community.org/job/nixpkgs/cuda/python3Packages.torch.x86_64-linux02:20:54
@hexa:lossy.networkhexabut yeah, that version is outdated02:21:14
@hexa:lossy.networkhexawhy newer versions wouldn't work with a newer setuptools but older versions do is beyond me 🙂 02:21:31
@apyh:matrix.orgapyhyeah no i don't think torch 2.7.1 *should* build with newer setuptools..02:57:01
@apyh:matrix.orgapyhoh, i see, 2.7 doesn't have a max version on setuptools (https://github.com/pytorch/pytorch/blob/release/2.7/pyproject.toml) but 2.8 does (https://github.com/pytorch/pytorch/blob/release/2.8/pyproject.toml)02:58:29
@apyh:matrix.orgapyhig however it's built in nixpkgs can ignore that constraint since it somehow will still run setup.py02:58:57
@hexa:lossy.networkhexa they're pinning to a version with distutils exposed, we can just provide distutils 🤷 03:25:52
@hexa:lossy.networkhexa * they're apparently pinning to a version with distutils exposed, we can just provide distutils 🤷 03:26:05
@apyh:matrix.orgapyhI'm doing all this because i really need a 2.9 nightly build but i get segfaults when doing multi-gpu NCCL stuff 😭07:35:38
@bot-wxt1221:matrix.orgBot_wxt1221 joined the room.08:45:43
@bot-wxt1221:matrix.orgBot_wxt1221Redacted or Malformed Event08:46:05
@glepage:matrix.orgGaétan Lepage

I'm having issues with updating torch to 2.8.0
https://github.com/NixOS/nixpkgs/pull/431973

ERROR Missing dependencies:
        setuptools<80.0,>=62.3.0

And I was not able to find any mentions of this constraint in the code base...

08:46:49
@bot-wxt1221:matrix.orgBot_wxt1221Could we build onnxruntime related packages?08:48:29
@glepage:matrix.orgGaétan LepageAre they currently broken?08:49:30
@glepage:matrix.orgGaétan Lepage I opened an update PR: https://github.com/NixOS/nixpkgs/pull/437307 08:49:40
@bot-wxt1221:matrix.orgBot_wxt1221No08:49:41
@bot-wxt1221:matrix.orgBot_wxt1221They are just mass cuda building08:49:51
@bot-wxt1221:matrix.orgBot_wxt1221like firefox and thunderbiar08:49:56
@bot-wxt1221:matrix.orgBot_wxt1221 * 08:50:00
@bot-wxt1221:matrix.orgBot_wxt1221 * 08:50:58

Show newer messages


Back to Room ListRoom Version: 9