!eWOErHSaiddIbsUNsJ:nixos.org

NixOS CUDA

300 Members
CUDA packages maintenance and support in nixpkgs | https://github.com/orgs/NixOS/projects/27/ | https://nixos.org/manual/nixpkgs/unstable/#cuda60 Servers

Load older messages


SenderMessageTime
24 Feb 2026
@connorbaker:matrix.orgconnor (burnt/out) (UTC-8)That’s partly why it’s a global config option Otherwise people get inconsistent closures and failure modes that make me want to yell at people :(16:51:31
@hexa:lossy.networkhexa (UTC+1)Thanks!16:52:11
@glepage:matrix.orgGaétan LepageRedacted or Malformed Event23:20:03
@glepage:matrix.orgGaétan Lepage

🔥 PyTorch 2.10.0 🔥

Changelog: https://github.com/pytorch/pytorch/releases/tag/v2.10.0
PR: https://github.com/NixOS/nixpkgs/pull/484881
PR tracker: https://nixpkgs-tracker.ocfox.me/?pr=484881

This one took quite a while to bring to nixpkgs, and I'm glad to have finally gotten it merged!

Some basic testing has been done (basic builds, cudaSupport builds, some gpuChecks).
However, exhaustively building and testing all the downstream dependencies isn't feasible (at least without more time and hardware).
-> Please, don't hesitate to report any breakage in this channel, and feel free to ping me as well.

Thanks a lot to everyone who helped, and more generally to everyone else for your patience.

23:30:01
@glepage:matrix.orgGaétan Lepage *

🔥 PyTorch 2.10.0 (+ triton 3.6.0) 🔥


Changelog: https://github.com/pytorch/pytorch/releases/tag/v2.10.0
PR: https://github.com/NixOS/nixpkgs/pull/484881
PR tracker: https://nixpkgs-tracker.ocfox.me/?pr=484881


This one took quite a while to bring to nixpkgs, and I'm glad to have finally gotten it merged!

Some basic testing has been done (basic builds, cudaSupport builds, some gpuChecks).
However, exhaustively building and testing all the downstream dependencies isn't feasible (at least without more time and hardware).
-> Please, don't hesitate to report any breakage in this channel, and feel free to ping me as well.

Thanks a lot to everyone who helped, and more generally to everyone else for your patience.

23:32:32
25 Feb 2026
@hugo:okeso.euHugo

Related to PyTorch but not to 2.10, it looks like my CI cannot build it since yesterday morning (it was still python3.13-torch-2.9.1) 🤔
Torch 2.10.0 does not solve that issue.

I build with:

      run: "cd nixpkgs-master\n  nix-build -I nixpkgs=. --arg config '{ allowUnfree\
        \ = true; cudaSupport = true; openclSupport = true; rocmSupport = false;}'\
        \ --option allow-import-from-derivation false --max-jobs 1 -A python313Packages.torch"

Here is the last part of my build log (after 3h12 of build).
https://pad.lassul.us/s/xWhnOmbeo2#

Any idea what could be the cause?

15:20:41
@hexa:lossy.networkhexa (UTC+1)log looks incomplete15:21:09
@hugo:okeso.euHugoHedgeDoc does not allow me to copy the complete log15:21:26
@hexa:lossy.networkhexa (UTC+1)bpa.st15:21:32
@hexa:lossy.networkhexa (UTC+1)* https://bpa.st15:21:35
@hugo:okeso.euHugohttps://bpa.st/5CQA15:22:04
@hugo:okeso.euHugo *

Related to PyTorch but not to 2.10, it looks like my CI cannot build it since yesterday morning (it was still python3.13-torch-2.9.1) 🤔
Torch 2.10.0 does not solve that issue.

I build with:

      run: "cd nixpkgs-master\n  nix-build -I nixpkgs=. --arg config '{ allowUnfree\
        \ = true; cudaSupport = true; openclSupport = true; rocmSupport = false;}'\
        \ --option allow-import-from-derivation false --max-jobs 1 -A python313Packages.torch"

Here is the last log (after 3h12 of build).
https://bpa.st/5CQA

Any idea what could be the cause?

15:22:17
@hugo:okeso.euHugoEdited my message with this link as well.15:22:31
@glepage:matrix.orgGaétan LepageAre you sure that you're not simply OOMing?19:43:36
@hugo:okeso.euHugoI investigated my metrics, it looks like OOM-ing for 2.10, but not for the latest failure of 2.9.1 🤔20:28:31
@hugo:okeso.euHugoI started a build with less cores, will see where that goes (mostl likely from 3.10 to ~5 hours)20:29:13
26 Feb 2026
@ctheune:matrix.flyingcircus.ioChristian Theune joined the room.07:05:25
@ctheune:matrix.flyingcircus.ioChristian Theune👋07:09:09
@ctheune:matrix.flyingcircus.ioChristian Theune Gaétan Lepage: if you need help testing the vllm 0.16 branch, i can do that. 07:27:08
@glepage:matrix.orgGaétan Lepage

Hi! Thanks :)
I rebased the PR yesterday: https://github.com/NixOS/nixpkgs/pull/490175

I couldn't do much as its dependendency xgrammar is broken. Once I'll properly bump the {c,q}utlass et al. overrides, then sure, help with testing will be welcome :)

07:57:01
@glepage:matrix.orgGaétan Lepage From my initial testing, 2.10 is significantly heavier to build.
Took me >1h instead of 45 min to build with cudaSupport on a 64T Threadripper
07:58:09
4 Aug 2022
@winterqt:nixos.devWinter (she/her) joined the room.03:26:42
@winterqt:nixos.devWinter (she/her)(hi, just came here to read + respond to this.)03:28:52
@tpw_rules:matrix.orgtpw_ruleshey. i had previously sympathzied with samuela and like i said before had some of the same frustrations. i just edited my github comment to add "[CUDA] packages are universally complicated, fragile to package, and critical to daily operations. Nix being able to manage them is unbelievably helpful to those of us who work with them regularly, even if support is downgraded to only having an expectation of function on stable branches."03:29:14
@winterqt:nixos.devWinter (she/her)
In reply to @tpw_rules:matrix.org
i'm mildly peeved about a recent merging of something i maintain where i'm pretty sure the merger does not own the expensive hardware required to properly test the package. i don't think it broke anything but i was given precisely 45 minutes to see the notification before somebody merged it
ugh, 45 minutes? that's... not great. not to air dirty laundry but did you do what samuela did in the wandb PR and at least say that that wasn't a great thing to do? (not sure how else to word that, you get what i mean)
03:30:23
@tpw_rules:matrix.orgtpw_rulesno, i haven't yet, but i probably will03:31:03
@winterqt:nixos.devWinter (she/her) i admittedly did that with a PR once, i forget how long the maintainer was requested for but i merged it because multiple people reported it fixed the issue. the maintainer said "hey, don't do that" after and now i do think twice before merging. so it could help, is what i'm saying. 03:31:50
@tpw_rules:matrix.orgtpw_rulesi'm not sure what went wrong with the wandb PR anyway, i think it was just a boneheaded move on the maintainer's part03:32:10
@winterqt:nixos.devWinter (she/her)(it was also simple enough that it was fine and the maintainer said it looked good after)03:32:15
@tpw_rules:matrix.orgtpw_rules * i'm not sure what went wrong with the wandb PR anyway, i think it was just a boneheaded move on the merger's part03:32:19

Show newer messages


Back to Room ListRoom Version: 9