| 4 Nov 2025 |
Gaétan Lepage | TIL: python3Packages.torchWithRocm is apprently sensitive to config.cudaSupport. | 20:11:25 |
Ari Lotter | ugh i wish we could compile packages with cudaCapabilities individually per-capability and merge them later, it's such a nightmare adding one new capability level and it causing a huge 8-hour recompile.. | 20:40:40 |
connor (burnt/out) (UTC-8) | These aliases must die, they make my life so difficult | 21:45:22 |
connor (burnt/out) (UTC-8) | Join the club
And it’s not even like we could do a mega-build in an intermediate derivation and then prune unused capabilities according to whatever the user requested because the amount of generated device code is so large linking will fail lmao | 21:46:17 |
connor (burnt/out) (UTC-8) | Gaétan Lepage are any of SomeoneSerge (back on matrix)’s comments on https://github.com/NixOS/nixpkgs/pull/457803 actionable or is it good to merge? | 21:48:00 |
connor (burnt/out) (UTC-8) | Also, would you mind reviewing https://github.com/NixOS/nixpkgs/pull/458619? | 21:48:09 |
hacker1024 | This is most likely due to a dependency, but I will also point out that all torch variants are at the moment due to an unconditional version access
https://github.com/NixOS/nixpkgs/blob/b3d51a0365f6695e7dd5cdf3e180604530ed33b4/pkgs/development/python-modules/torch/source/default.nix#L458
| 21:48:19 |
Gaétan Lepage | I quadruppled check.
Both commits of my PR are actually necessary to get a nvcc-free onnxruntime. | 21:48:42 |
Gaétan Lepage | Let me change one comment to mention the bisection | 21:48:57 |
Gaétan Lepage | connor (burnt/out) (UTC-8), I reviewed nccl-tests. Feel free to merge | 22:08:11 |
Ari Lotter | i'm trying to fix this exact linker error right now 😭 trying to get flash-attn built for cuda capabilities 7.5 thru 12.0a, and i'm so stuck, and every rebuild with an attempted fix takes ~2 hours... any ideas? 😭 | 22:17:28 |
Ari Lotter | maybe we're just screwed :) | 22:20:25 |
Robbie Buxton | Which flash attention version | 22:24:21 |
Robbie Buxton | V2 or v3 | 22:24:27 |