| 1 Oct 2025 |
Kevin Mittman (EOY sleep) | In CUDA 13, there was a split from cuda_nvcc to cuda_crt, libnvvm, and libnvptxcompiler components | 15:47:11 |
| Kevin Mittman (EOY sleep) changed their display name from Kevin Mittman (UTC+9) to Kevin Mittman (UTC-7). | 15:48:07 |
| @magic_rb:matrix.redalder.org left the room. | 18:23:33 |
Winter | this is just using pythonPackages.tensorflow w/ config.cudaSupport on 25.05 -- so that's CUDA 12, right? | 19:12:26 |
Winter | dunno why this would be sad then | 19:12:38 |
SomeoneSerge (back on matrix) | At what stage do you get that error? | 19:20:29 |
Winter | runtime, after i've successfully imported tf | 20:09:22 |
Winter | * runtime, after i've successfully imported tf -- i then get some JIT compilation error | 20:15:31 |
Winter | seems like XLA_FLAGS may be my friend here | 20:16:43 |
Winter | ok yeah setting XLA_FLAGS=--xla_gpu_cuda_data_dir=/nix/store/y16bl5h9nxdbyfs922x4bz9lkk51kx1d-cuda_nvcc-12.8.93 fixed it! | 20:20:09 |
Winter | i think this is just a simple fix in tensorflow-bin | 20:20:19 |
Winter | i don’t particularly want to build tf-bin again but i’m going to get a PR up to fix this :-) | 21:57:28 |
Winter | i assume we have the concept of a check for whatever cuda version is in use — connor (he/him) (UTC-7) do you want a check for <13 before 13 is actually in, as a reminder of sorts to test this out with 13? (still need an MRE tho) | 21:58:24 |
Winter | for clarity this is some JIT’d XLA stuff | 21:59:17 |
connor (he/him) | IIRC on 13 I symlink it so it should still be available in NVCC’s bin output | 22:38:35 |
Winter | awesome | 22:39:52 |
| 2 Oct 2025 |
Daniel Fahey | Hello there. Anyone got any spare time (and compute, lol) to help me upgrade vLLM in Nixpkgs? https://github.com/NixOS/nixpkgs/pull/447722 | 09:46:34 |
Gaétan Lepage | Sure! | 12:22:51 |
Gaétan Lepage | I pushed to the branch and fixed the CUDA build (hopefully) | 12:37:39 |
Gaétan Lepage | Well, unfortunately:
/nix/store/ycslb9zwv05yjp79ysvbwflwa9s9ffa8-source/include/cutlass/epilogue/collective/detail.hpp(719): error: no instance of function template "cutlass::epilogue::collective::detail::Sm100TmaWarpSpecializedAdapter<EpilogueOp>::operator()
| 12:41:39 |
Daniel Fahey | Legend! Beware I just force pushed | 12:56:59 |