!eWOErHSaiddIbsUNsJ:nixos.org

NixOS CUDA

286 Members
CUDA packages maintenance and support in nixpkgs | https://github.com/orgs/NixOS/projects/27/ | https://nixos.org/manual/nixpkgs/unstable/#cuda57 Servers

Load older messages


SenderMessageTime
1 Oct 2025
@winter:catgirl.cloudWinter runtime, after i've successfully imported tf 20:09:22
@winter:catgirl.cloudWinter* runtime, after i've successfully imported tf -- i then get some JIT compilation error20:15:31
@winter:catgirl.cloudWinter seems like XLA_FLAGS may be my friend here 20:16:43
@winter:catgirl.cloudWinter ok yeah setting XLA_FLAGS=--xla_gpu_cuda_data_dir=/nix/store/y16bl5h9nxdbyfs922x4bz9lkk51kx1d-cuda_nvcc-12.8.93 fixed it! 20:20:09
@winter:catgirl.cloudWinteri think this is just a simple fix in tensorflow-bin20:20:19
@winter:catgirl.cloudWinteri don’t particularly want to build tf-bin again but i’m going to get a PR up to fix this :-)21:57:28
@winter:catgirl.cloudWinter i assume we have the concept of a check for whatever cuda version is in use — connor (he/him) (UTC-7) do you want a check for <13 before 13 is actually in, as a reminder of sorts to test this out with 13? (still need an MRE tho) 21:58:24
@winter:catgirl.cloudWinterfor clarity this is some JIT’d XLA stuff21:59:17
@connorbaker:matrix.orgconnor (burnt/out) (UTC-8)IIRC on 13 I symlink it so it should still be available in NVCC’s bin output22:38:35
@winter:catgirl.cloudWinterawesome22:39:52
2 Oct 2025
@daniel-fahey:matrix.orgDaniel FaheyHello there. Anyone got any spare time (and compute, lol) to help me upgrade vLLM in Nixpkgs? https://github.com/NixOS/nixpkgs/pull/44772209:46:34
@glepage:matrix.orgGaétan LepageSure!12:22:51
@glepage:matrix.orgGaétan LepageI pushed to the branch and fixed the CUDA build (hopefully)12:37:39
@glepage:matrix.orgGaétan Lepage

Well, unfortunately:

/nix/store/ycslb9zwv05yjp79ysvbwflwa9s9ffa8-source/include/cutlass/epilogue/collective/detail.hpp(719): error: no instance of function template "cutlass::epilogue::collective::detail::Sm100TmaWarpSpecializedAdapter<EpilogueOp>::operator()
12:41:39
@daniel-fahey:matrix.orgDaniel FaheyLegend! Beware I just force pushed12:56:59
@daniel-fahey:matrix.orgDaniel Fahey(to fix a typo in the commit message)12:57:07
@glepage:matrix.orgGaétan LepagePushed new fixes. I initially had the wrong version of cutlass12:57:12
@daniel-fahey:matrix.orgDaniel Faheywoops, could you add you co-authorship again please12:58:19
@daniel-fahey:matrix.orgDaniel Fahey lost it when I did a git commit --amend 12:58:37
@glepage:matrix.orgGaétan LepageI might have force-pushed right after you13:04:07
@daniel-fahey:matrix.orgDaniel FaheyNo worries.13:04:15
@daniel-fahey:matrix.orgDaniel FaheyLooks okay, I'm going to force push again with the corrected commit message crediting you13:05:36
@glepage:matrix.orgGaétan LepageOk!13:12:44
@glepage:matrix.orgGaétan Lepage It built successfully on my system! Running a full nixpkgs-review with cuda support right now. 13:28:48
@daniel-fahey:matrix.orgDaniel FaheyLooking forward to seeing it build on https://hydra.nixos-cuda.org hehe13:32:04
3 Oct 2025
@daniel-fahey:matrix.orgDaniel Fahey Gaétan Lepage: good morning! Think I got to the bottom of the failing Python 3.12 CPU build. Can I please have your opinion on https://github.com/NixOS/nixpkgs/pull/447722#issuecomment-3364822620 think I'll just mark Python 3.12 CPU builds as broken? 08:49:51
4 Oct 2025
@palasso:matrix.org@palasso:matrix.org left the room.10:43:55
@longregen:matrix.orglonOh btw, v0.11 is out now https://github.com/vllm-project/vllm/releases/tag/v0.11.012:33:08
@longregen:matrix.orglonThank you all for making this package work and keeping it so up to date, you rock ❤️12:33:56
@daniel-fahey:matrix.orgDaniel Fahey Gaétan Lepage: I think this PR is good to merge, let's ship 14:09:13

Show newer messages


Back to Room ListRoom Version: 9