!eWOErHSaiddIbsUNsJ:nixos.org

NixOS CUDA

282 Members
CUDA packages maintenance and support in nixpkgs | https://github.com/orgs/NixOS/projects/27/ | https://nixos.org/manual/nixpkgs/unstable/#cuda58 Servers

Load older messages


SenderMessageTime
24 Sep 2025
@apyh:matrix.orgapyhok cool yeah then if you PR the missing gcc I'll see what else is missing in my setup :)21:21:09
@apyh:matrix.orgapyh
In reply to @sporeray:matrix.org
I’m confused why triton is struggling to find cuda tho
triton runs /sbin/ldconfig to find it
21:21:32
@apyh:matrix.orgapyhwhich doesn't exist under nixos / nix built docker images 21:21:47
@sporeray:matrix.orgRobbie Buxton I run triton on non NixOS and haven’t had issues 21:22:07
@sporeray:matrix.orgRobbie BuxtonDo you have a minimum repro or is it literally failing on import21:22:22
@apyh:matrix.orgapyhlike, calling torch.compile() fails 21:22:49
@apyh:matrix.orgapyhsec21:22:50
@sporeray:matrix.orgRobbie Buxton Maybe we should start a private chat to avoid spamming 21:23:17
@ss:someonex.netSomeoneSerge (back on matrix)I presume it's the -bin version of tensorflow, which means it's patchelfed to use whatever versions of things we've got and inshallah it happens to work?22:43:11
@ss:someonex.netSomeoneSerge (back on matrix)Didn't we recently change triton so it doesn't retain the reference to gcc?22:44:50
@ss:someonex.netSomeoneSerge (back on matrix)all of this should be patched out, maybe it slipped back in during updates22:46:17
@sporeray:matrix.orgRobbie Buxton
In reply to @ss:someonex.net
Didn't we recently change triton so it doesn't retain the reference to gcc?
This is a different flow that goes via _inductor/config.py, I’ll put the pr in tomorrow once torch finishes building
22:47:41
25 Sep 2025
@winter:catgirl.cloudWinter this is python3Packages.tensorflow 14:51:03
@winter:catgirl.cloudWinter but it appears that the _pywrap_... it's looking at is different because I have some stuff in LDLIBRARYPATH lol 14:51:42
@winter:catgirl.cloudWinter but it appears that the _pywrap_... it's looking at is different because I have some stuff in LD_LIBRARY_PATH lol 14:51:49
@winter:catgirl.cloudWinteri should dig into it at some point14:52:06
@winter:catgirl.cloudWinterout of curiosity/insanity?14:52:13
@winter:catgirl.cloudWinter* out of curiosity/insanity? (both?)14:52:23
@connorbaker:matrix.orgconnor (he/him)To clarify, are you building PyTorch and Triton with Nix and producing a container, or is this something else? I’d also like to see a reproducer of you have one handy15:07:20
@connorbaker:matrix.orgconnor (he/him)here be the path to (more) madness15:08:12
@apyh:matrix.orgapyh
In reply to @connorbaker:matrix.org
To clarify, are you building PyTorch and Triton with Nix and producing a container, or is this something else? I’d also like to see a reproducer of you have one handy
I'm building a container that includes PyTorch as a runtime dependency, and that PyTorch code calls torch.compile. Let me try to create a minimal repro :)
15:30:19
@apyh:matrix.orgapyhhttps://github.com/arilotter/nix-torch-compile a minimal repro !16:31:15
@apyh:matrix.orgapyhthis includes both things needed to run torch.compile inside a docker container 16:31:30
@hexa:lossy.networkhexaflox stable nixpkgs is still stuck on aug 27th https://github.com/flox/nixpkgs16:50:13
@hexa:lossy.networkhexanot sure who can effectively poke them16:50:23
@sporeray:matrix.orgRobbie Buxton @apyh pr is here https://github.com/NixOS/nixpkgs/pull/446105 17:36:25
@ss:someonex.netSomeoneSerge (back on matrix) Yes, I'm really embarrassed to say, but python3Packages.tensorflow has been defaulting to tensorlfow-bin for about a year now... and from what I've heard, even that is a PITA during upgrades 23:30:50
@ss:someonex.netSomeoneSerge (back on matrix)Soooo turns out flox-stable has nothing to do with nixos-stable23:31:25
@hexa:lossy.networkhexaso what do they build for nixos-stable then?23:32:29
@ss:someonex.netSomeoneSerge (back on matrix)It's a tad confusing, but uhh they follow nixos-unstable, and when it passes the tests, they merge it into flox/staging, and when that passes more tests that's merged into flox/stable 🙃23:32:45

Show newer messages


Back to Room ListRoom Version: 9