!eWOErHSaiddIbsUNsJ:nixos.org

NixOS CUDA

284 Members
CUDA packages maintenance and support in nixpkgs | https://github.com/orgs/NixOS/projects/27/ | https://nixos.org/manual/nixpkgs/unstable/#cuda59 Servers

Load older messages


SenderMessageTime
8 Dec 2025
@albertlarsan68:albertlarsan.frAlbert LarsanThat is what I do for the machines that have an Nvidia GPU, for which I eat the cost of building nix (although I have a private binary cache to which I push the closures of the updated machines before uploading the flake update to the machines)14:36:59
9 Dec 2025
@connorbaker:matrix.orgconnor (burnt/out) (UTC-8) Gaétan Lepage: SomeoneSerge (back on matrix): could one of you approve/merge https://github.com/NixOS/nixpkgs/pull/467975? 00:09:23
@ss:someonex.netSomeoneSerge (back on matrix) Robbie Buxton: have you seen https://linus.schreibt.jetzt/posts/ubuntu-images.html? Also stumbled on https://github.com/numtide/nix-vm-test while trying to remember the url 16:35:16
@ss:someonex.netSomeoneSerge (back on matrix)Nix in this case is just a tool we already had for memoization and isolation, it just happens to come with a particularly shitty scheduler16:36:28
@sporeray:matrix.orgRobbie BuxtonNo I haven’t, I’ll take a look, cheers!16:37:26
@ss:someonex.netSomeoneSerge (back on matrix)Any other memoization solution one could build must necessarily be a version of Nix (on top of the actual Nix), likely stripped down and using heuristics instead of trying to faithfully compute the hash "of that and only that which matters"... 16:38:47
@ss:someonex.netSomeoneSerge (back on matrix)Which with the current state of affairs is probably cheaper and more efficient 🤷16:39:14
@ss:someonex.netSomeoneSerge (back on matrix)But mathematically still the same thing16:39:27
@tomberek:matrix.orgtomberekAnyone using impure derivations to explicitly have non-caching behavior?16:42:29
@ss:someonex.netSomeoneSerge (back on matrix)No, that's not really useful?17:07:37
10 Dec 2025
@ss:someonex.netSomeoneSerge (back on matrix) *

No, that's not really useful?

Edit: we generally do want memoization (caching), as well as ability to deterministically name things in sentences "X succeeds (fails)". Just that so far we haven't included all relevant platform info in the derivation, so the equivalence classes are too big. It's one line fixable though

18:29:41
@ss:someonex.netSomeoneSerge (back on matrix) *

No, that's not really useful?

Edit: we generally do want memoization (caching), as well as ability to deterministically name things in sentences "X succeeds (fails)". Just that so far we haven't included all relevant platform info in the derivation, so the equivalence classes are too big. It's one line fixable though

Impure derivations just add sandboxing that needs to be bypassed, and a scheduler that is more of a liability

18:30:29
@arilotter:matrix.orgAri Lotterhm looks like vllm fails to build because outlines has a test that imports libcuda.so on collection..22:03:19
@ss:someonex.netSomeoneSerge (back on matrix)https://github.com/NixOS/nixpkgs/pull/465751#issuecomment-360411365223:30:45
@apyh:matrix.orgapyhhahaha you're already ahead of me!23:31:20
@ss:someonex.netSomeoneSerge (back on matrix)Gaetan has been on it23:32:00
@apyh:matrix.orgapyhyeah, seems like there's a clear path to patch / upstream a fix to llama cpp python to make it lazy23:33:22
@apyh:matrix.orgapyhbtw i posted logs about that torch nvrtc thing23:33:36
11 Dec 2025
@glepage:matrix.orgGaétan Lepage Yes, but it's not as straightforward as they initialize some top-level constants at module import time with the content of the loaded library...
I still think that it would be the best solution to this issue.
09:19:45
@youthlic:mozilla.orgyouthlic changed their profile picture.14:36:35
13 Dec 2025
@kaya:catnip.eekaya 𖤐 I recently found about a feature just for this: pkgsCuda
Could be the right thing for you.
23:06:15
14 Dec 2025
@tillerino:matrix.org@tillerino:matrix.org left the room.10:49:43
@suua:matrix.orgsuua joined the room.13:32:40
@ss:someonex.netSomeoneSerge (back on matrix)Not an official team stance, but personally I hope we deprecate it soon enough15:32:40
@ss:someonex.netSomeoneSerge (back on matrix)Yes!15:33:21
15 Dec 2025
@pdealbera:matrix.orgpdealbera joined the room.02:45:00
@pdealbera:matrix.orgpdealbera

Hi! I am encountering this issue when using the CUDA cache for NixOS, it probably an issue on my end but wanted to know if anybody encounter the same thing because it was working just hours ago:

warning: error: unable to download 'https://cache.nixos-cuda.org/mhf691zwwjrqi8b6an14pblyqbzwn1v2.narinfo': Could not connect to server (7) Failed to connect to cache.nixos-cuda.org port 443 after 6 ms: Could not connect to server; retrying in 258 ms

02:47:07
@hexa:lossy.networkhexa (UTC+1)looks up from here02:47:37
@hexa:lossy.networkhexa (UTC+1)might be a transient path issue02:47:46
@pdealbera:matrix.orgpdealberaDid you reproduced the same issue?02:49:57

Show newer messages


Back to Room ListRoom Version: 9