!eWOErHSaiddIbsUNsJ:nixos.org

NixOS CUDA

294 Members
CUDA packages maintenance and support in nixpkgs | https://github.com/orgs/NixOS/projects/27/ | https://nixos.org/manual/nixpkgs/unstable/#cuda58 Servers

You have reached the beginning of time (for this room).


SenderMessageTime
9 Dec 2025
@tomberek:matrix.orgtomberekAnyone using impure derivations to explicitly have non-caching behavior?16:42:29
@ss:someonex.netSomeoneSerge (back on matrix)No, that's not really useful?17:07:37
10 Dec 2025
@ss:someonex.netSomeoneSerge (back on matrix) *

No, that's not really useful?

Edit: we generally do want memoization (caching), as well as ability to deterministically name things in sentences "X succeeds (fails)". Just that so far we haven't included all relevant platform info in the derivation, so the equivalence classes are too big. It's one line fixable though

18:29:41
@ss:someonex.netSomeoneSerge (back on matrix) *

No, that's not really useful?

Edit: we generally do want memoization (caching), as well as ability to deterministically name things in sentences "X succeeds (fails)". Just that so far we haven't included all relevant platform info in the derivation, so the equivalence classes are too big. It's one line fixable though

Impure derivations just add sandboxing that needs to be bypassed, and a scheduler that is more of a liability

18:30:29
@arilotter:matrix.orgAri Lotterhm looks like vllm fails to build because outlines has a test that imports libcuda.so on collection..22:03:19
@ss:someonex.netSomeoneSerge (back on matrix)https://github.com/NixOS/nixpkgs/pull/465751#issuecomment-360411365223:30:45
@apyh:matrix.orgapyhhahaha you're already ahead of me!23:31:20
@ss:someonex.netSomeoneSerge (back on matrix)Gaetan has been on it23:32:00
@apyh:matrix.orgapyhyeah, seems like there's a clear path to patch / upstream a fix to llama cpp python to make it lazy23:33:22
@apyh:matrix.orgapyhbtw i posted logs about that torch nvrtc thing23:33:36
11 Dec 2025
@glepage:matrix.orgGaétan Lepage Yes, but it's not as straightforward as they initialize some top-level constants at module import time with the content of the loaded library...
I still think that it would be the best solution to this issue.
09:19:45
@youthlic:mozilla.orgyouthlic changed their profile picture.14:36:35
13 Dec 2025
@kaya:catnip.eekaya 𖤐 I recently found about a feature just for this: pkgsCuda
Could be the right thing for you.
23:06:15
14 Dec 2025
@tillerino:matrix.org@tillerino:matrix.org left the room.10:49:43
@suua:matrix.orgsuua joined the room.13:32:40
@ss:someonex.netSomeoneSerge (back on matrix)Not an official team stance, but personally I hope we deprecate it soon enough15:32:40
@ss:someonex.netSomeoneSerge (back on matrix)Yes!15:33:21
15 Dec 2025
@pdealbera:matrix.orgpdealbera joined the room.02:45:00
@pdealbera:matrix.orgpdealbera

Hi! I am encountering this issue when using the CUDA cache for NixOS, it probably an issue on my end but wanted to know if anybody encounter the same thing because it was working just hours ago:

warning: error: unable to download 'https://cache.nixos-cuda.org/mhf691zwwjrqi8b6an14pblyqbzwn1v2.narinfo': Could not connect to server (7) Failed to connect to cache.nixos-cuda.org port 443 after 6 ms: Could not connect to server; retrying in 258 ms

02:47:07
@hexa:lossy.networkhexalooks up from here02:47:37
@hexa:lossy.networkhexamight be a transient path issue02:47:46

Show newer messages


Back to Room ListRoom Version: 9