!eWOErHSaiddIbsUNsJ:nixos.org

NixOS CUDA

309 Members
CUDA packages maintenance and support in nixpkgs | https://github.com/orgs/NixOS/projects/27/ | https://nixos.org/manual/nixpkgs/unstable/#cuda60 Servers

You have reached the beginning of time (for this room).


SenderMessageTime
26 Jul 2024
@jasonschnitzer:matrix.orgJason Schnitzer joined the room.01:35:00
@nathan72419:matrix.orgnathan72419 joined the room.16:11:45
@connorbaker:matrix.orgconnor (burnt/out) (UTC-8)As a heads up, I’m moving this week so my availability will probably be more limited than it was already for a few weeks :/16:27:09
27 Jul 2024
@phirsch:matrix.orgPascal

@SomeoneSerge (UTC+3) @ˈt͡sɛːzaɐ̯ No dice... While ollama (without '-cuda') somehow manages to get GPU serial and VRAM allocation into, it doesn't use the GPU when actually running a model (outputs 'Not compiled with GPU offload support'). And unfortunately, using 'nix run --impure' as above from within a nix shell with 'nvcc' from nixpkgs still fails because it's using nvcc from /usr/local/...

07:04:48
28 Jul 2024
@matthewcroughan:defenestrate.itmatthewcroughan changed their display name from matthewcroughan to matthewcroughan - going to nix.camp.16:12:17
29 Jul 2024
@kaya:catnip.eekaya 𖤐 changed their profile picture.07:47:57
@ironbound:hackerspace.pl@ironbound:hackerspace.pl removed their display name P_Big.14:47:13

Show newer messages


Back to Room ListRoom Version: 9