!eWOErHSaiddIbsUNsJ:nixos.org

NixOS CUDA

305 Members
CUDA packages maintenance and support in nixpkgs | https://github.com/orgs/NixOS/projects/27/ | https://nixos.org/manual/nixpkgs/unstable/#cuda60 Servers

You have reached the beginning of time (for this room).


SenderMessageTime
7 Feb 2025
@ss:someonex.netSomeoneSerge (matrix works sometimes) Yes ofc. I was about to press the button but then this weird action failed even after I restarted it manually 15:23:31
@stick:matrix.orgstickis that the only thing needed to get vllm into nix-community cache?15:23:58
@ss:someonex.netSomeoneSerge (matrix works sometimes)Looks like it's happy after the rebase?15:24:01
@stick:matrix.orgstickyes, it is15:24:09
@stick:matrix.orgstickthanks for the merge!15:33:11
8 Feb 2025
@terrorjack:matrix.orgterrorjack joined the room.01:25:30
@terrorjack:matrix.orgterrorjack set a profile picture.02:24:20
@terrorjack:matrix.orgterrorjack removed their profile picture.02:24:57
@vanishingideal:matrix.orgvanishingideal joined the room.04:06:53
@mabau:matrix.org@mabau:matrix.org left the room.07:11:39
@zopieux:matrix.zopi.euzopieux

alright, we got a recent build, so I tried again. Updated to 550e11f and ran:

$ colmena build -v --show-trace --nix-option builders "" --nix-option cores 0
x | these 11 derivations will be built:
x |   /nix/store/f1s6y83hb8gdl0s49vmj0w54i5a75gd7-ollama-0.5.7.drv
x |   /nix/store/fpfv7cn50ns667qrkwx2frn26di1hnc7-ollama.service.drv
[snip]
x | building '/nix/store/f1s6y83hb8gdl0s49vmj0w54i5a75gd7-ollama-0.5.7.drv'...

even though f1s6… is right there. Is there a way to debug that nix-community is even being requested at all, perhaps?

15:36:58
@zopieux:matrix.zopi.euzopieux ok that was dumb, I should have checked nix flake show first. Something was overriding the substituters this whole time, despite my flake setting them. Sorry for the noise, it's all fine now! 16:02:13
@zopieux:matrix.zopi.euzopieux * ok that was dumb, I should have checked nix config show first. Something was overriding the substituters this whole time, despite my flake setting them. Sorry for the noise, it's all fine now! 16:02:25
@stick:matrix.orgstick

Do we want to enable aarch64-linux for cuda package set on hydra?

I think it makes sense with already available GH200 and Digits available in May

20:25:34
@stick:matrix.orgstickin the meantime I am compiling the aarch64-linux package set on my macbook, trying to remove potential build failures21:21:27
@adam:robins.wtf@adam:robins.wtf left the room.21:22:28
9 Feb 2025
@ss:someonex.netSomeoneSerge (matrix works sometimes) Yes. The only "blocker" is refactoring release-cuda.nix to support specifying jetson platforms instead of sbsa 04:21:13
@ss:someonex.netSomeoneSerge (matrix works sometimes) * Yes. The only "blocker" is refactoring release-cuda.nix to support specifying jetson platforms instead of (or in addition to? does anyone use) sbsa 04:21:29

Show newer messages


Back to Room ListRoom Version: 9