!eWOErHSaiddIbsUNsJ:nixos.org

NixOS CUDA

310 Members
CUDA packages maintenance and support in nixpkgs | https://github.com/orgs/NixOS/projects/27/ | https://nixos.org/manual/nixpkgs/unstable/#cuda60 Servers

You have reached the beginning of time (for this room).


SenderMessageTime
10 Sep 2024
@connorbaker:matrix.orgconnor (he/him)Can you try upgrading it as well? Looks like 0.3.10 is out now23:47:59
@adam:robins.wtf@adam:robins.wtf560.35.0323:48:19
@adam:robins.wtf@adam:robins.wtf
In reply to @connorbaker:matrix.org
Can you try upgrading it as well? Looks like 0.3.10 is out now
yeah i'll try that first
23:48:32
@connorbaker:matrix.orgconnor (he/him)Is this a NixOS system, and what GPU?23:50:19
@adam:robins.wtf@adam:robins.wtfyes, NixOS. 6700XT23:51:52
@adam:robins.wtf@adam:robins.wtf * yes, NixOS. 3060Ti23:52:05
@adam:robins.wtf@adam:robins.wtf * yes, NixOS. 306023:52:13
@adam:robins.wtf@adam:robins.wtf06:00.0 VGA compatible controller: NVIDIA Corporation GA106 [GeForce RTX 3060 Lite Hash Rate] (rev a1)23:52:25
11 Sep 2024
@adam:robins.wtf@adam:robins.wtfresults of my ollama testing are: 0.3.5 - works with cudaPackages 12_3 and 12_4 0.3.9 - works on 12_3, broken on 12_4 0.3.10 - works on 12_3, broken on 12_401:13:46
@connorbaker:matrix.orgconnor (he/him)It is surprising to me that 0.3.5 works with CUDA 12 at all; I guess there were no breaking API changes on stuff they relied on?18:05:26
12 Sep 2024
@connorbaker:matrix.orgconnor (he/him)
In reply to @connorbaker:matrix.org
So... I really don't want to have to figure out testing and stuff for OpenCV for https://github.com/NixOS/nixpkgs/pull/339619.
OpenCV 4.10 (we have 4.9) supports CUDA 12.4+. Maybe just updating it to punt the issue down the road is fine? (Our latest CUDA version right now is 12.4.)
I started writing a pkgs.testers implementation for what Serge suggested here: https://matrix.to/#/!eWOErHSaiddIbsUNsJ:nixos.org/$phSCjT-mxTap-ccF98Z7hZakHk3_-jjkPw2fIvzBhjA?via=nixos.org&via=matrix.org&via=nixos.dev
00:32:04
@connorbaker:matrix.orgconnor (he/him) SomeoneSerge (nix.camp): as a short-term thing, are you okay with me patching out OpenCV's requirement that CUDA version match so we can merge the CUDA fix? 23:30:01
@connorbaker:matrix.orgconnor (he/him)I'm in the process of implementing a tester (https://github.com/NixOS/nixpkgs/pull/341471) but it's taking a bit and I'd like OpenCV fixed (or at least buildable) with CUDA, without breaking a bunch of downstream consumers of OpenCV (like FFMPEG)23:35:35
13 Sep 2024
@kaya:catnip.eekaya 𖤐 changed their profile picture.07:16:41
@ss:someonex.netSomeoneSerge (matrix works sometimes)Sorry my availability has been limited this way10:19:52

Show newer messages


Back to Room ListRoom Version: 9