| 10 Sep 2024 |
connor (he/him) | Can you try upgrading it as well? Looks like 0.3.10 is out now | 23:47:59 |
@adam:robins.wtf | 560.35.03 | 23:48:19 |
@adam:robins.wtf | In reply to @connorbaker:matrix.org Can you try upgrading it as well? Looks like 0.3.10 is out now yeah i'll try that first | 23:48:32 |
connor (he/him) | Is this a NixOS system, and what GPU? | 23:50:19 |
@adam:robins.wtf | yes, NixOS. 6700XT | 23:51:52 |
@adam:robins.wtf | * yes, NixOS. 3060Ti | 23:52:05 |
@adam:robins.wtf | * yes, NixOS. 3060 | 23:52:13 |
@adam:robins.wtf | 06:00.0 VGA compatible controller: NVIDIA Corporation GA106 [GeForce RTX 3060 Lite Hash Rate] (rev a1) | 23:52:25 |
| 11 Sep 2024 |
@adam:robins.wtf | results of my ollama testing are:
0.3.5 - works with cudaPackages 12_3 and 12_4
0.3.9 - works on 12_3, broken on 12_4
0.3.10 - works on 12_3, broken on 12_4 | 01:13:46 |
connor (he/him) | It is surprising to me that 0.3.5 works with CUDA 12 at all; I guess there were no breaking API changes on stuff they relied on? | 18:05:26 |
| 12 Sep 2024 |
connor (he/him) | In reply to @connorbaker:matrix.org So... I really don't want to have to figure out testing and stuff for OpenCV for https://github.com/NixOS/nixpkgs/pull/339619. OpenCV 4.10 (we have 4.9) supports CUDA 12.4+. Maybe just updating it to punt the issue down the road is fine? (Our latest CUDA version right now is 12.4.) I started writing a pkgs.testers implementation for what Serge suggested here: https://matrix.to/#/!eWOErHSaiddIbsUNsJ:nixos.org/$phSCjT-mxTap-ccF98Z7hZakHk3_-jjkPw2fIvzBhjA?via=nixos.org&via=matrix.org&via=nixos.dev | 00:32:04 |
connor (he/him) | SomeoneSerge (nix.camp): as a short-term thing, are you okay with me patching out OpenCV's requirement that CUDA version match so we can merge the CUDA fix? | 23:30:01 |
connor (he/him) | I'm in the process of implementing a tester (https://github.com/NixOS/nixpkgs/pull/341471) but it's taking a bit and I'd like OpenCV fixed (or at least buildable) with CUDA, without breaking a bunch of downstream consumers of OpenCV (like FFMPEG) | 23:35:35 |
| 13 Sep 2024 |
| kaya 𖤐 changed their profile picture. | 07:16:41 |
SomeoneSerge (matrix works sometimes) | Sorry my availability has been limited this way | 10:19:52 |