| 14 Sep 2024 |
|  SomeoneSerge (matrix works sometimes) changed their display name from SomeoneSerge (nix.camp) to SomeoneSerge (utc+3). | 11:37:51 |
|  kaya 𖤐 changed their profile picture. | 20:26:46 |
| 15 Sep 2024 |
 @adam:robins.wtf | In reply to @connorbaker:matrix.org
It is surprising to me that 0.3.5 works with CUDA 12 at all; I guess there were no breaking API changes on stuff they relied on? Ok, so I think all the version stuff was a red herring. I believe I've found the culprit, which is that this derivation isn't ending up in the final nixos system. https://github.com/NixOS/nixpkgs/blob/345c263f2f53a3710abe117f28a5cb86d0ba4059/pkgs/by-name/ol/ollama/package.nix#L122 | 17:33:36 |
| @adam:robins.wtf | I run ollama in an incus(lxc) container with the GPU passed in, but I don't build the system configuration on that host | 17:34:12 |
| @adam:robins.wtf | manually copying it over from the build hosts allows ollama to successfully work | 17:34:27 |
