| 24 Jan 2025 |
 connor (burnt/out) (UTC-8) | Ah yeah; do you remember if I had a draft or if you did? | 06:31:29 |
 SomeoneSerge (back on matrix) | In reply to @ss:someonex.net
https://pad.lassul.us/DwBgo1SZSzSVL29wsnK0fg# ^ | 08:52:02 |
|  @leighleighleigh:matrix.org left the room. | 20:40:08 |
| 25 Jan 2025 |
 caniko | In reply to @ss:someonex.net
CUDA support is optional. If you enable it you have to rebuild ollama. It should be cached in nix-community cachix (more specifically, (import <nixpkgs> { config.cudaSupport = true; }).ollama should be) Really? It used compile stuff in C back when I did this the last time | 14:31:28 |
| caniko | perhaps something changed? | 14:31:42 |
| caniko | I just checked, it has parts that are written in C 😄 | 14:33:59 |
| caniko | does nix get the build requirements by itself? | 14:34:35 |
| SomeoneSerge (back on matrix) | The build recipe is described in nixpkgs, and its behaviour can be modified by a few parameters: https://github.com/NixOS/nixpkgs/blob/7b0f4d83a902d8718df0f09bad5c34670b72cda6/pkgs/by-name/ol/ollama/package.nix#L32-L40 | 14:37:53 |
| SomeoneSerge (back on matrix) | (import <nixpkgs> { config.cudaSupport = true; }).ollama in nixos-unstable seems to build fine, idk about the runtime: https://hydra.nix-community.org/build/2851634 | 14:39:00 |
