| 24 Jan 2025 |
 SomeoneSerge (back on matrix) | In reply to @ss:someonex.net
https://pad.lassul.us/DwBgo1SZSzSVL29wsnK0fg# ^ | 08:52:02 |
|  @leighleighleigh:matrix.org left the room. | 20:40:08 |
| 25 Jan 2025 |
 caniko | In reply to @ss:someonex.net
CUDA support is optional. If you enable it you have to rebuild ollama. It should be cached in nix-community cachix (more specifically, (import <nixpkgs> { config.cudaSupport = true; }).ollama should be) Really? It used compile stuff in C back when I did this the last time | 14:31:28 |
| caniko | perhaps something changed? | 14:31:42 |
| caniko | I just checked, it has parts that are written in C 😄 | 14:33:59 |
| caniko | does nix get the build requirements by itself? | 14:34:35 |
| SomeoneSerge (back on matrix) | The build recipe is described in nixpkgs, and its behaviour can be modified by a few parameters: https://github.com/NixOS/nixpkgs/blob/7b0f4d83a902d8718df0f09bad5c34670b72cda6/pkgs/by-name/ol/ollama/package.nix#L32-L40 | 14:37:53 |
| SomeoneSerge (back on matrix) | (import <nixpkgs> { config.cudaSupport = true; }).ollama in nixos-unstable seems to build fine, idk about the runtime: https://hydra.nix-community.org/build/2851634 | 14:39:00 |
| caniko | OK, very cool. Thank you | 14:41:56 |
| caniko | will you work towards caching ollama with cuda? | 14:42:12 |
| SomeoneSerge (back on matrix) | The build results of this hydra instance are cached in https://nix-community.org/cache/ | 14:42:43 |
| caniko | wow, it is cached already 😄 | 14:43:27 |
| caniko | OK, great. | 14:43:36 |
| SomeoneSerge (back on matrix) | Yes, thanks to the community-funded nix-community project: https://discourse.nixos.org/t/cuda-cache-for-nix-community/56038 | 15:01:25 |
 connor (he/him) | Good news: I got some experience writing tests for setup hooks in https://github.com/NixOS/nixpkgs/pull/370750, so I’m writing tests this weekend for the CUDA setup hooks I have in https://github.com/ConnorBaker/cuda-packages | 18:58:37 |
| connor (he/him) | Kevin Mittman: I don’t know if you’re able to raise this internally, but https://docs.nvidia.com/cuda/cuda-toolkit-release-notes/index.html#deprecated-toolchains seems like it should have a list of toolchains or something instead of being empty. Are you able to, or would you mind, seeing if it’s supposed to be empty? | 19:03:47 |
| 26 Jan 2025 |
 hexa | wandb build failure on python-updates https://hydra.lossy.network/build/2649332 | 22:26:22 |
| hexa | not sure anyone here cares about that, but samuela used to | 22:26:52 |
| 27 Jan 2025 |
 Kevin Mittman (UTC-8) | In reply to @connorbaker:matrix.org
Kevin Mittman: I don’t know if you’re able to raise this internally, but https://docs.nvidia.com/cuda/cuda-toolkit-release-notes/index.html#deprecated-toolchains seems like it should have a list of toolchains or something instead of being empty. Are you able to, or would you mind, seeing if it’s supposed to be empty? Fixed (for some definition of that) | 06:08:56 |
| connor (he/him) | I'm treating that doc as meeting notes -- I started drafting an update here: https://pad.lassul.us/ptoW_p-KSPWlD7Ep2Bx66A
Did we ever have an announcement anywhere about CUDA packages being available through the nix-community cache? | 23:10:44 |
| 29 Jan 2025 |
|  matthewcroughan changed their display name from matthewcroughan to matthewcroughan (already in Brussels). | 13:35:17 |
| 30 Jan 2025 |
 Gaétan Lepage | Which package provides libcusparseLt.so.0 ? | 14:45:19 |
| Gaétan Lepage | I tried lib.getLib cudaPackages.libcusparse but it doesn't have it. | 14:46:25 |
| Gaétan Lepage | Looks like we need to wait for https://github.com/NixOS/nixpkgs/pull/306172 | 14:50:07 |
 ruro | Can somebody review/merge this PR https://github.com/NixOS/nixpkgs/pull/371640 please? | 16:22:09 |
| ruro | Also, I occasionally have some free time and I would like to spend it on improving the state of CUDA in nixpkgs/NixOS. Do you have any suggestions for which issues I should start with? Alternatively, I could just start going down the list of eval/build failures on the nix-community CUDA builder... | 16:24:29 |
| ruro | * I occasionally have some free time and I would like to spend it on improving the state of CUDA in nixpkgs/NixOS. Do you have any suggestions for which issues I should start with? Alternatively, I could just start going down the list of eval/build failures on the nix-community CUDA builder... | 16:24:46 |
| ruro | * I occasionally have some free time and I would like to spend it on improving the state of CUDA in nixpkgs/NixOS. Do you have any suggestions for which issues I should start with?
I am not a complete newbie, but I haven't contributed to nixpkgs all that much (above PR is my third). I guess, I could just start going down the list of eval/build failures on the nix-community CUDA builder... but that might end up just being treadmill work. | 16:28:22 |
| ruro | * I occasionally have some free time and I would like to spend it on improving the state of CUDA in nixpkgs/NixOS. Do you have any suggestions for which issues I should start with?
I am not a complete newbie, but I haven't contributed to nixpkgs all that much (the above-mentioned PR is my third). I guess, I could just start going down the list of eval/build failures on the nix-community CUDA builder... but that might end up just being treadmill work. | 16:47:05 |
| connor (he/him) | In reply to @glepage:matrix.org
Looks like we need to wait for https://github.com/NixOS/nixpkgs/pull/306172 I meant to close that since I’ll make a new PR for the CUDA-packages work | 16:47:34 |
