| 25 Jan 2025 |
caniko | OK, very cool. Thank you | 14:41:56 |
caniko | will you work towards caching ollama with cuda? | 14:42:12 |
SomeoneSerge (back on matrix) | The build results of this hydra instance are cached in https://nix-community.org/cache/ | 14:42:43 |
caniko | wow, it is cached already 😄 | 14:43:27 |
caniko | OK, great. | 14:43:36 |
SomeoneSerge (back on matrix) | Yes, thanks to the community-funded nix-community project: https://discourse.nixos.org/t/cuda-cache-for-nix-community/56038 | 15:01:25 |
connor (burnt/out) (UTC-8) | Good news: I got some experience writing tests for setup hooks in https://github.com/NixOS/nixpkgs/pull/370750, so I’m writing tests this weekend for the CUDA setup hooks I have in https://github.com/ConnorBaker/cuda-packages | 18:58:37 |
connor (burnt/out) (UTC-8) | Kevin Mittman: I don’t know if you’re able to raise this internally, but https://docs.nvidia.com/cuda/cuda-toolkit-release-notes/index.html#deprecated-toolchains seems like it should have a list of toolchains or something instead of being empty. Are you able to, or would you mind, seeing if it’s supposed to be empty? | 19:03:47 |
| 26 Jan 2025 |
hexa (UTC+1) | wandb build failure on python-updates https://hydra.lossy.network/build/2649332 | 22:26:22 |
hexa (UTC+1) | not sure anyone here cares about that, but samuela used to | 22:26:52 |
| 27 Jan 2025 |
Kevin Mittman (UTC-8) | In reply to @connorbaker:matrix.org Kevin Mittman: I don’t know if you’re able to raise this internally, but https://docs.nvidia.com/cuda/cuda-toolkit-release-notes/index.html#deprecated-toolchains seems like it should have a list of toolchains or something instead of being empty. Are you able to, or would you mind, seeing if it’s supposed to be empty? Fixed (for some definition of that) | 06:08:56 |
connor (burnt/out) (UTC-8) | I'm treating that doc as meeting notes -- I started drafting an update here: https://pad.lassul.us/ptoW_p-KSPWlD7Ep2Bx66A
Did we ever have an announcement anywhere about CUDA packages being available through the nix-community cache? | 23:10:44 |
| 29 Jan 2025 |
| matthewcroughan changed their display name from matthewcroughan to matthewcroughan (already in Brussels). | 13:35:17 |
| 30 Jan 2025 |
Gaétan Lepage | Which package provides libcusparseLt.so.0 ? | 14:45:19 |
Gaétan Lepage | I tried lib.getLib cudaPackages.libcusparse but it doesn't have it. | 14:46:25 |
Gaétan Lepage | Looks like we need to wait for https://github.com/NixOS/nixpkgs/pull/306172 | 14:50:07 |
ruro | Can somebody review/merge this PR https://github.com/NixOS/nixpkgs/pull/371640 please? | 16:22:09 |
ruro | Also, I occasionally have some free time and I would like to spend it on improving the state of CUDA in nixpkgs/NixOS. Do you have any suggestions for which issues I should start with? Alternatively, I could just start going down the list of eval/build failures on the nix-community CUDA builder... | 16:24:29 |
ruro | * I occasionally have some free time and I would like to spend it on improving the state of CUDA in nixpkgs/NixOS. Do you have any suggestions for which issues I should start with? Alternatively, I could just start going down the list of eval/build failures on the nix-community CUDA builder... | 16:24:46 |
ruro | * I occasionally have some free time and I would like to spend it on improving the state of CUDA in nixpkgs/NixOS. Do you have any suggestions for which issues I should start with?
I am not a complete newbie, but I haven't contributed to nixpkgs all that much (above PR is my third). I guess, I could just start going down the list of eval/build failures on the nix-community CUDA builder... but that might end up just being treadmill work. | 16:28:22 |
ruro | * I occasionally have some free time and I would like to spend it on improving the state of CUDA in nixpkgs/NixOS. Do you have any suggestions for which issues I should start with?
I am not a complete newbie, but I haven't contributed to nixpkgs all that much (the above-mentioned PR is my third). I guess, I could just start going down the list of eval/build failures on the nix-community CUDA builder... but that might end up just being treadmill work. | 16:47:05 |
connor (burnt/out) (UTC-8) | In reply to @glepage:matrix.org Looks like we need to wait for https://github.com/NixOS/nixpkgs/pull/306172 I meant to close that since I’ll make a new PR for the CUDA-packages work | 16:47:34 |
Gaétan Lepage | Ok Connor. Do we have a short-term alternative to get this library ? | 16:48:28 |
connor (burnt/out) (UTC-8) | Depends on what you mean by short term :( | 16:53:34 |
connor (burnt/out) (UTC-8) | I should have everything landed by 25.05 but I suppose we’ll need it prior to that | 16:54:03 |
connor (burnt/out) (UTC-8) | I guess I can start trying to land things, but it’ll cause some breakages and I don’t have docs written yet | 16:54:43 |
Gaétan Lepage | I'm asking for pytorch (https://github.com/NixOS/nixpkgs/pull/377785). There is no emergency and we can surely wait before updating it. | 16:56:39 |
connor (burnt/out) (UTC-8) | Ugh didn’t they also remove support for CUDA 12.1 | 16:58:19 |
connor (burnt/out) (UTC-8) | Also I think they support newer architectures now (maybe Blackwell?) | 16:58:36 |
Gaétan Lepage | In reply to @connorbaker:matrix.org Ugh didn’t they also remove support for CUDA 12.1 From the CI at least: https://github.com/pytorch/pytorch/pull/141271, https://github.com/pytorch/pytorch/pull/142177 | 16:59:51 |