| 26 Jul 2024 |
 connor (he/him) | As a heads up, I’m moving this week so my availability will probably be more limited than it was already for a few weeks :/ | 16:27:09 |
| 27 Jul 2024 |
 Pascal | @SomeoneSerge (UTC+3) @ˈt͡sɛːzaɐ̯ No dice... While ollama (without '-cuda') somehow manages to get GPU serial and VRAM allocation into, it doesn't use the GPU when actually running a model (outputs 'Not compiled with GPU offload support'). And unfortunately, using 'nix run --impure' as above from within a nix shell with 'nvcc' from nixpkgs still fails because it's using nvcc from /usr/local/...
| 07:04:48 |
| 28 Jul 2024 |
|  matthewcroughan changed their display name from matthewcroughan to matthewcroughan - going to nix.camp. | 16:12:17 |
| 29 Jul 2024 |
|  kaya 𖤐 changed their profile picture. | 07:47:57 |
|  @ironbound:hackerspace.pl removed their display name P_Big. | 14:47:13 |
| @ironbound:hackerspace.pl removed their profile picture. | 14:47:26 |
| 30 Jul 2024 |
 srhb | I'm waving around a big hammer here. Does anyone want to save cuda-modules/aliases.nix? 😁
https://github.com/NixOS/nixpkgs/pull/331017 | 05:57:45 |
 SomeoneSerge (back on matrix) | In reply to @srhb:matrix.org
I'm waving around a big hammer here. Does anyone want to save cuda-modules/aliases.nix? 😁
https://github.com/NixOS/nixpkgs/pull/331017 Yes we want to save aliases. I think the solution should be to ensure these attributes are kept lazy, not to remove them | 07:06:42 |
| srhb | Sad. Alright, I'll draft them :) | 07:06:57 |
| srhb | The aliases I nuked are still OK to go by now, right? | 07:07:11 |
| SomeoneSerge (back on matrix) | I need to fetch my laptop:) | 07:07:36 |
| srhb | And laziness won't save that torch check, right? (equality has no choice but to strict) | 07:07:54 |
| srhb | Though I suppose I could exempt those exact attributes in the torch check. Lots of spooky action at a distance though. | 07:09:22 |
| SomeoneSerge (back on matrix) | Ooh, that, the package set comparison. I forgot it was there | 07:10:30 |
| srhb | I understand why it's there, but I think it should go. | 07:11:48 |
| SomeoneSerge (back on matrix) | Yea the check is quite a bit of a heuristic actually | 07:12:14 |
| SomeoneSerge (back on matrix) | In reply to @srhb:matrix.org
The aliases I nuked are still OK to go by now, right? Yes agreed | 07:12:48 |
| srhb | So my preferred choice of action would be to a) nuke the old aliases, b) keep the alias infrastructure, and ideally c) remove that torch check, because any aliasing will just reintroduce this problem across all tooling that touches torch, producing warnings that may be completely irrelevant as they are in this case. | 07:13:59 |
| SomeoneSerge (back on matrix) | Commented on github | 07:19:31 |
| SomeoneSerge (back on matrix) | And thanks a lot for picking up the shovel... | 07:20:20 |
| srhb | No problem, thanks for the response :D | 07:26:53 |
 Philip Taron (UTC-8) | SomeoneSerge (UTC+3): I'm taking a look at your llama.cpp PR. The TODO makes me think that it's in draft actually. Is that the case? | 18:22:57 |
| SomeoneSerge (back on matrix) | I mean it's more of a sanity check, I tested this with a bunch of packages in nixpkgs and generally the closures got smaller | 18:23:47 |
| Philip Taron (UTC-8) | I generally check closure size with nix path-info. Do you do that, or something else? | 18:24:13 |
| Philip Taron (UTC-8) | On another topic, I see a lot of build spam when building llama.cpp about "nvcc warning : incompatible redefinition for option 'compiler-bindir', the last value of this option was used."
I'd like to remove that. Is there a pointer you have to get started there? | 18:25:46 |
| Philip Taron (UTC-8) | In reply to @philiptaron:matrix.org
I generally check closure size with nix path-info. Do you do that, or something else? Using nix path-info results in identical closure sizes. | 18:35:31 |
| SomeoneSerge (back on matrix) | In reply to @philiptaron:matrix.org
On another topic, I see a lot of build spam when building llama.cpp about "nvcc warning : incompatible redefinition for option 'compiler-bindir', the last value of this option was used."
I'd like to remove that. Is there a pointer you have to get started there? Yeah it's somehwere in the setupCudaHook, I believe connor (he/him) (UTC-5) had actually located the source at some point? | 20:40:53 |
| 31 Jul 2024 |
| SomeoneSerge (back on matrix) | connor (he/him) (UTC-5) you might want to know that https://github.com/NixOS/nixpkgs/pull/318614 exists | 07:57:55 |
| connor (he/him) | Oh hell yeah | 15:21:27 |
| Philip Taron (UTC-8) | That's a baller PR. | 19:06:12 |
