| 6 Dec 2024 |
|  kaya 𖤐 changed their profile picture. | 21:17:32 |
| 7 Dec 2024 |
 SomeoneSerge (back on matrix) | In reply to @connorbaker:matrix.org
Does anyone have a NixOS system they recommend using to test eval performance? Working on cppnix? | 01:40:03 |
 connor (burnt/out) (UTC-8) | Kind of? More like preliminary work for a talk I plan to give at Nix Planet | 06:52:28 |
| SomeoneSerge (back on matrix) | Looking forward to watch the record:) | 12:28:11 |
| 8 Dec 2024 |
| kaya 𖤐 | Hi, im attempting to upstream my nix derivation for exllamav2 from https://github.com/BatteredBunny/nix-ai-stuff/blob/main/pkgs/exllamav2.nix
For some reason its complaining about CUDA_HOME being missing even though im specifying it which im kind of confused about, i thought maybe i would replace torch with torchWithCuda but then i get some mysterious error which i dont get in the flake
Anyone had issues with anything similar? Current attempt for anyone curious https://gist.github.com/BatteredBunny/2212ac469f07244d954bf556f128cb07 | 16:42:14 |
