| 7 Mar 2025 |
 SomeoneSerge (matrix works sometimes) | https://hydra.nix-community.org/job/nixpkgs/cuda/llama-cpp.x86_64-linux | 13:15:55 |
| SomeoneSerge (matrix works sometimes) | https://hydra.nix-community.org/job/nixpkgs/cuda/onnxruntime.x86_64-linux | 13:16:26 |
| SomeoneSerge (matrix works sometimes) | open-webui apparently wasn't added to the release-cuda.nix file yet: https://hydra.nix-community.org/job/nixpkgs/cuda/open-webui.x86_64-linuxd | 13:17:10 |
| SomeoneSerge (matrix works sometimes) | As for onnxruntime and llama-cpp, let's compare the hashes in your llama-cpp and the one reported by hydra | 13:18:20 |
 mdietrich | I am on x86_64, nixos-unstable with flakes with an RTX 3060 Ti and following substituters:
substituters = [
"https://nix-community.cachix.org"
];
trusted-public-keys = [
"nix-community.cachix.org-1:mB9FSh9qf2dCimDSUo8Zy7bkq5CX+/rkCWyvRCYg3Fs="
];
| 13:19:29 |
| mdietrich | Thank you for your quick answer | 13:20:01 |
| mdietrich | I think onnxruntime is a dependency of open-webui and not llama-cpp, open-webui itself probably (?) does not need cuda support itself | 13:20:45 |
| mdietrich | services.llama-cpp.package has the value "«derivation /nix/store/dhqdwqp6akr6h6f1k3rz190m3syrv6iy-llama-cpp-4731.drv»" | 13:23:06 |
| SomeoneSerge (matrix works sometimes) | Let's try nix path-info --override-input nixpkgs github:NixOS/nixpkgs/1d2fe0135f360c970aee1d57a53f816f3c9bddae --derivation .#nixosConfigurations.$(hostname).config.services.llama-cpp.package to make it comparable with https://hydra.nix-community.org/build/3552955#tabs-buildinputs | 13:24:11 |
| SomeoneSerge (matrix works sometimes) | I'd maybe not focus on these concerns, the expert hours are arguably more expensive that rebuild costs | 13:25:27 |
| SomeoneSerge (matrix works sometimes) | (still pending =) | 13:25:51 |
