22 Jul 2024 |
adamcstephens | yeah, confirmed on usntable version as well | 00:28:30 |
hexa (UTC+1) | X-Forwarded-For is what I'm hinting at | 00:28:38 |
hexa (UTC+1) | Also, you would probably expose a frontend like open-webui instead, no? | 00:41:46 |
adamcstephens | that was what i'm working on next | 00:43:17 |
adamcstephens | open-webui works pretty well. only had to disable pkce to connect it to kanidm :/ | 01:47:59 |
hexa (UTC+1) | it is always pkce | 02:08:28 |
adamcstephens | Yep | 02:13:45 |
23 Jul 2024 |
| sbc64 joined the room. | 03:49:16 |
| kaya changed their profile picture. | 05:30:28 |
| Ezzobir Bezziou joined the room. | 08:22:21 |
| sellout joined the room. | 13:32:24 |
SomeoneSerge (utc+3) | In reply to @ss:someonex.net Sounds like "why aren't we doing this yet?" Speaking of which, we need to stop copy-pasting this stuff because why aren't these default: https://github.com/NixOS/nixpkgs/pull/328713/files#diff-2d862bf9684df6fdface7aabf2af2b1767eb17ba2f9ab8b2e7db03d22c3c0660R196-R216 | 13:49:06 |
SomeoneSerge (utc+3) | Should be like a single option | 13:49:23 |
SomeoneSerge (utc+3) | A single option to blacklist everything, and then you add a few exceptions | 13:49:45 |
hexa (UTC+1) | ideally | 13:58:01 |
| @trofi:matrix.org left the room. | 19:05:15 |
24 Jul 2024 |
Pascal | Does anyone else have trouble building ollama-cuda from nixos-unstable lately? | 05:14:53 |
hexa (UTC+1) | Pascal: anything concrete that you are seeing? | 09:40:09 |
| kaya changed their profile picture. | 21:52:00 |
25 Jul 2024 |
Pascal | Compilation of nixpkgs#ollama-cuda fails with: '/nix/store/4fxpzb7rqf19r5hypxpzbf72jaa6mphw-cuda_cudart-12.2.140-dev/include/cuda_runtime.h:82:10: fatal error: crt/host_config.h: No such file or directory' | 05:54:18 |
Pascal | @hexa: 👆 | 05:55:35 |
Pascal | This is on non-NixOS (Ubuntu 22.04). | 06:00:40 |
Pascal | * @hexa (UTC+1) 👆
| 06:02:11 |
ˈt͡sɛːzaɐ̯ | I can't reproduce that on a nixos, github:NixOS/nixpkgs/289eafaaf02177e5814d8738cf57e259f9eae46e#ollama-cuda builds fine. (should master from an ~hour ago.) | 06:26:48 |
ˈt͡sɛːzaɐ̯ | * I can't reproduce that on a nixos, github:NixOS/nixpkgs/289eafaaf02177e5814d8738cf57e259f9eae46e#ollama-cuda builds fine. (should master from half an ~hour ago.) | 06:27:09 |
ˈt͡sɛːzaɐ̯ | * Pascal: I can't reproduce that on a nixos, github:NixOS/nixpkgs/289eafaaf02177e5814d8738cf57e259f9eae46e#ollama-cuda builds fine. (should master from half an ~hour ago.) | 06:27:22 |
Pascal | In reply to @julius:mtx.liftm.de Pascal: I can't reproduce that on a nixos, github:NixOS/nixpkgs/289eafaaf02177e5814d8738cf57e259f9eae46e#ollama-cuda builds fine. (should master from half an ~hour ago.) Thanks! I'll give that one a go later. | 09:17:32 |
Pascal | @julius:mtx.liftm.de: Just checked: Works on NixOS, but still fails on Ubuntu (using nix run --impure). Same error: crt/host_config.h not found. Dang... it worked until 3 weeks or so ago.
It fails during 'Compiling the CUDA compiler identification source file' oddly using /usr/local/cuda/bin/nvcc despite finding /nix/store/...-cuda_nvcc... 🤷♂️ | 15:07:36 |
SomeoneSerge (utc+3) | In reply to @phirsch:matrix.org @julius:mtx.liftm.de: Just checked: Works on NixOS, but still fails on Ubuntu (using nix run --impure). Same error: crt/host_config.h not found. Dang... it worked until 3 weeks or so ago.
It fails during 'Compiling the CUDA compiler identification source file' oddly using /usr/local/cuda/bin/nvcc despite finding /nix/store/...-cuda_nvcc... 🤷♂️ Try entering a shell with cudaPackages.cuda_nvcc I guess | 15:13:03 |