| 22 Jul 2024 |
 hexa (UTC+1) | yeah, few if any consumer cards have official rocm support | 00:10:32 |
| hexa (UTC+1) | and the rx 5000 series is just broken with rocm | 00:10:56 |
 @adam:robins.wtf | updated DeviceAllow still works | 00:12:31 |
| hexa (UTC+1) | Thanks! | 00:15:30 |
| @adam:robins.wtf | you motivated me to fix my ollama setup :) | 00:23:24 |
| @adam:robins.wtf | apparently you need to listen on all interfaces if you want to put it behind a proxy? | 00:24:24 |
| hexa (UTC+1) | I just hope they get tool support going and then I can have local voice control with freeform conversations and stuff 😄 | 00:24:39 |
| hexa (UTC+1) | no, that sounds wrong | 00:24:52 |
| hexa (UTC+1) | reverse proxy implies the opposite, that the services shouldn't need to expose it self beyond localhost and to the reverse proxy | 00:25:27 |
| hexa (UTC+1) | that's why best case is unix sockets 🙂 | 00:25:37 |
| @adam:robins.wtf | actually i didn't try this on the unstable version, but on 24.05 version listening on localhost would return a 403 but on 0.0.0.0 would succeed | 00:26:52 |
| hexa (UTC+1) | odd, did you enable recommendedProxySettings in nginx, or something similar in whatever you're using? | 00:28:29 |
| @adam:robins.wtf | yeah, confirmed on usntable version as well | 00:28:30 |
| hexa (UTC+1) | X-Forwarded-For is what I'm hinting at | 00:28:38 |
| hexa (UTC+1) | Also, you would probably expose a frontend like open-webui instead, no? | 00:41:46 |
| @adam:robins.wtf | that was what i'm working on next | 00:43:17 |
| @adam:robins.wtf | open-webui works pretty well. only had to disable pkce to connect it to kanidm :/ | 01:47:59 |
| hexa (UTC+1) | it is always pkce | 02:08:28 |
| @adam:robins.wtf | Yep | 02:13:45 |
| 23 Jul 2024 |
|  sbc64 joined the room. | 03:49:16 |
|  kaya 𖤐 changed their profile picture. | 05:30:28 |
|  Ezzobir Bezziou joined the room. | 08:22:21 |
|  sellout joined the room. | 13:32:24 |
 SomeoneSerge (back on matrix) | In reply to @ss:someonex.net
Sounds like "why aren't we doing this yet?" Speaking of which, we need to stop copy-pasting this stuff because why aren't these default: https://github.com/NixOS/nixpkgs/pull/328713/files#diff-2d862bf9684df6fdface7aabf2af2b1767eb17ba2f9ab8b2e7db03d22c3c0660R196-R216 | 13:49:06 |
| SomeoneSerge (back on matrix) | Should be like a single option | 13:49:23 |
| SomeoneSerge (back on matrix) | A single option to blacklist everything, and then you add a few exceptions | 13:49:45 |
| hexa (UTC+1) | ideally | 13:58:01 |
|  @trofi:matrix.org left the room. | 19:05:15 |
| 24 Jul 2024 |
 Pascal | Does anyone else have trouble building ollama-cuda from nixos-unstable lately? | 05:14:53 |
| hexa (UTC+1) | Pascal: anything concrete that you are seeing? | 09:40:09 |
