!eWOErHSaiddIbsUNsJ:nixos.org

NixOS CUDA

211 Members
CUDA packages maintenance and support in nixpkgs | https://github.com/orgs/NixOS/projects/27/ | https://nixos.org/manual/nixpkgs/unstable/#cuda42 Servers

You have reached the beginning of time (for this room).


SenderMessageTime
22 Jul 2024
@hexa:lossy.networkhexa (UTC+1)no, that sounds wrong00:24:52
@hexa:lossy.networkhexa (UTC+1)reverse proxy implies the opposite, that the services shouldn't need to expose it self beyond localhost and to the reverse proxy00:25:27
@hexa:lossy.networkhexa (UTC+1)that's why best case is unix sockets ๐Ÿ™‚ 00:25:37
@adam:robins.wtfadamcstephensactually i didn't try this on the unstable version, but on 24.05 version listening on localhost would return a 403 but on 0.0.0.0 would succeed00:26:52
@hexa:lossy.networkhexa (UTC+1)odd, did you enable recommendedProxySettings in nginx, or something similar in whatever you're using?00:28:29
@adam:robins.wtfadamcstephensyeah, confirmed on usntable version as well00:28:30
@hexa:lossy.networkhexa (UTC+1)X-Forwarded-For is what I'm hinting at00:28:38
@hexa:lossy.networkhexa (UTC+1)Also, you would probably expose a frontend like open-webui instead, no?00:41:46
@adam:robins.wtfadamcstephensthat was what i'm working on next00:43:17
@adam:robins.wtfadamcstephensopen-webui works pretty well. only had to disable pkce to connect it to kanidm :/01:47:59
@hexa:lossy.networkhexa (UTC+1)it is always pkce02:08:28
@adam:robins.wtfadamcstephens Yep 02:13:45
23 Jul 2024
@sbc64:matrix.orgsbc64 joined the room.03:49:16
@kaya:catnip.eekaya changed their profile picture.05:30:28
@ezzobirbezziou:matrix.orgEzzobir Bezziou joined the room.08:22:21
@sellout:matrix.orgsellout joined the room.13:32:24
@ss:someonex.netSomeoneSerge (utc+3)
In reply to @ss:someonex.net
Sounds like "why aren't we doing this yet?"
Speaking of which, we need to stop copy-pasting this stuff because why aren't these default: https://github.com/NixOS/nixpkgs/pull/328713/files#diff-2d862bf9684df6fdface7aabf2af2b1767eb17ba2f9ab8b2e7db03d22c3c0660R196-R216
13:49:06
@ss:someonex.netSomeoneSerge (utc+3)Should be like a single option13:49:23
@ss:someonex.netSomeoneSerge (utc+3)A single option to blacklist everything, and then you add a few exceptions13:49:45
@hexa:lossy.networkhexa (UTC+1)ideally13:58:01
@trofi:matrix.org@trofi:matrix.org left the room.19:05:15
24 Jul 2024
@phirsch:matrix.orgPascalDoes anyone else have trouble building ollama-cuda from nixos-unstable lately? 05:14:53
@hexa:lossy.networkhexa (UTC+1) Pascal: anything concrete that you are seeing? 09:40:09
@kaya:catnip.eekaya changed their profile picture.21:52:00
25 Jul 2024
@phirsch:matrix.orgPascalCompilation of nixpkgs#ollama-cuda fails with: '/nix/store/4fxpzb7rqf19r5hypxpzbf72jaa6mphw-cuda_cudart-12.2.140-dev/include/cuda_runtime.h:82:10: fatal error: crt/host_config.h: No such file or directory'05:54:18
@phirsch:matrix.orgPascal@hexa: ๐Ÿ‘†05:55:35
@phirsch:matrix.orgPascalThis is on non-NixOS (Ubuntu 22.04).06:00:40
@phirsch:matrix.orgPascal *

@hexa (UTC+1) ๐Ÿ‘†

06:02:11
@julius:mtx.liftm.deหˆtอกsษ›หzaษฬฏI can't reproduce that on a nixos, github:NixOS/nixpkgs/289eafaaf02177e5814d8738cf57e259f9eae46e#ollama-cuda builds fine. (should master from an ~hour ago.)06:26:48

Show newer messages


Back to Room ListRoom Version: 9