!eWOErHSaiddIbsUNsJ:nixos.org

NixOS CUDA

211 Members
CUDA packages maintenance and support in nixpkgs | https://github.com/orgs/NixOS/projects/27/ | https://nixos.org/manual/nixpkgs/unstable/#cuda42 Servers

You have reached the beginning of time (for this room).


SenderMessageTime
22 Jul 2024
@adam:robins.wtfadamcstephensyeah, confirmed on usntable version as well00:28:30
@hexa:lossy.networkhexa (UTC+1)X-Forwarded-For is what I'm hinting at00:28:38
@hexa:lossy.networkhexa (UTC+1)Also, you would probably expose a frontend like open-webui instead, no?00:41:46
@adam:robins.wtfadamcstephensthat was what i'm working on next00:43:17
@adam:robins.wtfadamcstephensopen-webui works pretty well. only had to disable pkce to connect it to kanidm :/01:47:59
@hexa:lossy.networkhexa (UTC+1)it is always pkce02:08:28
@adam:robins.wtfadamcstephens Yep 02:13:45
23 Jul 2024
@sbc64:matrix.orgsbc64 joined the room.03:49:16
@kaya:catnip.eekaya changed their profile picture.05:30:28
@ezzobirbezziou:matrix.orgEzzobir Bezziou joined the room.08:22:21
@sellout:matrix.orgsellout joined the room.13:32:24
@ss:someonex.netSomeoneSerge (utc+3)
In reply to @ss:someonex.net
Sounds like "why aren't we doing this yet?"
Speaking of which, we need to stop copy-pasting this stuff because why aren't these default: https://github.com/NixOS/nixpkgs/pull/328713/files#diff-2d862bf9684df6fdface7aabf2af2b1767eb17ba2f9ab8b2e7db03d22c3c0660R196-R216
13:49:06
@ss:someonex.netSomeoneSerge (utc+3)Should be like a single option13:49:23
@ss:someonex.netSomeoneSerge (utc+3)A single option to blacklist everything, and then you add a few exceptions13:49:45
@hexa:lossy.networkhexa (UTC+1)ideally13:58:01
@trofi:matrix.org@trofi:matrix.org left the room.19:05:15
24 Jul 2024
@phirsch:matrix.orgPascalDoes anyone else have trouble building ollama-cuda from nixos-unstable lately? 05:14:53
@hexa:lossy.networkhexa (UTC+1) Pascal: anything concrete that you are seeing? 09:40:09
@kaya:catnip.eekaya changed their profile picture.21:52:00
25 Jul 2024
@phirsch:matrix.orgPascalCompilation of nixpkgs#ollama-cuda fails with: '/nix/store/4fxpzb7rqf19r5hypxpzbf72jaa6mphw-cuda_cudart-12.2.140-dev/include/cuda_runtime.h:82:10: fatal error: crt/host_config.h: No such file or directory'05:54:18
@phirsch:matrix.orgPascal@hexa: 👆05:55:35
@phirsch:matrix.orgPascalThis is on non-NixOS (Ubuntu 22.04).06:00:40
@phirsch:matrix.orgPascal *

@hexa (UTC+1) 👆

06:02:11
@julius:mtx.liftm.deˈt͡sɛːzaɐ̯I can't reproduce that on a nixos, github:NixOS/nixpkgs/289eafaaf02177e5814d8738cf57e259f9eae46e#ollama-cuda builds fine. (should master from an ~hour ago.)06:26:48
@julius:mtx.liftm.deˈt͡sɛːzaɐ̯* I can't reproduce that on a nixos, github:NixOS/nixpkgs/289eafaaf02177e5814d8738cf57e259f9eae46e#ollama-cuda builds fine. (should master from half an ~hour ago.)06:27:09
@julius:mtx.liftm.deˈt͡sɛːzaɐ̯ * Pascal: I can't reproduce that on a nixos, github:NixOS/nixpkgs/289eafaaf02177e5814d8738cf57e259f9eae46e#ollama-cuda builds fine. (should master from half an ~hour ago.) 06:27:22
@phirsch:matrix.orgPascal
In reply to @julius:mtx.liftm.de
Pascal: I can't reproduce that on a nixos, github:NixOS/nixpkgs/289eafaaf02177e5814d8738cf57e259f9eae46e#ollama-cuda builds fine. (should master from half an ~hour ago.)
Thanks! I'll give that one a go later.
09:17:32
@phirsch:matrix.orgPascal @julius:mtx.liftm.de: Just checked: Works on NixOS, but still fails on Ubuntu (using nix run --impure). Same error: crt/host_config.h not found. Dang... it worked until 3 weeks or so ago. It fails during 'Compiling the CUDA compiler identification source file' oddly using /usr/local/cuda/bin/nvcc despite finding /nix/store/...-cuda_nvcc... 🤷‍♂️ 15:07:36
@ss:someonex.netSomeoneSerge (utc+3)
In reply to @phirsch:matrix.org
@julius:mtx.liftm.de: Just checked: Works on NixOS, but still fails on Ubuntu (using nix run --impure). Same error: crt/host_config.h not found. Dang... it worked until 3 weeks or so ago. It fails during 'Compiling the CUDA compiler identification source file' oddly using /usr/local/cuda/bin/nvcc despite finding /nix/store/...-cuda_nvcc... 🤷‍♂️
Try entering a shell with cudaPackages.cuda_nvcc I guess
15:13:03

Show newer messages


Back to Room ListRoom Version: 9