!eWOErHSaiddIbsUNsJ:nixos.org

NixOS CUDA

321 Members
CUDA packages maintenance and support in nixpkgs | https://github.com/orgs/NixOS/projects/27/ | https://nixos.org/manual/nixpkgs/unstable/#cuda63 Servers

You have reached the beginning of time (for this room).


SenderMessageTime
29 Dec 2025
@aliarokapis:matrix.orgAlexandros Liarokapis* I was thinking there is an authoritative source of all needed kernel-driver bound libraries and that is the nvidia container toolkit. One could mimic the search procedure and auto implement a /run/opengl symlinker for nix standalone systems and oci containers00:08:05
@aliarokapis:matrix.orgAlexandros Liarokapis* I was thinking there is an authoritative source of all needed kernel-driver bound libraries and that is the nvidia container toolkit. One could mimic the search procedure and implement an automatic :run/opengl symlinker for nix standalone systems and oci containers00:08:23
@aliarokapis:matrix.orgAlexandros Liarokapis* I was thinking there is an authoritative source of all needed kernel-driver bound libraries and that is the nvidia container toolkit. One could mimic the search procedure and implement an automatic /run/opengl symlinker for nix standalone systems and oci containers00:08:29
@aliarokapis:matrix.orgAlexandros Liarokapis* I was thinking there is an authoritative source of all needed kernel-driver bound libraries and that is the nvidia container toolkit. One could mimic the search procedure and implement an automatic /run/opengl l-driver symlinker for nix standalone systems and oci containers00:08:40
@aliarokapis:matrix.orgAlexandros Liarokapis* I was thinking there is an authoritative source of all needed kernel-driver bound libraries and that is the nvidia container toolkit. One could mimic the search procedure and implement an automatic /run/opengl-driver symlinker for nix standalone systems and oci containers00:08:51
@apyh:matrix.orgapyhyeah, they are. most folks will use nixgl or nixglhost to work around this00:09:12
@apyh:matrix.orgapyhi use nixglhost wrappers for my binaries in oci containers00:09:25
@aliarokapis:matrix.orgAlexandros LiarokapisI was thinking of the issues specified here https://github.com/soupglasses/nix-system-graphics#but-why-another-nix-with-opengl-project00:10:57
@aliarokapis:matrix.orgAlexandros LiarokapisNow nix system graphics is a nice approach but has the limitation of having to specify the nvidia driver version in a system manager config to switch it is not automatic which really hurts usability00:13:06
@aliarokapis:matrix.orgAlexandros LiarokapisI was thinking something more in the lines of actually generating the symlink farm populating with the proper host system library symlinks00:18:17
@aliarokapis:matrix.orgAlexandros LiarokapisWould probably also work for mesa on nix standalone systems as well00:19:29
@aliarokapis:matrix.orgAlexandros LiarokapisOne could probably directly reuse the discovery functionality of the nvidia container toolkit go library00:29:52
@aliarokapis:matrix.orgAlexandros Liarokapis* One could probably directly reuse the discovery functionality of the nvidia container toolkit go library (or flatboat or similar)00:49:05
@aliarokapis:matrix.orgAlexandros Liarokapis* One could probably directly reuse the discovery functionality of the nvidia container toolkit go library (or flatpak or similar)00:49:13
@glepage:matrix.orgGaƩtan Lepage Hi!
I finally found some time to work on the llama-cpp-python-libcuda.so-stubs-missing bug and fixed outlines by skipping its pythonImportsCheckHook and tests when cudaSupport was enabled.
This allowed me to finally unblock the vllm bump.
It builds fine with and without cudaSupport. Feel free to test/review: https://github.com/NixOS/nixpkgs/pull/467418
17:36:41

Show newer messages


Back to Room ListRoom Version: 9