!eWOErHSaiddIbsUNsJ:nixos.org

NixOS CUDA

288 Members
CUDA packages maintenance and support in nixpkgs | https://github.com/orgs/NixOS/projects/27/ | https://nixos.org/manual/nixpkgs/unstable/#cuda58 Servers

Load older messages


SenderMessageTime
28 Dec 2025
@aliarokapis:matrix.orgAlexandros LiarokapisAre nixpkgs built packages reliant on /run/opengl-driver to find libcuda.so.1 on non-nixos systems as well?23:53:35
@aliarokapis:matrix.orgAlexandros LiarokapisI guess OpenGL-driver symlinkfarm is responsible for all driver-bound bridge libraries…23:57:15
29 Dec 2025
@aliarokapis:matrix.orgAlexandros LiarokapisI was thinking there is an authoritative source of all needed kernel bound libraries and that is the nvidia container toolkit. One could mimic the search procedure and auto implement a /run/opengl symlinker for nix standalone systems and oci containers00:07:52
@aliarokapis:matrix.orgAlexandros Liarokapis* I was thinking there is an authoritative source of all needed kernel-driver bound libraries and that is the nvidia container toolkit. One could mimic the search procedure and auto implement a /run/opengl symlinker for nix standalone systems and oci containers00:08:05
@aliarokapis:matrix.orgAlexandros Liarokapis* I was thinking there is an authoritative source of all needed kernel-driver bound libraries and that is the nvidia container toolkit. One could mimic the search procedure and implement an automatic :run/opengl symlinker for nix standalone systems and oci containers00:08:23
@aliarokapis:matrix.orgAlexandros Liarokapis* I was thinking there is an authoritative source of all needed kernel-driver bound libraries and that is the nvidia container toolkit. One could mimic the search procedure and implement an automatic /run/opengl symlinker for nix standalone systems and oci containers00:08:29
@aliarokapis:matrix.orgAlexandros Liarokapis* I was thinking there is an authoritative source of all needed kernel-driver bound libraries and that is the nvidia container toolkit. One could mimic the search procedure and implement an automatic /run/opengl l-driver symlinker for nix standalone systems and oci containers00:08:40
@aliarokapis:matrix.orgAlexandros Liarokapis* I was thinking there is an authoritative source of all needed kernel-driver bound libraries and that is the nvidia container toolkit. One could mimic the search procedure and implement an automatic /run/opengl-driver symlinker for nix standalone systems and oci containers00:08:51
@apyh:matrix.orgapyhyeah, they are. most folks will use nixgl or nixglhost to work around this00:09:12
@apyh:matrix.orgapyhi use nixglhost wrappers for my binaries in oci containers00:09:25
@aliarokapis:matrix.orgAlexandros LiarokapisI was thinking of the issues specified here https://github.com/soupglasses/nix-system-graphics#but-why-another-nix-with-opengl-project00:10:57
@aliarokapis:matrix.orgAlexandros LiarokapisNow nix system graphics is a nice approach but has the limitation of having to specify the nvidia driver version in a system manager config to switch it is not automatic which really hurts usability00:13:06
@aliarokapis:matrix.orgAlexandros LiarokapisI was thinking something more in the lines of actually generating the symlink farm populating with the proper host system library symlinks00:18:17
@aliarokapis:matrix.orgAlexandros LiarokapisWould probably also work for mesa on nix standalone systems as well00:19:29
@aliarokapis:matrix.orgAlexandros LiarokapisOne could probably directly reuse the discovery functionality of the nvidia container toolkit go library00:29:52
@aliarokapis:matrix.orgAlexandros Liarokapis* One could probably directly reuse the discovery functionality of the nvidia container toolkit go library (or flatboat or similar)00:49:05
@aliarokapis:matrix.orgAlexandros Liarokapis* One could probably directly reuse the discovery functionality of the nvidia container toolkit go library (or flatpak or similar)00:49:13
@glepage:matrix.orgGaétan Lepage Hi!
I finally found some time to work on the llama-cpp-python-libcuda.so-stubs-missing bug and fixed outlines by skipping its pythonImportsCheckHook and tests when cudaSupport was enabled.
This allowed me to finally unblock the vllm bump.
It builds fine with and without cudaSupport. Feel free to test/review: https://github.com/NixOS/nixpkgs/pull/467418
17:36:41
@connorbaker:matrix.orgconnor (he/him)Good post about the exact problem we run into when trying to create dynamic libraries for Magma with our default set of CUDA capabilities: https://fzakaria.com/2025/12/28/huge-binaries18:06:21
@connorbaker:matrix.orgconnor (he/him)I won't be in the weekly call tomorrow btw18:06:33
30 Dec 2025
@collinarnett:matrix.orgCollin Arnett Hello, I'm working on getting a nixos module written for dcgm. connor (burnt/out) (UTC-8) I know you have an old draft PR so I'm basing a lot of it on that. As part of that I've had to go ahead and update dcgm and it's prometheus exporter. I would appreciate it if I could get a review from anyone here if they have the chance :) https://github.com/NixOS/nixpkgs/pull/474721 . dcgm is kind of a cursed package so I did my best with the patching but if anyone has any critical feedback it would be more than welcome. 14:49:19
@connorbaker:matrix.orgconnor (he/him)I don’t personally use it and will have limited time so I don’t think I can review it, but I’m fine with anyone else reviewing and merging it18:08:38
31 Dec 2025
@longregen:matrix.orglonWow super cool, thank you. Haven't run benchmarks but it looks a lot faster13:58:23
@collinarnett:matrix.orgCollin ArnettOh no worries. As far as the dcgm nix module I was mostly mentioning you above to make sure credit was given where credit is due :D16:21:47
1 Jan 2026
@matthewcroughan:defenestrate.itmatthewcroughan changed their display name from matthewcroughan @ 39c3 (DECT 94667 or 97340 or 67192) to matthewcroughan.20:04:02
4 Aug 2022
@winterqt:nixos.devWinter (she/her) joined the room.03:26:42
@winterqt:nixos.devWinter (she/her)(hi, just came here to read + respond to this.)03:28:52
@tpw_rules:matrix.orgtpw_ruleshey. i had previously sympathzied with samuela and like i said before had some of the same frustrations. i just edited my github comment to add "[CUDA] packages are universally complicated, fragile to package, and critical to daily operations. Nix being able to manage them is unbelievably helpful to those of us who work with them regularly, even if support is downgraded to only having an expectation of function on stable branches."03:29:14
@winterqt:nixos.devWinter (she/her)
In reply to @tpw_rules:matrix.org
i'm mildly peeved about a recent merging of something i maintain where i'm pretty sure the merger does not own the expensive hardware required to properly test the package. i don't think it broke anything but i was given precisely 45 minutes to see the notification before somebody merged it
ugh, 45 minutes? that's... not great. not to air dirty laundry but did you do what samuela did in the wandb PR and at least say that that wasn't a great thing to do? (not sure how else to word that, you get what i mean)
03:30:23
@tpw_rules:matrix.orgtpw_rulesno, i haven't yet, but i probably will03:31:03

Show newer messages


Back to Room ListRoom Version: 9