| 29 Dec 2025 |
Alexandros Liarokapis | I was thinking there is an authoritative source of all needed kernel bound libraries and that is the nvidia container toolkit. One could mimic the search procedure and auto implement a /run/opengl symlinker for nix standalone systems and oci containers | 00:07:52 |
Alexandros Liarokapis | * I was thinking there is an authoritative source of all needed kernel-driver bound libraries and that is the nvidia container toolkit. One could mimic the search procedure and auto implement a /run/opengl symlinker for nix standalone systems and oci containers | 00:08:05 |
Alexandros Liarokapis | * I was thinking there is an authoritative source of all needed kernel-driver bound libraries and that is the nvidia container toolkit. One could mimic the search procedure and implement an automatic :run/opengl symlinker for nix standalone systems and oci containers | 00:08:23 |
Alexandros Liarokapis | * I was thinking there is an authoritative source of all needed kernel-driver bound libraries and that is the nvidia container toolkit. One could mimic the search procedure and implement an automatic /run/opengl symlinker for nix standalone systems and oci containers | 00:08:29 |
Alexandros Liarokapis | * I was thinking there is an authoritative source of all needed kernel-driver bound libraries and that is the nvidia container toolkit. One could mimic the search procedure and implement an automatic /run/opengl l-driver symlinker for nix standalone systems and oci containers | 00:08:40 |
Alexandros Liarokapis | * I was thinking there is an authoritative source of all needed kernel-driver bound libraries and that is the nvidia container toolkit. One could mimic the search procedure and implement an automatic /run/opengl-driver symlinker for nix standalone systems and oci containers | 00:08:51 |
apyh | yeah, they are. most folks will use nixgl or nixglhost to work around this | 00:09:12 |
apyh | i use nixglhost wrappers for my binaries in oci containers | 00:09:25 |
Alexandros Liarokapis | I was thinking of the issues specified here https://github.com/soupglasses/nix-system-graphics#but-why-another-nix-with-opengl-project | 00:10:57 |
Alexandros Liarokapis | Now nix system graphics is a nice approach but has the limitation of having to specify the nvidia driver version in a system manager config to switch it is not automatic which really hurts usability | 00:13:06 |
Alexandros Liarokapis | I was thinking something more in the lines of actually generating the symlink farm populating with the proper host system library symlinks | 00:18:17 |
Alexandros Liarokapis | Would probably also work for mesa on nix standalone systems as well | 00:19:29 |
Alexandros Liarokapis | One could probably directly reuse the discovery functionality of the nvidia container toolkit go library | 00:29:52 |
Alexandros Liarokapis | * One could probably directly reuse the discovery functionality of the nvidia container toolkit go library (or flatboat or similar) | 00:49:05 |
Alexandros Liarokapis | * One could probably directly reuse the discovery functionality of the nvidia container toolkit go library (or flatpak or similar) | 00:49:13 |
Gaétan Lepage | Hi!
I finally found some time to work on the llama-cpp-python-libcuda.so-stubs-missing bug and fixed outlines by skipping its pythonImportsCheckHook and tests when cudaSupport was enabled.
This allowed me to finally unblock the vllm bump.
It builds fine with and without cudaSupport. Feel free to test/review: https://github.com/NixOS/nixpkgs/pull/467418 | 17:36:41 |
connor (burnt/out) (UTC-8) | Good post about the exact problem we run into when trying to create dynamic libraries for Magma with our default set of CUDA capabilities: https://fzakaria.com/2025/12/28/huge-binaries | 18:06:21 |
connor (burnt/out) (UTC-8) | I won't be in the weekly call tomorrow btw | 18:06:33 |
| 30 Dec 2025 |
Collin Arnett | Hello, I'm working on getting a nixos module written for dcgm. connor (burnt/out) (UTC-8) I know you have an old draft PR so I'm basing a lot of it on that. As part of that I've had to go ahead and update dcgm and it's prometheus exporter. I would appreciate it if I could get a review from anyone here if they have the chance :) https://github.com/NixOS/nixpkgs/pull/474721 . dcgm is kind of a cursed package so I did my best with the patching but if anyone has any critical feedback it would be more than welcome. | 14:49:19 |
connor (burnt/out) (UTC-8) | I don’t personally use it and will have limited time so I don’t think I can review it, but I’m fine with anyone else reviewing and merging it | 18:08:38 |
| 31 Dec 2025 |
lon | Wow super cool, thank you. Haven't run benchmarks but it looks a lot faster | 13:58:23 |
Collin Arnett | Oh no worries. As far as the dcgm nix module I was mostly mentioning you above to make sure credit was given where credit is due :D | 16:21:47 |
| 1 Jan 2026 |
| matthewcroughan changed their display name from matthewcroughan @ 39c3 (DECT 94667 or 97340 or 67192) to matthewcroughan. | 20:04:02 |
| 5 Jan 2026 |
Ari Lotter | is there a more general python/ml Nix chat anywhere? trying to get some stuff that isn't technically cuda-related going | 21:24:26 |
Gaétan Lepage | Just ask it here. There is no other "python+ML" official room I'm aware of.
The closest would be the official Python room, but you would end up pinging even more people. | 21:27:55 |
Ari Lotter | yeah fair enough.
trying to depend on the python module outlines, it seems not to build because it has a hard requirement of outlines-core==0.2.11, but the version of -core in nixpkgs is 0.2.13. seems like latest outlines release still does depend on 0.2.11. wondering if it makes more sense to PR to.. revert the core update? because it seems like outlines must have been "broken" since https://github.com/NixOS/nixpkgs/commit/a5370c8752db2465791097660563b3b2441b56ac either that or something changed about the pythonRuntimeDepsCheck - the error i get is that f"{package_name}{requirement.specifier} not satisfied by version {package.version}"
| 21:46:53 |
| Kevin Mittman (UTC-8) changed their display name from Kevin Mittman (EOY sleep) to Kevin Mittman (UTC-8). | 22:03:14 |
Ari Lotter | * yeah fair enough.
trying to depend on the python module outlines, it seems not to build because it has a hard requirement of outlines-core==0.2.11, but the version of -core in nixpkgs is 0.2.13. seems like latest outlines release still does depend on 0.2.11. wondering if it makes more sense to PR to.. revert the core update? because it seems like outlines must have been "broken" since https://github.com/NixOS/nixpkgs/commit/a5370c8752db2465791097660563b3b2441b56ac either that or something changed about the pythonRuntimeDepsCheck - the error i get is that f"{package_name}{requirement.specifier} not satisfied by version {package.version}": outlines-core==0.2.11 not satisfied by version 0.2.13
| 22:39:27 |
| 6 Jan 2026 |
Gaétan Lepage | Yes, I already fixed it in https://github.com/NixOS/nixpkgs/pull/476381.
You can track it here: https://nixpkgs-tracker.ocfox.me/?pr=476381 | 11:39:15 |
apyh | everyone is so fast lol thank you | 15:04:29 |