!eWOErHSaiddIbsUNsJ:nixos.org

NixOS CUDA

287 Members
CUDA packages maintenance and support in nixpkgs | https://github.com/orgs/NixOS/projects/27/ | https://nixos.org/manual/nixpkgs/unstable/#cuda57 Servers

Load older messages


SenderMessageTime
29 Dec 2025
@aliarokapis:matrix.orgAlexandros LiarokapisWould probably also work for mesa on nix standalone systems as well00:19:29
@aliarokapis:matrix.orgAlexandros LiarokapisOne could probably directly reuse the discovery functionality of the nvidia container toolkit go library00:29:52
@aliarokapis:matrix.orgAlexandros Liarokapis* One could probably directly reuse the discovery functionality of the nvidia container toolkit go library (or flatboat or similar)00:49:05
@aliarokapis:matrix.orgAlexandros Liarokapis* One could probably directly reuse the discovery functionality of the nvidia container toolkit go library (or flatpak or similar)00:49:13
@glepage:matrix.orgGaétan Lepage Hi!
I finally found some time to work on the llama-cpp-python-libcuda.so-stubs-missing bug and fixed outlines by skipping its pythonImportsCheckHook and tests when cudaSupport was enabled.
This allowed me to finally unblock the vllm bump.
It builds fine with and without cudaSupport. Feel free to test/review: https://github.com/NixOS/nixpkgs/pull/467418
17:36:41
@connorbaker:matrix.orgconnor (burnt/out) (UTC-8)Good post about the exact problem we run into when trying to create dynamic libraries for Magma with our default set of CUDA capabilities: https://fzakaria.com/2025/12/28/huge-binaries18:06:21
@connorbaker:matrix.orgconnor (burnt/out) (UTC-8)I won't be in the weekly call tomorrow btw18:06:33
30 Dec 2025
@collinarnett:matrix.orgCollin Arnett Hello, I'm working on getting a nixos module written for dcgm. connor (burnt/out) (UTC-8) I know you have an old draft PR so I'm basing a lot of it on that. As part of that I've had to go ahead and update dcgm and it's prometheus exporter. I would appreciate it if I could get a review from anyone here if they have the chance :) https://github.com/NixOS/nixpkgs/pull/474721 . dcgm is kind of a cursed package so I did my best with the patching but if anyone has any critical feedback it would be more than welcome. 14:49:19
@connorbaker:matrix.orgconnor (burnt/out) (UTC-8)I don’t personally use it and will have limited time so I don’t think I can review it, but I’m fine with anyone else reviewing and merging it18:08:38
31 Dec 2025
@longregen:matrix.orglonWow super cool, thank you. Haven't run benchmarks but it looks a lot faster13:58:23
@collinarnett:matrix.orgCollin ArnettOh no worries. As far as the dcgm nix module I was mostly mentioning you above to make sure credit was given where credit is due :D16:21:47
1 Jan 2026
@matthewcroughan:defenestrate.itmatthewcroughan changed their display name from matthewcroughan @ 39c3 (DECT 94667 or 97340 or 67192) to matthewcroughan.20:04:02
5 Jan 2026
@arilotter:matrix.orgAri Lotteris there a more general python/ml Nix chat anywhere? trying to get some stuff that isn't technically cuda-related going21:24:26
@glepage:matrix.orgGaétan Lepage Just ask it here. There is no other "python+ML" official room I'm aware of.
The closest would be the official Python room, but you would end up pinging even more people.
21:27:55
@arilotter:matrix.orgAri Lotter

yeah fair enough.

trying to depend on the python module outlines, it seems not to build because it has a hard requirement of outlines-core==0.2.11, but the version of -core in nixpkgs is 0.2.13. seems like latest outlines release still does depend on 0.2.11. wondering if it makes more sense to PR to.. revert the core update? because it seems like outlines must have been "broken" since https://github.com/NixOS/nixpkgs/commit/a5370c8752db2465791097660563b3b2441b56ac
either that or something changed about the pythonRuntimeDepsCheck - the error i get is that f"{package_name}{requirement.specifier} not satisfied by version {package.version}"

21:46:53
@justbrowsing:matrix.orgKevin Mittman (UTC-8) changed their display name from Kevin Mittman (EOY sleep) to Kevin Mittman (UTC-8).22:03:14
@arilotter:matrix.orgAri Lotter *

yeah fair enough.

trying to depend on the python module outlines, it seems not to build because it has a hard requirement of outlines-core==0.2.11, but the version of -core in nixpkgs is 0.2.13. seems like latest outlines release still does depend on 0.2.11. wondering if it makes more sense to PR to.. revert the core update? because it seems like outlines must have been "broken" since https://github.com/NixOS/nixpkgs/commit/a5370c8752db2465791097660563b3b2441b56ac
either that or something changed about the pythonRuntimeDepsCheck - the error i get is that f"{package_name}{requirement.specifier} not satisfied by version {package.version}": outlines-core==0.2.11 not satisfied by version 0.2.13

22:39:27
6 Jan 2026
@glepage:matrix.orgGaétan Lepage Yes, I already fixed it in https://github.com/NixOS/nixpkgs/pull/476381.
You can track it here: https://nixpkgs-tracker.ocfox.me/?pr=476381
11:39:15
@apyh:matrix.orgapyheveryone is so fast lol thank you15:04:29
8 Jan 2026
@glepage:matrix.orgGaétan Lepage

RE onnxruntime-dependent segfaults when cudaSupport is enabled.

Apparently, this does not only happen in onnxscript, but also in rapidocr-onnxruntime.

10:12:03
@glepage:matrix.orgGaétan Lepage Addressed in https://github.com/NixOS/nixpkgs/pull/478028. 10:46:28
@glepage:matrix.orgGaétan Lepage connor (burnt/out) (UTC-8) what is your plan for updating the default cudaPackages alias?
Bumping to 12.9 or directly to 13?
11:02:00
@glepage:matrix.orgGaétan Lepage I ask this because evaluating nixpkgs with cudaSupport = true is currently broken because of python3Packages.paddlepaddle which doesn't have sources for Cuda 12.8. 12:39:45
@glepage:matrix.orgGaétan Lepage And this broke our cuda-packages-unstable hydra jobset :/ 12:40:29
@wilhelmines:matrix.orgwilhelmines joined the room.16:58:46
@connorbaker:matrix.orgconnor (burnt/out) (UTC-8)Is that backport-able?17:19:30
@connorbaker:matrix.orgconnor (burnt/out) (UTC-8)I’d be okay bumping to the latest CUDA once we get OpenCV bumped to the latest release (4.13 came out recently and includes fixes to build with CUDA 13), assuming nothing super important breaks17:20:53
@connorbaker:matrix.orgconnor (burnt/out) (UTC-8)One of the longer discussions I keep pushing back is deciding on whether or not we want to do release gating, and if so, which packages should be considered blockers.17:21:32
@ss:someonex.netSomeoneSerge (back on matrix)Yes we should, at the least on pytorch19:52:18
@ss:someonex.netSomeoneSerge (back on matrix)Eval error like that is a bug. if you have the time, append "or null" to the attribute look up19:56:31

There are no newer messages yet.


Back to Room ListRoom Version: 9