!eWOErHSaiddIbsUNsJ:nixos.org

NixOS CUDA

293 Members
CUDA packages maintenance and support in nixpkgs | https://github.com/orgs/NixOS/projects/27/ | https://nixos.org/manual/nixpkgs/unstable/#cuda57 Servers

Load older messages


SenderMessageTime
12 Jan 2026
@glepage:matrix.orgGaétan Lepage Ok, I'll target staging-next once I'm done building for all platforms 15:55:50
@connorbaker:matrix.orgconnor (he/him)Any thoughts on whether it’s suitable for backport to 25.11? Would unbreak CUDA 13 functionality there which I welcome17:09:22
13 Jan 2026
@aliarokapis:matrix.orgAlexandros Liarokapiswhat do I use as inputs and nixpkgs config to get cached ucc with cuda support?23:00:25
@aliarokapis:matrix.orgAlexandros Liarokapiswhat I did was use https://hydra.nixos-cuda.org/build/63411#tabs-buildinputs for nixpkgs input, then instantiate only with allowUnfree and cudaSupport = true;23:01:46
@aliarokapis:matrix.orgAlexandros Liarokapisnvm my user nix config was overriding my systems's cache23:13:26
14 Jan 2026
@connorbaker:matrix.orgconnor (he/him) I didn't realize that by making TensorRT 10.14.1 the default I effectively broke aarch64-linux (non Jetson) builds using TensorRT since NVIDIA didn't make a release for that platform for CUDA 12 -- it's CUDA 13 only.
So... do I roll back the version of TensorRT on aarch64-linux for CUDA 12.x or do something else? It'd need to get backported to the release branch to unbreak that.
10.13.0 has support for aarch64-linux for CUDA 12, but it was removed in 10.13.2 (there is no 10.13.1 release I can find).
00:33:23
@yorik.sar:matrix.orgyorik.sarSo they removed support for a whole version+platform in a patch release? That’s not nice.04:45:45
@yorik.sar:matrix.orgyorik.sarI think we’d need 2 versions then - one for aarch64, one for the rest.04:46:34
@hexa:lossy.networkhexait might be possible that I can escape the tensorflow curse with ai-edge-litert21:30:09
@hexa:lossy.networkhexa* it might be possible that I can escape the tensorflow curse with ai-edge-litert, the successor to tflite21:30:15
15 Jan 2026
@connorbaker:matrix.orgconnor (he/him)Can someone do something to test or verify https://github.com/NixOS/nixpkgs/pull/48023203:07:04
@hexa:lossy.networkhexahttps://github.com/NixOS/nixpkgs/pull/480103 introduces reintroduces libtensorflow-bin at 2.18.1, if anyone cares for that15:15:31
@hexa:lossy.networkhexa* https://github.com/NixOS/nixpkgs/pull/480103 introduces reintroduces libtensorflow-bin at 2.18.1, if anyone here cares for that15:15:35
@hexa:lossy.networkhexa

Note: Publishing standalone libtensorflow packages was dropped in TensorFlow 2.19.0, so the binary version used in this package is the latest one.

15:16:07
@hexa:lossy.networkhexaah sure, that's why we package an outdated release 😬15:16:18
@connorbaker:matrix.orgconnor (he/him)Goddamn stubs and transitive symbol resolution17:33:35
* @connorbaker:matrix.orgconnor (he/him) grumbles17:33:39
16 Jan 2026
@connorbaker:matrix.orgconnor (he/him)PR to avoid rebuilding Nix itself whenever CUDA support is enabled: https://github.com/NixOS/nixpkgs/pull/48052400:01:13
@hexa:lossy.networkhexanix depends on onetbb?00:09:53
@connorbaker:matrix.orgconnor (he/him)Yes, IIRC at least through blake302:23:54
@connorbaker:matrix.orgconnor (he/him) hexa (UTC+1): any additional thoughts on merging https://github.com/NixOS/nixpkgs/pull/480524? 18:16:50
@hexa:lossy.networkhexanone18:30:44
@hexa:lossy.networkhexadidn't test anything18:30:47
@hexa:lossy.networkhexajust disables cuda support18:30:55
@hexa:lossy.networkhexawhat could go wrong?18:31:03
@ss:someonex.netSomeoneSerge (back on matrix)Wait, globally?20:00:50
@ss:someonex.netSomeoneSerge (back on matrix)This probably affects MPI and SLURM, and might be one of those libraries you're actually supposed to link dynamically and not how we do it20:26:15
@connorbaker:matrix.orgconnor (he/him)I don't follow; IIRC hwloc is pulled in by those directly and would use it untouched22:48:00
17 Jan 2026
@glepage:matrix.orgGaétan Lepage FYI, the onnxruntime bump was merged! 🎉
https://github.com/NixOS/nixpkgs/pull/450587
09:33:45
@kaya:catnip.eekaya 𖤐Hey. Im working on upstreaming packages for exllama & tabbyapi. I would appreciate if somebody from here could review the PR :) https://github.com/NixOS/nixpkgs/pull/48112119:11:25

Show newer messages


Back to Room ListRoom Version: 9