!eWOErHSaiddIbsUNsJ:nixos.org

NixOS CUDA

292 Members
CUDA packages maintenance and support in nixpkgs | https://github.com/orgs/NixOS/projects/27/ | https://nixos.org/manual/nixpkgs/unstable/#cuda57 Servers

Load older messages


SenderMessageTime
9 Feb 2026
@benesim:benesim.orgBenjamin IsbarnI'm not using any overlay for that purpose right now. Good point regarding the global override, will do that ;). So the cudaCapabilities would affect packages like the cudart, cublas etc. I guess i.e. what features it will consider available and thus use? the in theory this should yield better performance for the aforementioned libraries? 07:03:05
@connorbaker:matrix.orgconnor (burnt/out) (UTC-8) Read https://nixos.org/manual/nixpkgs/stable/#cuda -- Jetson isn't built by default and pre-thor uses different binaries so you need to make sure cudaCapabilities is set correctly; you'll get faster builds, smaller closures, and (possibly) better performance if you specify the exact capability 07:36:40
@solitudealma:matrix.orgSolitudeAlma joined the room.07:49:25
@glepage:matrix.orgGaétan Lepage VLLM is now 0.15.1 (latest version) 11:11:17
@cameronraysmith:matrix.orgcameronraysmith SomeoneSerge (back on matrix): let me know if the updates to https://github.com/NixOS/nixpkgs/pull/488199 captured what you suggested. No rush: thanks! 21:03:44
@glepage:matrix.orgGaétan Lepage

connor (burnt/out) (UTC-8) SomeoneSerge (back on matrix)
This PR should fix the last failing gpuCheck instance, i.e. python3Packages.triton.gpuCheck: https://github.com/NixOS/nixpkgs/pull/488887

I discovered one of our beloved dlopen instance in triton. We didn't know about it since then... This PR fixes it too.

23:39:42
@glepage:matrix.orgGaétan Lepage *

connor (burnt/out) (UTC-8) SomeoneSerge (back on matrix)
This PR should fix the last failing gpuCheck instance, i.e. python3Packages.triton.gpuCheck: https://github.com/NixOS/nixpkgs/pull/488887

I discovered one of our beloved dlopen instances in triton. We didn't know about it since then... This PR fixes it too.

23:55:34
10 Feb 2026
@connorbaker:matrix.orgconnor (burnt/out) (UTC-8)Don't think I linked it here, maybe interesting for people with heavy eval jobs: https://github.com/ConnorBaker/nix-optimization01:41:36

There are no newer messages yet.


Back to Room ListRoom Version: 9