!eWOErHSaiddIbsUNsJ:nixos.org

NixOS CUDA

291 Members
CUDA packages maintenance and support in nixpkgs | https://github.com/orgs/NixOS/projects/27/ | https://nixos.org/manual/nixpkgs/unstable/#cuda57 Servers

Load older messages


SenderMessageTime
11 Aug 2025
@apyh:matrix.orgapyhthank go that wasn't so bad at all lol21:46:57
12 Aug 2025
@luke:vuksta.comLukeThis would be really great to have imo, how can we get this started?03:49:22
13 Aug 2025
@le-chat:matrix.orgle-chat

I've restricted cudaCapabilities, built torch. NNStreamer build fails at mesonConfigurePhase with messages:

Run-time dependency pytorch found: NO (tried pkgconfig and cmake)
Run-time dependency torch found: NO (tried pkgconfig and cmake)

meson.build:693:6: ERROR: Problem encountered: pytorch-support is enabled but unable to find the target dependency

The gist is updated.
What should I try further?

09:29:03
@le-chat:matrix.orgle-chat

Looking into a build directory with --keep-failed I see in build/meson-logs/meson-log.txt.

env[PKG_CONFIG_PATH]: {long path here}
env[PKG_CONFIG]: /nix/store/d667kdfbfn17905f7kmdl33r9gvwzaji-pkg-config-wrapper-0.29.2/bin/pkg-config
-----------
Called: `/nix/store/d667kdfbfn17905f7kmdl33r9gvwzaji-pkg-config-wrapper-0.29.2/bin/pkg-config --modversion torch` -> 1
stderr:
Package torch was not found in the pkg-config search path.
Perhaps you should add the directory containing `torch.pc'
to the PKG_CONFIG_PATH environment variable

This long path does not contain any torch directory.

Also none of torch directories contain torch.pc.

12:12:48
@matthewcroughan:defenestrate.itmatthewcroughan changed their display name from matthewcroughan @ WHY2025 (DECT: 8793) to matthewcroughan.17:23:55
@luke:vuksta.comLukeThere is now! #ROCm:nixos.org17:37:21
15 Aug 2025
@connorbaker:matrix.orgconnor (he/him)

Two bugs to be aware of:

  • https://github.com/NixOS/nixpkgs/issues/434096
  • https://github.com/NixOS/nixpkgs/issues/434101
23:31:17
16 Aug 2025
@0xcaff:matrix.orgMartin Charles joined the room.04:58:51
@0xcaff:matrix.orgMartin Charlescurious, why is nvcomp missing from nixpkgs cuda?05:15:27
@connorbaker:matrix.orgconnor (he/him)lack of time, mostly -- there is a redist for it (https://developer.download.nvidia.com/compute/nvcomp/redist/redistrib_5.0.0.6.json)05:18:50
@0xcaff:matrix.orgMartin Charleshmm ok, i'm happy to package it are you guys open to patches?05:25:04
@0xcaff:matrix.orgMartin Charlesis there some way to consume this?05:26:22
@0xcaff:matrix.orgMartin Charlesit appears this is what the release.nix files are for05:26:33
@0xcaff:matrix.orgMartin Charlesthis nvcomp one seems different in that it has multiple cuda versions for each library version which the other packages don't seem to have?05:32:51
@connorbaker:matrix.orgconnor (he/him)You can try doing something similar to the steps listed here: https://github.com/NixOS/nixpkgs/blob/master/doc/languages-frameworks/cuda.section.md#updating-cutensor-cuda-updating-cutensor I've not had a chance to update that script in a while, so not sure how well/if it still works Generally we use the script from the docs to take the manfiest provided by NVIDIA (dubbed the redist or redistrib manifest) and create a feature manifest which tells us things relevant to the Nix packaging Then create a fixup function (https://github.com/NixOS/nixpkgs/tree/master/pkgs/development/cuda-modules/_cuda/fixups) for the packages from the manifest Lastly add it to the package sets by creating and importing an extension, like https://github.com/NixOS/nixpkgs/blob/3b0feaf8c2160a10a974c890e93f5f5387728784/pkgs/top-level/cuda-packages.nix#L20105:48:12
@connorbaker:matrix.orgconnor (he/him)It's fairly involved and I've been trying to automate away the entirety of it for the better part of the last year, but there are many sharp edges in many domains :l05:49:30
17 Aug 2025
@kallestrup-mastratisi:matrix.orgmastratisi joined the room.10:05:31
21 Aug 2025
@luke-skywalker:matrix.orgluke-skywalker

I ran into this issue with the latest nvidia driver (580.76.05) crashing gtk apps and GPU accelerated apps like zed editor on latest linux kernel (6.16.1) on wayland.

Im kind of overwhelmed by all the available packages. Can someone give me a quick hint on which of all the available packages I can safely revert back to?

13:23:10
@luke-skywalker:matrix.orgluke-skywalker *

I ran into this issue with the latest nvidia driver (580.76.05) crashing gtk apps and GPU accelerated apps like zed editor with latest linux kernel (6.16.1) on wayland.

Im kind of overwhelmed by all the available packages. Can someone give me a quick hint on which of all the available packages I can safely revert back to?

13:23:27
@luke-skywalker:matrix.orgluke-skywalker *

I ran into this issue with the latest nvidia driver (580.76.05) crashing gtk apps and GPU accelerated apps like zed editor with latest linux kernel (6.16.1) on wayland.

I am installing the nvidia drivers from the nvidia-container-toolkit.

Im kind of overwhelmed by all the available packages. Can someone give me a quick hint on which of all the available packages I can safely revert back to?

13:25:20
@luke-skywalker:matrix.orgluke-skywalker *

I ran into this issue with the latest nvidia driver (580.76.05) crashing gtk apps and GPU accelerated apps like zed editor with latest linux kernel (6.16.1) on wayland.

I am installing the nvidia drivers from the nvidia-container-toolkit.

Can someone give me a quick hint on which of all the available packages I can safely revert back to? I'm kind of overwhelmed by all the available packages.

13:40:31
@connorbaker:matrix.orgconnor (he/him)What do you mean the drivers from nvidia-container-toolkit? Your NixOS config should have something like this, right? https://github.com/ConnorBaker/nixos-configs/blob/5b9fe63698ee14a52a8187cd34ba769203fae24e/modules/nvidia.nix#L18 You should be able to select the version of the driver you want to use by changing that.14:45:00
@infinisil:matrix.orginfinisil joined the room.23:36:59
@infinisil:matrix.orginfinisil Does the CUDA team want to add a slide for NixCon's state of the union? The board and SC are reaching out to various teams to prepare a shared slide deck here, and I reserved a slot for the CUDA team :) https://docs.google.com/presentation/d/191-Bgwv6Bdb4KBzIfyAyZBftI0rSuCBo-_tSPrTSrtE/edit?slide=id.g376eb5e3048_2_152#slide=id.g376eb5e3048_2_152
23:38:14
@infinisil:matrix.orginfinisil @connor (he/him) (UTC-7) @SomeoneSerge (Ever OOMed by Element) @Samuel Ainsworth ^ 23:38:31
@infinisil:matrix.orginfinisilYou can PM me your google email to get permissions to edit23:38:39
22 Aug 2025
@connorbaker:matrix.orgconnor (he/him)Sure! I’ll let Serge know as well since I have him on Signal00:52:56
@stick:matrix.orgstick connor (he/him) (UTC-7): jfyi i tried to update cusparselt to 0.8.0 using your redist scripts, but it failed - it seems the scripts need to be adjusted somehow 09:42:02
23 Aug 2025
@stick:matrix.orgstick

Found the issue

New releases contain files to cuda12 and cuda13, introducing another level in json

See

https://developer.download.nvidia.com/compute/cusparselt/redist/redistrib_0.7.1.json

vs

https://developer.download.nvidia.com/compute/cusparselt/redist/redistrib_0.8.0.json

12:18:03
@stick:matrix.orgstickI manually edited the json to adhere to the old scheme and will create a cusparselt update PR although it is not ideal and i suspect the upcoming cuda releases will use the newer scheme too12:23:03

Show newer messages


Back to Room ListRoom Version: 9