| 7 Aug 2025 |
grw00 | hey all- is there a similar channel/effort for rocm in nixos? | 09:57:51 |
le-chat | Now magma fails to build, I did flake update. Switched to nixos-25.05, reran with torch.cxxdev only in buildInputs. Will see. | 10:09:53 |
connor (burnt/out) (UTC-8) | Make sure you’re specifying cudaCapabilities in config when you import Nixpkgs, otherwise Magma will fail to link because of the sheer amount of device code generated lol | 15:10:33 |
connor (burnt/out) (UTC-8) | There is/was a ROCm team, not sure about where they are or what they’re up to currently | 15:11:16 |
| 8 Aug 2025 |
| 0x4A6F joined the room. | 06:56:41 |
connor (burnt/out) (UTC-8) | Kevin Mittman you and SomeoneSerge (Ever OOMed by Element) should chat at some point about the database of binary archives he’s building because I think it might be useful to you as well as us | 14:12:07 |
indoor_squirrel | In reply to @connorbaker:matrix.org Kevin Mittman you and SomeoneSerge (Ever OOMed by Element) should chat at some point about the database of binary archives he’s building because I think it might be useful to you as well as us COLLAB!!! | 14:18:16 |
Kevin Mittman (UTC-8) | Sounds good to me | 16:48:45 |
Kevin Mittman (UTC-8) | Also if there are any CUDA 13 related packaging questions, let me know | 16:49:27 |
| 10 Aug 2025 |
| matthewcroughan changed their display name from matthewcroughan to matthewcroughan @ WHY2025 (DECT: 8793). | 11:36:29 |
| 11 Aug 2025 |
connor (burnt/out) (UTC-8) | For awareness:
- https://github.com/NixOS/nixpkgs/issues/428546
- https://github.com/NixOS/nixpkgs/issues/432646
If anyone has ideas, please chime in. I likely won't have a chance to dig into it for a while :L
| 14:59:10 |
apyh | ... so, nobody's packaged nvshmem yet, eh? 😭 building torch 2.9.0-nightly bails with > error: auto-patchelf could not satisfy dependency libnvshmem_host.so.3 wanted by /nix/store/73phyh3qhgjnihg20z1jf456xmld6dxr-python3.12-torch-2.9.0.dev20250811/lib/python3.12/site-packages/torch/lib/libtorch_nvshmem.so, i guess i gotta package it 😭 | 20:09:57 |
apyh | thank go that wasn't so bad at all lol | 21:46:57 |
| 12 Aug 2025 |
Luke | This would be really great to have imo, how can we get this started? | 03:49:22 |
| 13 Aug 2025 |
le-chat | I've restricted cudaCapabilities, built torch. NNStreamer build fails at mesonConfigurePhase with messages:
Run-time dependency pytorch found: NO (tried pkgconfig and cmake)
Run-time dependency torch found: NO (tried pkgconfig and cmake)
meson.build:693:6: ERROR: Problem encountered: pytorch-support is enabled but unable to find the target dependency
The gist is updated. What should I try further?
| 09:29:03 |
le-chat | Looking into a build directory with --keep-failed I see in build/meson-logs/meson-log.txt.
env[PKG_CONFIG_PATH]: {long path here}
env[PKG_CONFIG]: /nix/store/d667kdfbfn17905f7kmdl33r9gvwzaji-pkg-config-wrapper-0.29.2/bin/pkg-config
-----------
Called: `/nix/store/d667kdfbfn17905f7kmdl33r9gvwzaji-pkg-config-wrapper-0.29.2/bin/pkg-config --modversion torch` -> 1
stderr:
Package torch was not found in the pkg-config search path.
Perhaps you should add the directory containing `torch.pc'
to the PKG_CONFIG_PATH environment variable
This long path does not contain any torch directory.
Also none of torch directories contain torch.pc.
| 12:12:48 |
| matthewcroughan changed their display name from matthewcroughan @ WHY2025 (DECT: 8793) to matthewcroughan. | 17:23:55 |
Luke | There is now! #ROCm:nixos.org | 17:37:21 |
| 15 Aug 2025 |
connor (burnt/out) (UTC-8) | Two bugs to be aware of:
- https://github.com/NixOS/nixpkgs/issues/434096
- https://github.com/NixOS/nixpkgs/issues/434101
| 23:31:17 |
| 16 Aug 2025 |
| Martin Charles joined the room. | 04:58:51 |
Martin Charles | curious, why is nvcomp missing from nixpkgs cuda? | 05:15:27 |
connor (burnt/out) (UTC-8) | lack of time, mostly -- there is a redist for it (https://developer.download.nvidia.com/compute/nvcomp/redist/redistrib_5.0.0.6.json) | 05:18:50 |
Martin Charles | hmm ok, i'm happy to package it are you guys open to patches? | 05:25:04 |
Martin Charles | is there some way to consume this? | 05:26:22 |
Martin Charles | it appears this is what the release.nix files are for | 05:26:33 |
Martin Charles | this nvcomp one seems different in that it has multiple cuda versions for each library version which the other packages don't seem to have? | 05:32:51 |
connor (burnt/out) (UTC-8) | You can try doing something similar to the steps listed here: https://github.com/NixOS/nixpkgs/blob/master/doc/languages-frameworks/cuda.section.md#updating-cutensor-cuda-updating-cutensor
I've not had a chance to update that script in a while, so not sure how well/if it still works
Generally we use the script from the docs to take the manfiest provided by NVIDIA (dubbed the redist or redistrib manifest) and create a feature manifest which tells us things relevant to the Nix packaging
Then create a fixup function (https://github.com/NixOS/nixpkgs/tree/master/pkgs/development/cuda-modules/_cuda/fixups) for the packages from the manifest
Lastly add it to the package sets by creating and importing an extension, like https://github.com/NixOS/nixpkgs/blob/3b0feaf8c2160a10a974c890e93f5f5387728784/pkgs/top-level/cuda-packages.nix#L201 | 05:48:12 |
connor (burnt/out) (UTC-8) | It's fairly involved and I've been trying to automate away the entirety of it for the better part of the last year, but there are many sharp edges in many domains :l | 05:49:30 |
| 17 Aug 2025 |
| mastratisi joined the room. | 10:05:31 |
| 21 Aug 2025 |
luke-skywalker | I ran into this issue with the latest nvidia driver (580.76.05) crashing gtk apps and GPU accelerated apps like zed editor on latest linux kernel (6.16.1) on wayland.
Im kind of overwhelmed by all the available packages. Can someone give me a quick hint on which of all the available packages I can safely revert back to?
| 13:23:10 |