!eWOErHSaiddIbsUNsJ:nixos.org

NixOS CUDA

308 Members
CUDA packages maintenance and support in nixpkgs | https://github.com/orgs/NixOS/projects/27/ | https://nixos.org/manual/nixpkgs/unstable/#cuda60 Servers

You have reached the beginning of time (for this room).


SenderMessageTime
3 Nov 2025
@arilotter:matrix.orgAri Lotter

is this a horrible idea, if i need cuda support and don't want to wait hours for builds? :)

(final: prev: {
  python312Packages = prev.python312Packages.override {
    overrides = pyfinal: pyprev: {
      torch = pyfinal.torch-bin;
    };
  };
})
21:28:33
@glepage:matrix.orgGaétan Lepage

RE {cudaPackages.nccl, onnxruntime}: remove reference to nvcc in binary:

We need to patch both nccl's libnccl.so and onnxruntime's libonnxruntime_providers_cuda.so for the fix to actually work.

23:10:06
4 Nov 2025
@connorbaker:matrix.orgconnor (he/him) should be fine, but I'd always recommend using pythonPackagesExtensions since it's a little nicer to use 06:38:57
@ss:someonex.netSomeoneSerge (matrix works sometimes)I still have no explanation for why we cannot seem to reproduce the nvcc reference with saxpy15:07:47
@ss:someonex.netSomeoneSerge (matrix works sometimes)It's frustrating15:08:03
@ss:someonex.netSomeoneSerge (matrix works sometimes)Elaborated on github, but here for redundancy: the reference in onnxruntime only appears when nvcc is propagated by all these cuda libs, https://github.com/NixOS/nixpkgs/pull/457424#issuecomment-347573673815:11:32
@glepage:matrix.orgGaétan Lepage TIL: python3Packages.torchWithRocm is apprently sensitive to config.cudaSupport. 20:11:25
@arilotter:matrix.orgAri Lotterugh i wish we could compile packages with cudaCapabilities individually per-capability and merge them later, it's such a nightmare adding one new capability level and it causing a huge 8-hour recompile..20:40:40
@connorbaker:matrix.orgconnor (he/him)These aliases must die, they make my life so difficult21:45:22
@connorbaker:matrix.orgconnor (he/him)Join the club And it’s not even like we could do a mega-build in an intermediate derivation and then prune unused capabilities according to whatever the user requested because the amount of generated device code is so large linking will fail lmao21:46:17
@connorbaker:matrix.orgconnor (he/him) Gaétan Lepage are any of SomeoneSerge (back on matrix)’s comments on https://github.com/NixOS/nixpkgs/pull/457803 actionable or is it good to merge? 21:48:00
@connorbaker:matrix.orgconnor (he/him)Also, would you mind reviewing https://github.com/NixOS/nixpkgs/pull/458619?21:48:09

Show newer messages


Back to Room ListRoom Version: 9