NixOS CUDA | 288 Members | |
| CUDA packages maintenance and support in nixpkgs | https://github.com/orgs/NixOS/projects/27/ | https://nixos.org/manual/nixpkgs/unstable/#cuda | 56 Servers |
| Sender | Message | Time |
|---|---|---|
| 6 Feb 2025 | ||
Alternatively/additionally, we might want to mark torch-bin with the appropriate CUDA-specific license so that it passes the allowUnfreePredicate in release-cuda (assuming that the unfreeRedistributable part of torch-bin does indeed refer to the vendored(?) CUDA. | 13:07:01 | |
I am not sure if I like the idea of adding freeimage to allowInsecurePredicate "globally" in release-cuda, as the eval failure is a useful indicator for when some package ends up depending on it. I was thinking of allowing freeimage specifically for cuda-samples. Also, it seems that cuda-samples is only present in CUDA versions <=12.3 for some reason. I wonder, why is that? | 13:18:26 | |
| 14:20:42 | ||
| Hi team! I recently managed to update vllm to latest version - https://github.com/NixOS/nixpkgs/pull/379165 I think we should add vllm to release-cuda because it takes long time to compile and it would be great if the nix-community cache was populated with the prebuilt binaries. What do you think? I created a PR with the change here: https://github.com/NixOS/nixpkgs/pull/379575 | 14:21:45 | |
| 14:25:25 | ||
| 14:26:27 | ||
| 14:27:08 | ||
| 14:29:45 | ||
| I have bad news, lol
All
| 14:40:48 | |
| * I have bad news, lol
All
| 14:48:11 | |
* I am not sure if I like the idea of adding freeimage to allowInsecurePredicate "globally" in release-cuda, as the eval failure is a useful indicator for when some package ends up depending on it. I was thinking of allowing freeimage specifically for cuda-samples. Also, it seems that cuda-samples is not present for CUDA 12.4 for some reason. I wonder, why is that? | 14:53:29 | |
* I am not sure if I like the idea of adding freeimage to allowInsecurePredicate "globally" in release-cuda, as the eval failure is a useful indicator for when some package ends up depending on it. I was thinking of allowing freeimage specifically for cuda-samples. Also, it seems that cuda-samples is not present for CUDA 12.4 for some reason. I wonder, why is that? | 14:53:38 | |
| I think the first one is related to compiler version and the second one may be static libraries for cuda_cudart not being in one of the default installed outputs Although as a caveat I haven’t looked at Nixpkgs in a bit | 15:16:59 | |
| Yeah, it seems that a bunch of libraries are actually missing, not just the cudart_static. I am currently investigating. | 15:19:01 | |
| I know I did this in the out of tree because it’s a pain in the ass to explicitly include the static libraries for cuda_cudart for CMake (for some unknowable reason they’re required when doing compiler identification): https://github.com/ConnorBaker/cuda-packages/blob/dd0266aece12e5177e3ce32d62b6665c33847837/modules/redists/cuda/overrides/common/cuda_cudart.nix#L11 But generally to reduce the build time closure static libraries aren’t pulled in by default | 15:19:06 | |
| Might have to check the CMake for the CUDA samples — it’s possible they’re doing only static builds or preferentially linking against static libraries | 15:19:58 | |
| 15:49:57 | ||
| This might be a stupid question, but when the nixpkgs manual says
What if the upstream package expects a single | 16:54:13 | |
| * This might be a stupid question, but when the nixpkgs manual says
does it mean that individual derivations from What if the upstream package expects a single | 16:54:19 | |
| * This might be a stupid question, but when the nixpkgs manual says
does it mean that individual derivations from What if the upstream package expects a single | 16:54:58 | |
| Honestly, I've no idea what license, if any, applies to torch-bin | 17:24:28 | |
| Yes, or we could just agree that testing for insecure dependencies is out of scope for hydra | 17:26:09 | |
| I expect static and devrt to be in .dev's propagatedBuildInputs | 17:27:54 | |
If upstream is co-operative, they need to be contacted and offered a proper solution like FindCUDAToolkit.cmake without any CUDA_PATHs or merged-layout assumptiosn | 17:29:22 | |
thanks for looking. Sadly, I have now compiled the package myself so it's cached and this doesn't say anything useful. I suppose I can try next time I update. What do you except out of emptying builders? | 17:29:50 | |
That's the idea. We could consider an automation more along the lines of propagatedBuildInputs, but symlinks we hope to avoid, because it's hard to prune the references to static libraries after the build | 17:31:10 | |
| Maybe gc it? | 17:31:58 | |
Has anyone encountered this? I've no idea what this workflow is even for | 17:41:42 | |
| 17:51:07 | ||
The upstream in question is NVIDIA/cuda-samples. They are currently using "plain" Makefiles. I think that it's unlikely that we could get them to switch (and I don't really want to try to implement this myself). What would be "the most nixpkgs way" to create a merged CUDA_PATH in this case? | 17:54:37 | |