| 2 Jul 2024 |
 Jonas Chevalier | are the cases where you would use the *WithCuda packages instead of import nixpkgs { config.cudaSupport = true; }? This could create a similar situation as I had when trying to mix torch and tensorflow in one python.withPackages, where you get package name collisions. | 12:50:18 |
 SomeoneSerge (matrix works sometimes) | Holaaaa | 14:55:06 |
| SomeoneSerge (matrix works sometimes) | In reply to @zimbatm:numtide.com
are the cases where you would use the *WithCuda packages instead of import nixpkgs { config.cudaSupport = true; }? This could create a similar situation as I had when trying to mix torch and tensorflow in one python.withPackages, where you get package name collisions. Honestly, not many I think. "A standalone executable that has no transitive dependencies that require enabling optional cuda support". E.g. I think python3Packages.torchWithCuda would link against the wrong ucc/ucx/openmpi unless config.cudaSupport is set | 15:00:46 |
| SomeoneSerge (matrix works sometimes) | I think they were mainly introduced to be put in passthru.tests and for nixpkgs-reviews | 15:01:32 |
| SomeoneSerge (matrix works sometimes) | What I think we need instead is we need to somehow [more] publicly expose nixpkgsFun so we can access it from all-packages.nix and prepare the pkgsCuda and pkgsRocm attributes | 15:03:14 |
| SomeoneSerge (matrix works sometimes) | * What I think we need instead is we need to somehow [more] publicly expose nixpkgsFun so we can access it from all-packages.nix and prepare the pkgsCuda and pkgsRocm attributes (even without recurseIntoAttrs) | 15:03:33 |
| SomeoneSerge (matrix works sometimes) | In reply to @zimbatm:numtide.com
I'd love to do that We'd love that too ๐ we talk about it but never gain enough momentum to act | 15:05:16 |
| Jonas Chevalier | We could use the Hydra instance in nix-community. It's already there and available. | 16:19:24 |
| Jonas Chevalier | Something like this: https://github.com/nix-community/infra/pull/1335 | 16:45:30 |
| SomeoneSerge (matrix works sometimes) | In reply to @zimbatm:numtide.com
Something like this: https://github.com/nix-community/infra/pull/1335 Just like that... | 16:53:58 |
| 3 Jul 2024 |
 หtอกsษหzaษฬฏ | Jonas Chevalier: The link to the eval you posted on that PR 404s. | 10:35:07 |
| Jonas Chevalier | yeah, I renamed the jobset to https://hydra.nix-community.org/jobset/nixpkgs/cuda-nixos-unstable | 10:36:25 |
 hexa | awesome | 10:56:28 |
| SomeoneSerge (matrix works sometimes) | Yesterday seems a bit hazy... | 12:30:22 |
| SomeoneSerge (matrix works sometimes) | In reply to @zimbatm:numtide.com
Something like this: https://github.com/nix-community/infra/pull/1335 I'll look into updating cuda-release.nix | 12:30:34 |
| SomeoneSerge (matrix works sometimes) | In reply to @zimbatm:numtide.com
yeah, I renamed the jobset to https://hydra.nix-community.org/jobset/nixpkgs/cuda-nixos-unstable H'm so in hydra you "create a jobset" somewhere like in a web ui before you merge the terraform configs? | 12:32:08 |
| SomeoneSerge (matrix works sometimes) | * H'm so in hydra you "create a jobset" somewhere like in a web ui before you merge the terraform configs? Or the tf config is the whole thing but you deployed it manually? | 12:38:17 |
| SomeoneSerge (matrix works sometimes) | Isn't that a gem:
โฏ hydra-eval-jobs --help
error: unrecognised flag '--help'
Try 'hydra-eval-jobs --help' for more information.
| 16:16:04 |
| hexa | faissWithCuda pls ๐ | 16:56:57 |
| SomeoneSerge (matrix works sometimes) | In reply to @hexa:lossy.network
faissWithCuda pls ๐ Why not just https://github.com/NixOS/nixpkgs/pull/324379/files#diff-b3a88f86f137f8870849673fb9b06582cb73937114ee34a61ae5604e259829a5R37 | 17:13:53 |
| SomeoneSerge (matrix works sometimes) | Jonas Chevalier while at it, nobody is building import <nixpkgs> { config.rocmSupport = true; } either, and that one is free | 17:14:56 |
| SomeoneSerge (matrix works sometimes) | The only reason not to build that with the NixOS Hydra is... to save resources | 17:16:20 |
| hexa | not sure how many jobs that will generate | 17:17:40 |
| SomeoneSerge (matrix works sometimes) | Me neither ๐ | 17:21:54 |
| SomeoneSerge (matrix works sometimes) |
error: blackmagic-desktop-video has been due to being unmaintained
it has been and now it isn't | 17:55:39 |
| SomeoneSerge (matrix works sometimes) | In reply to @hexa:lossy.network
not sure how many jobs that will generate โฏ nix-eval-jobs --expr 'import ./pkgs/top-level/release-cuda.nix { }' --force-recurse | wc -l
...
138452
(not counting eval errors) | 19:11:06 |
| hexa | so all of them | 19:13:28 |
| hexa | if there was a cache behind nix-community hydra, than you'd be mirroring cache.nixos.org effecitvely | 19:13:45 |
| hexa | * if there was a cache behind nix-community hydra, than you'd be mirroring cache.nixos.org effectively | 19:13:47 |
| SomeoneSerge (matrix works sometimes) | Yeah... Ideally we'd have a solution that evaluates the full DAGs for vanilla and cuda nixpkgs, starts building cuda from the leaves (ehhh, the roots), and always suspends the build if it hash matches the vanilla hash | 19:23:45 |
