| 2 Jul 2024 |
Jonas Chevalier | i'd love to throw hardware at that problem :) | 12:24:59 |
Jonas Chevalier | are the cases where you would use the *WithCuda packages instead of import nixpkgs { config.cudaSupport = true; }? This could create a similar situation as I had when trying to mix torch and tensorflow in one python.withPackages, where you get package name collisions. | 12:50:18 |
SomeoneSerge (back on matrix) | Holaaaa | 14:55:06 |
SomeoneSerge (back on matrix) | In reply to @zimbatm:numtide.com are the cases where you would use the *WithCuda packages instead of import nixpkgs { config.cudaSupport = true; }? This could create a similar situation as I had when trying to mix torch and tensorflow in one python.withPackages, where you get package name collisions. Honestly, not many I think. "A standalone executable that has no transitive dependencies that require enabling optional cuda support". E.g. I think python3Packages.torchWithCuda would link against the wrong ucc/ucx/openmpi unless config.cudaSupport is set | 15:00:46 |
SomeoneSerge (back on matrix) | I think they were mainly introduced to be put in passthru.tests and for nixpkgs-reviews | 15:01:32 |
SomeoneSerge (back on matrix) | What I think we need instead is we need to somehow [more] publicly expose nixpkgsFun so we can access it from all-packages.nix and prepare the pkgsCuda and pkgsRocm attributes | 15:03:14 |
SomeoneSerge (back on matrix) | * What I think we need instead is we need to somehow [more] publicly expose nixpkgsFun so we can access it from all-packages.nix and prepare the pkgsCuda and pkgsRocm attributes (even without recurseIntoAttrs) | 15:03:33 |
SomeoneSerge (back on matrix) | In reply to @zimbatm:numtide.com I'd love to do that We'd love that too ๐ we talk about it but never gain enough momentum to act | 15:05:16 |
Jonas Chevalier | We could use the Hydra instance in nix-community. It's already there and available. | 16:19:24 |
Jonas Chevalier | Something like this: https://github.com/nix-community/infra/pull/1335 | 16:45:30 |
SomeoneSerge (back on matrix) | In reply to @zimbatm:numtide.com Something like this: https://github.com/nix-community/infra/pull/1335 Just like that... | 16:53:58 |
| 3 Jul 2024 |
หtอกsษหzaษฬฏ | Jonas Chevalier: The link to the eval you posted on that PR 404s. | 10:35:07 |
Jonas Chevalier | yeah, I renamed the jobset to https://hydra.nix-community.org/jobset/nixpkgs/cuda-nixos-unstable | 10:36:25 |
hexa (UTC+1) | awesome | 10:56:28 |
SomeoneSerge (back on matrix) | Yesterday seems a bit hazy... | 12:30:22 |
SomeoneSerge (back on matrix) | In reply to @zimbatm:numtide.com Something like this: https://github.com/nix-community/infra/pull/1335 I'll look into updating cuda-release.nix | 12:30:34 |
SomeoneSerge (back on matrix) | In reply to @zimbatm:numtide.com yeah, I renamed the jobset to https://hydra.nix-community.org/jobset/nixpkgs/cuda-nixos-unstable H'm so in hydra you "create a jobset" somewhere like in a web ui before you merge the terraform configs? | 12:32:08 |
SomeoneSerge (back on matrix) | * H'm so in hydra you "create a jobset" somewhere like in a web ui before you merge the terraform configs? Or the tf config is the whole thing but you deployed it manually? | 12:38:17 |
SomeoneSerge (back on matrix) | Isn't that a gem:
โฏ hydra-eval-jobs --help
error: unrecognised flag '--help'
Try 'hydra-eval-jobs --help' for more information.
| 16:16:04 |
hexa (UTC+1) | faissWithCuda pls ๐ | 16:56:57 |
SomeoneSerge (back on matrix) | In reply to @hexa:lossy.network faissWithCuda pls ๐ Why not just https://github.com/NixOS/nixpkgs/pull/324379/files#diff-b3a88f86f137f8870849673fb9b06582cb73937114ee34a61ae5604e259829a5R37 | 17:13:53 |
SomeoneSerge (back on matrix) | Jonas Chevalier while at it, nobody is building import <nixpkgs> { config.rocmSupport = true; } either, and that one is free | 17:14:56 |
SomeoneSerge (back on matrix) | The only reason not to build that with the NixOS Hydra is... to save resources | 17:16:20 |
hexa (UTC+1) | not sure how many jobs that will generate | 17:17:40 |
SomeoneSerge (back on matrix) | Me neither ๐ | 17:21:54 |
SomeoneSerge (back on matrix) |
error: blackmagic-desktop-video has been due to being unmaintained
it has been and now it isn't | 17:55:39 |
SomeoneSerge (back on matrix) | In reply to @hexa:lossy.network not sure how many jobs that will generate โฏ nix-eval-jobs --expr 'import ./pkgs/top-level/release-cuda.nix { }' --force-recurse | wc -l
...
138452
(not counting eval errors) | 19:11:06 |
hexa (UTC+1) | so all of them | 19:13:28 |
hexa (UTC+1) | if there was a cache behind nix-community hydra, than you'd be mirroring cache.nixos.org effecitvely | 19:13:45 |
hexa (UTC+1) | * if there was a cache behind nix-community hydra, than you'd be mirroring cache.nixos.org effectively | 19:13:47 |