!eWOErHSaiddIbsUNsJ:nixos.org

NixOS CUDA

290 Members
CUDA packages maintenance and support in nixpkgs | https://github.com/orgs/NixOS/projects/27/ | https://nixos.org/manual/nixpkgs/unstable/#cuda58 Servers

Load older messages


SenderMessageTime
2 Jul 2024
@zimbatm:numtide.comJonas Chevalieri'd love to throw hardware at that problem :)12:24:59
@zimbatm:numtide.comJonas Chevalier are the cases where you would use the *WithCuda packages instead of import nixpkgs { config.cudaSupport = true; }? This could create a similar situation as I had when trying to mix torch and tensorflow in one python.withPackages, where you get package name collisions. 12:50:18
@ss:someonex.netSomeoneSerge (back on matrix)Holaaaa14:55:06
@ss:someonex.netSomeoneSerge (back on matrix)
In reply to @zimbatm:numtide.com
are the cases where you would use the *WithCuda packages instead of import nixpkgs { config.cudaSupport = true; }? This could create a similar situation as I had when trying to mix torch and tensorflow in one python.withPackages, where you get package name collisions.
Honestly, not many I think. "A standalone executable that has no transitive dependencies that require enabling optional cuda support". E.g. I think python3Packages.torchWithCuda would link against the wrong ucc/ucx/openmpi unless config.cudaSupport is set
15:00:46
@ss:someonex.netSomeoneSerge (back on matrix) I think they were mainly introduced to be put in passthru.tests and for nixpkgs-reviews 15:01:32
@ss:someonex.netSomeoneSerge (back on matrix) What I think we need instead is we need to somehow [more] publicly expose nixpkgsFun so we can access it from all-packages.nix and prepare the pkgsCuda and pkgsRocm attributes 15:03:14
@ss:someonex.netSomeoneSerge (back on matrix) * What I think we need instead is we need to somehow [more] publicly expose nixpkgsFun so we can access it from all-packages.nix and prepare the pkgsCuda and pkgsRocm attributes (even without recurseIntoAttrs) 15:03:33
@ss:someonex.netSomeoneSerge (back on matrix)
In reply to @zimbatm:numtide.com
I'd love to do that
We'd love that too ๐Ÿ™ƒ we talk about it but never gain enough momentum to act
15:05:16
@zimbatm:numtide.comJonas ChevalierWe could use the Hydra instance in nix-community. It's already there and available.16:19:24
@zimbatm:numtide.comJonas ChevalierSomething like this: https://github.com/nix-community/infra/pull/133516:45:30
@ss:someonex.netSomeoneSerge (back on matrix)
In reply to @zimbatm:numtide.com
Something like this: https://github.com/nix-community/infra/pull/1335
Just like that...
16:53:58
3 Jul 2024
@julius:mtx.liftm.deหˆtอกsษ›หzaษฬฏ Jonas Chevalier: The link to the eval you posted on that PR 404s. 10:35:07
@zimbatm:numtide.comJonas Chevalieryeah, I renamed the jobset to https://hydra.nix-community.org/jobset/nixpkgs/cuda-nixos-unstable10:36:25
@hexa:lossy.networkhexa (UTC+1)awesome10:56:28
@ss:someonex.netSomeoneSerge (back on matrix)Yesterday seems a bit hazy...12:30:22
@ss:someonex.netSomeoneSerge (back on matrix)
In reply to @zimbatm:numtide.com
Something like this: https://github.com/nix-community/infra/pull/1335
I'll look into updating cuda-release.nix
12:30:34
@ss:someonex.netSomeoneSerge (back on matrix)
In reply to @zimbatm:numtide.com
yeah, I renamed the jobset to https://hydra.nix-community.org/jobset/nixpkgs/cuda-nixos-unstable
H'm so in hydra you "create a jobset" somewhere like in a web ui before you merge the terraform configs?
12:32:08
@ss:someonex.netSomeoneSerge (back on matrix)* H'm so in hydra you "create a jobset" somewhere like in a web ui before you merge the terraform configs? Or the tf config is the whole thing but you deployed it manually?12:38:17
@ss:someonex.netSomeoneSerge (back on matrix)

Isn't that a gem:

โฏ hydra-eval-jobs --help
error: unrecognised flag '--help'
Try 'hydra-eval-jobs --help' for more information.
16:16:04
@hexa:lossy.networkhexa (UTC+1)faissWithCuda pls ๐Ÿ˜„ 16:56:57
@ss:someonex.netSomeoneSerge (back on matrix)
In reply to @hexa:lossy.network
faissWithCuda pls ๐Ÿ˜„
Why not just https://github.com/NixOS/nixpkgs/pull/324379/files#diff-b3a88f86f137f8870849673fb9b06582cb73937114ee34a61ae5604e259829a5R37
17:13:53
@ss:someonex.netSomeoneSerge (back on matrix) Jonas Chevalier while at it, nobody is building import <nixpkgs> { config.rocmSupport = true; } either, and that one is free 17:14:56
@ss:someonex.netSomeoneSerge (back on matrix)The only reason not to build that with the NixOS Hydra is... to save resources17:16:20
@hexa:lossy.networkhexa (UTC+1)not sure how many jobs that will generate 17:17:40
@ss:someonex.netSomeoneSerge (back on matrix)Me neither ๐Ÿ™ƒ17:21:54
@ss:someonex.netSomeoneSerge (back on matrix)

error: blackmagic-desktop-video has been due to being unmaintained

it has been and now it isn't

17:55:39
@ss:someonex.netSomeoneSerge (back on matrix)
In reply to @hexa:lossy.network
not sure how many jobs that will generate
โฏ nix-eval-jobs --expr 'import ./pkgs/top-level/release-cuda.nix { }' --force-recurse | wc -l
...
138452

(not counting eval errors)

19:11:06
@hexa:lossy.networkhexa (UTC+1)so all of them19:13:28
@hexa:lossy.networkhexa (UTC+1)if there was a cache behind nix-community hydra, than you'd be mirroring cache.nixos.org effecitvely19:13:45
@hexa:lossy.networkhexa (UTC+1) * if there was a cache behind nix-community hydra, than you'd be mirroring cache.nixos.org effectively19:13:47

Show newer messages


Back to Room ListRoom Version: 9