!eWOErHSaiddIbsUNsJ:nixos.org

NixOS CUDA

310 Members
CUDA packages maintenance and support in nixpkgs | https://github.com/orgs/NixOS/projects/27/ | https://nixos.org/manual/nixpkgs/unstable/#cuda60 Servers

Load older messages


SenderMessageTime
2 Jul 2024
@ss:someonex.netSomeoneSerge (matrix works sometimes) * What I think we need instead is we need to somehow [more] publicly expose nixpkgsFun so we can access it from all-packages.nix and prepare the pkgsCuda and pkgsRocm attributes (even without recurseIntoAttrs) 15:03:33
@ss:someonex.netSomeoneSerge (matrix works sometimes)
In reply to @zimbatm:numtide.com
I'd love to do that
We'd love that too 🙃 we talk about it but never gain enough momentum to act
15:05:16
@zimbatm:numtide.comJonas ChevalierWe could use the Hydra instance in nix-community. It's already there and available.16:19:24
@zimbatm:numtide.comJonas ChevalierSomething like this: https://github.com/nix-community/infra/pull/133516:45:30
@ss:someonex.netSomeoneSerge (matrix works sometimes)
In reply to @zimbatm:numtide.com
Something like this: https://github.com/nix-community/infra/pull/1335
Just like that...
16:53:58
3 Jul 2024
@julius:mtx.liftm.deˈt͡sɛːzaɐ̯ Jonas Chevalier: The link to the eval you posted on that PR 404s. 10:35:07
@zimbatm:numtide.comJonas Chevalieryeah, I renamed the jobset to https://hydra.nix-community.org/jobset/nixpkgs/cuda-nixos-unstable10:36:25
@hexa:lossy.networkhexaawesome10:56:28
@ss:someonex.netSomeoneSerge (matrix works sometimes)Yesterday seems a bit hazy...12:30:22
@ss:someonex.netSomeoneSerge (matrix works sometimes)
In reply to @zimbatm:numtide.com
Something like this: https://github.com/nix-community/infra/pull/1335
I'll look into updating cuda-release.nix
12:30:34
@ss:someonex.netSomeoneSerge (matrix works sometimes)
In reply to @zimbatm:numtide.com
yeah, I renamed the jobset to https://hydra.nix-community.org/jobset/nixpkgs/cuda-nixos-unstable
H'm so in hydra you "create a jobset" somewhere like in a web ui before you merge the terraform configs?
12:32:08
@ss:someonex.netSomeoneSerge (matrix works sometimes)* H'm so in hydra you "create a jobset" somewhere like in a web ui before you merge the terraform configs? Or the tf config is the whole thing but you deployed it manually?12:38:17
@ss:someonex.netSomeoneSerge (matrix works sometimes)

Isn't that a gem:

❯ hydra-eval-jobs --help
error: unrecognised flag '--help'
Try 'hydra-eval-jobs --help' for more information.
16:16:04
@hexa:lossy.networkhexafaissWithCuda pls 😄 16:56:57
@ss:someonex.netSomeoneSerge (matrix works sometimes)
In reply to @hexa:lossy.network
faissWithCuda pls 😄
Why not just https://github.com/NixOS/nixpkgs/pull/324379/files#diff-b3a88f86f137f8870849673fb9b06582cb73937114ee34a61ae5604e259829a5R37
17:13:53
@ss:someonex.netSomeoneSerge (matrix works sometimes) Jonas Chevalier while at it, nobody is building import <nixpkgs> { config.rocmSupport = true; } either, and that one is free 17:14:56
@ss:someonex.netSomeoneSerge (matrix works sometimes)The only reason not to build that with the NixOS Hydra is... to save resources17:16:20
@hexa:lossy.networkhexanot sure how many jobs that will generate 17:17:40
@ss:someonex.netSomeoneSerge (matrix works sometimes)Me neither 🙃17:21:54
@ss:someonex.netSomeoneSerge (matrix works sometimes)

error: blackmagic-desktop-video has been due to being unmaintained

it has been and now it isn't

17:55:39
@ss:someonex.netSomeoneSerge (matrix works sometimes)
In reply to @hexa:lossy.network
not sure how many jobs that will generate
❯ nix-eval-jobs --expr 'import ./pkgs/top-level/release-cuda.nix { }' --force-recurse | wc -l
...
138452

(not counting eval errors)

19:11:06
@hexa:lossy.networkhexaso all of them19:13:28
@hexa:lossy.networkhexaif there was a cache behind nix-community hydra, than you'd be mirroring cache.nixos.org effecitvely19:13:45
@hexa:lossy.networkhexa * if there was a cache behind nix-community hydra, than you'd be mirroring cache.nixos.org effectively19:13:47
@ss:someonex.netSomeoneSerge (matrix works sometimes)Yeah... Ideally we'd have a solution that evaluates the full DAGs for vanilla and cuda nixpkgs, starts building cuda from the leaves (ehhh, the roots), and always suspends the build if it hash matches the vanilla hash19:23:45
@connorbaker:matrix.orgconnor (he/him)Is there an open collective for the community hydra instance19:24:40
@connorbaker:matrix.orgconnor (he/him)If they’re going to be building CUDA packages I definitely want to contribute lol19:25:56
@matthewcroughan:defenestrate.itmatthewcroughanHow can onnxruntime use more than 64G of memory with 12 cores22:28:09
@matthewcroughan:defenestrate.itmatthewcroughanugh22:28:09
@matthewcroughan:defenestrate.itmatthewcroughanoh, maybe because I lack https://github.com/NixOS/nixpkgs/blob/nixos-unstable/pkgs/development/libraries/onnxruntime/default.nix#L19122:30:58

Show newer messages


Back to Room ListRoom Version: 9