| 3 Jul 2024 |
 SomeoneSerge (back on matrix) | In reply to @hexa:lossy.network
faissWithCuda pls 😄 Why not just https://github.com/NixOS/nixpkgs/pull/324379/files#diff-b3a88f86f137f8870849673fb9b06582cb73937114ee34a61ae5604e259829a5R37 | 17:13:53 |
| SomeoneSerge (back on matrix) | Jonas Chevalier while at it, nobody is building import <nixpkgs> { config.rocmSupport = true; } either, and that one is free | 17:14:56 |
| SomeoneSerge (back on matrix) | The only reason not to build that with the NixOS Hydra is... to save resources | 17:16:20 |
 hexa (UTC+1) | not sure how many jobs that will generate | 17:17:40 |
| SomeoneSerge (back on matrix) | Me neither 🙃 | 17:21:54 |
| SomeoneSerge (back on matrix) |
error: blackmagic-desktop-video has been due to being unmaintained
it has been and now it isn't | 17:55:39 |
| SomeoneSerge (back on matrix) | In reply to @hexa:lossy.network
not sure how many jobs that will generate ❯ nix-eval-jobs --expr 'import ./pkgs/top-level/release-cuda.nix { }' --force-recurse | wc -l
...
138452
(not counting eval errors) | 19:11:06 |
| hexa (UTC+1) | so all of them | 19:13:28 |
| hexa (UTC+1) | if there was a cache behind nix-community hydra, than you'd be mirroring cache.nixos.org effecitvely | 19:13:45 |
| hexa (UTC+1) | * if there was a cache behind nix-community hydra, than you'd be mirroring cache.nixos.org effectively | 19:13:47 |
| SomeoneSerge (back on matrix) | Yeah... Ideally we'd have a solution that evaluates the full DAGs for vanilla and cuda nixpkgs, starts building cuda from the leaves (ehhh, the roots), and always suspends the build if it hash matches the vanilla hash | 19:23:45 |
 connor (burnt/out) (UTC-8) | Is there an open collective for the community hydra instance | 19:24:40 |
| connor (burnt/out) (UTC-8) | If they’re going to be building CUDA packages I definitely want to contribute lol | 19:25:56 |
 matthewcroughan | How can onnxruntime use more than 64G of memory with 12 cores | 22:28:09 |
| matthewcroughan | ugh | 22:28:09 |
| matthewcroughan | oh, maybe because I lack https://github.com/NixOS/nixpkgs/blob/nixos-unstable/pkgs/development/libraries/onnxruntime/default.nix#L191 | 22:30:58 |
| matthewcroughan | I think it reaches a part of the build where it runs away | 22:31:15 |
| matthewcroughan | * I think it reaches a part of the build where it runs away, without this | 22:31:20 |
| matthewcroughan | https://github.com/NixOS/nixpkgs/pull/304069 | 22:32:05 |
| matthewcroughan | this | 22:32:06 |
| 4 Jul 2024 |
 Jonas Chevalier | In reply to @connorbaker:matrix.org
Is there an open collective for the community hydra instance yes, we spend it all on hardware: https://opencollective.com/nix-community
we could also explore hardware donation if you want to bring esoteric hardware to the build farm.
| 08:06:20 |
| Jonas Chevalier | In reply to @ss:someonex.net
H'm so in hydra you "create a jobset" somewhere like in a web ui before you merge the terraform configs? Or the tf config is the whole thing but you deployed it manually? The jobset is created with Terraform with https://github.com/nix-community/infra/blob/master/terraform/hydra-projects.tf
This works well because Hydra is a mix of stateful stuff so having a convergence engine is quite nice there.
| 08:07:37 |
| Jonas Chevalier | In reply to @ss:someonex.net
Jonas Chevalier while at it, nobody is building import <nixpkgs> { config.rocmSupport = true; } either, and that one is free Ok, let's do that once CUDA is stable. Building unfreeRedistributable could also be nice. | 08:08:18 |
| Jonas Chevalier | In reply to @ss:someonex.net
Why not just https://github.com/NixOS/nixpkgs/pull/324379/files#diff-b3a88f86f137f8870849673fb9b06582cb73937114ee34a61ae5604e259829a5R37 I think this is going to break our instance. The main hydra needs 128GB of RAM to evaluate all of nixpkgs. If you want to keep the list up to date, it's probably better to invest in a script. | 08:11:25 |
| Jonas Chevalier | In reply to @ss:someonex.net
Why not just https://github.com/NixOS/nixpkgs/pull/324379/files#diff-b3a88f86f137f8870849673fb9b06582cb73937114ee34a61ae5604e259829a5R37 * I think this is going to break our instance. The main hydra needs 128GB of RAM to evaluate all of nixpkgs. If you want to keep the list up to date, it's probably better to invest in a script (that you run locally and commit the result). | 08:11:45 |
|  Philip Taron (UTC-8) left the room. | 15:46:31 |
| 5 Jul 2024 |
| Jonas Chevalier | I don't know if this has been discussed before: did you look at aligning the package versions with some upstream?
For example Nvidia are releasing the nvcr.io Docker images. If we could provide the same versions as a package sets, it would reduce the switching cost for those users. | 06:10:17 |
| SomeoneSerge (back on matrix) | In reply to @zimbatm:numtide.com
I don't know if this has been discussed before: did you look at aligning the package versions with some upstream?
For example Nvidia are releasing the nvcr.io Docker images. If we could provide the same versions as a package sets, it would reduce the switching cost for those users. Well if we're talking about cudaPackages, they are aligned with the manifests that upstream advertises | 07:20:34 |
| SomeoneSerge (back on matrix) |
it would reduce the switching cost for those users.
Do you have a specific example in mind? | 07:20:53 |
| SomeoneSerge (back on matrix) | *
it would reduce the switching cost for those users.
Do you have a specific user story in mind? | 07:21:02 |
