| 27 Jun 2026 |
hexa (signing key rotation when) | 🤡 | 14:22:50 |
emily | do we really need to GC that often? | 14:23:24 |
hexa (signing key rotation when) | we can try and reduce | 14:23:56 |
K900 | I assume those have less disk also? | 14:23:57 |
emily | oh I just mean in general | 14:24:03 |
hexa (signing key rotation when) | but fixing gc was annoying for the small macs with little disk | 14:24:08 |
hexa (signing key rotation when) | the linux builders have between 2x2 and 2x4TB NVME | 14:24:46 |
hexa (signing key rotation when) | the macs have like 256 for the hetzner ones | 14:24:58 |
hexa (signing key rotation when) | and more for the oakhost ones | 14:25:04 |
hexa (signing key rotation when) | we can try fast-nix-gc | 14:26:19 |
hexa (signing key rotation when) | what would it fix? I guess gcing faster would be benefitial to the nodes anyhow | 14:26:59 |
hexa (signing key rotation when) | but the window during which we'd gc would become smaller | 14:27:10 |
emily | yeah I'm just surprised that even Linux builders fill up that quickly | 14:27:17 |
emily | doing it twice an hour would be annoying if you wanted to drain the builders presumably | 14:27:38 |
hexa (signing key rotation when) | I don't think we tuned them as much | 14:27:41 |
hexa (signing key rotation when) | we like to keep them fuller so they have deps they might need later | 14:27:59 |
emily | wonder how easy it is to just make the builds take the GC lock | 14:28:01 |
hexa (signing key rotation when) | and with fast-nix-gc we can tell it to keep newer things alive | 14:28:17 |
emily | Sergei Zimmerman (xokdvium): how easy would it be to have an option for "refuse to try building something if some of its outputs are present" that defaults on if fallback paths would be used (i.e. macOS, unsandboxed Linux) and then we could set it on for all of Hydra? | 14:31:17 |
emily | I guess that still doesn't handle the case where some of the outputs reached the cache but others didn't, and another machine tries doing the build to satisfy another output, but hasn't substituted the outputs that are in the cache | 14:31:40 |
emily | then the cache still gets frankenbuilds | 14:31:46 |
Mic92 | In reply to @hexa:lossy.network we can try fast-nix-gc It also can skip recently added paths. And we can actually block on gc.lock now | 14:33:49 |
hexa (signing key rotation when) | that's what I meant here | 14:34:09 |
hexa (signing key rotation when) | can you pick your connection pooling change on top of hydra.nixos.org? | 14:34:28 |
hexa (signing key rotation when) | so we can merge | 14:34:31 |
Mic92 | * It also can skip recently added paths. And we can actually block on gc.lock now to not schedule new builds. It will now create more io | 14:34:35 |
Mic92 | * It also can skip recently added paths. And we can actually block on gc.lock now to not schedule new builds. It will now create more io anyway, so might be for the best to not schedule new builds during that | 14:35:44 |
Mic92 | In reply to @hexa:lossy.network can you pick your connection pooling change on top of hydra.nixos.org? I have on my laptop but not yet pushed. Need to wait for my train | 14:36:22 |
hexa (signing key rotation when) | i fairness, we now also clean out logs much more reliably on darwin | 14:41:54 |
hexa (signing key rotation when) | everything in macs/common/workarounds.nix | 14:42:15 |