| 14 Oct 2025 |
 vcunat | * It could matter. I mean, it could affect CPU saturation in future. | 17:15:09 |
 Sami Liedes | And I see that happen in practice with my builds; some serialized configure gets throttled because lots of derivations build, then it runs out of derivations and waits until that is finished, and then explodes again. | 17:15:45 |
| vcunat | Hydra has so much work that critical path matters little in practice. | 17:16:03 |
| vcunat | (Hundreds of thousands jobs.) | 17:16:28 |
 K900 | At Hydra scale the critical path finishes long before we're out of work in pretty much all cases | 17:17:07 |
| Sami Liedes | Right. That I can imagine (and is what I asked for :). So not building e.g. only a single architecture of a single channel helps presumably a lot. | 17:17:06 |
| vcunat | No, that's not it. | 17:17:29 |
| vcunat | Architectures mostly don't share hardware. | 17:17:45 |
| K900 | Hydra mostly always has overlapping loads | 17:17:56 |
| vcunat | (only *-darwin in our case) | 17:17:55 |
| Sami Liedes | That makes sense. | 17:18:04 |
| vcunat | We always have at least unstable and stable. And staging-* corresponding to those two. Lots of work. And sometimes extra stuff like testing glibc upgrade. | 17:19:00 |
| Sami Liedes | What kinds of loads then?
I have used as my test case building pkgs.freecad from an empty slate. I think this might be less of a problem if I reduced my cores/parallelism so that my load average didn't climb into 100-200 on this 16 core (32 thread) machine. | 17:19:02 |
| K900 | You definitely should do that, yes | 17:19:27 |
| K900 | You want to overcommit maybe 2x, but not 10x | 17:19:48 |
| Sami Liedes | Or maybe it's something else weird I'm doing, but I feel I see too many builds of binutils which seem to configure very slowly and serially :-) | 17:20:06 |
| vcunat | That's a pain point. But less so on Hydra scale. | 17:20:10 |
| vcunat | (which is primarily about throughput) | 17:20:30 |
| Sami Liedes | I actually also hacked on patches to make nix use systemd cgroups, but should figure out how to test it without risking my workstation... | 17:20:55 |
| Sami Liedes | Good to know that Hydra doesn't suffer of this :) | 17:21:25 |
| Sami Liedes | Just wanted to know if it's only my small scale! | 17:21:35 |
| vcunat | I don't think cgoups will help with this significantly. | 17:23:21 |
| Sami Liedes | No, not this issue, on hydra. | 17:23:28 |
| K900 | Yeah it won't | 17:23:37 |
| Sami Liedes | I agree, if it has enough work to do. | 17:23:35 |
| K900 | Not even on your own setup | 17:23:46 |
| Sami Liedes | Well, I think it should in the current stage, but maybe less if I reduce my overcommitment :) | 17:24:06 |
| Sami Liedes | But I'm also working to measure this, so I may get back to this! | 17:24:47 |
| 16 Oct 2025 |
 Arian | BMGcould you tell me how many narinfos we’re publishing per week? | 10:52:17 |
 BMG | Download query.csv | 11:06:14 |
