!RROtHmAaQIkiJzJZZE:nixos.org

NixOS Infrastructure

468 Members
Next Infra call: 2024-07-11, 18:00 CEST (UTC+2) | Infra operational issues backlog: https://github.com/orgs/NixOS/projects/52 | See #infra-alerts:nixos.org for real time alerts from Prometheus.147 Servers

Load older messages


SenderMessageTime
27 Jun 2026
@emilazy:matrix.orgemily guess that's not really a problem if big-parallel is sufficiently rare 14:03:47
@hexa:lossy.networkhexa (signing key rotation when)and if they are small they'll pass through much faster14:03:50
@hexa:lossy.networkhexa (signing key rotation when)so eventually they get clogged with big-parallel builds14:04:08
@emilazy:matrix.orgemilymore thinking about ones that will take roughly the same time but hog the slots14:04:13
@hexa:lossy.networkhexa (signing key rotation when)
❯ rg big-parallel -l | wc -l
60
14:04:23
@emilazy:matrix.orgemilyright14:04:30
@emilazy:matrix.orgemilyideally you wouldn't need to statically assign this stuff at all but … well, preaching to the choir14:04:47
@hexa:lossy.networkhexa (signing key rotation when) https://prometheus.nixos.org/query?g0.expr=hydraqueuerunner_machine_type_runnable&g0.show_tree=0&g0.tab=table&g0.range_input=1h&g0.res_type=auto&g0.res_density=medium&g0.display_mode=lines&g0.show_exemplars=0 14:06:28
@hexa:lossy.networkhexa (signing key rotation when)so I think we just don't have the required-system-features as a dimension any more14:06:48
@emilazy:matrix.orgemily the failure mode I can see is if e.g. we need LLVMs and stuff for staging/-next but big-parallel builders get busy building a billion backlog things for unstable/releases that don't really benefit from it much instead 14:07:13
@emilazy:matrix.orgemily but maybe that's fine since staging/-next getting delayed by other branches is normal, just thinking it could make the initial bottleneck worse but I guess that's what manual management is for 14:07:53
@hexa:lossy.networkhexa (signing key rotation when)we can always bump to front14:10:02
@hexa:lossy.networkhexa (signing key rotation when)and I say we do14:10:06
@vcunat:matrix.orgvcunatIf the overall speed gets 2x higher or more, slight occasional delays won't be such a big deal 😉14:10:33
@emilazy:matrix.orgemily have we had big-parallel builder just sitting idle most of the time until now? 14:11:05
@hexa:lossy.networkhexa (signing key rotation when)they remain as an architectural problem14:11:05
@hexa:lossy.networkhexa (signing key rotation when)no, mixed slots14:11:11
@hexa:lossy.networkhexa (signing key rotation when)4 bp, 6 normal14:11:14
@emilazy:matrix.orgemilyor has the whole system been clogged up enough that they always have a Firefox or something to do?14:11:19
@emilazy:matrix.orgemilyah, ok14:11:25
@hexa:lossy.networkhexa (signing key rotation when)for that we'd need to run multiple queue-builders now14:11:27
@hexa:lossy.networkhexa (signing key rotation when)but the module does not support that yet14:11:38
@emilazy:matrix.orgemily so they'd operate below capacity because big-parallel slots are frequently unused, but everything operated below capacity so it was less visible? 14:11:46
@hexa:lossy.networkhexa (signing key rotation when)or the queue-builder would need support for better slot definitions14:11:47
@hexa:lossy.networkhexa (signing key rotation when)yea14:11:54
@hexa:lossy.networkhexa (signing key rotation when)Redacted or Malformed Event14:11:55
@emilazy:matrix.orgemilygoing to supported but not required makes sense to me then. I wonder if it makes sense to slightly decrease the per-job core count at the same time in exchange for the extra jobs you get. (sorry, this is just curiosity on my part, not trying to meddle with the decisions :) )14:14:35
@sempiternal-aurora:matrix.orgMyriaUhhh, it seems the problems I had with stdenv on the gcc-15.3.0 changes is also affecting staging-next. gfortran is failing build on aarch64-darwin (https://hydra.nixos.org/build/333247000) but locally it builds for me whe I ignore the cache14:16:46
@sempiternal-aurora:matrix.orgMyriaActually, may just be a gc error14:17:43
@sempiternal-aurora:matrix.orgMyriaBut this likely causes a large amount of failures14:18:00

Show newer messages


Back to Room ListRoom Version: 6