!RROtHmAaQIkiJzJZZE:nixos.org

NixOS Infrastructure

386 Members
Next Infra call: 2024-07-11, 18:00 CEST (UTC+2) | Infra operational issues backlog: https://github.com/orgs/NixOS/projects/52 | See #infra-alerts:nixos.org for real time alerts from Prometheus.120 Servers

Load older messages


SenderMessageTime
21 Aug 2025
@k900:0upti.meK900If we're talking Hydra support, the answer is most likely just "no"15:41:05
@rosscomputerguy:matrix.orgTristan RossWe're figuring that out, we're needing to know what sort of requirements for infra there is for builders.15:43:28
@k900:0upti.meK900I am going to be real, it'll be a hard sell when there's no practical usage for RISC-V and no cores that are even Ampere ast15:44:08
@k900:0upti.meK900* I am going to be real, it'll be a hard sell when there's no practical usage for RISC-V and no cores that are even Ampere fast15:44:09
@k900:0upti.meK900And we can't fan out early bootstrap15:44:32
@k900:0upti.meK900I'd expect like, 2-3 days overhead per staging cycle from this, which is BAD15:44:47
@k900:0upti.meK900If my estimates of single machine RISC-V perf are anywhere close to reality15:45:06
@qyliss:fairydust.spaceAlyssa RossCouldn't we just not block staging on RISC-V?15:45:28
@k900:0upti.meK900We could run a separate jobset, but then the same thing could be done outside of official ifnra15:45:57
@k900:0upti.meK900* We could run a separate jobset, but then the same thing could be done outside of official infra15:45:58
@k900:0upti.meK900 (and probably should be done outside official infra, at least initially) 15:46:06
@vcunat:matrix.orgVladimír ČunátTrust is needed. People who have physical access to the HW can more-or-less put anything into the cache.15:53:05
@vcunat:matrix.orgVladimír Čunát(though not trivially at least)15:53:34
@rosscomputerguy:matrix.orgTristan RossIf the infra team doesn't have physical access but the hardware team does, is that acceptable for trust?15:53:55
@k900:0upti.meK900 Would not be great 15:54:38
@k900:0upti.meK900But also, again, I want to first see proof that there's enough hardware15:54:38
@k900:0upti.meK900 And that there's enough demand to justify the Hydra costs 15:54:43
@rosscomputerguy:matrix.orgTristan RossWhat sort of costs does it make on Hydra? Is it just eval and storage?15:55:56
@k900:0upti.meK900 Queue runner is slow 15:56:35
@emilazy:matrix.orgemilycache for the entire jobset on a new platform is substantial (since we pay the whole cost every staging cycle)15:56:40
@k900:0upti.meK900 Queue runner slowness scales with number of jobs 15:56:44
@emilazy:matrix.orgemilyand Hydra scheduling is a bottleneck15:56:53
@k900:0upti.meK900 Storage is also still questionable 15:56:59
@k900:0upti.meK900 Eval is largely not an issue 15:57:06
@emilazy:matrix.orgemilyI think it would make sense to prove this externally first15:57:12
@emilazy:matrix.orgemilywith a separate Hydra15:57:23
@emilazy:matrix.orgemilyand see if the hardware can even keep up15:57:33
@rosscomputerguy:matrix.orgTristan RossOk, I'll take this back to the HW team and discuss things more.15:57:42
@emilazy:matrix.orgemily the bottleneck right now is x86_64-darwin which I suspect is substantially faster than the best RISC-V hardware 15:58:10
@dramforever:matrix.orgdramforeveri think risc-v hydra for nixpkgs is "no"16:02:43

Show newer messages


Back to Room ListRoom Version: 6