!RROtHmAaQIkiJzJZZE:nixos.org

NixOS Infrastructure

272 Members
Next Infra call: 2024-07-11, 18:00 CEST (UTC+2) | Infra operational issues backlog: https://github.com/orgs/NixOS/projects/52 | See #infra-alerts:nixos.org for real time alerts from Prometheus.86 Servers

You have reached the beginning of time (for this room).


SenderMessageTime
11 Oct 2024
@rick:matrix.ciphernetics.nlMindaviTo be clear, the main bottleneck is compression for uploading the build results to S3? Or am I misunderstanding?04:51:08
@rosscomputerguy:matrix.orgTristan Ross
In reply to @emilazy:matrix.org
if the Foundation will pay for a month then it seems worth it to just do it?
Tbf, I don't think the cost is much of a concern, Tom brought up the cost being not too much more and I've been browsing Hetzner's site and the price difference is like 100 euros.
04:51:56
@rosscomputerguy:matrix.orgTristan Ross
In reply to @rick:matrix.ciphernetics.nl
To be clear, the main bottleneck is compression for uploading the build results to S3? Or am I misunderstanding?
From what I've read, it seems compression.
04:52:07
@rosscomputerguy:matrix.orgTristan RossI think S3 uploads would be more likely to saturate a network rather than cause CPU throttling04:52:45
@emilazy:matrix.orgemilyI think both compression and uploads are bottlenecks?04:56:29
@emilazy:matrix.orgemilynot sure though.04:56:45
@emilazy:matrix.orgemily"waiting for outputs", is what I always here.04:56:50
@rosscomputerguy:matrix.orgTristan RossOh04:57:04
@emilazy:matrix.orgemily * "waiting for outputs", is what I always hear.04:57:06
@rick:matrix.ciphernetics.nlMindaviIsn't that compression on the builders?05:11:06
@rosscomputerguy:matrix.orgTristan Ross
In reply to @rick:matrix.ciphernetics.nl
Isn't that compression on the builders?
No
05:11:24
@rosscomputerguy:matrix.orgTristan Rosshttps://github.com/NixOS/hydra/issues/55305:11:35
@rick:matrix.ciphernetics.nlMindaviAh, like that05:14:43
@rick:matrix.ciphernetics.nlMindaviOk now it makes sense again :)05:14:55
@vcunat:matrix.orgvcunatI'm fairly certainly that the compression of results on the central machine is what's limiting the throughput almost all the time, as the farm is currently.06:11:34
@emilazy:matrix.orgemilyan EPYC with better thermals seems like it'd be a good investment, then?06:12:06
@vcunat:matrix.orgvcunatWe have some bigger aarch64 in the farm already, so alternatively we could try that "for free".06:13:08
@emilazy:matrix.orgemilywouldn't that run into the atomics and platform purity problems wrt the evaluator?06:13:59

Show newer messages


Back to Room ListRoom Version: 6