!CcTBuBritXGywOEGWJ:matrix.org

NixOS Binary Cache Self-Hosting

160 Members
About how to host a very large-scale binary cache and more52 Servers

You have reached the beginning of time (for this room).


SenderMessageTime
11 Mar 2024
@shalokshalom:dendrite.matrix.orgShalok Shalomyou mentioned the database and the backend17:34:10
@edef1c:matrix.orgedefbut building a system that can run two things in parallel is still building a fair bit of new system17:34:29
@edef1c:matrix.orgedef
In reply to @shalokshalom:dendrite.matrix.org
but is it due to performance characteristics of Perl
i think Perl's perf should nowhere be on the hot path
17:34:44
@shalokshalom:dendrite.matrix.orgShalok Shalomnice17:34:55
@edef1c:matrix.orgedeffor the cache itself, there isn't really any perl on the hot path17:35:09
@shalokshalom:dendrite.matrix.orgShalok Shalom
In reply to @edef1c:matrix.org
but building a system that can run two things in parallel is still building a fair bit of new system
should be decoupled as far as possible
17:35:15
@edef1c:matrix.orgedefwe can't decouple so far that we're running two entirely parallel build pipelines17:35:38
@edef1c:matrix.orgedefwe literally can't afford to run two build farms side by side17:35:45
@shalokshalom:dendrite.matrix.orgShalok ShalomWhy is Hydra running new builds for the packages new to unstable only every 2 days?17:35:48
@shalokshalom:dendrite.matrix.orgShalok Shalom
In reply to @edef1c:matrix.org
we literally can't afford to run two build farms side by side
yeah, that is understandable. I would be tempted to care for that for the testing period.
17:36:07
@edef1c:matrix.orgedefthat's more about build farm capacity than anything about perl, i think17:36:11
@edef1c:matrix.orgedefi don't have stats on the build farm utilisation, maybe the infra team does17:36:31
@shalokshalom:dendrite.matrix.orgShalok Shalomdifferent opinions about that from different sides 17:36:36
@shalokshalom:dendrite.matrix.orgShalok ShalomI heard the word 'clusterfuck' 😃17:37:01
@edef1c:matrix.orgedefon priors i'd lean towards "we just don't have enough compute" rather than "we're leaving it idle", but talk is cheap, i'd love to see some data17:37:11
@edef1c:matrix.orgedeflike, broadly it's not very complicated, we (hopefully) have a Prometheus somewhere and a Grafana dash somewhere that can tell us this17:37:39

Show newer messages


Back to Room ListRoom Version: 10