!CcTBuBritXGywOEGWJ:matrix.org

NixOS Binary Cache Self-Hosting

132 Members
About how to host a very large-scale binary cache and more47 Servers

Load older messages


SenderMessageTime
11 Mar 2024
@shalokshalom:dendrite.matrix.orgShalok ShalomAnd how complicated would it be, to test such an instance to verify, if the 300k long build queues would be satisfied and such 17:19:25
@edef1c:matrix.orgedefi think we can do a lot better wrt build queues and scheduling17:19:37
@edef1c:matrix.orgedefbut i'm fearful people want to go for a Big Rewrite17:19:50
@shalokshalom:dendrite.matrix.orgShalok Shalom
In reply to @edef1c:matrix.org
as much as Joe Armstrong liked to talk about that number, it's not really from a representative sample
I know ;) But its still quite reasonable to assume, 7 nines are common to Erlang
17:19:59
@shalokshalom:dendrite.matrix.orgShalok Shalom
In reply to @edef1c:matrix.org
but i'm fearful people want to go for a Big Rewrite
I would suggest an already written alternative 😬
17:20:23
@shalokshalom:dendrite.matrix.orgShalok Shalom
In reply to @edef1c:matrix.org
right now it's doing an impressive job of wringing the worst possible perf out of postgres
Haha :D
17:20:40
@edef1c:matrix.orgedef
In reply to @edef1c:matrix.org
basically i don't really want to be all "you need to be this tall to ride, please have actual irl ops experience at scale to talk at all" but if people want to participate in conversations like this and make demands about SLOs/SLAs i'd like them to at least read the SRE at Google book and learn to think about this well, it's literally free
i'm afraid i have to point at the sign
17:20:42
@shalokshalom:dendrite.matrix.orgShalok Shalom
In reply to @edef1c:matrix.org
i think reworking the database / storage backend for Hydra would already provide a lot of value
Do we have an issue for that?
17:20:53
@edef1c:matrix.orgedefi don't think so17:20:59
@edef1c:matrix.orgedefbut i think we could quite reasonably strangler-pattern it17:21:06
@shalokshalom:dendrite.matrix.orgShalok ShalomHow many people do we have, that happen to be fine with Perl yet17:21:41
@shalokshalom:dendrite.matrix.orgShalok ShalomIn an appropriate manner 17:22:06
@edef1c:matrix.orgedefi grew up writing Perl but it's been a decade or two since i've been primarily a Perl programmer17:22:16
@shalokshalom:dendrite.matrix.orgShalok ShalomI see17:22:30
@edef1c:matrix.orgedefit's not particularly hard to learn, and it's a nice language for a lot of things if you grasp it properly17:23:41
@shalokshalom:dendrite.matrix.orgShalok ShalomYeah, I saw the existing Perl code and found it to be reasonable readable, but I heard community voices..17:24:10
@shalokshalom:dendrite.matrix.orgShalok ShalomI care more about the established architecture, as the language itself17:24:25
@shalokshalom:dendrite.matrix.orgShalok ShalomAnd thought, it might take an experienced Perl hacker to circumvent that17:24:40
@edef1c:matrix.orgedefi wouldn't say that Hydra is one of the nicer Perl codebases i've seen17:24:41
@shalokshalom:dendrite.matrix.orgShalok Shalomeventually17:24:43
@edef1c:matrix.orgedefbut you fight with the army you have, not the one you want17:24:54
@shalokshalom:dendrite.matrix.orgShalok ShalomSo you wouldnt agree to see if a replacement has any sense.17:25:21
@edef1c:matrix.orgedefmy experience tells me that these grand migrations rarely go well, and staged migrations provide value continuously with far more predictability17:26:41
@edef1c:matrix.orgedefeven if you have a credible replacement you could deploy tomorrow in a greenfield scenario, that does not mean there is a migration path17:28:19
@edef1c:matrix.orgedefwherever migration paths do exist, they are generally not pre-tested on a system of this scale17:28:51
@edef1c:matrix.orgedefscale is where ideas that look good on paper go to die, pretty much17:29:20
@shalokshalom:dendrite.matrix.orgShalok Shalom
In reply to @edef1c:matrix.org
even if you have a credible replacement you could deploy tomorrow in a greenfield scenario, that does not mean there is a migration path
yeah, sure
17:29:25
@shalokshalom:dendrite.matrix.orgShalok Shalomyou paint a rosier picture of Hydra, as that one that I got today by another contributor 17:29:43
@shalokshalom:dendrite.matrix.orgShalok ShalomI dont really have an overview, on how bad it is17:29:54
@shalokshalom:dendrite.matrix.orgShalok Shalomcouple of things look really broken from the outside17:30:03

Show newer messages


Back to Room ListRoom Version: 10