!CcTBuBritXGywOEGWJ:matrix.org

NixOS Binary Cache Self-Hosting

137 Members
About how to host a very large-scale binary cache and more48 Servers

Load older messages


SenderMessageTime
11 Mar 2024
@shalokshalom:dendrite.matrix.orgShalok Shalom
In reply to @edef1c:matrix.org
right now it's doing an impressive job of wringing the worst possible perf out of postgres
Haha :D
17:20:40
@edef1c:matrix.orgedef
In reply to @edef1c:matrix.org
basically i don't really want to be all "you need to be this tall to ride, please have actual irl ops experience at scale to talk at all" but if people want to participate in conversations like this and make demands about SLOs/SLAs i'd like them to at least read the SRE at Google book and learn to think about this well, it's literally free
i'm afraid i have to point at the sign
17:20:42
@shalokshalom:dendrite.matrix.orgShalok Shalom
In reply to @edef1c:matrix.org
i think reworking the database / storage backend for Hydra would already provide a lot of value
Do we have an issue for that?
17:20:53
@edef1c:matrix.orgedefi don't think so17:20:59
@edef1c:matrix.orgedefbut i think we could quite reasonably strangler-pattern it17:21:06
@shalokshalom:dendrite.matrix.orgShalok ShalomHow many people do we have, that happen to be fine with Perl yet17:21:41
@shalokshalom:dendrite.matrix.orgShalok ShalomIn an appropriate manner 17:22:06
@edef1c:matrix.orgedefi grew up writing Perl but it's been a decade or two since i've been primarily a Perl programmer17:22:16
@shalokshalom:dendrite.matrix.orgShalok ShalomI see17:22:30
@edef1c:matrix.orgedefit's not particularly hard to learn, and it's a nice language for a lot of things if you grasp it properly17:23:41
@shalokshalom:dendrite.matrix.orgShalok ShalomYeah, I saw the existing Perl code and found it to be reasonable readable, but I heard community voices..17:24:10
@shalokshalom:dendrite.matrix.orgShalok ShalomI care more about the established architecture, as the language itself17:24:25
@shalokshalom:dendrite.matrix.orgShalok ShalomAnd thought, it might take an experienced Perl hacker to circumvent that17:24:40
@edef1c:matrix.orgedefi wouldn't say that Hydra is one of the nicer Perl codebases i've seen17:24:41
@shalokshalom:dendrite.matrix.orgShalok Shalomeventually17:24:43
@edef1c:matrix.orgedefbut you fight with the army you have, not the one you want17:24:54
@shalokshalom:dendrite.matrix.orgShalok ShalomSo you wouldnt agree to see if a replacement has any sense.17:25:21
@edef1c:matrix.orgedefmy experience tells me that these grand migrations rarely go well, and staged migrations provide value continuously with far more predictability17:26:41
@edef1c:matrix.orgedefeven if you have a credible replacement you could deploy tomorrow in a greenfield scenario, that does not mean there is a migration path17:28:19
@edef1c:matrix.orgedefwherever migration paths do exist, they are generally not pre-tested on a system of this scale17:28:51
@edef1c:matrix.orgedefscale is where ideas that look good on paper go to die, pretty much17:29:20
@shalokshalom:dendrite.matrix.orgShalok Shalom
In reply to @edef1c:matrix.org
even if you have a credible replacement you could deploy tomorrow in a greenfield scenario, that does not mean there is a migration path
yeah, sure
17:29:25
@shalokshalom:dendrite.matrix.orgShalok Shalomyou paint a rosier picture of Hydra, as that one that I got today by another contributor 17:29:43
@shalokshalom:dendrite.matrix.orgShalok ShalomI dont really have an overview, on how bad it is17:29:54
@shalokshalom:dendrite.matrix.orgShalok Shalomcouple of things look really broken from the outside17:30:03
@shalokshalom:dendrite.matrix.orgShalok Shalomsearch queries as an example17:30:12
@edef1c:matrix.orgedefeh. i've seen some shit in this world, we are nowhere near rock bottom yet17:30:22
@shalokshalom:dendrite.matrix.orgShalok Shalomand even just downloading an ISO, which took a full 15 minutes yesterday to even start17:30:28
@edef1c:matrix.orgedefwe could improve search queries and blob downloads quite directly17:30:45
@whentze:matrix.orgWanja Hentzeand preferring an incremental replacement is not an endorsement of what's there17:30:51

Show newer messages


Back to Room ListRoom Version: 10