!CcTBuBritXGywOEGWJ:matrix.org

NixOS Binary Cache Self-Hosting

108 Members
About how to host a very large-scale binary cache and more48 Servers

You have reached the beginning of time (for this room).


SenderMessageTime
11 Mar 2024
@edef1c:matrix.orgedef
In reply to @arianvp:matrix.org
Can i ask why you didn't claim more than 5k? And I generally agree with this sentiment. I was hoping that me fighting for my company to donate 10k would cause more companies to do the same
the whole reason we have this project going on is that the foundation is underfunded
17:04:49
@edef1c:matrix.orgedeflike, there are other reasons to improve the storage/infra situation, but the cost reduction would be a pretty minor motivator to do it otherwise17:05:37
@shalokshalom:dendrite.matrix.orgShalok Shalomthat does seem to sound like a contradiction?17:11:50
@edef1c:matrix.orgedefin what sense17:12:20
@shalokshalom:dendrite.matrix.orgShalok Shalomdo you mean major, and not a minor motivator 17:12:22
@edef1c:matrix.orgedefwe can't burn like $15k/mo on this17:12:27
@shalokshalom:dendrite.matrix.orgShalok Shalomsince if its underfunded, I dont see how it is only a minor motivator17:12:43
@shalokshalom:dendrite.matrix.orgShalok Shalomseems a pretty major one 17:12:49
@edef1c:matrix.orgedef"otherwise"17:12:54
@edef1c:matrix.orgedefie, we are not in the case where it would be minor, but other than the underfunding, it's not exactly a huge number for an org that serves this many people17:14:04
@shalokshalom:dendrite.matrix.orgShalok Shalommy English skills had let me down, thanks for the explanation 🙂 17:15:11
@edef1c:matrix.orgedefnp! i do have a habit of using language in a way where a lot hinges on a single word17:15:50
@whentze:matrix.orgWanja Hentzeagreed, the cost is not large in relation to the value provided. it is large in relation to funding available17:15:57
@shalokshalom:dendrite.matrix.orgShalok ShalomI had a discussion today with K900, about the capabilities that a possible replacement for Hydra would need to provide for us to be valuable. How much do you think does it need to save, in order to come into question for you?17:17:33
@edef1c:matrix.orgedefi think reworking the database / storage backend for Hydra would already provide a lot of value17:18:13
@shalokshalom:dendrite.matrix.orgShalok ShalomIt would obviously also provide other benefits, but purely speaking in terms of performance 17:18:14
@edef1c:matrix.orgedefright now it's doing an impressive job of wringing the worst possible perf out of postgres17:18:34
@edef1c:matrix.orgedef
In reply to @shalokshalom:dendrite.matrix.org
Erlang is popular for its 9 nines :)
as much as Joe Armstrong liked to talk about that number, it's not really from a representative sample
17:19:21
@shalokshalom:dendrite.matrix.orgShalok ShalomAnd how complicated would it be, to test such an instance to verify, if the 300k long build queues would be satisfied and such 17:19:25
@edef1c:matrix.orgedefi think we can do a lot better wrt build queues and scheduling17:19:37
@edef1c:matrix.orgedefbut i'm fearful people want to go for a Big Rewrite17:19:50
@shalokshalom:dendrite.matrix.orgShalok Shalom
In reply to @edef1c:matrix.org
as much as Joe Armstrong liked to talk about that number, it's not really from a representative sample
I know ;) But its still quite reasonable to assume, 7 nines are common to Erlang
17:19:59
@shalokshalom:dendrite.matrix.orgShalok Shalom
In reply to @edef1c:matrix.org
but i'm fearful people want to go for a Big Rewrite
I would suggest an already written alternative 😬
17:20:23
@shalokshalom:dendrite.matrix.orgShalok Shalom
In reply to @edef1c:matrix.org
right now it's doing an impressive job of wringing the worst possible perf out of postgres
Haha :D
17:20:40
@edef1c:matrix.orgedef
In reply to @edef1c:matrix.org
basically i don't really want to be all "you need to be this tall to ride, please have actual irl ops experience at scale to talk at all" but if people want to participate in conversations like this and make demands about SLOs/SLAs i'd like them to at least read the SRE at Google book and learn to think about this well, it's literally free
i'm afraid i have to point at the sign
17:20:42
@shalokshalom:dendrite.matrix.orgShalok Shalom
In reply to @edef1c:matrix.org
i think reworking the database / storage backend for Hydra would already provide a lot of value
Do we have an issue for that?
17:20:53
@edef1c:matrix.orgedefi don't think so17:20:59
@edef1c:matrix.orgedefbut i think we could quite reasonably strangler-pattern it17:21:06
@shalokshalom:dendrite.matrix.orgShalok ShalomHow many people do we have, that happen to be fine with Perl yet17:21:41
@shalokshalom:dendrite.matrix.orgShalok ShalomIn an appropriate manner 17:22:06

Show newer messages


Back to Room ListRoom Version: 10