!CcTBuBritXGywOEGWJ:matrix.org

NixOS Binary Cache Self-Hosting

141 Members
About how to host a very large-scale binary cache and more50 Servers

Load older messages


SenderMessageTime
7 Mar 2024
@whentze:matrix.orgWanja Hentzethey're just chucking shitty tiny boxes everywhere to hit the hottest cache entries really fast (because closes to users)00:26:01
@whentze:matrix.orgWanja Hentze* they're just chucking shitty tiny boxes everywhere to hit the hottest cache entries really fast (because closer to users)00:26:15
@edef1c:matrix.orgedefwe have Fastly covering that and i have some other stuff i could call00:26:33
@edef1c:matrix.orgedef * we have Fastly covering that and i have some other stuff i could call in00:26:37
@edef1c:matrix.orgedefbroadly CDN is not the biggest thing to worry about right this second00:27:04
@whentze:matrix.orgWanja Hentzeoh, so the plan is not to self host the CDN00:27:09
@whentze:matrix.orgWanja Hentzethat makes it much easier indeed00:27:15
@raitobezarius:matrix.orgraitobezarius
In reply to @whentze:matrix.org
oh, so the plan is not to self host the CDN
in some very distant long term super future where Fastly may drop us
00:27:22
@edef1c:matrix.orgedef
In reply to @whentze:matrix.org
oh, so the plan is not to self host the CDN
yeah, not in the short term anyway
00:27:29
@edef1c:matrix.orgedefi'd like to have a more worked out story for "what if Fastly dies / quits on us" but i'm broadly satisfied with our risk exposures there00:28:01
@delroth:delroth.net@delroth:delroth.net
In reply to @linus:schreibt.jetzt
we also have the advantage of the cache not being super critical for nix/nixos to be usable
I think it's part of the prerequisite work for self hosting to actually determine answers to those questions (at least to some level of consensus). My personal opinion is different from yours there - I think that (recent, not historical) cache unavailability is very visible and very impactful for nixpkgs users.
00:28:28
@edef1c:matrix.orgedefdoesn't mean we can't diversify if it's easy or cheap00:28:33
@edef1c:matrix.orgedef
In reply to @delroth:delroth.net
I think it's part of the prerequisite work for self hosting to actually determine answers to those questions (at least to some level of consensus). My personal opinion is different from yours there - I think that (recent, not historical) cache unavailability is very visible and very impactful for nixpkgs users.
i mean, we can always turn it off for a bit if we want to find out
00:28:51
@whentze:matrix.orgWanja Hentzethe ol' yank 'n' yell00:29:51
@edef1c:matrix.orgedefin part by how reliable it has been, we've created this dependence00:30:41
@edef1c:matrix.orgedeflike, if we exceed our SLOs by far, we ought to blink it00:31:26
@edef1c:matrix.orgedefHyrum's law holds always and everywhere, even for availability00:33:08
@whentze:matrix.orgWanja Hentzeso the thing to self host would be large, robust, highly available but not necessarily screaming fast (object?) storage?00:33:31
@edef1c:matrix.orgedefyeah00:33:41
@edef1c:matrix.orgedefwe can always slap on more cache, our hot set is relatively small00:33:59
@whentze:matrix.orgWanja Hentzeslaps roof of fastly00:34:15
@raitobezarius:matrix.orgraitobezariusactually as cache stakeholders are around here00:34:22
@raitobezarius:matrix.orgraitobezariuswhat is the process / is it fine / is it bad to download the last 2-3 releases of each channels directly?00:34:36
@raitobezarius:matrix.orgraitobezariusover Fastly00:34:38
@raitobezarius:matrix.orgraitobezariusor does it thrash the CDN to your opinion?00:34:44
@raitobezarius:matrix.orgraitobezariusI don't have the data00:34:45
@raitobezarius:matrix.orgraitobezariusshould I do S3 Requester Pays stuff for that00:35:04
@edef1c:matrix.orgedefFastly is fairly okay about scans, but it would be nice if you hit the bucket with requester pays00:35:08
@raitobezarius:matrix.orgraitobezariusokie00:35:29
@raitobezarius:matrix.orgraitobezariusi might bother you later on with some queries00:35:33

Show newer messages


Back to Room ListRoom Version: 10