!CcTBuBritXGywOEGWJ:matrix.org

NixOS Binary Cache Self-Hosting

172 Members
About how to host a very large-scale binary cache and more58 Servers

Load older messages


SenderMessageTime
7 Mar 2024
@whentze:matrix.orgWanja Hentzeif you do a good job on the infra and have reasonable requirements (this one is important), on-call can be relatively okay00:08:19
@whentze:matrix.orgWanja Hentzethat being said I would currently not join a 2nd rotation because I simply need time off for real once in a while00:11:49
@whentze:matrix.orgWanja HentzeI can help with infra work though if you want me to beat a NixOS over the head or replace a hard drive or whatever00:13:21
@linus:schreibt.jetzt@linus:schreibt.jetztYeah I'm not sure "on-call" makes that much sense here anyway? I'd consider it to be a best-effort thing, and I expect that if stuff catches fire people will scramble to fix it, but nobody needs to be paged out of whatever they're doing for it00:15:25
@whentze:matrix.orgWanja Hentzeidk, crates.io has a rotation and I consider that less essential00:16:07
@linus:schreibt.jetzt@linus:schreibt.jetzt we also have the advantage of the cache not being super critical for nix/nixos to be usable 00:16:16
@linus:schreibt.jetzt@linus:schreibt.jetztlike if it goes down for a day, that would be much less of a problem than the ubuntu package servers being down for a day would be for ubuntu00:17:10
@linus:schreibt.jetzt@linus:schreibt.jetztergh, I should sleep, not think about this, for now00:19:46
@linus:schreibt.jetzt@linus:schreibt.jetztgood night :D00:19:48
@whentze:matrix.orgWanja Hentzeeh, for a loooot of NixOS users, the cache being down means nixos-rebuild just becomes a desk warming app00:19:53
@edef1c:matrix.orgedefyeah00:20:03
@edef1c:matrix.orgedeffrom the cache logs, i know we have a lot of users in like, low-GDP countries you've never heard of before00:20:30
@whentze:matrix.orgWanja Hentzewe can actually build our closures on our CI infra but I'm sure many can't00:20:36
@edef1c:matrix.orgedefi don't think they would appreciate the desk warming since it is coming out of their power bill00:20:46
@whentze:matrix.orgWanja Hentzeand in my hobby usage I definitely can't00:20:55
@edef1c:matrix.orgedefnor do they likely have the RAM to actually build most things00:21:11
@raitobezarius:matrix.orgraitobezarius
In reply to @edef1c:matrix.org
from the cache logs, i know we have a lot of users in like, low-GDP countries you've never heard of before
i wonder if low GDP countries can download fast enough some of our stuff though
00:21:31
@raitobezarius:matrix.orgraitobezarius and if they don't end up passing --no-substituters or something 00:21:42
@edef1c:matrix.orgedefi'm working from cache logs, so they do seem to hit it00:22:01
@edef1c:matrix.orgedefor they wouldn't show on my radar at all00:22:05
@raitobezarius:matrix.orgraitobezariusah right00:22:05
@edef1c:matrix.orgedefbandwidth will hopefully improve in the long run if we can get deduping to work well and carry all the way through to the frontend protocol00:22:55
@whentze:matrix.orgWanja Hentzeanyone familiar with the micromirror project? https://blog.thelifeofkenneth.com/2023/05/building-micro-mirror-free-software-cdn.html?m=100:25:25
@whentze:matrix.orgWanja Hentzethey're just chucking shitty tiny boxes everywhere to hit the hottest cache entries really fast (because closes to users)00:26:01
@whentze:matrix.orgWanja Hentze* they're just chucking shitty tiny boxes everywhere to hit the hottest cache entries really fast (because closer to users)00:26:15
@edef1c:matrix.orgedefwe have Fastly covering that and i have some other stuff i could call00:26:33
@edef1c:matrix.orgedef * we have Fastly covering that and i have some other stuff i could call in00:26:37
@edef1c:matrix.orgedefbroadly CDN is not the biggest thing to worry about right this second00:27:04
@whentze:matrix.orgWanja Hentzeoh, so the plan is not to self host the CDN00:27:09
@whentze:matrix.orgWanja Hentzethat makes it much easier indeed00:27:15

Show newer messages


Back to Room ListRoom Version: 10