!CcTBuBritXGywOEGWJ:matrix.org

NixOS Binary Cache Self-Hosting

167 Members
About how to host a very large-scale binary cache and more57 Servers

Load older messages


SenderMessageTime
2 Mar 2024
@raitobezarius:matrix.orgraitobezariusI personally think buying the HW comes cheaper in the end01:58:30
@raitobezarius:matrix.orgraitobezariusBut then we have to manage HW01:58:34
@raitobezarius:matrix.orgraitobezariusI already do it for a bunch of hardware, but it's not something that thousands of people depend on, so it's another discussion01:58:57
@nh2:matrix.orgnh2Theoretically it does not matter so much. You can buy the HW, ship it to hetzner, and pay them 21 EUR for 15 minutes "Remote hands" https://docs.hetzner.com/robot/colocation/faq/#can-hetzner-online-install-my-hardware01:59:34
@raitobezarius:matrix.orgraitobezariusPeople may have other ideas like freezing the bucket in Glacier temporarily, then sending it to R2/Backblaze B2, or doing slow transfer proxy by replicating any data that gets requested via Fastly01:59:35
@raitobezarius:matrix.orgraitobezarius
In reply to @nh2:matrix.org
Theoretically it does not matter so much. You can buy the HW, ship it to hetzner, and pay them 21 EUR for 15 minutes "Remote hands"
https://docs.hetzner.com/robot/colocation/faq/#can-hetzner-online-install-my-hardware
Yeah, I guess
02:00:24
@raitobezarius:matrix.orgraitobezariusI just don't know if we can afford or if we want to go for Hetzner Colo vs. Hetzner managed hardware if we go for a Hetzner service02:00:42
@raitobezarius:matrix.orgraitobezariusAll of that is very fuzzy in my mind and dependent on current infrastructure team decisions / will02:00:54
@raitobezarius:matrix.orgraitobezariusSo I would rather avoid pushing on them anything02:01:00
@raitobezarius:matrix.orgraitobezariusAlso why I build my own solution on my side02:01:10
@raitobezarius:matrix.orgraitobezariusOverall, what I believe is that if someone comes in and drops 50K on the Foundation for the objective of duplicating the binary cache to save it, it's a solved problem02:01:46
@raitobezarius:matrix.orgraitobezariusUnder that amount, you are kinda stuck having to ask the Foundation to consider taking the risk02:01:57
@raitobezarius:matrix.orgraitobezariusAnd it's not clear that it's a right choice or not02:02:04
@nh2:matrix.orgnh2For your colo, does it offer separate datacenters that isolated failure domains against fire?02:02:15
@raitobezarius:matrix.orgraitobezariusvs. garbage collecting and giving up on that data and preparing for the next set of data02:02:17
@raitobezarius:matrix.orgraitobezarius
In reply to @nh2:matrix.org
For your colo, does it offer separate datacenters that isolated failure domains against fire?
Nope
02:02:27
@raitobezarius:matrix.orgraitobezariusIf that was a goal, I would just send things in Glacier that I really care about, e.g. FODs02:02:56
@raitobezarius:matrix.orgraitobezarius In cache.nixos.org, there's cache :) 02:03:02
@raitobezarius:matrix.orgraitobezarius Actually, cache.nixos.org was unavailable a lot of times 02:03:20
@raitobezarius:matrix.orgraitobezariusBut no one notice it in general02:03:23
@raitobezarius:matrix.orgraitobezariusBecause a CDN is in front of it so…02:03:36
@nh2:matrix.orgnh2I mean in Hetzner it's a standard setup to setup servers different data centers to ensure proper HA02:04:32
@raitobezarius:matrix.orgraitobezariusYes, yes, if we have the means and money02:04:49
@raitobezarius:matrix.orgraitobezariusLet's go for multi-site HA02:04:53
@raitobezarius:matrix.orgraitobezariusBut again, from my PoV (maybe wrong?), short of sponsoring from hardware manufacturers or companies, it's hard to support those costs upfront02:06:06
@raitobezarius:matrix.orgraitobezariusLet's say, if HW manufacturers said: here's disks, here's servers (cheap in the context anyhow), and we could just pay colo, that'd be interesting02:06:30
@raitobezarius:matrix.orgraitobezariusetc.02:06:33
@nh2:matrix.orgnh2This is not what I mean. I mean that if you buy the hardware for a colo, it costs a fixed price. You could put it into your colo in France, or in Hetzner, where you would get proper HA.02:06:33
@raitobezarius:matrix.orgraitobezarius
In reply to @nh2:matrix.org
This is not what I mean. I mean that if you buy the hardware for a colo, it costs a fixed price. You could put it into your colo in France, or in Hetzner, where you would get proper HA.
This, I don't disagree
02:06:56
@raitobezarius:matrix.orgraitobezariusBut what's your point regarding that?02:07:07

There are no newer messages yet.


Back to Room ListRoom Version: 10