!CcTBuBritXGywOEGWJ:matrix.org

NixOS Binary Cache Self-Hosting

153 Members
About how to host a very large-scale binary cache and more54 Servers

Load older messages


SenderMessageTime
7 Mar 2024
@raitobezarius:matrix.orgraitobezarius(or you should teach me a bit your clickhouse workflow and i will mimic it so i become autonomous)00:36:27
@edef1c:matrix.orgedefif you want a lot of stuff, we can plausibly pull and dedupe it for you EC2-side00:36:27
@raitobezarius:matrix.orgraitobezariusi'm basically working on a project to enable a small 2x10Gbps appliance to serve offline "fresh" nixpkgs/nixos 00:36:52
@raitobezarius:matrix.orgraitobezariusand in that sense, i need to do regular syncs with last N releases of nixos00:37:47
@edef1c:matrix.orgedef
In reply to @whentze:matrix.org
so the thing to self host would be large, robust, highly available but not necessarily screaming fast (object?) storage?
to elaborate on this more: we basically have three tiers. frontend cache, semi-hot fast-enough storage, cold storage / DR
00:37:51
@raitobezarius:matrix.orgraitobezarius(actually i mostly need latest release)00:37:53
@edef1c:matrix.orgedefhmm, okay00:38:01
@raitobezarius:matrix.orgraitobezariusbut ideally stable and unstable00:38:15
@edef1c:matrix.orgedefobviously requester pays means it's none of my problem in that capacity00:38:19
@edef1c:matrix.orgedefbut deduped cache replication might be positive-sum here00:38:38
@raitobezarius:matrix.orgraitobezariusi'm okay funding deduped cache replication via my own requester pays stuff to avoid putting any churn on the foundation00:38:58
@edef1c:matrix.orgedef
In reply to @edef1c:matrix.org
to elaborate on this more: we basically have three tiers. frontend cache, semi-hot fast-enough storage, cold storage / DR
one of the other considerations is like, the ingestion path leads straight into the AWS prison
00:39:03
@edef1c:matrix.orgedef
In reply to @edef1c:matrix.org
to elaborate on this more: we basically have three tiers. frontend cache, semi-hot fast-enough storage, cold storage / DR
* one of the other considerations is like, the ingestion path leads straight into the AWS prison right now
00:39:08
@raitobezarius:matrix.orgraitobezariusbut my stuff is mostly a tangent and i will go to bed00:39:24
@edef1c:matrix.orgedefi'd much rather have that piped into somewhere cheap and from there to S3, or replicated into two places00:39:40
@edef1c:matrix.orgedefthere just isn't a separate ingestion mechanism right now, the build farm hits S3 directly00:39:53
@raitobezarius:matrix.orgraitobezariusto be discussed next meeting I guess00:40:00
@edef1c:matrix.orgedef i'm not even sure it fetches from Fastly 00:40:02
@raitobezarius:matrix.orgraitobezariusI need to hammer a bit more the software00:40:04
@raitobezarius:matrix.orgraitobezariusto make this more tangible00:40:07
@zhaofeng:zhaofeng.liZhaofeng Li<offtopic>Ah, Requester Pays... I always wondered why AWS/Google don't provide an easy way for non-technical people to access those buckets (i.e., enter credit card and bucket name, get web access)</offtopic>01:02:24
@edef1c:matrix.orgedefhmm, that seems buildable01:02:53
@edef1c:matrix.orgedefi think their ToS might have some stuff about reselling but i'm not sure how much that applies here01:03:32
@edef1c:matrix.orgedef * i think their ToS might have some stuff about reselling their services too directly but i'm not sure how much that applies here01:03:48
@edef1c:matrix.orgedefbut you can probably go forth and be the change in the world you want to see01:04:11
@raitobezarius:matrix.orgraitobezariusaka build a startup on the top of that01:04:25
@zhaofeng:zhaofeng.liZhaofeng LiIt would be nice if such an UI can avoid being in the middle of the payment process01:05:03
@zhaofeng:zhaofeng.liZhaofeng Lilike research teams can self-host the UI and not have to worry about fees, tax implications etc01:05:36
@edef1c:matrix.orgedefyou can totally sign up for an AWS account and use the bucket explorer UI, i think?01:05:39
@zhaofeng:zhaofeng.liZhaofeng Li * like research teams (dataset publishers) can self-host the UI and not have to worry about fees, tax implications etc01:05:55

There are no newer messages yet.


Back to Room ListRoom Version: 10