!CcTBuBritXGywOEGWJ:matrix.org

NixOS Binary Cache Self-Hosting

173 Members
About how to host a very large-scale binary cache and more60 Servers

Load older messages


SenderMessageTime
7 Mar 2024
@edef1c:matrix.orgedefand we have UI on eg https://releases.nixos.org01:06:01
@edef1c:matrix.orgedefbut for cache.nixos.org there's basically no easy UI on top of the raw objects that would be that useful01:06:22
@zhaofeng:zhaofeng.liZhaofeng Liyou totally can, but the setup process can be daunting/annoying for those who have never used AWS before and just want to download one dataset01:06:35
@edef1c:matrix.orgedefwe have the data to build a cache explorer now though :p01:06:35
@edef1c:matrix.orgedefthe counterparty risk is different doing credit card processing for long-lived accounts vs one-offs01:07:15
@edef1c:matrix.orgedeflike, it may well be a profitable business, it's just a different one01:07:26
@raitobezarius:matrix.orgraitobezariusis there anything like frontend clickhouse01:07:30
@raitobezarius:matrix.orgraitobezariuswhere people can type clickhouse queries in their browser and get results01:07:39
@edef1c:matrix.orgedef
In reply to @raitobezarius:matrix.org
is there anything like frontend clickhouse
it has a UI on the same port
01:07:40
@edef1c:matrix.orgedefit's just a textbox01:07:43
@raitobezarius:matrix.orgraitobezariusis it safe to expose?01:07:44
@raitobezarius:matrix.orgraitobezariuspublicly I mean01:07:52
@edef1c:matrix.orgedefif you set the auth and confine CH properly, kinda?01:08:13
@edef1c:matrix.orgedefit's a pile of C++ and i have segfaulted it before01:08:21
@raitobezarius:matrix.orgraitobezariuswell seccomp should reasonably prevent bad things to happen01:08:34
@raitobezarius:matrix.orgraitobezariusmmmmm01:08:37
@raitobezarius:matrix.orgraitobezariusi may be tempted to run this01:08:40
@edef1c:matrix.orgedefbut give it a read-only dataset and seccomp it, and it should be fine01:08:44
@edef1c:matrix.orgedefyou probably want to leave the query caches on, so don't wipe it for every request01:08:56
@edef1c:matrix.orgedefbut wipe it every 24h or something and it shouldn't get too nasty, i think01:09:15
@edef1c:matrix.orgedefor every hour, doesn't really matter01:09:28
@raitobezarius:matrix.orgraitobezariusclickhouse-gc.service01:09:37
@edef1c:matrix.orgedefyour biggest concern is like, someone hogging your CPU01:09:37
@raitobezarius:matrix.orgraitobezariuscgroups for that01:09:42
@edef1c:matrix.orgedefsince it does arbitrary computation01:09:44
@edef1c:matrix.orgedefdunno what odds i'd take bets on ClickHouse RCEs for but they're not as huge as you'd like01:10:53
@edef1c:matrix.orgedefdunno how well it responds to seccomping01:11:45
@edef1c:matrix.orgedefit has explicit mechanisms for running arbitrary subprocesses iirc but i don't know what the defaults on that are01:12:29
@raitobezarius:matrix.orgraitobezarius.o O(cgroup slice per web session)01:12:44
@edef1c:matrix.orgedefwhatever faith you place in local code exec ≠ local root is your call :p01:13:38

Show newer messages


Back to Room ListRoom Version: 10