!CcTBuBritXGywOEGWJ:matrix.org

NixOS Binary Cache Self-Hosting

170 Members
About how to host a very large-scale binary cache and more58 Servers

Load older messages


SenderMessageTime
6 Mar 2024
@flokli:matrix.orgflokliWe need more than that.12:41:58
@domenkozar:matrix.org@domenkozar:matrix.orgcache is a common good, we shouldn't just remove stuff if we have a chance of keeping it12:42:01
@domenkozar:matrix.org@domenkozar:matrix.orgit's 500GB of storage no?12:42:13
@julienmalka:matrix.orgJulien
In reply to @domenkozar:matrix.org
it's 500GB of storage no?
Tb
12:42:28
@domenkozar:matrix.org@domenkozar:matrix.orgeh 500TB :)12:42:35
@julienmalka:matrix.orgJulienIt’s going to continue to grow tho12:42:48
@flokli:matrix.orgflokliWe need a more long-term commitment to keep sponsoring this. We need to be certain we can go to cloudflare, and we need to be certain they're ok both with the traffic levels and that staying free12:43:01
@domenkozar:matrix.org@domenkozar:matrix.orgNix is also growing and companies should pay back to keep it alive12:43:04
@domenkozar:matrix.org@domenkozar:matrix.orgit used to be one company paying for all of this12:43:21
@flokli:matrix.orgflokli We need to be sure we can have some "cloud functions" too, so we can store things differently and more compact, to make this more sustainable too. 12:43:31
@domenkozar:matrix.org@domenkozar:matrix.orgyeah you have cloudflare workers12:43:43
@flokli:matrix.orgflokliAnd this is now all being discussed a week after we wanted to start the GC.12:43:53
@domenkozar:matrix.org@domenkozar:matrix.orgwe shouldn't let sunk cost fallacy destroy our history if we can do another plan of saving it12:44:32
@flokli:matrix.orgflokliI don't think workers will be free if we send NAR files through them.12:44:42
@flokli:matrix.orgflokliSomeone needs to do the math, ensure the proposal is feasible, and the sponsors we do come up with can commit a bit long time12:45:06
@julienmalka:matrix.orgJulien
In reply to @domenkozar:matrix.org
it used to be one company paying for all of this
Well that is one topic where I fully agree with you, but we also must be resilient to situations where we don’t have that solution working. The situation we currently face with GC/AWS cost shows that we are not ready to sustain the costs of hosting the cache with a cloud provider, and we do not own our own data
12:45:16
@flokli:matrix.orgflokli
In reply to @domenkozar:matrix.org
we shouldn't let sunk cost fallacy destroy our history if we can do another plan of saving it
We don't talk about destroying it, the plan was to put it into glacier, where we can get it back, it's just not immediately accessible, but much cheaper to store.
12:45:43
@domenkozar:matrix.org@domenkozar:matrix.orgwe own the data, you can transfer it out any time12:45:47
@flokli:matrix.orgflokli* We don't talk about destroying it, the plan was to put it into glacier, where we can get it back, it's just not immediately accessible, but much cheaper to store. Until we have a better place to host it long-term.12:46:01
@julienmalka:matrix.orgJulien
In reply to @domenkozar:matrix.org
we own the data, you can transfer it out any time
But because we don’t have our own hardware this is kind of a dream
12:46:14
@domenkozar:matrix.org@domenkozar:matrix.org
In reply to @flokli:matrix.org
We don't talk about destroying it, the plan was to put it into glacier, where we can get it back, it's just not immediately accessible, but much cheaper to store. Until we have a better place to host it long-term.
well that effectively makes it unusuable
12:46:14
@domenkozar:matrix.org@domenkozar:matrix.orgI feel like there are some really weird requirements coming up, when did we decide we need to own data?12:46:41
@julienmalka:matrix.orgJulien
In reply to @domenkozar:matrix.org
well that effectively makes it unusuable
If we save it to glacier we can in the future recover it all at once on another infra ?
12:46:43
@domenkozar:matrix.org@domenkozar:matrix.orgwe don't own github as well12:46:45
@domenkozar:matrix.org@domenkozar:matrix.orgthese are some really weird decisions to me12:47:22
@julienmalka:matrix.orgJulienI'm not talking on behalf of anyone here, these are just my political biases 12:47:49
@domenkozar:matrix.org@domenkozar:matrix.orgmy political bias is to make Nix succeed, at all cost12:48:08
@domenkozar:matrix.org@domenkozar:matrix.orgthis is not time nor place to bring our the morals because we all have our own and it's going to be impossible to find a common ground, that's how morals work12:48:55
@julienmalka:matrix.orgJulienBut I feel that currently we are obligated to delete some data we would not want to delete ideally just because we are not in control of the data. For example if we were, the scenario where we put in in CA storage would be more believable 12:50:10
@whentze:matrix.orgWanja Hentze"it's fine to do everything via cloud" is as much of a moral position as "it's not fine to do everything via cloud"12:50:11

Show newer messages


Back to Room ListRoom Version: 10