| 6 Mar 2024 |
Domen Kožar | I don't think this is going to end well | 12:39:33 |
Julien | 7k/mo is still a load difficult to bear for the fondation, no ? If I understand well currently the excess cost with AWS is 6k/mo ? | 12:39:53 |
flokli | Well, this channel is about binary cache self-hosting ;-) | 12:40:06 |
Domen Kožar | 7k/mo I can guarantee I can get sponsorship for | 12:40:10 |
Domen Kožar | flokli: ok, so where can we discuss the plan then | 12:40:24 |
Domen Kožar | I'm fine in any channel :) | 12:40:29 |
flokli | The foundation currently pays 6k a month out of their own pocket and doesn't want to do this long-term, and the AWS sponsorship coving some more costs is time-limited too, because we need to get our costs down. | 12:41:07 |
flokli | The number of data in the bucket is also growing, it certainly will if we don't want to GC and don't have the wiggle room to dedup | 12:41:46 |
Domen Kožar | yes, we migrate to R2 and we get 6k/mo of sponsors for the foundation and we have the full history | 12:41:49 |
flokli | We need more than that. | 12:41:58 |
Domen Kožar | cache is a common good, we shouldn't just remove stuff if we have a chance of keeping it | 12:42:01 |
Domen Kožar | it's 500GB of storage no? | 12:42:13 |
Julien | In reply to @domenkozar:matrix.org it's 500GB of storage no? Tb | 12:42:28 |
Domen Kožar | eh 500TB :) | 12:42:35 |
Julien | It’s going to continue to grow tho | 12:42:48 |
flokli | We need a more long-term commitment to keep sponsoring this. We need to be certain we can go to cloudflare, and we need to be certain they're ok both with the traffic levels and that staying free | 12:43:01 |
Domen Kožar | Nix is also growing and companies should pay back to keep it alive | 12:43:04 |
Domen Kožar | it used to be one company paying for all of this | 12:43:21 |
flokli | We need to be sure we can have some "cloud functions" too, so we can store things differently and more compact, to make this more sustainable too. | 12:43:31 |
Domen Kožar | yeah you have cloudflare workers | 12:43:43 |
flokli | And this is now all being discussed a week after we wanted to start the GC. | 12:43:53 |
Domen Kožar | we shouldn't let sunk cost fallacy destroy our history if we can do another plan of saving it | 12:44:32 |
flokli | I don't think workers will be free if we send NAR files through them. | 12:44:42 |
flokli | Someone needs to do the math, ensure the proposal is feasible, and the sponsors we do come up with can commit a bit long time | 12:45:06 |
Julien | In reply to @domenkozar:matrix.org it used to be one company paying for all of this Well that is one topic where I fully agree with you, but we also must be resilient to situations where we don’t have that solution working. The situation we currently face with GC/AWS cost shows that we are not ready to sustain the costs of hosting the cache with a cloud provider, and we do not own our own data | 12:45:16 |
flokli | In reply to @domenkozar:matrix.org we shouldn't let sunk cost fallacy destroy our history if we can do another plan of saving it We don't talk about destroying it, the plan was to put it into glacier, where we can get it back, it's just not immediately accessible, but much cheaper to store. | 12:45:43 |
Domen Kožar | we own the data, you can transfer it out any time | 12:45:47 |
flokli | * We don't talk about destroying it, the plan was to put it into glacier, where we can get it back, it's just not immediately accessible, but much cheaper to store. Until we have a better place to host it long-term. | 12:46:01 |
Julien | In reply to @domenkozar:matrix.org we own the data, you can transfer it out any time But because we don’t have our own hardware this is kind of a dream | 12:46:14 |
Domen Kožar | In reply to @flokli:matrix.org We don't talk about destroying it, the plan was to put it into glacier, where we can get it back, it's just not immediately accessible, but much cheaper to store. Until we have a better place to host it long-term. well that effectively makes it unusuable | 12:46:14 |