| 4 Mar 2025 |
|  fpletz joined the room. | 07:35:17 |
| fpletz | Are there still interested people in this room in getting something done about our cache issues, in particular to get the GC/Glacierization going? I would like to revive the meetings to document the status quo and draft a plan to move forward with the efforts. | 08:29:59 |
 flokli | Yes, I'm still interested. The problem what got me to move on was a bit of a lack of being able to make decisions, having predictability on timelines and / or commitments to a certain solution. | 11:41:52 |
| flokli | I personally also still think we should dedicate some time to properly build tooling that allows us to determine closures and how they are connected to channel bumps, so we can play with various parameters and simulate the expected outcome. Moving to different buckets per channel, another proposal I've seen is only gonna increase the amount of complexity to reason about the system as a whole, while potentially adding even more duplicates. | 11:45:59 |
 nh2 | I'm also still interested in setting up a Hetzner Ceph cluster where everything fits. | 12:28:43 |
| fpletz | If there are any decisions to be made I will try to fast track them in the SC. That's my job after all. :) But I also want to help in a technical capability. | 13:38:37 |
| flokli | We might not need an awfully large cluster to begin with. nixos.tvix.store still uses less than 1% of its disks 😄 | 14:17:07 |
 tomberek | @flokli:matrix.org: I've still not seen a comparison. Is there an estimate of the dedup and compression ratio? Compared to just NAR compression we do now? | 14:23:42 |
| flokli | How good you can dedup largely depends on your dataset, and the size of it. We did some test drives on some channel bumps, it's somewhere in discourse, need to dig up the link. | 14:27:34 |
| flokli | Someone who's more into statistics and visualization should also probably take a look at the chunking parameters and play with them a bit, the current chunking params are just some gut feeling numbers. | 14:28:33 |
| flokli | It should probably be not too much work to expose the list of store paths present, and the uncompressed nar size (uncompressed) of all Pathinfos aggregated. If you compare that with the disk usage you get the current dedup ratio. | 14:29:55 |
| flokli | It would just need to be wired up into the metrics. | 14:30:26 |
| tomberek | Okay. I still think it is reasonable to incur the cost of copying nearly everything to Glacier. Then do a GC. (Or GC first if we have high confidence.) It's something that helps and something we'd likely want regardless of any other approaches we take. | 14:35:42 |
| flokli | We would need to first find out *what* to copy to glacier. We don't have the tooling for that | 14:38:17 |
| flokli | And if we accidentally glacier something that's being requested, have an idea about the costs for this. | 14:38:38 |
| flokli | And I'd honestly rather copy the to-be-glaciered data to a self-hosted object storage and serve from there, rather than only having it somewhere where you have to pay premium to AWS to get it out. | 14:39:40 |
| flokli | But well, I can share my opinions here all day long, ultimately we need to agree on a path forward and realistic timelines attached to it, and then do this plan / empower people to do it. | 14:40:49 |
|  lassulus changed their profile picture. | 17:49:06 |
|  John Ericson joined the room. | 19:57:59 |
| 15 Mar 2025 |
|  loudgolem joined the room. | 07:07:37 |
| 23 Mar 2025 |
|  connor (he/him) (UTC-7) changed their display name from connor (he/him) (UTC-8) to connor (he/him) (UTC-7). | 18:28:11 |
| 15 Apr 2025 |
|  allrealmsoflife joined the room. | 20:42:09 |
| 27 Apr 2025 |
|  Honnip joined the room. | 11:16:07 |
| 29 May 2025 |
|  @deeok:matrix.org joined the room. | 09:09:52 |
| 1 Jun 2025 |
|  Sean Thawe joined the room. | 23:39:47 |
| 7 Jun 2025 |
| @deeok:matrix.org changed their display name from deeok to matrixrooms.info mod bot (does NOT read/send messages and/or invites; used for checking reported rooms). | 22:02:33 |
| @deeok:matrix.org left the room. | 22:03:04 |
| 22 Jun 2025 |
|  SomeoneSerge (back on matrix) changed their display name from SomeoneSerge (UTC+U[-12,12]) to SomeoneSerge (Ever OOMed by Element). | 12:13:52 |
| 9 Jul 2025 |
|  @jonhermansen:matrix.org joined the room. | 01:18:49 |
| 13 Jul 2025 |
|  timschumi joined the room. | 18:31:28 |
