| 24 Mar 2025 |
hexa | you'd think we'd have a grafana dashboard for that number | 14:11:58 |
hexa |  Download image.png | 14:12:34 |
hexa | from the state of the union slide | 14:12:40 |
hexa | 2024/10 -> 2025/03 | 14:13:01 |
ElvishJerricco | that's user downloads, not hydra uploads, right? | 14:14:01 |
hexa | that is the space we allocate in the S3 bucket | 14:14:33 |
ElvishJerricco | oh, that makes more sense | 14:14:42 |
emily | is the standard number going down from moving things to infrequent access? | 14:15:32 |
hexa | new stuff enters the standard tier and gets put into IA at some point | 14:16:14 |
hexa | that is a manual thing iirc | 14:16:20 |
emily | so i guess in the region of 2–4.5% increase of current cache growth rate? | 14:18:54 |
emily | monthly | 14:19:01 |
emily | uh wait no | 14:19:44 |
emily | had a - instead of a + :) | 14:19:58 |
emily | so current growth rate is ~6.56 TiB/month, so cache growth size would be 1.15–1.3× current? | 14:20:34 |
emily | has there been any work or even proposals for things to reduce cache size growth other than "GC everything" that would have anything like a 15–30% impact/ | 14:24:43 |
emily | * has there been any work or even proposals for things to reduce cache size growth other than "GC everything" that would have anything like a 15–30% impact? | 14:24:46 |
hexa | Download BucketSizeBytes-2023_12_26_00_00_00-2025_03_23_00_00_00-UTC.csv | 14:28:22 |
hexa | daily bucket sizes for the last 36 months | 14:28:31 |
hexa | * daily bucket sizes for the last 15 months | 14:29:00 |
hexa | * that is a manual thing iirc | 14:29:29 |
Vladimír Čunát | I've certainly heard proposals like GC everything that's never "been in a channel". | 14:29:58 |
emily | right, that's what i meant re: GC | 14:34:40 |
ElvishJerricco | this seems to indicate the cache grows by like 300G a day, doesn't it? | 14:43:05 |
hexa | https://docs.google.com/spreadsheets/d/1KA2tbPsi1kQuwlHJC89iWUQBXPv6p1N3n0t73bbK7n4/edit?usp=sharing | 14:44:00 |
emily | about in line with the 6.56 TiB/month figure | 14:45:16 |
emily | so seems accurate | 14:45:25 |
ElvishJerricco | hexa (signing key rotation when): i think your columns are backward; you have the IA labeled as standard and vice versa | 14:45:30 |
hexa | lol 🙂 | 14:45:38 |
hexa | feel free to edit | 14:45:41 |