| 8 May 2026 |
 emily | I forget what the conclusion of that discussion was (I know the focus was on missing paths because of the access pattern but presumably those are not what's causing these expenses) | 11:11:26 |
| emily | I guess the issue is that if it's sufficiently spread out/high cardinality no per-path caching will help.
(though it seems surprising for scrapers to be going out of their way to find old stuff to query, I really doubt N versions of the same binaries are valuable?)
| 11:12:57 |
 Arian | Missing paths don't generate bandwidth cost. They generate API call cost. Which is small | 11:33:00 |
| emily | right | 11:58:09 |
| emily | but I mean if a present path is being hammered, how long does Fastly cache that before going back to S3? | 11:58:33 |
| Arian | 24h i think | 11:58:46 |
| emily | IIRC you said it was not that long? | 11:58:53 |
| emily | yeah | 11:58:57 |
| emily | so I wonder if just increasing that a ton would help? | 11:59:10 |
| emily | I don't know how much Fastly will cache before evicting things though. but at least there's definitely no reason to evict something just because it's been a day :) | 11:59:59 |
 hexa (signing key rotation when) | do you think we can get better caching than what fastly currently provides? | 13:13:50 |
| emily | (not sure if you're asking me but) if it expires every 24 hours then a bot that hits a bunch of store paths every 24 hours and then repeats causes costs every day vs. potentially getting cached indefinitely if we tell Fastly there's no need to expire known store paths right?
(but obviously it's just throwing things at the wall unless it's known what the access pattern looks like. still I imagine it's good in general for e.g. the latest stable installer ISO to not get redownloaded from S3 every day?)
| 13:17:15 |
| hexa (signing key rotation when) | 
Download | 13:19:25 |
| hexa (signing key rotation when) | 
Download | 13:20:08 |
| emily | but it's precisely that 5% that must be causing ^ right? 🤔 | 13:20:50 |
| hexa (signing key rotation when) | at the same time | 13:21:00 |
| hexa (signing key rotation when) | 
Download | 13:21:02 |
| hexa (signing key rotation when) | 
Download | 13:21:22 |
| emily | Nix probably counts as "other bots"? | 13:21:57 |
