| 30 May 2025 |
@adam:robins.wtf | ahh, this is the nix manual. https://nixos.org/manual/nix/unstable/ redirects to nix.dev 🫠| 14:13:48 |
hexa | it is just that hydra provides a stable link and that made it easy to proxy that | 14:13:49 |
@adam:robins.wtf | https://docs.netlify.com/routing/redirects/rewrites-proxies/#proxy-to-another-service | 14:17:14 |
@adam:robins.wtf | yes, custom headers are an option for proxying | 14:18:24 |
@adam:robins.wtf | or the request can be signed, but not sure what that entails on the other end | 14:18:51 |
@adam:robins.wtf | In theory, something like this would give us a header we could trust on the hydra side: https://github.com/NixOS/nix.dev/compare/master...adamcstephens:nix.dev:random-header?expand=1 | 15:00:36 |
Alyssa Ross | I don't think header forging should matter very much — if the scraper bots were smart they'd just use a User-Agent that doesn't look like a browser to anubis. | 15:26:18 |
Alyssa Ross | (If I'm understanding what you mean by trust) | 15:26:43 |
hexa | the anubis module unfortunately looks like … use the default bot policy or write your own | 15:28:52 |