| 1 May 2025 |
Alyssa Ross | I'm getting 403 Forbidden from Hydra. JS is enabled. | 04:56:49 |
Jeremy Fleischman (jfly) | We had to disable anubis, and are back to playing whack-a-mole with nginx use agent sniffing :(
https://github.com/NixOS/infra/issues/670 | 05:15:36 |
Jeremy Fleischman (jfly) | * We had to disable anubis, and are back to playing whack-a-mole with nginx user agent sniffing :(
https://github.com/NixOS/infra/issues/670 | 05:15:48 |
Alyssa Ross | Guess I need to more aggressively update my Firefox… | 05:22:09 |
hexa | I'm looking into alternatives, but availbility of hydra-server (the webfrontend) had been spotty yesterday | 10:38:54 |
adamcstephens | https://git.gammaspectra.live/git/go-away was one i saw yesterday | 13:07:00 |
symphorien | I saw https://dgl.cx/2025/04/using-haproxy-to-stop-scrapers in pure haproxy | 13:10:02 |
hexa | i have it packaged locally already since yesterday | 14:35:27 |
hexa | that uses robots.txt to entrap bots that disregard and abuse the listings in it, not a fan | 14:35:54 |
symphorien | I think the robots.txt is independent from the hash-based one | 14:43:52 |
symphorien | but maybe I understood wrong | 14:43:59 |
hexa | exactly 0 of the bots we filter out right now actually look at robots.txt | 14:44:03 |
hexa | nvm, we don't filter on the robots.txt | 14:44:31 |