| 1 May 2025 |
 Jeremy Fleischman (jfly) | * We had to disable anubis, and are back to playing whack-a-mole with nginx user agent sniffing :(
https://github.com/NixOS/infra/issues/670 | 05:15:48 |
 Alyssa Ross | Guess I need to more aggressively update my Firefox… | 05:22:09 |
 hexa | I'm looking into alternatives, but availbility of hydra-server (the webfrontend) had been spotty yesterday | 10:38:54 |
 adamcstephens | https://git.gammaspectra.live/git/go-away was one i saw yesterday | 13:07:00 |
 symphorien | I saw https://dgl.cx/2025/04/using-haproxy-to-stop-scrapers in pure haproxy | 13:10:02 |
| hexa | i have it packaged locally already since yesterday | 14:35:27 |
| hexa | that uses robots.txt to entrap bots that disregard and abuse the listings in it, not a fan | 14:35:54 |
| symphorien | I think the robots.txt is independent from the hash-based one | 14:43:52 |
| symphorien | but maybe I understood wrong | 14:43:59 |
| hexa | exactly 0 of the bots we filter out right now actually look at robots.txt | 14:44:03 |
| hexa | nvm, we don't filter on the robots.txt | 14:44:31 |
| hexa | * exactly 0 of the bots we filter out right now actually look at robots.txt | 14:44:33 |
| symphorien | * | 14:44:42 |
| hexa | "hash" means proof-of-work aiui | 14:45:17 |
| hexa | that's what we'd already get by using anubis | 14:45:28 |
| symphorien | I thought you were looking for alternatives | 14:45:56 |
| hexa | we had anubis deployed for a day or two already | 14:46:14 |
| hexa | and what we have right now is some bespoke user-agent filtering | 14:46:30 |
| hexa | and we likely need something more customizable due to https://github.com/NixOS/nix.dev/issues/1130 for example | 14:46:56 |
| symphorien | hmm I don't really understand the issue, sorry | 14:48:34 |
| hexa | the issue is that nix.dev tells netlify to reverse proxy the hydra output for the nix manual | 14:49:17 |
| hexa | and netlify is unable to bypass anubis | 14:49:43 |
| symphorien | ah I see, so another proof of work thing can't help | 14:50:04 |
| hexa | they show the user a broken anubis validation page | 14:50:05 |
| hexa | I want something more customizable basically | 14:50:27 |
| hexa | we see little to no abuse from IPv6 for example | 14:50:34 |
| hexa | infra call in one hour | 14:56:30 |
| hexa | * open infra call in one hour | 14:56:36 |
| hexa | at 16:00 UTC | 14:59:09 |
 Tristan Ross | Same here | 15:19:36 |
