!RROtHmAaQIkiJzJZZE:nixos.org

NixOS Infrastructure

468 Members
Next Infra call: 2024-07-11, 18:00 CEST (UTC+2) | Infra operational issues backlog: https://github.com/orgs/NixOS/projects/52 | See #infra-alerts:nixos.org for real time alerts from Prometheus.147 Servers

Load older messages


SenderMessageTime
27 Jun 2026
@hexa:lossy.networkhexa (signing key rotation when)so we have more headroom anyway14:42:24
@hexa:lossy.networkhexa (signing key rotation when)I have fast-nix-gc prepared locally15:22:20
@xokdvium:matrix.orgSergei Zimmerman (xokdvium)
In reply to @emilazy:matrix.org
Sergei Zimmerman (xokdvium): how easy would it be to have an option for "refuse to try building something if some of its outputs are present" that defaults on if fallback paths would be used (i.e. macOS, unsandboxed Linux) and then we could set it on for all of Hydra?
Should be doable
15:25:47
@emilazy:matrix.orgemily can it extend to "don't try to build if any of the other outputs are able to be substituted"? :) 15:26:21
@xokdvium:matrix.orgSergei Zimmerman (xokdvium)
In reply to @emilazy:matrix.org
can it extend to "don't try to build if any of the other outputs are able to be substituted"? :)
Harder, but maybe doable
15:29:34
@emilazy:matrix.orgemilytbh the macOS case is more concerning since at least in principle frankenbuilds without fallback paths should never actually be a problem unless packages are non-reproducible15:30:19
@joerg:thalheim.ioMic92
In reply to @emilazy:matrix.org
can it extend to "don't try to build if any of the other outputs are able to be substituted"? :)
Queue builder always requires inputs to be substituted
15:38:04
@emilazy:matrix.orgemilythis is siblings though (outputs of the same derivation), rather than inputs15:38:23
@joerg:thalheim.ioMic92It could ignore all inputs that haven't been signed by hydra... And sign local paths after upload.15:42:58
@joerg:thalheim.ioMic92Or queue runner specifies the content addressed path instead of the input addressed one15:45:30
@emilazy:matrix.orgemilyI don't understand what that does for sibling outputs, since those aren't inputs?15:52:42
@hexa:lossy.networkhexa (signing key rotation when)
Jun 27 19:05:46 mimas hydra-evaluator[1724970]:   created cached eval 1826650
Jun 27 19:05:46 mimas hydra-evaluator[1867846]: evaluation of jobset ‘nixos:unstable-small (jobset#240)’ succeeded
19:08:03
@hexa:lossy.networkhexa (signing key rotation when)https://hydra.nixos.org/eval/182665019:08:09
@hexa:lossy.networkhexa (signing key rotation when)does not get listeed in https://hydra.nixos.org/jobset/nixos/unstable-small19:09:03
@hexa:lossy.networkhexa (signing key rotation when)retrying20:24:54
@hexa:lossy.networkhexa (signing key rotation when)this time it went … cool.20:25:41
28 Jun 2026
@eymeric:onyx.ovhEymeric joined the room.08:40:34
@eymeric:onyx.ovhEymeric

Hi! From my home Internet connection in Vietnam (ip: 14.160.32.91), https://hydra.nixos.org doesn't work correctly. Instead of the normal Hydra UI, I get a small HTML page with random-looking text (starting with Forward. The man in the middle of the European and Asiatic land-mass, from Portugal to....).

I compared it with machines I have in France and elsewhere. They all resolve the same IP (157.90.104.34), present the same TLS certificate (CN=hydra.nixos.org), and serve the normal Hydra page. The issue also disappears if I use a VPN from Vietnam.

Is there any sort of geo-blocking, filtering, or infrastructure issue that could explain this?

08:41:21
@sandro:supersandro.deSandro 🐧You've run into the bot detection 😂08:43:36
@sandro:supersandro.deSandro 🐧 @hexa:lossy.network 08:43:56
@eymeric:onyx.ovhEymericCould it just be that the IP has a bad reputation or do the bot detection need more hints ?08:46:35
@grimmauld:m.grimmauld.deGrimmauld (any/all)is it bot detection or just a funny dns?08:46:52
@grimmauld:m.grimmauld.deGrimmauld (any/all) what happens if you dig? 08:46:58
@k900:0upti.meK900It's bot detection08:47:16
@k900:0upti.meK900Specifically iocaine08:47:19
@eymeric:onyx.ovhEymeric

I get the same ip as from france :

dig hydra.nixos.org

; <<>> DiG 9.20.23 <<>> hydra.nixos.org
;; global options: +cmd
;; Got answer:
;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 44837
;; flags: qr rd ra; QUERY: 1, ANSWER: 2, AUTHORITY: 0, ADDITIONAL: 1

;; OPT PSEUDOSECTION:
; EDNS: version: 0, flags:; udp: 1232
;; QUESTION SECTION:
;hydra.nixos.org.               IN      A

;; ANSWER SECTION:
hydra.nixos.org.        3600    IN      CNAME   mimas.nixos.org.
mimas.nixos.org.        3600    IN      A       157.90.104.34

;; Query time: 161 msec
;; SERVER: 1.1.1.1#53(1.1.1.1) (UDP)
;; WHEN: Sun Jun 28 15:47:27 +07 2026
;; MSG SIZE  rcvd: 80


08:47:32
@k900:0upti.meK900I assume your AS is on a list somewhere08:47:47
@k900:0upti.meK900As a lot of the LLM scraperbots use residential connections now to obfuscate their behavior08:48:10
@eymeric:onyx.ovhEymerichmmm ok so nothing simple to fix it other than switching to a different ip08:48:43
@k900:0upti.meK900https://github.com/NixOS/infra/blob/8527b8acb0c44c20c592e94eb725e1452592764a/build/hydra-proxy.nix#L5008:49:14

Show newer messages


Back to Room ListRoom Version: 6