!RROtHmAaQIkiJzJZZE:nixos.org

NixOS Infrastructure

426 Members
Next Infra call: 2024-07-11, 18:00 CEST (UTC+2) | Infra operational issues backlog: https://github.com/orgs/NixOS/projects/52 | See #infra-alerts:nixos.org for real time alerts from Prometheus.131 Servers

Load older messages


SenderMessageTime
5 Jun 2026
@dramforever:matrix.orgdramforeverat least until we fix nixos.org AAAA08:25:24
@dramforever:matrix.orgdramforever* at least until we fix nixos.org AAAA i suppose08:25:30
@k900:0upti.meK900 That's on netlify, unfortunately 08:26:36
@k900:0upti.meK900 But I'm pretty sure it's just a redirect and you can grab wherever it's redirecting to 08:26:50
@dramforever:matrix.orgdramforever it is, but the funny part is that that above only half-is what https://nixos.org/nix/install redirects to 08:30:37
@dramforever:matrix.orgdramforever https://nixos.org/nix/install goes straight to https://releases.nixos.org/nix/nix-2.34.7/install now 08:31:07
@dramforever:matrix.orgdramforever but it's configured to go to https://channels.nixos.org/nix-latest/install in https://github.com/NixOS/nixos-homepage/blob/main/core/public/netlify.toml 08:31:45
@dramforever:matrix.orgdramforeverso is it some sort of redirect flattening going on in netlify...?08:31:54
@xokdvium:matrix.orgSergei Zimmerman (xokdvium)Hm there’s a redirect in the S3 nix channels bucket08:58:42
@xokdvium:matrix.orgSergei Zimmerman (xokdvium)I have no clue how x-amz-website-redirect-location works09:02:32
@dramforever:matrix.orgdramforeveri think it gets converted into a redirect at some point during the fastlyification09:03:45
@vcunat:matrix.orgVladimír Čunát eager-heisenberg.mac.nixos.org looked stuck for roughly 24h, rebooting. 11:05:32
7 Jun 2026
@fgrsnau:matrix.orgStefan joined the room.13:44:34
9 Jun 2026
@lyndeno:matrix.orgLyndeno joined the room.13:03:02
10 Jun 2026
@tomberek:matrix.orgtomberekupdate or news about https://github.com/NixOS/nix/pull/15949 ?03:50:13
@k900:0upti.meK900Cancelled nixos-unstable{,-small} from 5 minutes ago06:30:08
@k900:0upti.meK900 For https://github.com/NixOS/nixpkgs/pull/530238 06:30:13
@k900:0upti.meK900Will restart once that lands06:30:28
@k900:0upti.meK900Ughhh06:54:58
@k900:0upti.meK900 @vcunat can you cancel the evals 06:55:01
@vcunat:matrix.orgVladimír ČunátI already did.06:56:42
@k900:0upti.meK900Thanks06:58:14
@vcunat:matrix.orgVladimír ČunátI haven't confirmed any failure in the Hydra's UI since then. I looked specifically at ISO builds, as those seemed to suffer abnormally from this. I don't know if this evidence has statistical significance already, though.14:34:52
@vcunat:matrix.orgVladimír ČunátLooking at hydra-queue-runner logs, we have lots of cases even today where the attempt counter goes over 10/32.14:37:32
@vcunat:matrix.orgVladimír ČunátWait... "retrying in 2346603 ms". Thats 39 minutes. 14:39:32
@vcunat:matrix.orgVladimír Čunát* Wait... "retrying in 2346603 ms". That's 39 minutes. 14:39:42
@xokdvium:matrix.orgSergei Zimmerman (xokdvium)Mhm yeah I mentioned that we should cap the retry time limit, I think that on master but not 2.3414:40:30
@xokdvium:matrix.orgSergei Zimmerman (xokdvium)Or even just make these failures exempt, those don’t need exponential back off at all14:41:06
@vcunat:matrix.orgVladimír ČunátIf the cap is 32 attempts, the backoff goes up to 2^32? 🤣14:42:21
@xokdvium:matrix.orgSergei Zimmerman (xokdvium)😵‍💫14:42:33

Show newer messages


Back to Room ListRoom Version: 6