| 15 Mar 2026 |
 dramforever | afaict anything doing that is too theoretical to work | 10:07:23 |
 Alyssa Ross | appears I am wrong | 10:15:34 |
|  @codayon:matrix.org left the room. | 13:44:09 |
|  mjolnir banned  @jykrwn_bot:matrix.org (disagreement). | 20:28:08 |
|  isabel changed their profile picture. | 20:54:45 |
| isabel changed their profile picture. | 20:55:02 |
| 17 Mar 2026 |
 Mic92 | bumping hydra: https://github.com/NixOS/infra/pull/978 | 17:48:21 |
| Mic92 | 9m Waiting for reboot hexa (signing key rotation when) how long should I give it? | 18:07:57 |
| Mic92 | Haven't done a update & reboot since we switched to the new hw | 18:08:39 |
 Vladimír Čunát | mimas has longer boots, IIRC. | 18:10:09 |
| Vladimír Čunát | ... and it's up. | 18:11:11 |
 hexa | mimas takes ~13-14 minutes | 18:20:28 |
| hexa | stays 11min+ in firmware | 18:20:53 |
| 18 Mar 2026 |
| Vladimír Čunát | enormous-catfish.mac.nixos.org doesn't seem to be building anything. 0 steps since the last queue-runner restart, as reported by https://hydra.nixos.org/machines | 07:42:36 |
| Vladimír Čunát | I don't know how to debug these, but we're waiting for *-darwin builds a lot (primarily in staging-next now). | 07:43:58 |
| Vladimír Čunát | * enormous-catfish.mac.nixos.org doesn't seem to be building anything. 0 steps since the last queue-runner restart (~13h ago), as reported by https://hydra.nixos.org/machines | 07:51:29 |
| hexa | [hydra-queue-runner@mimas:~]$ ssh root@enormous-catfish.mac.nixos.org
sh: /nix/store/4l10cjldqc53nvycma09lfsg46w52s28-nix-2.31.2/bin/nix-store: No such file or directory
Connection to enormous-catfish.mac.nixos.org closed.
| 12:59:04 |
| hexa | command="NIX_SSL_CERT_FILE=/nix/store/s6x1s57vgmiccc1grwwcmphzbffs76cd-nss-cacert-3.121/etc/ssl/certs/ca-bundle.crt /nix/store/92nq0147myzffvhq6jlq06ad68yh0ja3-nix-2.31.2+1/bin/nix-store --serve --store daemon --write"
| 12:59:48 |
| hexa | looks like it runs the wrong nix-store binary? | 13:00:11 |
| hexa | rebooting | 13:05:14 |
| hexa | no change | 13:09:03 |
| hexa | ok, what helped was deconfiguring the key and reconfiguring it fresh | 13:25:32 |
 Winter | could I get restart-jobs on hydra please? email is [name]@[name].cafe | 14:04:03 |
| hexa | 
Download image.png | 16:05:47 |
| hexa | applied | 16:05:48 |
| Winter | thank you 🫡 | 16:06:16 |
|  debtquity joined the room. | 21:56:55 |
| 19 Mar 2026 |
| Vladimír Čunát | Hydra now shows lots of abortions from S3 uploads.
Aborted: [31;1merror:[0m … while uploading to S3 binary cache at '[35;1ms3://nix-cache[0m' [31;1merror:[0m unable to upload '[35;1mhttps://nix-cache.s3.us-east-1.amazonaws.com/nar/0fi6dj94id8fla40n3h98b9spmsbszl7i7k2bkpnjbqk9fcgyad8.nar.xz[0m': HTTP error [35;1m400[0m[35;1m[0m response body: [35;1m<?xml version="1.0" encoding="UTF-8"?> <Error><Code>RequestTimeout</Code><Message>Your socket connection to the server was not read from or written to within the timeout period. Idle connections will be closed.</Message><RequestId>2SDA6N47EBP0Y9TY</RequestId><HostId>DzalNia2QC6pPMWG4tSso2PO0E+w+ZmqUrCtA+oI2GP1hMZV3IVW5WibfNELfak4rQVKuh6OrCw=</HostId></Error>[0m
| 08:08:00 |
| hexa | RequestTimeout
| 08:08:37 |
| hexa | hydra surely retries uplodas, right? | 08:08:50 |
