| 17 Jun 2026 |
|  ryand56 joined the room. | 03:20:04 |
 Vladimír Čunát | Uh, what's happening here now?
https://hydra.nixos.org/jobset/nixpkgs/unstable | 04:41:16 |
| Vladimír Čunát | 100k+ already succeeded jobs get retried? | 04:41:57 |
| Vladimír Čunát | (but it got cleared up quickly) | 05:45:50 |
| Vladimír Čunát | Is it expected that we don't have these metrics?
https://grafana.nixos.org/d/MJw9PcAiz/hydra-jobs | 05:46:58 |
| Vladimír Čunát | 🤔 I do see some new metrics, now prefixed with hydraqueuerunner_. They're named differently, or maybe completely different. | 05:57:56 |
 leona | There are also a few strange builds, e.g. https://hydra.nixos.org/build/331651002, https://hydra.nixos.org/build/331652806 which are succeeded, but the step is still in 'receiving output' stage. | 06:10:13 |
| leona | and also shop up in the 'running builds' view | 06:10:57 |
| Vladimír Čunát | Those paths are on cache.nixos.org already, at least. | 06:38:06 |
| leona | * and also show up in the 'running builds' view | 06:38:25 |
 hexa | https://paste.lossy.network/raw/CN3FRYPEEHF4N2QTDJXA6UDATY
https://hydra.nixos.org/build/331656644 | 07:53:30 |
| hexa | https://paste.lossy.network/GS3TZVHGHUQGTJET6M7ZP56FFA and from the queue-builder | 07:58:06 |
| hexa | Redacted or Malformed Event | 07:58:18 |
 Mic92 | We need to work on our logging serializer a bit. It has too many hex strings | 08:01:15 |
| hexa | not super clear how to unstuck https://hydra.nixos.org/build/331656644 | 08:23:12 |
| hexa | did a few changes to make the new metrics appear | 08:34:48 |
| hexa | ok, got all graphs hooked up | 08:45:58 |
| hexa | 
Download | 09:25:04 |
| hexa | the latter two seem very stuck | 09:25:07 |
| hexa | I stopped the queue-builder on elated-minsky and they're not going away | 09:25:17 |
| hexa | restarting the queue-runner next | 09:26:11 |
| hexa | ok, that did clear those | 09:26:45 |
| Vladimír Čunát | "Unsupported system type" here is very fishy:
https://hydra.nixos.org/build/331649953#tabs-buildsteps | 10:05:11 |
| Vladimír Čunát | There are weird inconsistencies. Some evals restart jobs which already succeeded. And now e.g. page https://hydra.nixos.org/jobset/nixos/release-26.05 shows cancellations only in the last eval but if click older evals, the cancellations also get shown in there. | 13:02:47 |
| Vladimír Čunát | * There are weird inconsistencies. Some evals restart jobs which already succeeded. And now e.g. page https://hydra.nixos.org/jobset/nixos/release-26.05 shows cancellations only in the last eval but if you click older evals, the cancellations also get shown in there. | 13:03:03 |
 Sergei Zimmerman (xokdvium) | In reply to @vcunat:matrix.org
"Unsupported system type" here is very fishy:
https://hydra.nixos.org/build/331649953#tabs-buildsteps A lot of nix jobs fail similarly:
https://hydra.nixos.org/build/331656015 | 13:22:46 |
| Vladimír Čunát | Oh, could it be meaning i686-linux? | 13:24:11 |
| Sergei Zimmerman (xokdvium) | No, all systems seem to sporadically show this it seems | 13:24:47 |
| hexa | we noticed unsupported system last night, too | 13:36:25 |
| hexa | and I thought it didn't respect max_unsupported_time and aborted builds when builders were unavailable for a short time | 13:36:57 |
