| 17 Jun 2026 |
 hexa | looks like we're keeping it running over night | 00:18:54 |
 John Ericson | 🤞! | 00:21:04 |
|  ranidspace (they/it/xe) joined the room. | 02:15:39 |
|  @jay-goyal:matrix.org joined the room. | 02:17:21 |
| @jay-goyal:matrix.org left the room. | 02:17:39 |
|  ryand56 joined the room. | 03:20:04 |
 Vladimír Čunát | Uh, what's happening here now?
https://hydra.nixos.org/jobset/nixpkgs/unstable | 04:41:16 |
| Vladimír Čunát | 100k+ already succeeded jobs get retried? | 04:41:57 |
| Vladimír Čunát | (but it got cleared up quickly) | 05:45:50 |
| Vladimír Čunát | Is it expected that we don't have these metrics?
https://grafana.nixos.org/d/MJw9PcAiz/hydra-jobs | 05:46:58 |
| Vladimír Čunát | 🤔 I do see some new metrics, now prefixed with hydraqueuerunner_. They're named differently, or maybe completely different. | 05:57:56 |
 leona | There are also a few strange builds, e.g. https://hydra.nixos.org/build/331651002, https://hydra.nixos.org/build/331652806 which are succeeded, but the step is still in 'receiving output' stage. | 06:10:13 |
| leona | and also shop up in the 'running builds' view | 06:10:57 |
| Vladimír Čunát | Those paths are on cache.nixos.org already, at least. | 06:38:06 |
| leona | * and also show up in the 'running builds' view | 06:38:25 |
| hexa | https://paste.lossy.network/raw/CN3FRYPEEHF4N2QTDJXA6UDATY
https://hydra.nixos.org/build/331656644 | 07:53:30 |
| hexa | https://paste.lossy.network/GS3TZVHGHUQGTJET6M7ZP56FFA and from the queue-builder | 07:58:06 |
| hexa | Redacted or Malformed Event | 07:58:18 |
 Mic92 | We need to work on our logging serializer a bit. It has too many hex strings | 08:01:15 |
| hexa | not super clear how to unstuck https://hydra.nixos.org/build/331656644 | 08:23:12 |
| hexa | did a few changes to make the new metrics appear | 08:34:48 |
| hexa | ok, got all graphs hooked up | 08:45:58 |
| hexa | 
Download | 09:25:04 |
| hexa | the latter two seem very stuck | 09:25:07 |
| hexa | I stopped the queue-builder on elated-minsky and they're not going away | 09:25:17 |
| hexa | restarting the queue-runner next | 09:26:11 |
| hexa | ok, that did clear those | 09:26:45 |
| Vladimír Čunát | "Unsupported system type" here is very fishy:
https://hydra.nixos.org/build/331649953#tabs-buildsteps | 10:05:11 |
| Vladimír Čunát | There are weird inconsistencies. Some evals restart jobs which already succeeded. And now e.g. page https://hydra.nixos.org/jobset/nixos/release-26.05 shows cancellations only in the last eval but if click older evals, the cancellations also get shown in there. | 13:02:47 |
| Vladimír Čunát | * There are weird inconsistencies. Some evals restart jobs which already succeeded. And now e.g. page https://hydra.nixos.org/jobset/nixos/release-26.05 shows cancellations only in the last eval but if you click older evals, the cancellations also get shown in there. | 13:03:03 |
