| 26 Jun 2026 |
 Vladimír Čunát | (and it still showed the running status on the first one) | 08:55:56 |
| Vladimír Čunát | * I'm quite sure that Hydra was showing the "running" status even after finishing an eval and then finished some other evals, too. | 08:56:08 |
 hexa | after killing it, it started evaling unstable-small | 08:56:18 |
 Mic92 | I did remove some spamy messages. But I think I need to do another round | 08:56:24 |
| Mic92 | some log fields are also print as bytes still | 08:56:33 |
| Vladimír Čunát | Either way, this weird behavior is a new thing. | 08:56:34 |
| Vladimír Čunát | And I've restarted the service at least once after appearing stuck, sometime in the last 3 days. | 08:57:31 |
| hexa | right now we log every build step on INFO | 08:59:02 |
| hexa | that already creates a huge volume of logs | 08:59:10 |
| hexa | Redacted or Malformed Event | 08:59:13 |
| Vladimír Čunát | I expect it's useful now when fixing new queue-runner bugs. | 09:00:49 |
| Vladimír Čunát | Maybe we'd better increase the overall journal size limit? | 09:01:14 |
| Vladimír Čunát | In this case, a few GBs shouldn't matter. | 09:02:41 |
| Vladimír Čunát | (I see 831G available for / right now.) | 09:03:25 |
| hexa | looks like pgmpy | 09:57:30 |
| hexa | because of course we stack four of them on elated-minsky | 09:57:44 |
| hexa | I'd say we kill them all and I send a fix to master | 10:03:54 |
 K900 | 
Download OK the highlighted output on NixOS tests is REALLY nice | 10:08:14 |
| hexa | that looks much better | 10:08:17 |
| hexa | https://github.com/NixOS/nixpkgs/pull/535575 | 10:24:29 |
| hexa | vcunat did you restart the graphical iso just now? | 10:51:25 |
| Vladimír Čunát | I did, but it didn't help. | 10:51:43 |
| hexa | https://hydra.nixos.org/build/332754507 | 10:51:43 |
| hexa | Use of uninitialized value $key in hash element at /nix/store/jvlbqylkvks50vfiqncbyxrgas38bb5z-nixos-channel-scripts/bin/.mirror-nixos-branch-wrapped line 193.
Use of uninitialized value $productType in concatenation (.) or string at /nix/store/jvlbqylkvks50vfiqncbyxrgas38bb5z-nixos-channel-scripts/bin/.mirror-nixos-branch-wrapped line 200.
No product could be selected for nixos.iso_graphical.x86_64-linux, with type at /nix/store/jvlbqylkvks50vfiqncbyxrgas38bb5z-nixos-channel-scripts/bin/.mirror-nixos-branch-wrapped line 200.
| 10:51:56 |
| Vladimír Čunát | It's stuck, despite the result already being in cache. | 10:51:58 |
| Vladimír Čunát | The hydra job itself never finished. | 10:52:16 |
| Vladimír Čunát | (post-processing for hours) I already asked Mic directly with details from log. | 10:52:38 |
| hexa | I don't think this was caused by my change fwiw | 10:53:08 |
| hexa | but I was worried for a second there | 10:53:20 |
| Vladimír Čunát | And in the meantime I triggered another eval, as I really hate that nixos-unstable is on a 10 days old commit. | 10:53:17 |
