| 26 Jun 2026 |
 hexa | # strace -fp 1061238
strace: Process 1061238 attached
restart_syscall(<... resuming interrupted restart_syscall ...>
| 08:51:58 |
 Vladimír Čunát | It started about 5h ago and produced an eval. | 08:53:08 |
| hexa | so it does not exit properly anymore and blocks new evals? | 08:53:34 |
| hexa | killed the job | 08:53:58 |
| hexa | it will certainly return | 08:54:08 |
| Vladimír Čunát | Uh, log for that service only has the last 2 hours. | 08:54:11 |
| hexa | yeah, queue-runner spam | 08:54:19 |
| hexa | and journal being limited at 4.0G right now | 08:54:37 |
| Vladimír Čunát | I'm quite sure that Hydra was showing the "running" status even after finishing and eval and then finished some other evals, too. | 08:55:44 |
| Vladimír Čunát | (and it still showed the running status on the first one) | 08:55:56 |
| Vladimír Čunát | * I'm quite sure that Hydra was showing the "running" status even after finishing an eval and then finished some other evals, too. | 08:56:08 |
| hexa | after killing it, it started evaling unstable-small | 08:56:18 |
 Mic92 | I did remove some spamy messages. But I think I need to do another round | 08:56:24 |
| Mic92 | some log fields are also print as bytes still | 08:56:33 |
| Vladimír Čunát | Either way, this weird behavior is a new thing. | 08:56:34 |
| Vladimír Čunát | And I've restarted the service at least once after appearing stuck, sometime in the last 3 days. | 08:57:31 |
| hexa | right now we log every build step on INFO | 08:59:02 |
| hexa | that already creates a huge volume of logs | 08:59:10 |
| hexa | Redacted or Malformed Event | 08:59:13 |
| Vladimír Čunát | I expect it's useful now when fixing new queue-runner bugs. | 09:00:49 |
| Vladimír Čunát | Maybe we'd better increase the overall journal size limit? | 09:01:14 |
| Vladimír Čunát | In this case, a few GBs shouldn't matter. | 09:02:41 |
| Vladimír Čunát | (I see 831G available for / right now.) | 09:03:25 |
| hexa | looks like pgmpy | 09:57:30 |
| hexa | because of course we stack four of them on elated-minsky | 09:57:44 |
| hexa | I'd say we kill them all and I send a fix to master | 10:03:54 |
 K900 | 
Download OK the highlighted output on NixOS tests is REALLY nice | 10:08:14 |
| hexa | that looks much better | 10:08:17 |
| hexa | https://github.com/NixOS/nixpkgs/pull/535575 | 10:24:29 |
| hexa | vcunat did you restart the graphical iso just now? | 10:51:25 |
