| 21 Oct 2021 |
 Vladimír Čunát | Jonas Chevalier was doing caching changes and also migration shortly before, and he's on the GitHub thread. | 06:30:20 |
| Vladimír Čunát | I'm seeing lag over 33 hours behind 9aeeb7574fb..5f0194220f2 nixos-unstable | 06:31:17 |
| Vladimír Čunát | * I'm seeing lag over 33 hours behind git's 9aeeb7574fb..5f0194220f2 nixos-unstable | 06:31:24 |
| Vladimír Čunát | * Right now I'm seeing lag over 33 hours behind git's 9aeeb7574fb..5f0194220f2 nixos-unstable | 06:31:32 |
| Vladimír Čunát | I'm now unable to restart jobs on Hydra:
Caught exception in Hydra::Controller::Build->restart "Can't locate object method "search" via package "Hydra::Model::DB::Builds" at /nix/store/4yh4dda4w8f4w7gr5mvvc576b157nq50-hydra-0.1.20211020.30e5001/libexec/hydra/lib/Hydra/Helper/Nix.pm line 511."
| 08:59:48 |
| Vladimír Čunát | I tried different jobs and to relog, but the issue appears to be persistent. I expect it's the same for everyone else, too. | 09:02:55 |
 Janne Heß | With every day, the test runner gets more strange on unstable: https://hydra.nixos.org/build/156420853 | 12:19:18 |
| Janne Heß | * With every passing day, the test runner gets more strange on unstable: https://hydra.nixos.org/build/156420853 | 12:19:28 |
 sterni | and now restarting is broken :( | 12:40:28 |
| Vladimír Čunát | It's still possible to restart all-failed or all-aborted in an eval. | 12:42:14 |
| sterni | :D | 12:42:24 |
| Vladimír Čunát | ... but that often restarts much more than one wants. | 12:42:33 |
 K900 | Janne Heß is the QEMU process alive when it hangs? | 18:58:50 |
| K900 | It should definitely exit when that exits | 18:58:59 |
| Janne Heß | nope, it's already dead | 18:59:03 |
| Janne Heß | ah sorry it is | 18:59:11 |
| K900 | Oh no | 18:59:16 |
| Janne Heß | 
Download image.png | 18:59:21 |
| K900 | Can you poke it and see what it's doing? | 18:59:38 |
| K900 | Or at least get a core dump | 18:59:45 |
| K900 | Cause it should have been sigtermed | 18:59:51 |
| Janne Heß | core dump of what? | 19:00:06 |
| K900 | Qemu | 19:00:11 |
| K900 | Just to see why it's not dying | 19:00:38 |
| Janne Heß | SIGABRT causes python to coredump as well btw | 19:01:17 |
| K900 | Huh | 19:01:35 |
 baloo | may I suggest find /proc/$(pidof qemu)/ -name stack -print -exec cat {} \; as well? | 19:01:57 |
| Janne Heß | I'll rerun the test, might take some minutes | 19:02:13 |
| Janne Heß | I also outlined the flakyness that you mentioned, K900 without rewriting the entire function ;) | 19:02:39 |
| Janne Heß | * I also fixed the flakyness that you mentioned, K900 without rewriting the entire function ;) | 19:02:44 |
