| 22 Jun 2026 |
 Mic92 | The performance changes are now in staging-hydra.nixos.org branch | 12:44:28 |
| Mic92 | https://github.com/NixOS/hydra/commits/staging-hydra.nixos.org | 12:44:37 |
 hexa | hm, I saw two chromium builds complete after 1d 1h yesterday | 12:45:46 |
| Mic92 | * The performance changes are now in the staging-hydra.nixos.org branch | 12:47:11 |
| hexa | cancelling jobs seems to work as bad as before | 13:42:42 |
| hexa | meaning I log onto the builder and kill -9 the thing | 13:43:51 |
| hexa | done for the stuck lix builds | 13:44:00 |
 Vladimír Čunát | Before there was usually the problem that other non-cancelled jobs were depending on that particular step. | 13:44:00 |
| Mic92 | I do have a branch flying around that allows to drain builders... I think we can have the same for canceling a build we want to cancel. | 14:18:34 |
| Mic92 | when things calm down | 14:18:51 |
| Mic92 | * I do have a branch flying around that allows to drain builders machines... I think we can have the same for canceling a build we want to cancel. | 14:19:08 |
| Mic92 | * I do have a branch flying around that allows to drain builder machines... I think we can have the same for canceling a build we want to cancel. | 14:19:11 |
 Sergei Zimmerman (xokdvium) | Hydra stil seems to be doing quite poorly:
https://hydra.nixos.org/build/332391533/log sh: line 1: g++: command not found. Don't know what that's about, GC issues again?
| 21:56:27 |
| 23 Jun 2026 |
 vmfunc | sh: line 1: g++: command not found, huh?? | 04:27:09 |
| Vladimír Čunát | FYI: nixos-unstable is on a 7 days old commit now, but this time queue-runner isn't the issue; we have a different pair of blockers: https://github.com/NixOS/nixpkgs/pull/530382#issuecomment-4776516421 | 06:52:57 |
| Vladimír Čunát | * FYI: nixos-unstable is on a 7 days old commit now, but this time infra isn't the issue; we have a different pair of blockers: https://github.com/NixOS/nixpkgs/pull/530382#issuecomment-4776516421 | 06:53:13 |
| Vladimír Čunát |
GC issues again?
Step 22 here looks like some GC issue as well:
https://hydra.nixos.org/build/332396502#tabs-buildsteps
(when I fetch this /nix/store path from cache.nixos.org, the file is there)
| 07:41:38 |
| Mic92 | @xokdvium:matrix.org: there was still a TOCTOU bug in my temproots fix, I added now a regression test for the future: https://github.com/NixOS/hydra/commit/3bcea35e40abece41eee094ea1cb0e8407ed7325 | 07:57:21 |
| Mic92 | @hexa:lossy.network: I got some work to do and I am out this evening. In case you got time, I have also some new builder limit options that should be wired | 08:01:04 |
| Mic92 | The last 3 commits in the branch | 08:01:29 |
| hexa | ready for prod? | 08:02:07 |
| hexa | 
Download | 08:10:16 |
| hexa | builds stuck in connecting for hours | 08:10:25 |
| Mic92 | @hexa:lossy.network: yes. I kept the other patches still in the staging branch that I want to test. | 08:12:29 |
| hexa | alright | 08:12:40 |
| Mic92 | Check if grpc listening socket is still up | 08:12:52 |
| Mic92 | Maybe same issue as the metrics server | 08:13:21 |
| hexa | root@sweeping-filly:~/ > netstat | grep mimas
tcp6 0 0 sweeping-filly.b.59366 mimas.nixos.org.https ESTABLISHED
tcp6 0 0 sweeping-filly.b.58946 mimas.nixos.org.https ESTABLISHED
| 08:14:48 |
| hexa | aren't they multiplexed into the same grpc stream? | 08:14:58 |
| hexa | [root@mimas:~]# ss | grep 2a01:4f8:261:1351::1
tcp ESTAB 0 0 [2a01:4f8:2220:11c8::1]:https [2a01:4f8:261:1351::1]:58946
tcp ESTAB 0 0 [2a01:4f8:2220:11c8::1]:https [2a01:4f8:261:1351::1]:59366\
| 08:15:35 |
