| 11 Aug 2023 |
cole-h | @ofborg build [attrpath] | 17:02:04 |
| 13 Aug 2023 |
| @10leej:matrix.org joined the room. | 01:27:03 |
| 14 Aug 2023 |
emily | do we know why aarch64-linux consumers dropped from 4 down to 1, around 10 hours ago?
the aarch64-linux build queue is rising again (92 at the moment) 🫠| 11:32:30 |
cole-h | Fixed. (It happens slowly over time, Graham and I looked at it a couple years ago and couldn't figure out why, so it's just something that happens....) | 15:32:02 |
Lily Foster | In reply to @cole-h:matrix.org Fixed. (It happens slowly over time, Graham and I looked at it a couple years ago and couldn't figure out why, so it's just something that happens....) If you have any details, I could come up with some bad ideas to root it out. It's just 4 runners on the same aarch64 community builder, right? | 15:58:40 |
cole-h | No, the community builder has 16 runners | 15:59:10 |
cole-h | But it steadily decreases over time until it gets to 0 and then I get an alert (maybe I should alert when we're at 4 instead of 0 lol) | 15:59:34 |
Lily Foster | Is it because the runners die or something? I forget how ofborg has that setup right now. I'll probably look more at the code later | 16:00:34 |
cole-h | No, it's something networking related where they just hang and stop sending heartbeats, IIRC. | 16:00:58 |
| * cole-h wonders if he still has his IRC logs somewhere.... | 16:01:18 |