!sBfrWMVsLoSyFTCkNv:nixos.org

OfBorg

179 Members
Number of builds and evals in queue: <TBD>63 Servers

You have reached the beginning of time (for this room).


SenderMessageTime
11 Aug 2023
@cole-h:matrix.orgcole-h @ofborg build [attrpath] 17:02:04
13 Aug 2023
@10leej:matrix.org@10leej:matrix.org joined the room.01:27:03
14 Aug 2023
@me:indeednotjames.comemilydo we know why aarch64-linux consumers dropped from 4 down to 1, around 10 hours ago? the aarch64-linux build queue is rising again (92 at the moment) 🫠11:32:30
@cole-h:matrix.orgcole-hFixed. (It happens slowly over time, Graham and I looked at it a couple years ago and couldn't figure out why, so it's just something that happens....)15:32:02
@lily:lily.flowersLily Foster
In reply to @cole-h:matrix.org
Fixed. (It happens slowly over time, Graham and I looked at it a couple years ago and couldn't figure out why, so it's just something that happens....)
If you have any details, I could come up with some bad ideas to root it out. It's just 4 runners on the same aarch64 community builder, right?
15:58:40
@cole-h:matrix.orgcole-hNo, the community builder has 16 runners15:59:10
@cole-h:matrix.orgcole-hBut it steadily decreases over time until it gets to 0 and then I get an alert (maybe I should alert when we're at 4 instead of 0 lol)15:59:34
@lily:lily.flowersLily FosterIs it because the runners die or something? I forget how ofborg has that setup right now. I'll probably look more at the code later16:00:34
@cole-h:matrix.orgcole-hNo, it's something networking related where they just hang and stop sending heartbeats, IIRC.16:00:58
* @cole-h:matrix.orgcole-h wonders if he still has his IRC logs somewhere....16:01:18

Show newer messages


Back to Room ListRoom Version: 6