11 Jun 2025 |
| etndiaz joined the room. | 17:49:00 |
15 Jun 2025 |
| @c3r5b8:matrix.org left the room. | 13:32:28 |
16 Jun 2025 |
| @ygt:matrix.org left the room. | 21:50:53 |
19 Jun 2025 |
| lgcl (she/they) changed their display name from lgcl (they/them) to lgcl (she/they). | 18:05:23 |
20 Jun 2025 |
| @genericnerdyusername:matrix.org left the room. | 23:31:05 |
22 Jun 2025 |
| Katalin 🔪 changed their display name from Katalin ⚧︎ to Katalin ⚧︎. | 20:44:11 |
| Katalin 🔪 changed their display name from Katalin ⚧︎ to Katalin ⚧︎. | 20:45:19 |
27 Jun 2025 |
| R̴̨͕͇͍̞̮̐̅͆̌̀̉̐͋̈́̃̀͒́̎̅̚̚̚͠͝Ĕ̵̡̛͖͖̟̙̫̱͈̘̞̭͍͍͑̌̄͑̓̋̓̀̈̏̈́͊̇͊͆̉͂̏̀̃̚͘͝͝ͅͅD̶̡̢͔̱̖̮͙͉̘̺͓͍̩̮͈͍͗̃̀̏͌͘͜ͅŚ̸̬̭̯̬͙͇͓̬̩̳̤͚͓̤̩̺͉͖̉͛̓̿̎͊̿̆́̐͂̇͌̄̇̓͘ͅͅT̴̞̫̘̝͇͔̟̪̪̦͂̔̎̀̎ͅŎ̷̡̬̹̪͈̭̣͈̭̭͉̦̖̝̘̪͖͔̥̦̘̻̳Ṋ̶̛̫͈̳̘͚̜̔̋͆̅̈́͊̑͊̉̌̈́̾͑̈́̚ͅË̸̡̨̨̛͇̜̖͔͖̻̟̗̠̙͓̘̗̥͉͇̜͑͆͊͑͑̀̓͒͜͝͝ changed their display name from Redstone to R̴̨͕͇͍̞̮̐̅͆̌̀̉̐͋̈́̃̀͒́̎̅̚̚̚͠͝Ĕ̵̡̛͖͖̟̙̫̱͈̘̞̭͍͍͑̌̄͑̓̋̓̀̈̏̈́͊̇͊͆̉͂̏̀̃̚͘͝͝ͅͅD̶̡̢͔̱̖̮͙͉̘̺͓͍̩̮͈͍͗̃̀̏͌͘͜ͅŚ̸̬̭̯̬͙͇͓̬̩̳̤͚͓̤̩̺͉͖̉͛̓̿̎͊̿̆́̐͂̇͌̄̇̓͘ͅͅT̴̞̫̘̝͇͔̟̪̪̦͂̔̎̀̎ͅŎ̷̡̬̹̪͈̭̣͈̭̭͉̦̖̝̘̪͖͔̥̦̘̻̳Ṋ̶̛̫͈̳̘͚̜̔̋͆̅̈́͊̑͊̉̌̈́̾͑̈́̚ͅË̸̡̨̨̛͇̜̖͔͖̻̟̗̠̙͓̘̗̥͉͇̜͑͆͊͑͑̀̓͒͜͝͝. | 00:56:15 |
28 Jun 2025 |
ElvishJerricco | I've been running a personal hydra for a couple years now, and a couple days it basically just stopped doing builds. I can get it to do a couple more every time I restart it, but it doesn't continue through the queue. Meanwhile in the journal I see this every 10 seconds: hydra-queue-runner[345]: checking the queue for builds... | 02:41:59 |
aftix | I had something similar which happened since the disk was full | 03:01:48 |
hexa | oh yeah, watermark level 🙂 | 03:04:21 |
hexa | minimumDiskFree[Evaluator] | 03:04:47 |
ElvishJerricco | that has never been a problem before, and my disk is not as full as it has been in the past | 03:05:34 |
ElvishJerricco | how would I check if that's it? | 03:05:43 |
hexa | did you configure a limit? | 03:09:11 |
ElvishJerricco | nope | 03:09:20 |
hexa | then the feature is probably not enabled | 03:09:40 |
hexa | you can inspect the internal state of the queue-runner by appending /queue-runner-status to the baseur | 03:11:59 |
hexa | * you can inspect the internal state of the queue-runner by appending /queue-runner-status to the base url | 03:12:03 |
hexa | relevant is whether there are runnables, because only those jobs are ready to be scheduled | 03:12:59 |
hexa | ideally consecutiveFailures is 0 for all builders | 03:13:17 |
ElvishJerricco | "machineTypes" : {
"x86_64-linux:kvm,nixos-test" : {
"runnable" : 5,
"running" : 0
},
"x86_64-linux:local" : {
"runnable" : 0,
"running" : 0
}
},
"consecutiveFailures" : 1, for the builder, presumably because I canceled a build
| 03:17:54 |
hexa | does the builder have the relevant system features? | 03:30:49 |
ElvishJerricco | Yep | 03:30:55 |
ElvishJerricco | I also see "disabledUntil" : 1751079864, , which corresponds with the log message hydra-queue-runner[345]: will disable machine ‘ssh://builder@pyromancer’ for 71s that came after I canceled that build. | 03:31:24 |
ElvishJerricco | But that timestamp has come and gone | 03:31:28 |
ElvishJerricco | long gone | 03:31:30 |
ElvishJerricco | should it still have that disabledUntil field if the time has passed? | 03:31:48 |
hexa | I don't think so | 03:32:06 |
hexa | or yes, it can | 03:32:22 |