| 28 Feb 2024 |
@adam:robins.wtf | there was some discussion above about moving to all aarch64 builders and running x86 on those instead, but i don't think any changes were made | 14:21:32 |
@adam:robins.wtf | (not that that helps this specific timeout, but potentially it helps overall capacity) | 14:23:00 |
Lily Foster | yeah increasing the timeout may help that problem for sure. we could just try it and see | 14:23:22 |
hexa | 5x x86_64-linux, 1x aarch64-linux, 2x aarch64-darwin, 3x x86_64-darwin | 14:23:24 |
hexa | *
- 5x x86_64-linux,
- 1x aarch64-linux,
- 2x aarch64-darwin,
- 3x x86_64-darwin
| 14:23:46 |
hexa | *
- 5 x86_64-linux,
- 1 aarch64-linux,
- 2 aarch64-darwin,
- 3 x86_64-darwin
| 14:23:51 |
@adam:robins.wtf | wow, we run all the aarch64-linux on one machine! and yet we never wait on it | 14:23:55 |
Alyssa Ross | It's usually the fastest, even, IME | 14:24:09 |
hexa | that is aarch64.nixos.community | 14:24:12 |
hexa | fwiw | 14:24:13 |
hexa | the community builder | 14:24:18 |
7c6f434c | It has cores, lots of cores. | 14:24:20 |
hexa | ampere altra q80-30 | 14:24:22 |
Lily Foster | yeah the 1x for aarch64-linux is an absolute monster | 14:24:33 |
hexa | the x86_64-linux machines co host the evaluators | 14:24:36 |
Lily Foster | and actually runs like 20 ofborg consumers at once | 14:24:46 |
hexa | 3 evaluators per host, 15 in parallel | 14:24:49 |
Alyssa Ross | My latest OfBorg LLVM build for a staging PR on aarch46-darwin timed out with Ninja showing 2533/4188 | 14:25:05 |
Alyssa Ross | but there's also the test suite after that, which takes a while | 14:25:11 |
hexa | so 3h? | 14:25:17 |
Alyssa Ross | so we might need to go to 2.5 or 3 hours | 14:25:17 |
hexa |  Download image.png | 14:25:49 |
hexa | green is the queue for aarch64-darwin | 14:25:54 |
hexa | * green is the queue for aarch64-darwin for the last 7 days | 14:26:02 |
Lily Foster | yeah maybe we could just try it? it's definitely wasting time on builds it's not gonna finish. it's hard to tell without data if it finishing the builds at the cost of 3h would actually help or hurt though | 14:26:17 |
hexa | please do | 14:26:31 |
Lily Foster | otherwise disabling aarch64-darwin builds on staging PRs can be the backup | 14:26:49 |
Lily Foster | In reply to @hexa:lossy.network please do @[cole-h] | 14:26:53 |
hexa | but we also need another machine to work through that queue in a reasonable time | 14:26:56 |
@adam:robins.wtf | honestly i don't see how we can make things much worse | 14:26:58 |