OfBorg | 169 Members | |
| Number of builds and evals in queue: <TBD> | 62 Servers |
| Sender | Message | Time |
|---|---|---|
| 11 Jan 2024 | ||
In reply to @elvishjerricco:matrix.orgit may not be cached on master rn 🤷🏻♀️ | 16:15:50 | |
| it always rebases on master and there's sometimes rebuilds of dependencies on master | 16:16:08 | |
| * it always applies patch against master and there's sometimes rebuilds of dependencies on master | 16:16:19 | |
so I guess I just asked it to build too much at once and it ran out of space in /tmp? | 16:16:29 | |
| looks like kernels are not currently cached on master, and it was trying to build two of them at once to run the zfs tests | 16:18:36 | |
In reply to @elvishjerricco:matrix.orgwell there were kernel releases yesterday and those get merged straight to master, so i can believe that there would be kernel rebuilds on master right now and that ofborg ran out of space trying to build those so it could build the actual test | 16:18:54 | |
| I guess I'll build the tests myself then | 16:19:33 | |
| could ofborg be failing on https://github.com/NixOS/nixpkgs/pull/274089 because because it's trying to evaluate the packages in (the new) pkgsExtraHardening? | 20:09:55 | |
* could ofborg be failing on https://github.com/NixOS/nixpkgs/pull/274089 because because it's trying to evaluate the packages in (the new) pkgsExtraHardening? | 20:10:12 | |
* could ofborg be failing on https://github.com/NixOS/nixpkgs/pull/274089 because it's trying to evaluate the packages in (the new) pkgsExtraHardening? | 20:10:22 | |
| I doubt it. The eval failure is because the staging commit your PR is built off of was busted. If you rebase, it should work (or at least get further):
| 20:11:28 | |
In reply to @r_i_s:matrix.org possibly. on a quick glance on mobile i see the ofborg-eval failure link which shows eval output says this though:
| 20:11:36 | |
| yeah what cole said (i typed too slow 😅l | 20:11:57 | |
| * yeah what cole said (i typed too slow 😅) | 20:12:00 | |
In reply to @cole-h:matrix.orgi mean it merged onto base branch before doing evals, so staging must have been busted at that anyway? they should just need to retrigger eval rather than rebasing | 20:12:58 | |
| * i mean it merges onto base branch before doing evals, so staging must have been busted at that anyway? they should just need to retrigger eval rather than rebasing | 20:13:04 | |
| * i mean it merges onto base branch before doing evals, so staging must have been busted at that time anyway? they should just need to retrigger eval rather than rebasing | 20:13:11 | |
| 15 Jan 2024 | ||
| how can we speed up eval and aarch64-darwin builders? can we throw money at these problems? | 13:45:02 | |
In reply to @adam:robins.wtfmoney can to an extent probably be thrown at the problem. really our eval shouldn't be so expensive, but if we had the money, we could still theoretically just get more evaluators/x86_64-linux builders (they are colocated) and more aarch64-darwin builders for short-term and have it be better (but our eval compute cost has been going up a lot the last year or so, and it's not helped by nix performance regressing in both eval time and memory pretty much every release iirc...) | 13:56:53 | |
| honestly i think the aarch64-darwin builders is the bigger problem. | 13:58:04 | |
| 12+ hours just to get time on an aarch64-darwin builder is absurd and can only hurt the support of this platform as people will merge without waiting | 14:00:00 | |
| especially given that x86_64-darwin, a dying platform, is competing in a much more reasonable amount of time | 14:01:21 | |
| * especially given that x86_64-darwin, a dying platform, is completing in a much more reasonable amount of time | 14:01:33 | |
| idk how much the macstadium aarch64-darwin builders are now, but tbh we could probably do what we did for hydra and switch our x86_64-darwin builders to aarch64-darwin and just use rosetta | 14:02:01 | |
In reply to @lily:lily.flowersthoughts on this @[cole-h]? | 14:02:38 | |
| i'd be willing to contribute some money directly towards better aarch64-darwin resources. maybe not enough to fully fund expansion, but i'm willing to try and raise funds from others too | 14:05:11 | |
In reply to @adam:robins.wtfwell tbh i'm thinking if the cost difference isn't that much, we can probably just have 6 aarch64-darwin/rosetta instead of 4 x86_64 + 2 aarch64. but depending on how the x86_64 builders are performing it could be a bit if a performance hit. however given they are mostly idle and the aarch64 queue is mostly behind, i think it may come out in our favor | 14:08:13 | |
| * well tbh i'm thinking if the cost difference isn't that much, we can probably just have 6 aarch64-darwin/rosetta instead of 4 x86_64 + 2 aarch64. but depending on how the x86_64 builders are performing it could be a bit of a performance hit. however given they are mostly idle and the aarch64 queue is mostly behind, i think it may come out in our favor | 14:08:26 | |
| if it's not enough, we can probably look at funding more builders from there | 14:08:47 | |
| i've found rosetta performance to be pretty good | 14:08:54 | |