!sBfrWMVsLoSyFTCkNv:nixos.org

OfBorg

172 Members
Number of builds and evals in queue: https://ofborg.org/prometheus/graph?g0.expr=ofborg_queue_evaluator_waiting&g0.tab=1&g0.stacked=0&g0.show_exemplars=0&g0.range_input=2h&g1.expr=ofborg_queue_builder_waiting%7Barch!~%22.*-lowprior%22%7D&g1.tab=1&g1.stacked=0&g1.show_exemplars=0&g1.range_input=2h62 Servers

Load older messages


SenderMessageTime
9 Feb 2024
@artturin:matrix.orgArtturin
In reply to @pinpox:matrix.org
crossposting here as requested:

ofborg is failing to run my test, even though it works fine locally. Can anyone tell me what I'm doing wrong? https://github.com/NixOS/nixpkgs/actions/runs/7843526136/job/21404048992?pr=287455
That's not ofborg, it's https://github.com/NixOS/nixpkgs/blob/master/.github/workflows/nix-parse.yml
13:41:05
@artturin:matrix.orgArtturin Add the test to the passthru.tests of the package btw 13:45:57
@artturin:matrix.orgArtturin pinpox: it passes now 15:20:13
@artturin:matrix.orgArtturincheck the darwin failure and drop the merge15:20:35
@pinpox:matrix.org@pinpox:matrix.org Artturin: I removed the merge but now it conflicts again 20:59:30
@pinpox:matrix.org@pinpox:matrix.orgI'm not sure how to resolve this20:59:43
@artturin:matrix.orgArtturin
In reply to @pinpox:matrix.org
Artturin: I removed the merge but now it conflicts again
conflicts should be resolved via rebasing
21:00:49
@artturin:matrix.orgArtturinhttps://github.com/NixOS/nixpkgs/blob/master/CONTRIBUTING.md#how-to-create-pull-requests 7.21:01:00
@artturin:matrix.orgArtturin
In reply to @pinpox:matrix.org
Artturin: I removed the merge but now it conflicts again
* conflicts should be resolved by rebasing
21:01:43
@pinpox:matrix.org@pinpox:matrix.org Artturin: got it fixed, thanks! 21:06:35
@pinpox:matrix.org@pinpox:matrix.org * Artturin: got it fixed, thanks! Rebased and without conflicts now 21:06:44
12 Feb 2024
@infinisil:matrix.org@infinisil:matrix.orgRegarding https://github.com/NixOS/nixpkgs/pull/269403, I actually don't think it would improve ofborg speed at all00:53:17
@infinisil:matrix.org@infinisil:matrix.org * Regarding https://github.com/NixOS/nixpkgs/pull/269403, I actually don't think it would improve ofborg eval speed at all00:53:21
@infinisil:matrix.org@infinisil:matrix.orgIt gives a 5x speedup if you have 31 additional cores without anything to do00:53:55
@infinisil:matrix.org@infinisil:matrix.orgWell I guess it depends on how booked-out ofborg generally is00:54:42
@infinisil:matrix.org@infinisil:matrix.orgBecause if it's already using 32 cores for 32 separate evaluations, that PR would not help at all (in fact it would make it a lot worse, because each parallel unit of work duplicates work..)00:55:42
@cole-h:matrix.orgcole-hofborg does not use 32 cores for 32 evaluations 😆 It only has enough memory to run 3 evaluations on one machine most times. (256GiB total, each eval-outpaths takes ~60+GiB of memory.)15:03:16
@cole-h:matrix.orgcole-hSo, provided there's no huge build taking place on the same box, the other cores are usually sitting around twiddling their thumbs.15:04:13
@raitobezarius:matrix.orgraitobezarius
In reply to @infinisil:matrix.org
Because if it's already using 32 cores for 32 separate evaluations, that PR would not help at all (in fact it would make it a lot worse, because each parallel unit of work duplicates work..)
well it's not like Nix is smart and knows how to deal with values appropriately
15:51:22
@raitobezarius:matrix.orgraitobezarius so not sure if that would be that wasteful 15:51:26
@raitobezarius:matrix.orgraitobezariusmeasurements are important here15:51:28
@raitobezarius:matrix.orgraitobezariusbecause the GC is really in a bad shape15:51:36
@infinisil:matrix.org@infinisil:matrix.orgI see, so it sounds like it would still help a bunch16:29:41
@trofi:matrix.orgtrofi It would improve in a sense that that PR does not really list a superset of all hydra attributes. For example it skips all recursive attributes like pythonPackages or haskellPackages. 21:42:19
@trofi:matrix.orgtrofi But I agree nix's RAM usage for tree traversals is unusable on large trees. https://github.com/NixOS/nix/issues/9671 feels like being a bit more eager about evicting unreferenced values would help a lot. nix-env -qa is a bit trickier as package list is built and sorted outside nix expressions. 21:44:08
14 Feb 2024
@keiichi:matrix.orgtetoHow can I see the actual ofborg queue ? I would like to see where my PR (288761) darwin job is to get an idea how long it will take. I see there are 133 jobs19:35:26
@7c6f434c:nitro.chat7c6f434cBased on another PR and the stats, I think the two Darwin queues are comparable, so one of them reaching that PR is a good sign…19:40:14
@cole-h:matrix.orgcole-h You can't, sorry.  19:40:31
@keiichi:matrix.orgtetoI suspected so :'( ty19:59:35
16 Feb 2024
@a-n-n-a-l-e-e:matrix.org@a-n-n-a-l-e-e:matrix.orgnot sure if this is the right channel but: i think i'm seeing some failures on ofborg aarch64-darwin that aren't on hydra. hydra builds are passing but ofborg builds are failing. i created ofborg builds by creating a PR and adding a comment in postPatch to trigger a rebuild but seem to be failing 100% while running unit tests. I noticed issues when trying to upgrade the same package and which is why i backgracked to a known good build (green hydra) but am still seeing failures.09:11:01

Show newer messages


Back to Room ListRoom Version: 6