!sBfrWMVsLoSyFTCkNv:nixos.org

OfBorg

165 Members
Number of builds and evals in queue: <TBD>61 Servers

Load older messages


SenderMessageTime
27 Nov 2023
@cole-h:matrix.orgcole-h
In reply to @artturin:matrix.org
prs from 2+ hours haven't been evalled
Yep, unfortunately that’s because Nixpkgs still takes on the order of ~10+ minutes for each evaluation. We used to be able to get by with 5-7 machines, but nowadays even 9 is too slow. I think I investigated this slowdown before and posted here, but I don’t remember
13:37:58
@lily:lily.flowersLily Foster
In reply to @cole-h:matrix.org
Yep, unfortunately that’s because Nixpkgs still takes on the order of ~10+ minutes for each evaluation. We used to be able to get by with 5-7 machines, but nowadays even 9 is too slow. I think I investigated this slowdown before and posted here, but I don’t remember
There's an ambitious PR at https://github.com/NixOS/nixpkgs/pull/269403 which we could possibly replace our outpath calculation with to get a bit improvement. I haven't looked at the specifics of it though
13:40:47
@cole-h:matrix.orgcole-hHm!13:41:24
@lily:lily.flowersLily Foster
In reply to @cole-h:matrix.org
Yep, unfortunately that’s because Nixpkgs still takes on the order of ~10+ minutes for each evaluation. We used to be able to get by with 5-7 machines, but nowadays even 9 is too slow. I think I investigated this slowdown before and posted here, but I don’t remember
* There's an ambitious PR at https://github.com/NixOS/nixpkgs/pull/269403 which we could possibly replace our outpath calculation with to get a big improvement. I haven't looked at the specifics of it though
13:41:34
@lily:lily.flowersLily FosterI was hopefully going to give that PR a close look sometime today (not that I would know what I'm doing, but at least to have some understanding of the technical changes)13:43:40
@artturin:matrix.orgArtturinA few people said that the eval ram usage went up in the last few days15:18:01
@keiichi:matrix.orgteto Artturin brought to my attention hte problem of nix eval going up ( I witnessed it myself before). Do we know why that is (due to release workload )? Is there a ticket to track this down ? Does ofborg use maintainers/scripts/rebuild-amount.sh ? I wonder if that's what ofborg used ? The script could use some polish https://github.com/NixOS/nixpkgs/issues/269616, I sometimes see fancy benchmarks on eval metrics, what do people use ? 22:48:57
@lily:lily.flowersLily Foster
In reply to @keiichi:matrix.org
Artturin brought to my attention hte problem of nix eval going up ( I witnessed it myself before). Do we know why that is (due to release workload )? Is there a ticket to track this down ? Does ofborg use maintainers/scripts/rebuild-amount.sh ? I wonder if that's what ofborg used ? The script could use some polish https://github.com/NixOS/nixpkgs/issues/269616, I sometimes see fancy benchmarks on eval metrics, what do people use ?
It does not use that script. It uses its own outpaths.nix that it copies into the nixpkgs checkout and then evaluates. See above in the scrollback for a PR that could really help what ofborg does though
22:52:48
@keiichi:matrix.orgtetosaw that one a few days ago, looked exciting 22:56:49
29 Nov 2023
@piegames:matrix.orgpiegames If I have a package set, and add a tests attribute to it, and modify multiple packages in the package set in a single commit with an appropriate title, will OfBorg then build that test? 11:55:57
1 Dec 2023
@moritz.hedtke:matrix.orgmoritz.hedtke set their display name to Moritz Hedtke.11:08:13
8 Dec 2023
@k900:0upti.meK900Are the evaluators overloaded again?12:00:54
@k900:0upti.meK900My kernels PR this morning got all green pretty quick12:01:02
@k900:0upti.meK900But https://github.com/NixOS/nixpkgs/pull/272870 is stuck12:01:04
@lily:lily.flowersLily Foster
In reply to @k900:0upti.me
But https://github.com/NixOS/nixpkgs/pull/272870 is stuck
It seems to be progressing? What was stuck?
12:08:41
@k900:0upti.meK900Oh yeah it just got picked up I guess12:08:59
15 Dec 2023
@fgaz:matrix.orgfgaz joined the room.15:46:42
16 Dec 2023
@a-kenji:matrix.orgkenji joined the room.13:23:31
19 Dec 2023
@infinisil:matrix.org@infinisil:matrix.orgThe eval queue is rising..21:13:11
@hexa:lossy.networkhexaRedacted or Malformed Event22:11:21
@hexa:lossy.networkhexaRedacted or Malformed Event22:11:22
@hexa:lossy.networkhexaRedacted or Malformed Event22:11:37
@hexa:lossy.networkhexaRedacted or Malformed Event22:13:02
@hexa:lossy.networkhexalooks like there was a blip, but we still have 9 evaluators22:14:36
@cole-h:matrix.orgcole-h
In reply to @infinisil:matrix.org
The eval queue is rising..
A side effect of evals taking 10m+ a pop 😅
22:45:30
@infinisil:matrix.org@infinisil:matrix.orghttps://github.com/NixOS/nixpkgs/pull/269403 will be able to help, but it needs to get done first 🙃22:46:43
@cole-h:matrix.orgcole-h I've got my eye on it. I also tried out nix-eval-jobs manually with outpaths.nix at one point but it took more than 24 hours (at which point I killed it) 22:48:26
@cole-h:matrix.orgcole-h Maybe I was holding it wrong  22:48:37
@lily:lily.flowersLily Foster
In reply to @cole-h:matrix.org
Maybe I was holding it wrong 
probably, as i did not experience that. i've experimented with it as well but the semantics were a little different in result. i intend to more thoroughly at least attempt to make a PoC with ofborg using it soon for comparison
23:03:42
20 Dec 2023
@janik0:matrix.org@janik0:matrix.orgDid ofborg die? It feels like the eval for most prs is stalled, but I don't really know where to look.19:42:33

Show newer messages


Back to Room ListRoom Version: 6