!sBfrWMVsLoSyFTCkNv:nixos.org

OfBorg

168 Members
Number of builds and evals in queue: <TBD>60 Servers

Load older messages


SenderMessageTime
7 Jul 2023
@cole-h:matrix.orgcole-hSo I'd be hesitant to even entertain the idea of pinning to 2.3 until I see an actual, non-contrived / non-forced issue caused by not using the Nixpkgs minver17:09:59
@vcunat:matrix.orgVladimír ČunátWe should probably measure the difference in performance on the particular expensive eval ofBorg is doing. Otherwise I don't trust it really.17:12:05
@cole-h:matrix.orgcole-h

I'll do so. On 5dd0190da9b5aecb5238c1bea1ebaa77f15c6a45, here are the time stats:

822.67user 14.59system 10:02.16elapsed 139%CPU (0avgtext+0avgdata 58247012maxresident)k
72088inputs+0outputs (0major+14564664minor)pagefaults 0swaps
17:13:06
@cole-h:matrix.orgcole-h Running 2.4pre20210810_a6ba313 (not an ofborg machine, but same type) 17:14:08
@cole-h:matrix.orgcole-h(I already bisected the largest increase in eval time to 4af22aab8e239b1ca28da851755c6da1a35fc91b, which made the leap from ~4-5m to like 7m, but not yet the remaining increase to 10m)17:17:20
@cole-h:matrix.orgcole-h * (I already bisected the largest increase in eval time to 4af22aab8e239b1ca28da851755c6da1a35fc91b, which made the leap from ~4-5m to like 7m, but not yet the remaining increase to 10m) 17:17:28
@artturin:matrix.orgArtturin2.3.16 and 2.4pre-rc1 have a difference of 3,902 commits https://github.com/NixOS/nix/compare/2.3.16...2.4pre-rc1 17:24:14
@artturin:matrix.orgArtturin * fun fact 2.3.16 and 2.4pre-rc1 have a difference of 3,902 commits https://github.com/NixOS/nix/compare/2.3.16...2.4pre-rc1 17:26:46
@cole-h:matrix.orgcole-h
$ GC_INITIAL_HEAP_SIZE=8g NIX_REMOTE= time nix-env -f ./outpaths.nix -qaP --no-name --out-path --arg checkMeta true >/dev/null
warning: unknown setting 'experimental-features'
805.99user 13.80system 13:39.89elapsed 99%CPU (0avgtext+0avgdata 54731940maxresident)k
0inputs+8outputs (1major+13685712minor)pagefaults 0swaps

13:40 on the same commit using Nix 2.13

17:31:47
@cole-h:matrix.orgcole-h *
$ GC_INITIAL_HEAP_SIZE=8g NIX_REMOTE= time nix-env -f ./outpaths.nix -qaP --no-name --out-path --arg checkMeta true >/dev/null
warning: unknown setting 'experimental-features'
805.99user 13.80system 13:39.89elapsed 99%CPU (0avgtext+0avgdata 54731940maxresident)k
0inputs+8outputs (1major+13685712minor)pagefaults 0swaps

13m40s on the same commit using Nix 2.13

17:31:51
@cole-h:matrix.orgcole-hErr Nix 2.317:33:15
@cole-h:matrix.orgcole-hlol17:33:16
@cole-h:matrix.orgcole-h *
$ GC_INITIAL_HEAP_SIZE=8g NIX_REMOTE= time nix-env -f ./outpaths.nix -qaP --no-name --out-path --arg checkMeta true >/dev/null
warning: unknown setting 'experimental-features'
805.99user 13.80system 13:39.89elapsed 99%CPU (0avgtext+0avgdata 54731940maxresident)k
0inputs+8outputs (1major+13685712minor)pagefaults 0swaps

13m40s on the same commit using Nix 2.3

17:33:17
@cole-h:matrix.orgcole-h

(coming back) using 2.15.1:

$ GC_INITIAL_HEAP_SIZE=8g NIX_REMOTE= time nix-env -f ./outpaths.nix -qaP --no-name --out-path --arg checkMeta true >/dev/null
680.15user 11.32system 11:31.55elapsed 99%CPU (0avgtext+0avgdata 43949464maxresident)k
0inputs+0outputs (0major+11026151minor)pagefaults 0swaps
20:59:25
8 Jul 2023
@vcunat:matrix.orgVladimír Čunát Hmm, so both CPU and RAM usage would be significantly worse. I thought of doing this for the tarball job instead, but the RAM requirements wouldn't most likely become a problem with the current infra. 08:05:06
@vcunat:matrix.orgVladimír Čunát * Hmm, so both CPU and RAM usage would be significantly worse. I thought of doing this for the tarball job instead, but the RAM requirements would most likely become a problem with the current infra. 08:05:18
@vcunat:matrix.orgVladimír ČunátThe corresponding machines have only 64 GiB physical RAM.08:07:24
@sternenseemann:systemli.orgsterni
In reply to @cole-h:matrix.org
Is there a case that would have been caught with 2.3 that wasn't?
We already had path interpolation slip into master before: https://github.com/NixOS/ofborg/issues/612
08:55:27
10 Jul 2023
@simonmenke:matrix.orgSimon Menke joined the room.08:57:06
11 Jul 2023
@artturin:matrix.orgArtturinhttps://github.com/NixOS/ofborg/pull/64201:00:41
@artturin:matrix.orgArtturinwill be a great addition01:00:52
13 Jul 2023
@vcunat:matrix.orgVladimír Čunát changed their display name from @vcunat to vcunat.08:27:38
14 Jul 2023
@cole-h:matrix.orgcole-h changed their display name from cole-h to cole-h (back 1 Aug).23:51:17
15 Jul 2023
@piegames:matrix.orgpiegamesHi, I'm currently implementing RFC 127 in https://github.com/NixOS/nixpkgs/pull/177272. There is this comment in check-meta.nix, "!!! reason strings are hardcoded into OfBorg, make sure to keep them in sync". So I'd like to coordinate this change with the OfBorg maintainers19:22:09
16 Jul 2023
@piegames:matrix.orgpiegamesSo I did some keyword search through the OfBorg code base, the only relevant thing I found is https://github.com/NixOS/ofborg/blob/released/ofborg/src/outpaths.nix#L28-L34, which does not look like it needs updating08:02:16
@piegames:matrix.orgpiegamesOn the other hand, the implementation pull request causes OfBorg internal errors (according to the label it added), so clearly there is something weird going on here08:02:48
@piegames:matrix.orgpiegamesWhere do I find the OfBorg error logs?08:04:56
@lily:lily.flowersLily Foster
In reply to @piegames:matrix.org
Where do I find the OfBorg error logs?
I'm not sure where the ofborg logs are, but if it did fail in outpath caculation, you could try to run that manually with the instructions at https://github.com/NixOS/ofborg#running-meta-checks-locally (I just hope you have a system with 60+ GiB of RAM though...)
10:55:04
@piegames:matrix.orgpiegamesUnfortunately that is not an option for me then11:00:21
@lily:lily.flowersLily Foster
In reply to @piegames:matrix.org
Unfortunately that is not an option for me then
So I'm running some stuff manually for you and it looks like ofborg may be failing in the stdenv check, which runs with a merged stderr+stdout to attempt to get the stdenv output path (but this PR throws a bunch of maintainless warnings to stderr)
11:18:20

Show newer messages


Back to Room ListRoom Version: 6