!sBfrWMVsLoSyFTCkNv:nixos.org

OfBorg

174 Members
Number of builds and evals in queue: <TBD>65 Servers

Load older messages


SenderMessageTime
17 Aug 2023
@infinisil:matrix.org@infinisil:matrix.orgHmm my initial guess is just more23:16:09
@cole-h:matrix.orgcole-hIf you remind me tomorrow (well, my tomorrow) I can pull out the bisect log I did a month or two ago23:16:34
@lily:lily.flowersLily Foster
In reply to @lily:lily.flowers
(and like 64G of memory!)
(I can't even test the outpaths on any system I have access to aside from the aarch64-linux community builder. Which I'm not entirely convinced isn't due to something about how outpaths.nix is structured, but I haven't dove into it)
23:16:42
@cole-h:matrix.orgcole-hBut meta checks are expensive these days23:16:59
@infinisil:matrix.org@infinisil:matrix.orgOoof.. https://github.com/NixOS/nixpkgs/pull/17727223:17:18
@cole-h:matrix.orgcole-hYes that one, I think that was one of the larger bumps 23:17:45
@infinisil:matrix.org@infinisil:matrix.org(that one isn't merged but it adds more meta checks)23:17:59
@cole-h:matrix.orgcole-hOh then there was another one x)23:18:14
@cole-h:matrix.orgcole-hI saw check-meta and jumped haha23:18:24
@piegames:matrix.orgpiegamesWe need more meta checks, not less23:23:30
@piegames:matrix.orgpiegames
In reply to @infinisil:matrix.org
Ooof.. https://github.com/NixOS/nixpkgs/pull/177272
But review form the OfBorg side on this one would still be appreciated, because it modifies stuff with a "keep in sync with stuff hard-coded in OfBorg" comment above it. Although I couldn't find anything relevant in the OfBorg code base
23:24:49
@piegames:matrix.orgpiegames* <mx-reply><blockquote><a href="https://matrix.to/#/!sBfrWMVsLoSyFTCkNv:nixos.org/$kuAqGSPeZHdC_oU4pviRsMgTrwxHrqfdN5BpdK-1nOs?via=matrix.org&via=nixos.dev&via=nixos.org">In reply to</a> <a href="https://matrix.to/#/@infinisil:matrix.org">@infinisil:matrix.org</a><br />Ooof.. https://github.com/NixOS/nixpkgs/pull/177272</blockquote></mx-reply> But review form the OfBorg side on this one would still be appreciated, because it modifies stuff with a &quot;keep in sync with stuff hard-coded in OfBorg&quot; comment above it. Although I couldn't find anything related in the OfBorg code base23:25:20
@piegames:matrix.orgpiegames* But review form the OfBorg side on this one would still be appreciated, because it modifies stuff with a &quot;keep in sync with stuff hard-coded in OfBorg&quot; comment above it. Although I couldn't find anything related in the OfBorg code base23:26:11
@infinisil:matrix.org@infinisil:matrix.orgBtw I really said oof for that one because I still had it in mind that it enabled meta checks for all packages. But for one, it doesn't anymore, and for another, ofborg does meta checks anyways even if it's off by default23:26:12
@infinisil:matrix.org@infinisil:matrix.org I don't think it's that problematic, it just adds a bit more meta checks 23:26:34
@infinisil:matrix.org@infinisil:matrix.orgMaybe a permanent fix should be a way to only evaluate what changed for a PR23:29:27
@piegames:matrix.orgpiegamesNot sure to which extent this is feasible, given the spooky-action-at-a-distance nature of Nixpkgs fix points23:30:27
@infinisil:matrix.org@infinisil:matrix.org Nix does know which files get accessed underneath, see nix-build '<nixpkgs>' -A hello -v 23:31:14
@lily:lily.flowersLily Foster
In reply to @infinisil:matrix.org
Maybe a permanent fix should be a way to only evaluate what changed for a PR
So like only doing meta checks for outpaths that's changed, or something else? If so, meta could still be changed without outpath changing
23:31:19
@infinisil:matrix.org@infinisil:matrix.org
In reply to @infinisil:matrix.org
Nix does know which files get accessed underneath, see nix-build '<nixpkgs>' -A hello -v
Do this for each attribute once, then for each commit/PR, only re-evaluate it if the commit changed any of those paths
23:31:57
@lily:lily.flowersLily Foster
In reply to @infinisil:matrix.org
Nix does know which files get accessed underneath, see nix-build '<nixpkgs>' -A hello -v
Ah so which files Nix touches at all. That could maybe be done, but I'm not sure it would be faster....
23:32:21
@infinisil:matrix.org@infinisil:matrix.orgThis should definitely be faster!23:33:03
@piegames:matrix.orgpiegamesMy gut feeling says one could still come up with edge cases where this does not work23:33:06
@infinisil:matrix.org@infinisil:matrix.orgChanging files only leaf packages need will only cause those leaf packages to need re-evaluation23:33:16
@infinisil:matrix.org@infinisil:matrix.org
In reply to @piegames:matrix.org
My gut feeling says one could still come up with edge cases where this does not work
Same, but I imagine we could implement a more resilient thing rather than nix-build -v :P
23:33:40
@lily:lily.flowersLily Foster
In reply to @infinisil:matrix.org
This should definitely be faster!
Okay I'll trust your claim then, I'm admittedly a bit tired and distracted right now and not fully grasping what you are suggesting 😅
23:33:52
@infinisil:matrix.org@infinisil:matrix.orgLike, I know you can detect filesystem access with inotifywait or similar tools23:33:52
@infinisil:matrix.org@infinisil:matrix.orgfuse filesystems work too23:34:01
@infinisil:matrix.org@infinisil:matrix.orgI could probably come up with a hacky but reliable way to do that in a day23:34:30
@piegames:matrix.orgpiegamesThis should be a proper Nix eval API instead then23:35:25

Show newer messages


Back to Room ListRoom Version: 6