!PbtOpdWBSRFbEZRLIf:numtide.com

Nix Community Projects

635 Members
Meta discussions related to https://nix-community.org. (For project specific discussions use github issues or projects own matrix channel). Need help from an admin? Open an issue on https://github.com/nix-community/infra/issues162 Servers

Load older messages


SenderMessageTime
19 Jul 2024
@traxys:familleboyer.netTraxys * Yup I'm subscribed to that PR :D I think it could help a lot, as we may be able to ditch our link farm :D18:05:39
@traxys:familleboyer.netTraxysOk so we have on the order of 1100 builbot jobs :x Would it risk to overwhelm something in builbot?18:35:47
@traxys:familleboyer.netTraxys * Ok so we have on the order of 1100 builbot jobs :x Would it risk to overwhelm something in builbot? (if we ditch the link farm)18:36:10
@magic_rb:matrix.redalder.orgmagic_rb
In reply to @traxys:familleboyer.net
Ok so we have on the order of 1100 builbot jobs :x Would it risk to overwhelm something in builbot? (if we ditch the link farm)
do it, i dont know, itll create lots of builds for sure, but to the github side it wont be a problem thats taken care of, by that open PR, so after, test it and we'll see :)
20:34:38
@traxys:familleboyer.netTraxys I have an WIP PR doing that: https://github.com/nix-community/nixvim/pull/1898
What seems to happen is that builds are a bit long, mostly on waiting for builders as each derivation is very quick to compute (https://buildbot.nix-community.org/#/builders/43/builds/294)
20:41:17
@traxys:familleboyer.netTraxysThough with more than a 1000 checks it's a bit of a mess on the github side, but that should be fixed by the buildbot PR :D20:41:48
@magic_rb:matrix.redalder.orgmagic_rbOkay im genuinely impressed this works 👀20:49:40
@traxys:familleboyer.netTraxysOops I think something broke buildbot, I get connection refused while trying to evaluate a flake (https://buildbot.nix-community.org/#/builders/43/builds/307)22:31:45
@traxys:familleboyer.netTraxysHope it was not the 1000 derivation build x)22:32:01
@glepage:matrix.orgGaétan LepageMe too22:36:45
@glepage:matrix.orgGaétan Lepageclipboard.png
Download clipboard.png
22:37:09
@mattsturg:matrix.orgMatt SturgeonWe've had those kinda errors randomly in the past, but the timing of it happening after testing #1898 doesn't look good...22:51:13
20 Jul 2024
@zowoq:matrix.orgzowoqI've restarted it.00:24:58
@brisingr05:matrix.org@brisingr05:matrix.org left the room.05:48:41
@traxys:familleboyer.netTraxys zowoq I tried running the command you provided with this PR and I get a Maximum Resident Set Size of 4.7 GiB, is this more acceptable? 13:36:30
@joerg:thalheim.ioMic92Nscloud runners also support a /nix cache across CI runs: https://github.com/nix-community/nix-eval-jobs/pull/318/files19:56:05
@joerg:thalheim.ioMic92
In reply to @traxys:familleboyer.net
Hope it was not the 1000 derivation build x)
How much memory does it use if you try to build it with nix-fast-build locally?
20:44:51
@traxys:familleboyer.netTraxys I tried this command: nix run nixpkgs#nix-eval-jobs -- --workers 1 --check-cache-status --force-recurse --flake 'github:nix-community/nixvim#checks' and that's what used ~4.7 GiB 20:46:40
@traxys:familleboyer.netTraxysWell not github though, a local checkout of the PR removing a link farm20:47:36
@joerg:thalheim.ioMic92Doesn't sound that crazy20:51:12
@joerg:thalheim.ioMic92is your link farm aggregating all plugins in one attribute?20:51:25
@traxys:familleboyer.netTraxysYeah20:51:47
@joerg:thalheim.ioMic92Sounds like something that would actually make parallel evaluation slower20:51:50
@traxys:familleboyer.netTraxysI'd say it had about 300 derivations?20:52:12
@traxys:familleboyer.netTraxys(as a 1000 checks were with all 4 architectures)20:52:54
@traxys:familleboyer.netTraxys We had a link farm I think mostly for the reason fixed by https://github.com/nix-community/buildbot-nix/pull/217
Though I have a question, why does using a link farm consume more RAM than splitting them up? Shouldn't we expect the same result in-fine ?
20:56:38
@magic_rb:matrix.redalder.orgmagic_rbIirc nix doesnt really do GC that well20:59:08
@magic_rb:matrix.redalder.orgmagic_rbSo it doesnt GC as much as you would think it should20:59:23
@aidalgol:matrix.orgaidalgolDo you mean the nix store, or nix the language and runtime?21:38:51
@aidalgol:matrix.orgaidalgol * Do you mean the nix store, or the nix language runtime?21:40:34

Show newer messages


Back to Room ListRoom Version: 6