!PbtOpdWBSRFbEZRLIf:numtide.com

Nix Community Projects

632 Members
Meta discussions related to https://nix-community.org. (For project specific discussions use github issues or projects own matrix channel). Need help from an admin? Open an issue on https://github.com/nix-community/infra/issues161 Servers

Load older messages


SenderMessageTime
19 Jul 2024
@mattsturg:matrix.orgMatt Sturgeon I think my 2018 laptop uses 100% all cores for most of the test build, my desktop is less affected.
We used to use around 32GB RAM, but Traxys recent change dropped this to around 3GB (which fixed some of our other buildbot issues, ass mentioned on #227)
16:50:45
@mattsturg:matrix.orgMatt Sturgeon * I think my 2018 laptop uses 100% all cores for most of the test build, my desktop is less affected.
We used to use around 32GB RAM, but Traxys' recent change dropped this to around 3GB (which fixed some of our other buildbot issues, ass mentioned on #227)
16:50:56
@mattsturg:matrix.orgMatt Sturgeon * I think my 2018 laptop uses 100% all cores for most of the test build, my desktop is less affected.
We used to use around 32GB RAM, but Traxys' recent change dropped this to around 3GB (which fixed some of our other buildbot issues, as mentioned on #227)
16:51:11
@traxys:familleboyer.netTraxys The test are mostly nix evaluations, there are on the order of ~300 lib.evalModules + pkgs.wrapNeovim + launch of neovim 16:52:29
@traxys:familleboyer.netTraxys(maybe more than 300 I never checked exactly --')16:52:41
@magic_rb:matrix.redalder.orgmagic_rbYeah that should be fine, ill test it later today16:59:34
@joerg:thalheim.ioMic92
In reply to @mattsturg:matrix.org
I think my 2018 laptop uses 100% all cores for most of the test build, my desktop is less affected.
We used to use around 32GB RAM, but Traxys' recent change dropped this to around 3GB (which fixed some of our other buildbot issues, as mentioned on #227)
We should also soon be better at handling many derivations in .checks: https://github.com/nix-community/buildbot-nix/pull/217
18:03:44
@traxys:familleboyer.netTraxysYup I'm subscribed to that issue :D I think it could help a lot, as we may be able to ditch our link farm :D18:05:33
@traxys:familleboyer.netTraxys * Yup I'm subscribed to that PR :D I think it could help a lot, as we may be able to ditch our link farm :D18:05:39
@traxys:familleboyer.netTraxysOk so we have on the order of 1100 builbot jobs :x Would it risk to overwhelm something in builbot?18:35:47
@traxys:familleboyer.netTraxys * Ok so we have on the order of 1100 builbot jobs :x Would it risk to overwhelm something in builbot? (if we ditch the link farm)18:36:10
@magic_rb:matrix.redalder.orgmagic_rb
In reply to @traxys:familleboyer.net
Ok so we have on the order of 1100 builbot jobs :x Would it risk to overwhelm something in builbot? (if we ditch the link farm)
do it, i dont know, itll create lots of builds for sure, but to the github side it wont be a problem thats taken care of, by that open PR, so after, test it and we'll see :)
20:34:38
@traxys:familleboyer.netTraxys I have an WIP PR doing that: https://github.com/nix-community/nixvim/pull/1898
What seems to happen is that builds are a bit long, mostly on waiting for builders as each derivation is very quick to compute (https://buildbot.nix-community.org/#/builders/43/builds/294)
20:41:17
@traxys:familleboyer.netTraxysThough with more than a 1000 checks it's a bit of a mess on the github side, but that should be fixed by the buildbot PR :D20:41:48
@magic_rb:matrix.redalder.orgmagic_rbOkay im genuinely impressed this works 👀20:49:40
@traxys:familleboyer.netTraxysOops I think something broke buildbot, I get connection refused while trying to evaluate a flake (https://buildbot.nix-community.org/#/builders/43/builds/307)22:31:45
@traxys:familleboyer.netTraxysHope it was not the 1000 derivation build x)22:32:01
@glepage:matrix.orgGaétan LepageMe too22:36:45
@glepage:matrix.orgGaétan Lepageclipboard.png
Download clipboard.png
22:37:09
@mattsturg:matrix.orgMatt SturgeonWe've had those kinda errors randomly in the past, but the timing of it happening after testing #1898 doesn't look good...22:51:13
20 Jul 2024
@zowoq:matrix.orgzowoqI've restarted it.00:24:58
@brisingr05:matrix.org@brisingr05:matrix.org left the room.05:48:41
@traxys:familleboyer.netTraxys zowoq I tried running the command you provided with this PR and I get a Maximum Resident Set Size of 4.7 GiB, is this more acceptable? 13:36:30
@joerg:thalheim.ioMic92Nscloud runners also support a /nix cache across CI runs: https://github.com/nix-community/nix-eval-jobs/pull/318/files19:56:05
@joerg:thalheim.ioMic92
In reply to @traxys:familleboyer.net
Hope it was not the 1000 derivation build x)
How much memory does it use if you try to build it with nix-fast-build locally?
20:44:51
@traxys:familleboyer.netTraxys I tried this command: nix run nixpkgs#nix-eval-jobs -- --workers 1 --check-cache-status --force-recurse --flake 'github:nix-community/nixvim#checks' and that's what used ~4.7 GiB 20:46:40
@traxys:familleboyer.netTraxysWell not github though, a local checkout of the PR removing a link farm20:47:36
@joerg:thalheim.ioMic92Doesn't sound that crazy20:51:12
@joerg:thalheim.ioMic92is your link farm aggregating all plugins in one attribute?20:51:25
@traxys:familleboyer.netTraxysYeah20:51:47

Show newer messages


Back to Room ListRoom Version: 6