!PbtOpdWBSRFbEZRLIf:numtide.com

Nix Community Projects

591 Members
Meta discussions related to https://nix-community.org. (For project specific discussions use github issues or projects own matrix channel). Need help from an admin? Open an issue on https://github.com/nix-community/infra/issues155 Servers

Load older messages


SenderMessageTime
2 Apr 2025
@magic_rb:matrix.redalder.orgmagic_rb
In reply to @phaer:matrix.org
A matrix room? You can create that yourself, then make @admin:nixos.org an admin and ask in #matrix-suggestions:nixos.org for an :nixos.org alias
Thanks :)
13:57:31
@emilazy:matrix.orgemily

Gaétan Lepage:

[emily@build01:~/nixpkgs]$ uptime
 20:35:14  up 3 days 20:58,  4 users,  load average: 29.53, 31.60, 35.04

[emily@build01:~/nixpkgs]$ nproc
24

[emily@build01:~/nixpkgs]$ ps aux | grep nix-store
glepage  2015522  0.0  0.0  80472  5684 ?        Ss   20:02   0:00 fish -c nix-store --serve --write
glepage  2015527  0.1  0.0 530700 24596 ?        Sl   20:02   0:02 nix-store --serve --write
emily    2124287  0.0  0.0   6812  2188 pts/17   S+   20:35   0:00 grep nix-store
20:35:38
@glepage:matrix.orgGaétan LepageI have no jobs running right now20:50:47
@glepage:matrix.orgGaétan Lepage(I am connected by ssh, but am not building anything)20:51:24
@glepage:matrix.orgGaétan LepageI have been very cautious recently with my use of the builders and noticed them being severly overloaded.20:52:21
@grimmauld:grapevine.grimmauld.deGrimmauld (any/all)linux or darwin?20:52:23
@grimmauld:grapevine.grimmauld.deGrimmauld (any/all)if this is linux then its me20:52:39
@glepage:matrix.orgGaétan LepageLinux & ARM right now20:52:44
@emilazy:matrix.orgemilyah, it is from non-remote-builder jobs after taking a closer look. sorry about that20:53:00
@grimmauld:grapevine.grimmauld.deGrimmauld (any/all)my linux x86_64 jas 4 builds left running, i'll slow on arm20:53:10
@emilazy:matrix.orgemilylooks like both x86 and AArch64 Linux are overloaded right now20:53:19
@grimmauld:grapevine.grimmauld.deGrimmauld (any/all)currently going through this list all building manually: https://github.com/NixOS/nixpkgs/pull/395499 i'll slow down20:53:42
@emilazy:matrix.orgemily wish we had the Nix load-limit PR, could set it globally and the machines wouldn't get like this no matter how many jobs get run 20:53:44
@glepage:matrix.orgGaétan LepageThat seems like a very useful feature indeed20:54:20
@emilazy:matrix.orgemilymight want to bump the cores/jobs down a bit, looks like we have 2–3 people running builds right now :)20:54:24
@ihar.hrachyshka:matrix.orgIhar Hrachyshkamaybe it's me. I'd love to see some guidance as to how I should build stuff though.20:54:25
@grimmauld:grapevine.grimmauld.deGrimmauld (any/all)the x86_64 one should really be fine though, it only has 1 job running from me at this point20:54:27
@grimmauld:grapevine.grimmauld.deGrimmauld (any/all)image.png
Download image.png
20:54:44
@emilazy:matrix.orgemilyI'll do what I was going to do on the Darwin one since that one is idle 😅20:54:49
@grimmauld:grapevine.grimmauld.deGrimmauld (any/all)will slow on the aarch64 though20:54:50
@grimmauld:grapevine.grimmauld.deGrimmauld (any/all)Sorry!20:55:08
@glepage:matrix.orgGaétan Lepageclipboard.png
Download clipboard.png
20:55:09
@emilazy:matrix.orgemilyyou want cores × jobs < nproc always although when multiple people are using them that pretty much has to be divided by that20:55:31
@grimmauld:grapevine.grimmauld.deGrimmauld (any/all)when i started this work it was completely idle20:55:33
@emilazy:matrix.orgemilythankfully the AArch64 one has so many cores that you can probably just pick something conservative and still have it finish faster than anything else would :P20:55:45
@emilazy:matrix.orgemilyno worries. it's hard to load balance20:55:56
@ihar.hrachyshka:matrix.orgIhar HrachyshkaI do 1 job and 20 cores on aarch64 but it's pytorch...20:55:56
@emilazy:matrix.orgemily and sorry again to Gaétan Lepage for the dodgy grep :) 20:56:04
@glepage:matrix.orgGaétan LepageIdeally we would need a scheduler like SLURM for those shared systems20:56:07
@grimmauld:grapevine.grimmauld.deGrimmauld (any/all)thats exactly why i am building all those packages on aarch64-linux, it just is the fastest builder20:56:13

Show newer messages


Back to Room ListRoom Version: 6