!PbtOpdWBSRFbEZRLIf:numtide.com

Nix Community Projects

572 Members
Meta discussions related to https://nix-community.org. (For project specific discussions use github issues or projects own matrix channel). Need help from an admin? Open an issue on https://github.com/nix-community/infra/issues150 Servers

Load older messages


SenderMessageTime
23 May 2025
@divit:matrix.orgdivit joined the room.20:59:58
24 May 2025
@emilazy:matrix.orgemily
09:38:56  up   8:56,  3 users,  load average: 165.47, 75.01, 30.85
09:39:24
@emilazy:matrix.orgemilythis is on the x86 Linux box with 24 cores09:39:28
@emilazy:matrix.orgemilydo we have any way of setting up cgroups to limit the total number of cores a given builder user can use or is it hopeless because it all goes through the daemon?09:40:17
@emilazy:matrix.orgemilymaybe some way of hard-limiting the jobs/cores the daemon will accept?09:40:45
@emilazy:matrix.orgemily7× overloaded is really a bit much…09:41:03
@emilazy:matrix.orgemilyevery time I check the builders to go to use them they're either completely/almost unused or completely dying from load09:41:54
@emilazy:matrix.orgemily I don't think expecting people to check uptime and choose parallelism settings considerately based on utilization is working out 09:42:30
@emilazy:matrix.orgemilymaybe it would be a good idea to disable the remote builder protocol entirely so that it has to be used by SSHing in and random Nix commands won't inevitably overload the builder due to bad remote builder configuration?09:43:11
@emilazy:matrix.orgemilyI really value the builders as an invaluable shared resource but for the last several months the load balancing has really been messed up. just trying to figure out how we can make them usable as a shared resource09:44:04
@glepage:matrix.orgGaétan Lepage
In reply to @emilazy:matrix.org
09:38:56  up   8:56,  3 users,  load average: 165.47, 75.01, 30.85
@matthias?
09:48:37
@emilazy:matrix.orgemilynot sure if he is on Matrix?09:48:54
@emilazy:matrix.orgemily it's now 11× overloaded. I'm going to try wall 09:49:20
@emilazy:matrix.orgemily not sure if that actually went through since I'm not root, but I sent a wall 09:51:05
@glepage:matrix.orgGaétan LepageIs there a way to restart the daemon on the darwin builder? Some derivations are locked, but they should have been cancelled.09:55:28
@zowoq:matrix.orgzowoqRestarted.12:10:27
@glepage:matrix.orgGaétan LepageThanks!12:10:34
@zowoq:matrix.orgzowoqMight be possible, I'll take a look.12:28:17
@zowoq:matrix.orgzowoqCould try this as well.12:28:29
@zowoq:matrix.orgzowoqslurm has been mentioned a couple of times, might be time that we try something like that as well.12:32:00
@glepage:matrix.orgGaétan Lepage
In reply to @zowoq:matrix.org
slurm has been mentioned a couple of times, might be time that we try something like that as well.
I don't know how we could combine the nix daemon and slurm in practice, but it would be great if we could.
12:39:16
@sss:matrix.dark-alexandr.netsss joined the room.13:02:23
@vengmark2:matrix.orgl0b0Redacted or Malformed Event13:13:13
28 May 2025
@deeok:matrix.org@deeok:matrix.org joined the room.00:01:11
30 May 2025
@tpw_rules:matrix.orgtpw_rules joined the room.22:25:13
@tpw_rules:matrix.orgtpw_rules hi all, finally time to migrate nixos-apple-silicon here. apparently Jonas Chevalier has been previously alerted? 22:25:56
@tgerbet:matrix.orgtgerbet joined the room.23:03:54
31 May 2025
@zowoq:matrix.orgzowoqI've sent you an invite to the nix-community org. Github usually downgrades permissions on the repo during the transfer, I'll restore your admin access on the repo after it is transferred.00:15:49
@tpw_rules:matrix.orgtpw_rulestransfer completed, and yeah it looks like that happened00:27:10
@tpw_rules:matrix.orgtpw_rulesoh wait it's back00:28:16

Show newer messages


Back to Room ListRoom Version: 6