!coeAONBrWyDJnYMbMi:nixos.org

NixOS System Operations

545 Members
About system administration for running NixOS systems in production. Declaratively manage your operations. | Room recommendations: #networking:nixos.org145 Servers

Load older messages


SenderMessageTime
5 Oct 2024
@3von:matrix.org3vonOh I c. OK activating keyring now11:21:45
@3von:matrix.org3vonThat worked like a charm. Thanks all11:23:37
@philip4g:matrix.orgPhilip

Hello all. Can anyone suggest why my NixOS system is periodically killing processes with an 'out of memory' status, like this:

Oct 02 10:52:15 pmwhome kernel: Out of memory: Killed process 3118 (dbus-daemon) total-vm:5420kB, anon-rss:0kB, file-rss:2348kB, shmem-rss:0kB, UID:1000 pgtables:48kB oom_score_adj:200
Oct 04 22:55:19 pmwhome kernel: Out of memory: Killed process 2355 (dbus-daemon) total-vm:5420kB, anon-rss:0kB, file-rss:1416kB, shmem-rss:0kB, UID:1000 pgtables:48kB oom_score_adj:200
Oct 05 08:01:44 home kernel: Out of memory: Killed process 2216 (systemd) total-vm:20340kB, anon-rss:0kB, file-rss:1896kB, shmem-rss:0kB, UID:1000 pgtables:80kB oom_score_adj:100

Meanwhile, I have a huge amount of memory:

$ free -m
               total        used        free      shared  buff/cache   available
Mem:           64048        3573       18849          10       41626       59752
Swap:         953851        1525      952326
15:33:47
@philip4g:matrix.orgPhilip *

Hello all. Can anyone suggest why my NixOS system is periodically killing processes with an 'out of memory' status, like this:

Oct 02 10:52:15 home kernel: Out of memory: Killed process 3118 (dbus-daemon) total-vm:5420kB, anon-rss:0kB, file-rss:2348kB, shmem-rss:0kB, UID:1000 pgtables:48kB oom_score_adj:200
Oct 04 22:55:19 home kernel: Out of memory: Killed process 2355 (dbus-daemon) total-vm:5420kB, anon-rss:0kB, file-rss:1416kB, shmem-rss:0kB, UID:1000 pgtables:48kB oom_score_adj:200
Oct 05 08:01:44 home kernel: Out of memory: Killed process 2216 (systemd) total-vm:20340kB, anon-rss:0kB, file-rss:1896kB, shmem-rss:0kB, UID:1000 pgtables:80kB oom_score_adj:100

Meanwhile, I have a huge amount of memory:

$ free -m
               total        used        free      shared  buff/cache   available
Mem:           64048        3573       18849          10       41626       59752
Swap:         953851        1525      952326
15:34:05
@k900:0upti.meK900Well presumably you don't have memory at the time 15:35:11
@k900:0upti.meK900Also, swap doesn't really count 15:35:19
@philip4g:matrix.orgPhilipThe kernel would consider it out of memory without using swap? Or what do you mean by doesn't count?15:39:23
@k900:0upti.meK900The kernel would consider it an out of memory condition if it can't find a page to swap out 15:41:05
@k900:0upti.meK900Which is why you can't just throw swap at your OOM problems and expect them to go away 15:42:23
@elvishjerricco:matrix.orgElvishJerricco Philip: Huh, that's extremely odd; @rosscomputerguy:matrix.org was having a very similar issue in #users:nixos.org the other day 15:43:30
@elvishjerricco:matrix.orgElvishJerriccoOOMs on processes that weren't using much memory when the total used wasn't very high15:43:46
@elvishjerricco:matrix.orgElvishJerriccoI think they found out it was some kernel tuning they had done that was the problem. But maybe that was wrong and the problem is somewhere in nixos?15:44:44
@elvishjerricco:matrix.orgElvishJerricco (also, that is an unbelievable amount of swap. Absolutely a waste lol) 15:47:56
@philip4g:matrix.orgPhilip
In reply to @elvishjerricco:matrix.org
(also, that is an unbelievable amount of swap. Absolutely a waste lol)
Yes, totally obscene... I have a 1 TB NVMe drive that I am not using for anything right now, so I thought I'd dedicate it to swap. But that'll be the first to go when I need more storage.
17:24:41
@theelevated:matrix.orgtheelevatedI need to duplicate the same system over 30 school laptops with the same setup and settings everywhere. Would nixos be feaseable also considering every laptop need to be a little unique with hostname? 21:43:56
@scrumplex:duckhub.ioScrumplex
In reply to @theelevated:matrix.org
I need to duplicate the same system over 30 school laptops with the same setup and settings everywhere. Would nixos be feaseable also considering every laptop need to be a little unique with hostname?

I think it could be a great option here.

Basically you could configure everything once and then just set different hostnames for different machines in separate configurations. You could then generate small disk images that you can then dd onto the drives while using the option boot.growPartition to expand the rootfs to the remaining size.

21:51:51
@theelevated:matrix.orgtheelevated
In reply to @scrumplex:duckhub.io

I think it could be a great option here.

Basically you could configure everything once and then just set different hostnames for different machines in separate configurations. You could then generate small disk images that you can then dd onto the drives while using the option boot.growPartition to expand the rootfs to the remaining size.

does nix also shell bin commands? if I need want to have a elevated listener for a root ssh session and in the global file.
21:53:56
@theelevated:matrix.orgtheelevated
In reply to @scrumplex:duckhub.io

I think it could be a great option here.

Basically you could configure everything once and then just set different hostnames for different machines in separate configurations. You could then generate small disk images that you can then dd onto the drives while using the option boot.growPartition to expand the rootfs to the remaining size.

* does nix also shell bin commands? if I need want to have a elevated listener for a root ssh session in the global file.
21:54:12
@magic_rb:matrix.redalder.orgmagic_rb changed their profile picture.22:16:52
6 Oct 2024
@raf:notashelf.devraf joined the room.12:43:02
@bytebandit:tac.lolDerivationDingus changed their display name from bytebandit to DerivationDingus.19:43:20
7 Oct 2024
@memegames99:matrix.org@memegames99:matrix.org removed their profile picture.00:05:36
@memegames99:matrix.org@memegames99:matrix.org removed their display name memegames99.00:05:47
@memegames99:matrix.org@memegames99:matrix.org left the room.00:06:01
@julius:mtx.liftm.deˈt͡sɛːzaɐ̯
In reply to @scrumplex:duckhub.io

I think it could be a great option here.

Basically you could configure everything once and then just set different hostnames for different machines in separate configurations. You could then generate small disk images that you can then dd onto the drives while using the option boot.growPartition to expand the rootfs to the remaining size.

I wonder, is there a more elegant way of doing this? If you build an image per system, you'll be compressing the same content a lot of times. I'd rather have one image, and an activation script that checks what mac addresses it can find on the system and then pics the hostname / activation script for the correct system. But that sounds brittle to set up. Are there any examples of doing this in a sane way?
05:47:17
@julius:mtx.liftm.deˈt͡sɛːzaɐ̯
In reply to @theelevated:matrix.org
does nix also shell bin commands? if I need want to have a elevated listener for a root ssh session and in the global file.
Your question is a little bit gibberish. Are you using some translation software? In any case: Yes, you can run sshd and add something to users.users.root.openssh.authorizedKeys.keys on all hosts, so you'll be able to ssh in as root and e.g. execute nixos-rebuild.
05:48:39
@thunder:kotiboksi.xyz@thunder:kotiboksi.xyz joined the room.08:28:15
@mabh:matrix.orgmabh joined the room.10:19:59
@steveej0:matrix.orgsteveejdoes anyone here happen to have a disko config for EFI boot with raid0 over two drives?11:34:23
@steveej0:matrix.orgsteveej

interesting, hetzner puts the EFI partition on a mdadm raid1 with their default debian installations. it seems they're doing something non-standard which is using "EFI System" as a partition type for a mdadm member:

/dev/nvme0n1p1     4096     528383     524288  256M EFI System

i'll see if disko supports creating such a layout

12:07:49

Show newer messages


Back to Room ListRoom Version: 10