!coeAONBrWyDJnYMbMi:nixos.org

NixOS System Operations

614 Members
About system administration for running NixOS systems in production. Declaratively manage your operations. | Room recommendations: #networking:nixos.org168 Servers

Load older messages


SenderMessageTime
4 Apr 2026
@elisaado:elisaado.comEli Saadohow high/low level is it? I've built a small NixOS POC with colemena where I can deploy a k3s cluster to multiple machines at once, but you're basically writing a normal NixOS system configuration yourself and you also manage the bootstrapping and secret management of nodes yourself20:47:29
@chris:kruining.euChris P Bacon

The deploying to multiple machines is what a clan service is for, this is what I was builing with my "cloud machines" I have 4 machines, 1 control node and 3 compute nodes. I made a clan serive which wraps k3s config with two roles in that service. Then I have a single instance of that service in which I assign the machines to that instance's roles. You can see all this in https://git.amarth.cloud/amarth/infra/clan.nix

If this sounds nice than I suggest you read through the getting started of the clan docs and join clan's matrix room. Plenty of smart helpful people there 😁

20:53:54
@elisaado:elisaado.comEli SaadoI'll check out your repo, thanks :)20:56:42
@elisaado:elisaado.comEli Saado it sounds amazing 20:56:45
@chris:kruining.euChris P Bacon *

The deploying to multiple machines is what a clan service is for, this is what I was builing with my "cloud machines" I have 4 machines, 1 control node and 3 compute nodes. I made a clan serive which wraps k3s config with two roles in that service. Then I have a single instance of that service in which I assign the machines to that instance's roles. You can see all this in https://git.amarth.cloud/amarth/infra/src/branch/main/clan.nix

If this sounds nice than I suggest you read through the getting started of the clan docs and join clan's matrix room. Plenty of smart helpful people there 😁

20:58:05
5 Apr 2026
@apernaah:matrix.orgaparna changed their profile picture.06:55:47
@mystic-neutron:matrix.orgRishi B joined the room.21:03:55
@elisaado:elisaado.comEli Saadojust found out Clan has the same flaw when onboarding new machines as my own setup (changing IP adressess), feeling kinda defeated right now 😭22:14:31
@magic_rb:matrix.redalder.orgmagic_rbWhat flaw?22:34:33
@elisaado:elisaado.comEli Saadowhen you onboard a new server, in the installer it'll have a different IP than after the installation in most dhcp setups22:41:04
@magic_rb:matrix.redalder.orgmagic_rbReally? Id expect that to not be the case since the mac should be stable, so id expect the router to hand back the same ip22:45:11
@magic_rb:matrix.redalder.orgmagic_rbThough i havent tested this22:45:18
@magic_rb:matrix.redalder.orgmagic_rbBut ig the router can just decide to give back another one cause why the fuck not. Not sure if anything can really done about that22:45:54
@chris:kruining.euChris P Bacon Depends on how the dhcp server and client handle the lease. 22:46:50
@magic_rb:matrix.redalder.orgmagic_rbWell id expect the lease to last :P but ig not22:47:09
@magic_rb:matrix.redalder.orgmagic_rbI do wonder why the servers switching ips is a problem and if it is a problem, why are they using dhcp with non-static leases at all22:47:53
@chris:kruining.euChris P Bacon But, why not disable dhcp if you want static adresses? 22:47:59
@magic_rb:matrix.redalder.orgmagic_rb That seems like relying on finicky behavior 22:48:06
@magic_rb:matrix.redalder.orgmagic_rbYeah exactly my point, or just static leases. But somehow pin the damn thing22:48:23
@magic_rb:matrix.redalder.orgmagic_rb

There are 3 options imo:

  1. Dont use dhcp
  2. Use static leases
  3. Build a overlay network

Anything else will be finicky

22:50:29
6 Apr 2026
@haruki7049:matrix.org@haruki7049:matrix.org left the room.09:42:52
@elisaado:elisaado.comEli Saado

then machine onboarding is still clunky since you'd have to manually assign an ip adress either:

  • on the routers side using the MAC (pretty clean) and then still use DHCP with that static DHCP allocation (but not all routers support this and you'd need to log in to your router each time)
  • or on the machine during the installation and enable an option in the NixOS config to make that same IP adress also it's IP after installation
09:57:54
@elisaado:elisaado.comEli Saadohaving an overlay network is nice but you'd still need to bootstrap it (and have ways around it when you're messing with its options and it restarts during a rebuild or whateverK09:58:36
@elisaado:elisaado.comEli Saado * 09:58:40
@elisaado:elisaado.comEli SaadoI'm going to experiment some more tonight, have to study for an exam first :S09:58:58
@elisaado:elisaado.comEli Saado changed their profile picture.10:36:18
@elisaado:elisaado.comEli Saado changed their profile picture.10:42:14
@elisaado:elisaado.comEli Saado changed their profile picture.11:03:14
@elisaado:elisaado.comEli Saado changed their profile picture.11:04:08
@elisaado:elisaado.comEli Saado changed their profile picture.11:05:02

Show newer messages


Back to Room ListRoom Version: 10