| 4 Apr 2026 |
Eli Saado | how high/low level is it? I've built a small NixOS POC with colemena where I can deploy a k3s cluster to multiple machines at once, but you're basically writing a normal NixOS system configuration yourself and you also manage the bootstrapping and secret management of nodes yourself | 20:47:29 |
Chris P Bacon | The deploying to multiple machines is what a clan service is for, this is what I was builing with my "cloud machines" I have 4 machines, 1 control node and 3 compute nodes. I made a clan serive which wraps k3s config with two roles in that service. Then I have a single instance of that service in which I assign the machines to that instance's roles. You can see all this in https://git.amarth.cloud/amarth/infra/clan.nix
If this sounds nice than I suggest you read through the getting started of the clan docs and join clan's matrix room. Plenty of smart helpful people there 😁
| 20:53:54 |
Eli Saado | I'll check out your repo, thanks :) | 20:56:42 |
Eli Saado | it sounds amazing | 20:56:45 |
Chris P Bacon | * The deploying to multiple machines is what a clan service is for, this is what I was builing with my "cloud machines" I have 4 machines, 1 control node and 3 compute nodes. I made a clan serive which wraps k3s config with two roles in that service. Then I have a single instance of that service in which I assign the machines to that instance's roles. You can see all this in https://git.amarth.cloud/amarth/infra/src/branch/main/clan.nix
If this sounds nice than I suggest you read through the getting started of the clan docs and join clan's matrix room. Plenty of smart helpful people there 😁
| 20:58:05 |
| 5 Apr 2026 |
| aparna changed their profile picture. | 06:55:47 |
| Rishi B joined the room. | 21:03:55 |
Eli Saado | just found out Clan has the same flaw when onboarding new machines as my own setup (changing IP adressess), feeling kinda defeated right now 😭 | 22:14:31 |
magic_rb | What flaw? | 22:34:33 |
Eli Saado | when you onboard a new server, in the installer it'll have a different IP than after the installation in most dhcp setups | 22:41:04 |
magic_rb | Really? Id expect that to not be the case since the mac should be stable, so id expect the router to hand back the same ip | 22:45:11 |
magic_rb | Though i havent tested this | 22:45:18 |
magic_rb | But ig the router can just decide to give back another one cause why the fuck not. Not sure if anything can really done about that | 22:45:54 |
Chris P Bacon | Depends on how the dhcp server and client handle the lease. | 22:46:50 |
magic_rb | Well id expect the lease to last :P but ig not | 22:47:09 |
magic_rb | I do wonder why the servers switching ips is a problem and if it is a problem, why are they using dhcp with non-static leases at all | 22:47:53 |
Chris P Bacon | But, why not disable dhcp if you want static adresses? | 22:47:59 |
magic_rb | That seems like relying on finicky behavior | 22:48:06 |
magic_rb | Yeah exactly my point, or just static leases. But somehow pin the damn thing | 22:48:23 |
magic_rb | There are 3 options imo:
- Dont use dhcp
- Use static leases
- Build a overlay network
Anything else will be finicky
| 22:50:29 |
| 6 Apr 2026 |
| @haruki7049:matrix.org left the room. | 09:42:52 |
Eli Saado | then machine onboarding is still clunky since you'd have to manually assign an ip adress either:
- on the routers side using the MAC (pretty clean) and then still use DHCP with that static DHCP allocation (but not all routers support this and you'd need to log in to your router each time)
- or on the machine during the installation and enable an option in the NixOS config to make that same IP adress also it's IP after installation
| 09:57:54 |
Eli Saado | having an overlay network is nice but you'd still need to bootstrap it (and have ways around it when you're messing with its options and it restarts during a rebuild or whateverK | 09:58:36 |
Eli Saado | * | 09:58:40 |
Eli Saado | I'm going to experiment some more tonight, have to study for an exam first :S | 09:58:58 |
| Eli Saado changed their profile picture. | 10:36:18 |
| Eli Saado changed their profile picture. | 10:42:14 |
| Eli Saado changed their profile picture. | 11:03:14 |
| Eli Saado changed their profile picture. | 11:04:08 |
| Eli Saado changed their profile picture. | 11:05:02 |