!PSmBFWNKoXmlQBzUQf:helsinki-systems.de

Stage 1 systemd

83 Members
systemd in NixOs's stage 1, replacing the current bash tooling https://github.com/NixOS/nixpkgs/projects/5127 Servers

Load older messages


SenderMessageTime
4 Jan 2022
@colemickens:matrix.orgcolemickens
In reply to @phaer:matrix.org
Arian: Are you running your initrd code in production already? I have a remote-nixos-on-zfs-root-installer laying around, but one of it's practical problems atm is that the initrd gets pretty big and thats painful to improve as the moment as https://github.com/NixOS/nixpkgs/commit/776a5e6ebfacc6831527bc6c3c1a58ef2087c819 was reverted and nixpkgs initrd still uses ./paths-from-graph.pl which seems to confuse nix-tree, store-path info, etc.
That installer is something I was considering hacking together for netboot oracle instances. Id love to take a peek
15:56:48
@phaer:matrix.orgPaul Haerle colemickens πŸ³οΈβ€πŸŒˆ: It's not really in a state to be published yet. I have some local branches, but what's there in main should work at least on hetzners hcloud and you might get an idea or two for your oracle instances from there. Be aware that the resulting initrd is currently gigantic (1.3GB uncompressed at last count) 17:11:43
@phaer:matrix.orgPaul Haerle colemickens πŸ³οΈβ€πŸŒˆ: Ah, forgot the link which i just made public https://github.com/dep-sys/nixos-zfs-installer 17:12:22
@phaer:matrix.orgPaul HaerleI think it should in theory be doable to maintain a generic flake which provides nix functions and nixosModules to bundle parameterized install scripts with a somewhat minimal kernel configuration + initrd for kexec, netbooting and vms all together. Making them unattended and seed thinks such as the host name, network config, etc to the installer in a generic way seems challenging to me. Same as flexible partitioning. e.g. EFI & zfs mirroing support would be awesome17:28:23
@colemickens:matrix.orgcolemickensI think maybe this is OT and maybe I should throw up a repo even just so we can spitball ideas, but I am thinking along the same lines. In many cases, disk layout will be known ahead of time and I'm thinking a heuristic for "matching" to a selected disk layout to a booted machine, it notices the disks are not zpool members and kicks in.18:56:02
@colemickens:matrix.orgcolemickensI am also thinking this initrd could be smart enough to consume VM userdata via cloud api, libvirtd, etc for last mile provisioning.18:56:42
@colemickens:matrix.orgcolemickensWith sops-nix having support for cloud KVM, and a scheme I've found for supporting multiple user zfs keys... I think some somewhat interesting things could be built that would be highly appealing to certain types of orgs.18:57:32
@colemickens:matrix.orgcolemickens phaer: ^^ 18:57:50
@janne.hess:helsinki-systems.de@janne.hess:helsinki-systems.de
In reply to @colemickens:matrix.org
With sops-nix having support for cloud KVM, and a scheme I've found for supporting multiple user zfs keys... I think some somewhat interesting things could be built that would be highly appealing to certain types of orgs.
We don't have stage-1 support in sops-nix yet though. But it's one of my next projects apart from the stc stuff
19:13:26
5 Jan 2022
@phaer:matrix.orgPaul Haerle
In reply to @colemickens:matrix.org
I think maybe this is OT and maybe I should throw up a repo even just so we can spitball ideas, but I am thinking along the same lines. In many cases, disk layout will be known ahead of time and I'm thinking a heuristic for "matching" to a selected disk layout to a booted machine, it notices the disks are not zpool members and kicks in.
A place to collect ideas would be most welcome, I learned a lot since and would have a few ideas to improve my current playground. Also quite interested in the vm data via cloud api thing! :)
01:01:25
6 Jan 2022
@sjanssen:matrix.orgSpencer Janssen joined the room.05:15:42
14 Jan 2022
@colemickens:matrix.orgcolemickens phaer: finally circling back to look at this and I noticed that your zfs sets "encryption=off". why is that? 02:28:12
@colemickens:matrix.orgcolemickensI was all into my idea of iPXE booting Oracle VMs into some sort of installer like that, but I'm not sure it gets me a whole lot over your kexec approach, since kexec seems to work even on OCI aarch64 VMs.02:31:21
@phaer:matrix.orgPaul Haerle
In reply to @colemickens:matrix.org
phaer: finally circling back to look at this and I noticed that your zfs sets "encryption=off". why is that?
Where is that? There's encryption=on in https://github.com/dep-sys/nixos-zfs-installer/blob/main/installer/scripts/nuke-disk.sh#L35
08:32:23
@phaer:matrix.orgPaul Haerle
In reply to @colemickens:matrix.org
I was all into my idea of iPXE booting Oracle VMs into some sort of installer like that, but I'm not sure it gets me a whole lot over your kexec approach, since kexec seems to work even on OCI aarch64 VMs.
My main problem with it is that the installer image is so huge, next time i have time for this project, I'd like to work on that. Which is also one of the reasons i became interested in systemd in stage one.
But as we are a bit off-topic here. Shall we discuss in a repo, new channel or dms?
09:06:11
@colemickens:matrix.orgcolemickensweird, maybe I was just really tired. I'll make a room or something soon23:57:00
3 Feb 2022
@kirelagin:matrix.orgkirelagin joined the room.01:58:33
2 Mar 2022
@phaer:matrix.orgPaul Haerle set a profile picture.13:09:04
@phaer:matrix.orgPaul Haerle changed their display name from phaer to Paul Haerle.13:09:36
3 Mar 2022
@colemickens:matrix.orgcolemickens changed their display name from colemickens πŸ³οΈβ€πŸŒˆ to colemickens.07:10:23
12 Mar 2022
@bobvanderlinden_:matrix.orgbobvanderlinden joined the room.11:23:42
@bobvanderlinden_:matrix.orgbobvanderlindenHi! I'm currently working on getting systemd to work in initrd. I was wondering whether others have attempted to do so as well and how far you got?11:25:35
@ius:nltrix.netius joined the room.11:31:07
@arianvp:matrix.orgArian I'm planning to work on this with Janne Heß during oceansprint.org 11:41:25
@bobvanderlinden_:matrix.orgbobvanderlindenCool. I just found out about https://github.com/NixOS/nixpkgs/pull/120015, so I'm going to give that a go πŸ‘οΈ Is this PR also what you're going to work on?11:42:59
@arianvp:matrix.orgArianI don't know yet. Have to recap it a bit. I have my own homegrown initrd but it hasn't put any effort yet in minimizing closure size11:46:38
@bobvanderlinden_:matrix.orgbobvanderlinden Ah, same here. I resurrected an old local branch of the systemd work and wasn't aware the PR was made yet. I ran into the same problem as ElvishJerricco in that the extraUtils was not a good solution and looked into a same kind of thing as his make-initrd-ng tool. I'm excited how far along the PR seems to be, but it does seem outdated. I'll look if it can be based on current nixos-unstable. 11:59:43
13 Mar 2022
@yinfeng:matrix.orgyinfeng joined the room.01:44:49
@bobvanderlinden_:matrix.orgbobvanderlindenI worked a bit more on the initrd-systemd PR and make-initrd-ng: https://github.com/NixOS/nixpkgs/pull/120015#issuecomment-106600189101:45:20
14 Mar 2022
@shu9:matrix.orgshu9 joined the room.01:57:48

Show newer messages


Back to Room ListRoom Version: 6