| 13 Aug 2022 |
colemickens | that's a visionfive board, tow-boot -> pxe -> sysd-stage1-netboot -> nixos | 22:41:30 |
colemickens | <3 <3 <3 | 22:41:43 |
@elvishjerricco:matrix.org | wow that's a helluva stack | 22:41:44 |
@elvishjerricco:matrix.org | So do you have / on NFS? Or is it a squashfs style setup? | 22:43:16 |
colemickens | I've got a little command that rebuilds my rpi netboot hosts on the community builder, my riscv netboot host cross-compiled, then deploys my "server" that references those outputs and serves via atftpd/nfsd | 22:43:47 |
colemickens | it's just initrd -> and then... it does mount a rootfs, but it could trivially be a tmpfs | 22:44:23 |
colemickens | I serve the nix-store for the entire netbootserver up, but I also serve a specialized export of the netboot-client's store export to the client | 22:44:44 |
colemickens | So on activation it only has to "hydrate" enough store for itself to boot, even though it theoretically can "see" the nix-store for the netboot server itself. | 22:45:15 |
colemickens | * it's just initrd -> and then... it does mount a rootfs (over nfs), but it could trivially be a tmpfs | 22:48:57 |
colemickens | * I serve the nix-store for the entire netbootserver up, but I also serve a specialized nix-db export of the netboot-client's store export to the client | 22:49:09 |
colemickens | now that my rpipkg branch is rebased, I can say that visionfive, rpi02w, rpi3b+, rpi4b all netboot with systemd-init with my sbin patch (that I think I might even be able to eliminate) | 23:31:51 |
@elvishjerricco:matrix.org | wow that's excellent | 23:32:14 |
| 14 Aug 2022 |
colemickens | I would like to maybe try using this on one of my rpi02w systems: https://github.com/mhx/dwarfs | 00:23:26 |
colemickens | it seems rather slow with this nfs setup compared to one with an sd card in it | 00:24:04 |
colemickens | I suspect even just tmpfs root would really speed it up though | 00:26:36 |
@elvishjerricco:matrix.org | colemickens: NFS just kinda sucks in general in my limited experience | 00:28:35 |
@elvishjerricco:matrix.org | for one thing all writes are sync writes on the server for some reason | 00:29:18 |
colemickens | that's why I'm hoping it will be enough to kill the rootfs if the rest is just the RO nix store | 00:29:46 |
@elvishjerricco:matrix.org | there's probably better network file systems, though I guess it's rare for them to be suitable for a rootfs | 00:30:16 |
colemickens | but also I don't really need nfs at all, so... now I'm dreaming up the recursive-nix initrd builder combiend with this dwarFS business.. | 00:30:18 |
@elvishjerricco:matrix.org | why would that need recursive nix? | 00:30:37 |
colemickens | it doesn't, I'm conflating things | 00:31:00 |
colemickens | part of nfs = quick turnaround times since there's no images to build/push around | 00:31:09 |
colemickens | the recursive nix initrd builder would presumably help with that a bit ( I think) | 00:31:36 |
@elvishjerricco:matrix.org | "the recursive nix initrd builder" I do not know what this is | 00:31:53 |
colemickens | https://github.com/grahamc/netboot.nix | 00:32:03 |
colemickens | (sorry) | 00:32:06 |
@grahamc:nixos.org | I don’t use that anymore preferring a faster option | 00:32:37 |
colemickens | oh! and... oh? | 00:32:54 |
@grahamc:nixos.org | https://github.com/DeterminateSystems/nix-netboot-serve | 00:33:04 |