!UUqahLbShAYkkrXmKs:matrix.org

DevOS

31 Members
Seeking help and geeking out together on https://github.com/divnix/devos & https://github.com/divnix/digga10 Servers

Load older messages


SenderMessageTime
15 Oct 2021
@timdeh:matrix.org@timdeh:matrix.orgThat's a fairly interesting usecase. Did you make a module that acts similar to nixos-containers or something?18:08:54
@kraftnix:matrix.org@kraftnix:matrix.org i've actually been using Ma27's networkd-containers rewrite of nixos-containers since May (which has an rfc 108) which already has a nicer interface for nixos-containers, and then I have my own wrapper on top to add more functionality such as expanded networking, secrets integration (ala agenix), dataset/storage provisioning (btrfs/zfs)), so I'm just integrating microvm as a hypervisor/provider for it atm 18:13:25
@kraftnix:matrix.org@kraftnix:matrix.org * i've actually been using Ma27's networkd-containers rewrite of nixos-containers since May (which has an rfc 108) which already has a nicer interface for nixos-containers, and then I have my own wrapper on top to add more functionality such as expanded networking, secrets integration (ala agenix), dataset/storage provisioning (btrfs/zfs), some simple SNI routing), so I'm just integrating microvm as a hypervisor/provider for it atm 18:14:15
@kraftnix:matrix.org@kraftnix:matrix.orgbtw i do recommend checking out https://github.com/NixOS/nixpkgs/pull/140669 to see the new nixos-container api, it is significantly better than before and I've been using it with 10+ nixos containers on my server since May without issues (it's much more stable + less prone to weird networking issues than the previous nixos-containers)18:22:25
@timdeh:matrix.org@timdeh:matrix.orgnice18:22:43
@timdeh:matrix.org@timdeh:matrix.org I wonder if this would help you David Arnold (blaggacao) on:
https://github.com/input-output-hk/nomad-driver-nspawn-nixos-container
18:23:10
@kraftnix:matrix.org@kraftnix:matrix.orgRedacted or Malformed Event20:09:49
@kraftnix:matrix.org@kraftnix:matrix.org^ sometimes your yubikey just decides to say something20:11:59
@blaggacao:matrix.orgDavid Arnold (blaggacao)
In reply to @timdeh:matrix.org
I wonder if this would help you David Arnold (blaggacao) on:
https://github.com/input-output-hk/nomad-driver-nspawn-nixos-container
I'd rather have liked to see a move to OCI compliance. That would have made those custom runtime-adapters a whole class of non-ware.
20:22:28
@timdeh:matrix.org@timdeh:matrix.orgyeah, I think systemd is the biggest blocker when it comes to OCI compliant NixOS containers unfortunately 😩20:23:40
@blaggacao:matrix.orgDavid Arnold (blaggacao)Why?20:23:51
@blaggacao:matrix.orgDavid Arnold (blaggacao) systemd is a fair PID 1, no? 20:24:27
@timdeh:matrix.org@timdeh:matrix.orgWell, have you found any OCI containers with systemd working inside them? Last I looked I couldn't find any examples 😅20:24:33
@kraftnix:matrix.org@kraftnix:matrix.orgI've done a few experiments with podman + building OCI containers with nix, but it is a bit nasty UX to debug when things don't work (+ rootless networking/containers was an issue at the time, may have changed)20:24:34
@blaggacao:matrix.orgDavid Arnold (blaggacao)I mean, I would be surprised if systemd can't be pid 1 in a encapsulated environment.20:25:26
@blaggacao:matrix.orgDavid Arnold (blaggacao)But systemd is a complete overhead.20:25:41
@blaggacao:matrix.orgDavid Arnold (blaggacao)Sure.20:25:43
@blaggacao:matrix.orgDavid Arnold (blaggacao)A runtime in a runtime 😎20:25:54
@blaggacao:matrix.orgDavid Arnold (blaggacao)But, if the goal is to make nixos container more interoperable...20:26:14
@timdeh:matrix.org@timdeh:matrix.org I mean building an OCI container is simple with nix: pkgs.ociTools.buildContainer. It's putting an entire NixOS system inside one, complete with working service modules that's the real trick 20:26:28
@kraftnix:matrix.org@kraftnix:matrix.orgthe systemd overhead is definitely one of the sadder parts of running nixos-containers / VM's on with a nixos hypervisor20:26:43
@timdeh:matrix.org@timdeh:matrix.org I'm sure it is possible somehow, but I couldn't find an example of anyone who's figured it out yet 20:26:54
@blaggacao:matrix.orgDavid Arnold (blaggacao)OCI is just a file system contract + a manifest.20:27:16
@blaggacao:matrix.orgDavid Arnold (blaggacao)And the runtime is an OCI compliemt runtime.20:27:27
@blaggacao:matrix.orgDavid Arnold (blaggacao)What's run, that can be a single static binary.20:27:42
@blaggacao:matrix.orgDavid Arnold (blaggacao)Or, systemd or s6 or ...20:27:53
@blaggacao:matrix.orgDavid Arnold (blaggacao)systemd, a runtime itself, would try to compete with the runtime domain.20:28:32
@blaggacao:matrix.orgDavid Arnold (blaggacao)So this layering is what makes it complex and the UX less than great.20:28:56
@timdeh:matrix.org@timdeh:matrix.orgyeah, I think that's why systemd made nspawn in the first place20:29:25
@timdeh:matrix.org@timdeh:matrix.orgI don't think it is an easy problem to solve 20:29:31

Show newer messages


Back to Room ListRoom Version: 6