!UKDpaKNNsBpOPfLWfX:zhaofeng.li

Colmena

326 Members
A simple, stateless NixOS deployment tool - https://github.com/zhaofengli/colmena107 Servers

You have reached the beginning of time (for this room).


SenderMessageTime
1 May 2022
@blaggacao:matrix.org@blaggacao:matrix.org Zhaofeng Li: host dns or static ips or ssh config alias might only be known after an initial (metal) deployment task has returned. I think it might make sense to get a map of these values from an auxiliary json file. Have you thought about this workflow / use case, already? 17:47:21
@blaggacao:matrix.org@blaggacao:matrix.org I mean it's easy with nix. Just want to make sure I'm not actually re-inventing something. 17:48:09
@blaggacao:matrix.org@blaggacao:matrix.orgRebased.18:39:34
@blaggacao:matrix.org@blaggacao:matrix.org I'm also thinking maybe it's in order for keeping colmena maintainable to refactor it to use two different libraries, one for classical nix and one for flakes. Switch case at the leaves is the source of all evil, imo. 18:42:37
@blaggacao:matrix.org@blaggacao:matrix.org* I'm also thinking maybe it's in order for keeping `colmena` maintainable to refactor it to use two different libraries, one for classical nix and one for flakes. Switch case at the leaves is the source of all evil, imo. I've decent trouble unwinding the double lane reasoning when going through the code. Took me maybe already 2-3 days.18:43:42
@blaggacao:matrix.org@blaggacao:matrix.orgIn any way, ideally the compatibility layer wouldn't bleed too much into the code, if that makes sense.18:44:47
@blaggacao:matrix.org@blaggacao:matrix.org Yet another low level suggestion: are you interested in clap_derive? I find that so much more readable in most circumstances. And I think it also uses less LoCs 19:10:43
@zhaofeng:zhaofeng.liZhaofeng LiYes, migrating to the new Derive API has been in the back burner for a while20:02:44
@zhaofeng:zhaofeng.liZhaofeng Li That's already possible to do yourself with fromJSON. I'm a bit wary of blessing any specific format in Colmena itself, to keep it lean and "provisioner-agnostic" 20:07:36
@blaggacao:matrix.org@blaggacao:matrix.org K, so I implemented a hidden flag --eval that can swap eval.nix for a different implementation. This way, I can query .#__std metadata to autodetect colmenaConfigurations and make them available to the colmena CLI. 🎉 Will be testing this in a bit. 20:17:44
@blaggacao:matrix.org@blaggacao:matrix.orgTotally agree!20:18:15
@zhaofeng:zhaofeng.liZhaofeng LiI'm not really sure about this, as I don't want to guarantee any compatibility for the internal eval API. It limits refactorability and can lead to errors indecipherable to the average user.20:29:48
@blaggacao:matrix.org@blaggacao:matrix.org Hm, I see. Alternatively I could just patch colmena, but that would make me responsible for building and caching, which I generally try to avoid. 20:42:02
@blaggacao:matrix.org@blaggacao:matrix.orgThe problem I have with the built-in interface is that it pertains to 'nix as boilerplate' which is fine for power-users but usually quite a non-starter for nix-newbies.20:42:50
@blaggacao:matrix.org@blaggacao:matrix.orgIt is a real challenge to present newcomers with a consistent and well-designed system that is explicitly free of adapter code and boilerplate.20:43:34
@blaggacao:matrix.org@blaggacao:matrix.org But on the other hand, ofc, I don't claim that std layout should be any officially supported layout. 20:43:59
@blaggacao:matrix.org@blaggacao:matrix.org With that draft PR I was thinking to ship a wrapped colemena version with std that makes use of the --eval flag and a custom / purpose-built evaluator. 20:45:57
@blaggacao:matrix.org@blaggacao:matrix.org By not documenting that --eval flag, maybe we might have found an acceptable solution? I'm happy to follow-up on the internal interface when there are changes. 20:47:19
@blaggacao:matrix.org@blaggacao:matrix.org .hide(true), that is. 21:00:11
@zhaofeng:zhaofeng.liZhaofeng Li I know what you mean, but I'm still not convinced that this brings enough benefits for the headaches it will cause (any addition to eval.nix will break this contract). Can your growOn expose a "normal" outputs.colmena/outputs.colmenaConfigurations? 21:13:40
@blaggacao:matrix.org@blaggacao:matrix.orgYes it can, but it's not an option due to the non-nix natives that would be confused by this boilerplate.21:14:47
@blaggacao:matrix.org@blaggacao:matrix.org Also the problem gets exacerbated by the handling of system. 21:15:25
@blaggacao:matrix.org@blaggacao:matrix.org Essentially, nixosConfigurations live in all top-level system spaces, but are filtered out if the systems don't match. Reducing that to q multi-system typed outputs.colmena would be probably the largest chunk of any stdized flake and pure boilerplate. 21:16:50
@blaggacao:matrix.org@blaggacao:matrix.org* Essentially, nixosConfigurations live in all top-level system spaces, but are filtered out if the systems don't match. Reducing that to a multi-system typed `outputs.colmena` would be probably the largest chunk of any `std`ized flake and pure boilerplate.21:17:12
@blaggacao:matrix.org@blaggacao:matrix.org I mean, my use case is explicitly to make the use of nix friendly enough that strong & principled nix opponents don't veto everything. 21:18:13
@blaggacao:matrix.org@blaggacao:matrix.org

Another problem might be that I can't do a std-native colmenaConfig action. Because for it to work, any end user would have to replicate that boilerplate.

That also means that we directly load the problem of schema-drift out to all the future end users of that boilerplate.

In this scenario, I think it's better for me to maintain this centrally and collocate colmena and schema with pinned versions.

21:22:25
@zhaofeng:zhaofeng.liZhaofeng Li
In reply to @blaggacao:matrix.org
Essentially, nixosConfigurations live in all top-level system spaces, but are filtered out if the systems don't match. Reducing that to a multi-system typed outputs.colmena would be probably the largest chunk of any stdized flake and pure boilerplate.
Could you elaborate? All the conversion can be done in your opinionated std layer, and there is no boilerplate from the user's perspective if they buy into your view.
21:22:56
@blaggacao:matrix.org@blaggacao:matrix.org Well, the flake.nix is a user flake. It needs to have a co.pat layer right there to work with colmena. 21:24:01
@blaggacao:matrix.org@blaggacao:matrix.org std has no middle ware to do that conversion for the user. 21:24:38
@blaggacao:matrix.org@blaggacao:matrix.org Essentially, std has just gotten rid of it's last compatibility layer that projected the schema onto something that nix itself requires. 21:25:41

Show newer messages


Back to Room ListRoom Version: 6