!UKDpaKNNsBpOPfLWfX:zhaofeng.li

Colmena

331 Members
A simple, stateless NixOS deployment tool - https://github.com/zhaofengli/colmena117 Servers

Load older messages


SenderMessageTime
4 Feb 2022
@github:maunium.net@github:maunium.net [zhaofengli/colmena] cole-h edited issue #54: Don't require meta.nixpkgs if meta.nodeNixpkgs is set for the target host(s) 23:56:56
5 Feb 2022
@github:maunium.net@github:maunium.net [zhaofengli/colmena] Repo forked into cole-h/colmena 01:06:39
@github:maunium.net@github:maunium.net [zhaofengli/colmena] cole-h drafted pull request #56: WIP: add deployment.nixpkgs option

See https://github.com/zhaofengli/colmena/issues/55.

01:08:13
@github:maunium.net@github:maunium.net [zhaofengli/colmena] cole-h commented on pull request #56: WIP: add deployment.nixpkgs option 01:10:06
@github:maunium.net@github:maunium.net [zhaofengli/colmena] cole-h edited pull request #56: WIP: add deployment.nixpkgs option 01:16:27
@github:maunium.net@github:maunium.net [zhaofengli/colmena] zhaofengli commented on pull request #56: WIP: add deployment.nixpkgs option :

Please use the following as a test:

let
  nixpkgs_2111 = builtins.fetchTarball {
    url = "https://github.com/NixOS/nixpkgs/archive/f6ddd55d5f9d5eca08df138c248008c1ba73ecec.tar.gz";
    sha256 = "03ms1mk4m4ni3bxjzdqngxvwyvh3rn7yb8ybzjlg62r9iv3l0ppa";
  };
  nixpkgs_unstable = builtins.fetchTarball {
    url = "https://github.com/NixOS/nixpkgs/archive/554d2d8aa25b6e583575459c297ec23750adb6cb.tar.gz";
    sha256 = "01yfqslnkyrfb5yjfablhvw830iw0za3mab4n03a0ldyq5ac6wh1";
  };
in {
  meta.nixpkgs = import nixpkgs_2111 { system = "x86_64-linux"; };

  alpha = { pkgs, ... }: {
    deployment.nixpkgs = import nixpkgs_unstable {
      system = "x86_64-linux";
    };

    # Does not exist in 21.11
    nix.settings.trusted-users = [ "zhaofeng" ];
    boot.isContainer = true;
  };
}
02:07:08
@zhaofeng:zhaofeng.liZhaofeng LiWow, that was noisy 🙉 Let me turn off the comment and edit notifications...03:14:01
@zhaofeng:zhaofeng.liZhaofeng LiWell, actually I can't just disable the webhook event, since the "Pull requests" event encompasses PR opening (which I want to appear), (un)drafting as well as editing of the description. It has to be done from the bot's end which isn't very configurable 🤷‍♂️03:19:16
9 Feb 2022
@winterqt:nixos.devWinter (she/her)Zhaofeng Li: How did you determine that the change in e58dde1be08cf7fbac7299e928b6d0e143edbec9 would fix #50? Like, what was your debug process?16:15:32
@winterqt:nixos.devWinter (she/her)curious16:15:34
@zhaofeng:zhaofeng.liZhaofeng Li
In reply to @winterqt:nixos.dev
Zhaofeng Li: How did you determine that the change in e58dde1be08cf7fbac7299e928b6d0e143edbec9 would fix #50? Like, what was your debug process?
I reproduced on my end, and it also resulted in logs in the following form: /nix/store/2vw01kp965w65cjb390c5hpcn220qavi-source/nixos/modules//nix/store/2vw01kp965w65cjb390c5hpcn220qavi-source/nixos/modules/config/debug-info.nix. So there were two repeated modulePaths, somehow.
19:18:30
@zhaofeng:zhaofeng.liZhaofeng Li
In reply to @winterqt:nixos.dev
Zhaofeng Li: How did you determine that the change in e58dde1be08cf7fbac7299e928b6d0e143edbec9 would fix #50? Like, what was your debug process?
* I reproduced on my end, and it also resulted in logs in the following form: '/nix/store/2vw01kp965w65cjb390c5hpcn220qavi-source/nixos/modules//nix/store/2vw01kp965w65cjb390c5hpcn220qavi-source/nixos/modules/config/debug-info.nix': no such file or directory. So there were two repeated modulePaths, somehow.
19:19:15
@zhaofeng:zhaofeng.liZhaofeng Li Then I added traces to the split docs build process in documentation.nix, and found out that it was trying to do a removePrefix on the full module paths using modulesPath, and remembered that I was explicitly setting modulesPath in Colmena 19:21:04
@winterqt:nixos.devWinter (she/her)
In reply to @zhaofeng:zhaofeng.li
Then I added traces to the split docs build process in documentation.nix, and found out that it was trying to do a removePrefix on the full module paths using modulesPath, and remembered that I was explicitly setting modulesPath in Colmena
got it -- why were you setting it in the first place, anyways?
20:10:36
@zhaofeng:zhaofeng.liZhaofeng Li
In reply to @winterqt:nixos.dev
got it -- why were you setting it in the first place, anyways?
It was added very early on to debug some missing argument problems that turned out to be unrelated. But yeah, shouldn't have added it in the first place.
20:13:16
@winterqt:nixos.devWinter (she/her)got it.20:56:28
@winterqt:nixos.devWinter (she/her)does Colmena add much overhead to the underlying things it does? or does speed depend on build speed + ssh connection latency + multiple ssh connection handshakes (unless you use ControlMaster)?20:57:14
@zhaofeng:zhaofeng.liZhaofeng Li
In reply to @winterqt:nixos.dev
does Colmena add much overhead to the underlying things it does? or does speed depend on build speed + ssh connection latency + multiple ssh connection handshakes (unless you use ControlMaster)?
At its core Colmena is basically a "shell command scheduler" for lack of a better term, and it doesn't add much latency to what it shells out to do (nix-instantiate, nix-build, ssh)
21:03:44
@winterqt:nixos.devWinter (she/her)right, that's what i got from the code21:05:09
@zhaofeng:zhaofeng.liZhaofeng LiAnd regarding ControlMaster, it is indeed required if you have a lot of key files, for instance, otherwise the deployment can be very slow. And before you jump in suggesting using thrussh/ssh2, yes, I have considered it (and it was the plan for the beginning), but the downsides outweigh the upsides: https://github.com/zhaofengli/colmena/issues/621:07:13
@winterqt:nixos.devWinter (she/her)right21:12:55
@winterqt:nixos.devWinter (she/her) (also, that "and before you jump in." wasn't meant to be rude/negative, right? i can't tell 😅, apologies) 21:13:22
@zhaofeng:zhaofeng.liZhaofeng LiNo, sorry, that wasn't my intention at all 🙂 I just got reminded of that from the SSH stuff that you mentioned21:15:10
10 Feb 2022
@winterqt:nixos.devWinter (she/her)all good :)02:14:10
@zhaofeng:zhaofeng.liZhaofeng LiI do appreciate you pointing out that you perceived it as rude 🙂 It helps me improve how I communicate as a non-native speaker02:40:53
@zhaofeng:zhaofeng.liZhaofeng Li(I meant it in the "now you may ask" sense)02:41:18
@winterqt:nixos.devWinter (she/her)
In reply to @zhaofeng:zhaofeng.li
I do appreciate you pointing out that you perceived it as rude 🙂 It helps me improve how I communicate as a non-native speaker
Well I didn't think you meant to be rude (at least, I hoped that you didn't!), but I was pointing out that it could be interpreted as that.
02:55:03
@winterqt:nixos.devWinter (she/her)
In reply to @zhaofeng:zhaofeng.li
(I meant it in the "now you may ask" sense)
That's definitely a better way of phrasing it, imo.
02:55:13
@winterqt:nixos.devWinter (she/her) Also, unrelated, but how do y'all secure/protect your SSH private keys? It seems like an issue with no perfect solution :c
(since rogue software could easily steal them or utilize them maliciously in every circumstance >.<)
02:56:25
@buckley310:matrix.orgBuckley At work I use a smartcard to deploy stuff, and my computer never sees the private key. It can also be done with yubikeys since the can emulate smartcards 02:57:28

Show newer messages


Back to Room ListRoom Version: 6