!UKDpaKNNsBpOPfLWfX:zhaofeng.li

Colmena

332 Members
A simple, stateless NixOS deployment tool - https://github.com/zhaofengli/colmena117 Servers

Load older messages


SenderMessageTime
14 Mar 2022
@cw:kernelpanic.cafeChinchilla Washington
In reply to @zhaofeng:zhaofeng.li
--no-substitutes which will probably be renamed in the future (https://github.com/zhaofengli/colmena/issues/59)

syntaxerror ✅ 4m Activation successful

Thank you very much!

01:45:50
@cw:kernelpanic.cafeChinchilla WashingtonI should have asked this a long time ago. 01:46:09
@buckley310:matrix.orgBuckleyI just disable the binary caches in the configs of machines with no internet. Less typing04:38:09
@cw:kernelpanic.cafeChinchilla Washington
In reply to @buckley310:matrix.org
I just disable the binary caches in the configs of machines with no internet. Less typing
Sometimes the lack of internet isn't planned, heh
05:42:08
@buckley310:matrix.orgBuckleylol13:45:46
15 Mar 2022
@winterqt:nixos.devWinter (she/her)So when using buildOnTarget, what decides if the drv should be built and copied on the host or built on the target? I know most do the latter, but things such as a source folder (from a flake input) have definitely gotten copied before, so...19:48:55
16 Mar 2022
@zhaofeng:zhaofeng.liZhaofeng Li
In reply to @winterqt:nixos.dev
So when using buildOnTarget, what decides if the drv should be built and copied on the host or built on the target? I know most do the latter, but things such as a source folder (from a flake input) have definitely gotten copied before, so...
Oops, missed this one. I think sources (fixed hash paths produced by addToStore or similar) are always directly copied, and because Colmena passes --include-outputs when copying the .drvs existing outputs will be copied as well
21:23:16
17 Mar 2022
@github:maunium.net@github:maunium.net [zhaofengli/colmena] xddxdd opened issue #65: Colmena build is stuck unless "-v" argument is present

When I run colmena build --on some-host, colmena will be stuck in the "Evaluating" step and seemingly never ends. When I run colmena build --on some-host -v (note the added -v argument), the same build continues normally and finishes within one minute.

Example output:


# Time 00:25:20 
$ colmena build --on some-host
warning: Git tree '/path/to/my/nixos-config' is dirty
[INFO ] Using flake: git+file:///path/to/my/nixos-config
[INFO ] Enumerating nodes...
warning: Git tree '/path/to/my/nixos-config' is dirty
warning: Git tree '/path/to/my/nixos-config' is dirty
warning: Git tree '/path/to/my/nixos-config' is dirty
[INFO ] Selected 1 out of 13 hosts.
                🕓 54s 1 running
# I pressed Ctrl-C after ~1min, but it will run forever if I didn't do that

# Time 00:26:19
$ colmena build --on some-host -v
warning: Git tree '/path/to/my/nixos-config' is dirty
[INFO ] Using flake: git+file:///path/to/my/nixos-config
[INFO ] Enumerating nodes...
warning: Git tree '/path/to/my/nixos-config' is dirty
warning: Git tree '/path/to/my/nixos-config' is dirty
warning: Git tree '/path/to/my/nixos-config' is dirty
[INFO ] Selected 1 out of 13 hosts.
some-host | Evaluating some-host
some-host | warning: Git tree '/path/to/my/nixos-config' is dirty
some-host | Evaluated some-host
some-host | Building some-host
some-host | /nix/store/xl1n3k4vbd8aa20kgs6nx10wyyzmbiij-nixos-system-some-host-22.05pre-git
some-host | Built "/nix/store/xl1n3k4vbd8aa20kgs6nx10wyyzmbiij-nixos-system-some-host-22.05pre-git"
          | All done!
# Time 00:26:36, the same job is done in 20 seconds

When colmena is stuck, it seems to be waiting for a defunct nix-store process:

$ ps -aux
# ...
lantian   811648  0.1  0.0 1225260 6016 pts/1    S<l+ 00:25   0:00 colmena build --on some-host
lantian   847160  0.0  0.0      0     0 pts/1    Z<+  00:25   0:00 [nix-store] <defunct>

Bisect shows this issue is introduced in https://github.com/zhaofengli/colmena/commit/26b2203da9a8a0f7913c61de3343430da66579b5.

I'm on latest nixos-unstable, and here's my nix-info report:

 - system: `"x86_64-linux"`
 - host os: `Linux 5.16.13-xanmod1-lantian, NixOS, 22.05 (Quokka)`
 - multi-user?: `yes`
 - sandbox: `yes`
 - version: `nix-env (Nix) 2.8.0pre20220311_d532269`
 - nixpkgs: `/etc/nix/inputs/nixpkgs`
05:38:05
@github:maunium.net@github:maunium.net [zhaofengli/colmena] zhaofengli closed issue #65: Colmena build is stuck unless "-v" argument is present 06:34:24
20 Mar 2022
@winterqt:nixos.devWinter (she/her)I wish there was a way we could parallelize the derivation copy step for buildOnTarget, this takes ages on large upgrades >.<05:04:10
@winterqt:nixos.devWinter (she/her)especially with node packages 😅05:04:33
21 Mar 2022
@zhaofeng:zhaofeng.liZhaofeng Li
In reply to @winterqt:nixos.dev
I wish there was a way we could parallelize the derivation copy step for buildOnTarget, this takes ages on large upgrades >.<
I looked at it, and it appears that Nix used to be able to copy paths in parallel, but it's disabled for some reason: https://discourse.nixos.org/t/speed-up-nix-copy/15884/5
00:34:55
@zhaofeng:zhaofeng.liZhaofeng Li copyPaths is used by both nix copy and nix-copy-closure (through copyClosure) 00:35:06
@hexa:lossy.networkhexaI wish I had the motivation to migrate to colmena already 😽01:17:52
@winterqt:nixos.devWinter (she/her)
In reply to @zhaofeng:zhaofeng.li
I looked at it, and it appears that Nix used to be able to copy paths in parallel, but it's disabled for some reason: https://discourse.nixos.org/t/speed-up-nix-copy/15884/5
I'll ask around
01:39:28
@winterqt:nixos.devWinter (she/her)Definitely interesting01:39:32
@github:maunium.net@github:maunium.net [zhaofengli/colmena] Repo forked into winterqt/colmena 01:46:02
@github:maunium.net@github:maunium.net [zhaofengli/colmena] winterqt opened pull request #66: cli: add reboot command
01:57:33
@github:maunium.net@github:maunium.net [zhaofengli/colmena] winterqt commented on pull request #66: cli: add reboot command 01:58:47
@github:maunium.net@github:maunium.net [zhaofengli/colmena] winterqt edited pull request #66: cli: add reboot command 02:00:24
@winterqt:nixos.devWinter (she/her)basically a draft if i'm being honest, but a good first step02:00:50
@github:maunium.net@github:maunium.net [zhaofengli/colmena] lheckemann opened issue #67: Allow excluding hosts

Nixops has the convenient --exclude option that allows deploying every node except the given ones. This would be nice to have in colmena as well, particularly in combination with the tags feature.

07:03:53
22 Mar 2022
@github:maunium.net@github:maunium.net [zhaofengli/colmena] justinas commented on pull request #66: cli: add reboot command 22:27:26
23 Mar 2022
@pinage404:matrix.orgpinage404 joined the room.21:22:30
25 Mar 2022
@github:maunium.net@github:maunium.net [zhaofengli/colmena] zhaofengli unpinned issue #50: Nixpkgs fails to build on unstable 02:22:59
30 Mar 2022
@github:maunium.net@github:maunium.net [zhaofengli/colmena] blaggacao opened issue #68: Boostrapping from ISO
  • Suppose I have a headless machine with link-local connectivity
  • That machine has a specially prepared live iso with a well-known (static & link-local) ip address
  • The mount point of the store is to be construed at /mnt/nix/...
  • Let's call the still anonymous host (no own IP, no crypto identiy) larva
  • Now we want to: colmena apply --on larva --over [fe80::47]:2222 --store /mnt/nix

Can you give me a few pointers where to implement this?

05:11:30
@github:maunium.net@github:maunium.net [zhaofengli/colmena] blaggacao edited issue #68: Boostrapping from ISO 05:13:06
@github:maunium.net@github:maunium.net [zhaofengli/colmena] blaggacao edited issue #68: Boostrapping from ISO 05:13:48
@github:maunium.net@github:maunium.net [zhaofengli/colmena] blaggacao opened issue #69: Deploying home-manager profiles

What would be the conceptual steps for feature parity with deploy-rs and enable deployment of home-manager profiles as a "grand unified deployment tool"?

05:15:07
@aanderse:nixos.devaanderse hoping someone can help me dig into this... i'm trying to deploy to a server i deployed to using colmena last week
i tried deploying to the same server today and colmena just hangs
is there a higher debug level or some flags i can pass?
09:34:22

Show newer messages


Back to Room ListRoom Version: 6