| 2 Jan 2022 |
|  @grahamc:nixos.org joined the room. | 01:49:13 |
| @grahamc:nixos.org | hi Zhaofeng Li I'd be happy to get that set up for you, can you make me an Admin in here? | 01:49:49 |
 Zhaofeng Li | Sure, one sec | 01:50:33 |
| Zhaofeng Lichanged room power levels. | 01:50:47 |
| @grahamc:nixos.org invited  NixOS Moderation Bot. | 01:52:20 |
| NixOS Moderation Bot joined the room. | 01:52:21 |
| @grahamc:nixos.orgchanged room power levels. | 01:52:22 |
| Room Avatar Renderer. | 01:52:24 |
| @grahamc:nixos.org | all set! | 01:52:41 |
| @grahamc:nixos.org | I like the parallel evaluation | 01:53:12 |
| Zhaofeng Li | Nice, thank you so much! Parallel build (eval is chunked, not parallelized for each host to save RAM) is one of the initial reasons I created Colmena in the first place - I looked into hacking it into Morph, but it's difficult due to how it's architected | 02:02:39 |
| @grahamc:nixos.org | yeah, and it looks like Morph's developers are happy with it as is | 02:04:39 |
| @grahamc:nixos.org | I wonder if you've looked at using the evaluator from Hydra? here is the evaluator extracted out: https://github.com/nix-community/nix-eval-jobs | 02:05:25 |
| Zhaofeng Li | Cool, I'll look into how it can be extracted out. Initially I was compared evaluating all nodes at once versus individually in parallel (one nix-instantiate for each node), and full parallel eval consumed much more RAM than evaluating all nodes together. | 02:11:42 |
| Zhaofeng Li | So the current solution is to use a naive heuristic based on available RAM to determine how many nodes to evaluate at the same time. Once a chunk of nodes is evaluated, it fires off evaluation for the next chunk while the current one is building/deploying. | 02:13:17 |
| Zhaofeng Li | * Cool, I'll look into how it can be extracted out. Initially I compared evaluating all nodes at once versus individually in parallel (one nix-instantiate for each node), and full parallel eval consumed much more RAM than evaluating all nodes together. | 02:13:35 |
| Zhaofeng Li | (https://github.com/zhaofengli/colmena/issues/1) | 02:14:29 |
| @grahamc:nixos.org | [nix-shell:~/projects/github.com/grahamc/network]$ colmena build --config network.nix --on "flexo,lord-nibbler,kif,netboot"
[INFO ] Using configuration: ./network.nix
[INFO ] Enumerating nodes...
[INFO ] Selected 4 out of 5 hosts.
✅ 58s All done!
(...) ✅ 25s Evaluated lord-nibbler, netboot, and 1 other nodes
netboot ✅ 1s Built "/nix/store/dyv9dbvipsy7b4530kj3mgja3r6rkffg-nixos-system-netboot-22.05pre-git"
flexo ✅ 1s Built "/nix/store/7yfr6nqgyy0lh46ki00dnh9k9y0ka1gp-nixos-system-flexo-22.05pre-git"
lord-nibbler ✅ 4s Built "/nix/store/xf03vpkymjdxl6c8c800ggcin89bik9h-nixos-system-lord-nibbler-22.05pre-git"
kif ✅ 28s Evaluated kif
kif ✅ 5s Built "/nix/store/21n7hcvqs1cqpya1pvnrrjp1a4nvvpw6-nixos-system-kif-22.05pre-git"
[nix-shell:~/projects/github.com/grahamc/network]$ colmena apply --config network.nix --on "kif"
[INFO ] Using configuration: ./network.nix
[INFO ] Enumerating nodes...
[INFO ] Selected 1 out of 5 hosts.
✅ 44s All done!
kif ✅ 31s Evaluated kif
kif ✅ 2s Built "/nix/store/21n7hcvqs1cqpya1pvnrrjp1a4nvvpw6-nixos-system-kif-22.05pre-git"
kif ✅ 2s Pushed system closure
kif ✅ 1s Uploaded keys (pre-activation)
kif ✅ 9s Activation successful
really nice!
| 02:19:52 |
| @grahamc:nixos.org | I just deployed to 6 hosts and it works great | 02:23:50 |
| @grahamc:nixos.org | I kind of wish it waited until everything was ready before activating anything, but that is a nit really | 02:24:10 |
| @grahamc:nixos.org | welp, I just migrated over from nixops | 02:41:40 |
|  hexa joined the room. | 03:18:38 |
|  kraem joined the room. | 05:13:02 |
|  [0x4A6F] joined the room. | 09:33:21 |
 @github:maunium.net | [zhaofengli/colmena] zhaofengli pushed
3 commits
to
main: -
f9fab830
deployment: Remove useless Arc clones
-
1adb0b42
.github: Rename workflows for clarity
-
7b055580
Advertise Matrix channel
| 21:16:33 |
| @github:maunium.net | [zhaofengli/colmena] zhaofengli pushed
1 commit
to
release-0.2.x: | 21:18:56 |
| @github:maunium.net | [zhaofengli/colmena] github-actions[bot] pushed
1 commit
to
gh-pages: -
7d6f66f0
Deploying to gh-pages from @ zhaofengli/colmena@b701b72e6a3c2c2fd078561f…
by zhaofengli
| 21:23:27 |
| @github:maunium.net | [zhaofengli/colmena] github-actions[bot] pushed
1 commit
to
gh-pages: -
ac475ba7
Deploying to gh-pages from @ zhaofengli/colmena@7b05558008fd75cb19b1be32…
by zhaofengli
| 21:23:53 |
| Zhaofeng Li | Hmm, this is kind of noisy. Let me disable the commit notifications for now. | 21:25:36 |
| 3 Jan 2022 |
| hexa | very odd, I'd expect it to know there would be many url previews | 00:52:31 |
