!UKDpaKNNsBpOPfLWfX:zhaofeng.li

Colmena

280 Members
A simple, stateless NixOS deployment tool - https://github.com/zhaofengli/colmena96 Servers

Load older messages


SenderMessageTime
17 Jun 2025
@zhaofeng:zhaofeng.liZhaofeng Li (cc: Khalil Santana) 15:46:55
@khalil:ksantana.netKhalil SantanaThank you! I'll test this and answer back with results15:48:04
@khalil:ksantana.netKhalil Santana

That seems to get nixos-rebuild --flake performance closer to colmena's, but there's still a significant difference (if I'm reading the output of zshs time correctly, that is).

colmena apply --on=andromeda --nix-option eval-cache false  9,84s user 5,36s system 41% cpu 36,341 total
nixos-rebuild switch --flake .#andromeda --target-host  --option eval-cache   7,88s user 1,11s system 58% cpu 15,299 total
15:54:11
@khalil:ksantana.netKhalil Santana

I was trying to setup profiling in nix using this[1] to figure out why colmena is slower, but didn't quite succeed (I think I got a -ENOSPC or something due to /tmp/ as tmpfs or something). Do you think something like this would be useful to debug this performance behaviour?

[1] - https://github.com/crabdancing/nix-flamegraph

15:59:54
@khalil:ksantana.netKhalil Santana (cc: Zhaofeng Li ) 16:03:25
@zhaofeng:zhaofeng.liZhaofeng Li
In reply to @khalil:ksantana.net

I was trying to setup profiling in nix using this[1] to figure out why colmena is slower, but didn't quite succeed (I think I got a -ENOSPC or something due to /tmp/ as tmpfs or something). Do you think something like this would be useful to debug this performance behaviour?

[1] - https://github.com/crabdancing/nix-flamegraph

Yeah, I think something like this is useful in general, not just for colmena but for nixpkgs slowness as well
16:04:20
@zhaofeng:zhaofeng.liZhaofeng LiAlso the issue I linked above has a list of commands that correspond to what Colmena actually evaluates underneath, so you can manually invoke the same evaluation in the profiler16:04:25
@khalil:ksantana.netKhalil Santana

Heh, it seems that plotting the flamegraph it is not quite possible in my system with 32GB of RAM.:

khalil:~/Documentos/NixOS % nix run github:crabdancing/nix-flamegraph -- --target  .#colmenaHive.toplevel.andromeda
Started `nix eval` against target...
Done. Running `stack-collapse`...
Done. Running `inferno-flamegraph`...
Error: Io(Kind(OutOfMemory))
nix run github:crabdancing/nix-flamegraph -- --target   655,34s user 224,26s system 97% cpu 14:59,05 total
[ 3404.188809] __vm_enough_memory: pid: 43928, comm: inferno-flamegr, bytes: 104871428096 not enough memory for the allocation
[ 3404.188815] __vm_enough_memory: pid: 43928, comm: inferno-flamegr, bytes: 104871497728 not enough memory for the allocation
[ 3404.188817] __vm_enough_memory: pid: 43928, comm: inferno-flamegr, bytes: 104871563264 not enough memory for the allocation
17:28:21
19 Jun 2025
@marshmallow:althaea.zonemarshmallowAm i crazy or did the makeHive change and the flake output being renamed not receive a changelog note?05:41:10
@hexa:lossy.networkhexait didn't even make a release, sooo05:42:07
@hexa:lossy.networkhexa

It's been long overdue, but Colmena 0.4.0 is finally here:

05:42:15
@hexa:lossy.networkhexaI't s been long overdue, again05:42:21
@marshmallow:althaea.zonemarshmallow changed their profile picture.05:52:57
@marshmallow:althaea.zonemarshmallowOh, maybe I shouldn't be using main and assuming its stable. But the nixpkgs version appears to always break for me :(05:58:03
@lgcl:lgcl.delgcl (she/they) changed their display name from lgcl (they/them) to lgcl (she/they).18:08:04
20 Jun 2025
@disco_stick:matrix.orgseaweed salad changed their display name from SS Bullshit Dreams to Corporate Cute.22:58:17
25 Jun 2025
@freexploit:trafkin.com@freexploit:trafkin.com joined the room.16:29:20
@freexploit:trafkin.com@freexploit:trafkin.comRedacted or Malformed Event16:30:02
@prroet:prroet.dynv6.netprroet
In reply to @freexploit:trafkin.com
I just want to say thank you 😄 for now I've been using colmena for more than a year to manage my home lab and it has been great
Same here
16:35:29
27 Jun 2025
@redstone-menace:matrix.orgR̴̨͕͇͍̞̮̐̅͆̌̀̉̐͋̈́̃̀͒́̎̅̚̚̚͠͝Ĕ̵̡̛͖͖̟̙̫̱͈̘̞̭͍͍͑̌̄͑̓̋̓̀̈̏̈́͊̇͊͆̉͂̏̀̃̚͘͝͝ͅͅD̶̡̢͔̱̖̮͙͉̘̺͓͍̩̮͈͍͗̃̀̏͌͘͜ͅŚ̸̬̭̯̬͙͇͓̬̩̳̤͚͓̤̩̺͉͖̉͛̓̿̎͊̿̆́̐͂̇͌̄̇̓͘ͅͅT̴̞̫̘̝͇͔̟̪̪̦͂̔̎̀̎ͅŎ̷̡̬̹̪͈̭̣͈̭̭͉̦̖̝̘̪͖͔̥̦̘̻̳Ṋ̶̛̫͈̳̘͚̜̔̋͆̅̈́͊̑͊̉̌̈́̾͑̈́̚ͅË̸̡̨̨̛͇̜̖͔͖̻̟̗̠̙͓̘̗̥͉͇̜͑͆͊͑͑̀̓͒͜͝͝ changed their display name from Redstone to R̴̨͕͇͍̞̮̐̅͆̌̀̉̐͋̈́̃̀͒́̎̅̚̚̚͠͝Ĕ̵̡̛͖͖̟̙̫̱͈̘̞̭͍͍͑̌̄͑̓̋̓̀̈̏̈́͊̇͊͆̉͂̏̀̃̚͘͝͝ͅͅD̶̡̢͔̱̖̮͙͉̘̺͓͍̩̮͈͍͗̃̀̏͌͘͜ͅŚ̸̬̭̯̬͙͇͓̬̩̳̤͚͓̤̩̺͉͖̉͛̓̿̎͊̿̆́̐͂̇͌̄̇̓͘ͅͅT̴̞̫̘̝͇͔̟̪̪̦͂̔̎̀̎ͅŎ̷̡̬̹̪͈̭̣͈̭̭͉̦̖̝̘̪͖͔̥̦̘̻̳Ṋ̶̛̫͈̳̘͚̜̔̋͆̅̈́͊̑͊̉̌̈́̾͑̈́̚ͅË̸̡̨̨̛͇̜̖͔͖̻̟̗̠̙͓̘̗̥͉͇̜͑͆͊͑͑̀̓͒͜͝͝.00:56:43
28 Jun 2025
@tebriel:frodux.nettebriel joined the room.21:14:16
29 Jun 2025
@jtremesay:matrix.orgJonathan Tremesaygues joined the room.13:29:44
30 Jun 2025
@tebriel:frodux.nettebriel is there an equivalent of nix flake check for the colmena hive configurations? like flake check evaluates nixosConfigurations.<name>.config.system.build.toplevel 00:20:58
@felschr:matrix.orgfelschr joined the room.22:01:32
4 Jul 2025
@emanueljohnsongodin:matrix.orgEmanuel Johnson Godin joined the room.22:48:54
@emanueljohnsongodin:matrix.orgEmanuel Johnson Godin I'm looking to switch from deploy-rs to colmena. But colmena's module feels strange. Why do I put host configuration inside outputs.colmena? Shouldn't outputs.colmena consume nixosConfigurations? 22:51:18
@emanueljohnsongodin:matrix.orgEmanuel Johnson Godin * I'm looking to switch from deploy-rs to colmena. But colmena's lib feels strange. Why do I put host configuration inside outputs.colmena? Shouldn't outputs.colmena consume nixosConfigurations? 22:51:37
@emanueljohnsongodin:matrix.orgEmanuel Johnson Godinalso, can colmena deploy standalone home-manager configuration?22:53:19
@zhaofeng:zhaofeng.liZhaofeng Li
In reply to @emanueljohnsongodin:matrix.org
I'm looking to switch from deploy-rs to colmena. But colmena's module feels strange. Why do I put host configuration inside outputs.colmena? Shouldn't outputs.colmena consume nixosConfigurations?
The design is for the makeHive function control the evaluation so you're able to get config cross-reference via the nodes argument, apply a set of common modules, etc. There are ways to shove existing nixosConfigurations into colmenaHive though (see the issue on this)
22:56:43
@zhaofeng:zhaofeng.liZhaofeng Li
In reply to @emanueljohnsongodin:matrix.org
also, can colmena deploy standalone home-manager configuration?
No, no such support yet. Some deploy-rs-style pluggable target support would be nice, but don't have the cycles at the moment
22:57:54

Show newer messages


Back to Room ListRoom Version: 6