| 19 Sep 2023 |
 aanderse | question about the experimental streaming evaluator:
is there a specific reason --evaluator streaming can't be used with colmena eval?
i read the basic description of what nix-eval-jobs is and i don't see any reason why it couldn't be used with the colmena eval command
maybe just hasn't been implemented but it could?
i would appreciate any info on this 🙇♂️
| 12:10:29 |
 raitobezarius | It can definitely be used as far as I imagine it | 13:49:01 |
| raitobezarius | But what is the size of the deployment you are trying to use it for? | 13:49:12 |
| raitobezarius | It won't work very efficiently, will it? | 13:49:20 |
| raitobezarius | Except if your biggest annoyance is evaluating nixpkgs | 13:49:31 |
| aanderse | raitobezarius: when i evaluate some large things (like config.system.build.toplevel) with colmena eval it is very slow
when i run colmena apply (with streaming evaluator) it is very fast
i'd wager if i could run colmena eval with streaming evaluator it would also be fast
| 14:19:32 |
| raitobezarius | interesting | 14:19:47 |
| raitobezarius | oh but yes | 14:19:50 |
| raitobezarius | this is completely the usecase for the streaming evaluator | 14:19:56 |
| raitobezarius | But the streaming evaluator may not know how to parallelize the deployment part | 14:20:20 |
| raitobezarius | Because it's intertwined | 14:20:26 |
| raitobezarius | But if you see this type of perf, this makes sense | 14:20:31 |
| aanderse | this runs on ci machines which have plenty of resources... so i think it should all just work magically :) | 14:21:10 |
| aanderse | anyways, i'll take your answer as a confirmation that this simply hasn't been added to colmena for whatever reason | 14:21:59 |
| raitobezarius | https://github.com/zhaofengli/colmena/blob/main/src/nix/hive/mod.rs#L368-L383 | 14:23:28 |
| raitobezarius | use the streaming evaluator here | 14:23:31 |
| raitobezarius | instead of a simple nix-instantiate | 14:23:36 |
| aanderse | i think i'll open an issue to track this
thanks 😄 | 14:28:49 |
| 20 Sep 2023 |
|  @mutantmell:helveticastandard.com joined the room. | 01:27:15 |
|  dustee joined the room. | 16:15:00 |
| dustee | guys what causes this error
[ERROR] stderr) error: attribute 'inputs' missing
| 16:15:47 |
| dustee | the nix flake builds normally, but not with colmena | 16:16:03 |
| dustee | fixed it but adding meta.specialArgs = {inherit inputs outputs;}; | 16:44:26 |
| dustee | * fixed it by adding meta.specialArgs = {inherit inputs outputs;}; | 16:44:37 |
| 21 Sep 2023 |
|  dedmunwalk joined the room. | 23:07:54 |
| 22 Sep 2023 |
|  bl1nk changed their profile picture. | 11:21:25 |
| bl1nk changed their profile picture. | 11:23:10 |
| 24 Sep 2023 |
|  mib 🥐 joined the room. | 12:23:07 |
| 25 Sep 2023 |
|  cafkafk joined the room. | 13:52:43 |
| cafkafk | Are there other people on Colmena that have write access? | 14:11:42 |
