| 17 Sep 2023 |
rendakuenthusiast⚡️ | In reply to @lytedev:matrix.org hey, folks - I'm feeling pretty dumb and can't figure out where/how the configuration for the host goes in the colmena flake output - any pointers or docs or examples for my dumb brain? here's a somewhat-edited version of my own config: https://privatebin.net/?52786ff541369743#8bjfkQW278J7Gjvsf6ph35xQkxamraf3ZzFFtE4LunGW | 08:04:31 |
rendakuenthusiast⚡️ | where I have host-a.imports = [ ./local/configuration.nix], that was basically the configuration.nix of that machine before I was using colmena + flakes | 08:05:05 |
| smrtak joined the room. | 18:33:22 |
smrtak | Redacted or Malformed Event | 19:01:56 |
| 18 Sep 2023 |
| @mutantmell:helveticastandard.com left the room. | 01:05:39 |
dantefromhell | Redacted or Malformed Event | 18:37:45 |
| 19 Sep 2023 |
aanderse | question about the experimental streaming evaluator:
is there a specific reason --evaluator streaming can't be used with colmena eval? i read the basic description of what nix-eval-jobs is and i don't see any reason why it couldn't be used with the colmena eval command maybe just hasn't been implemented but it could?
i would appreciate any info on this 🙇♂️
| 12:10:29 |
raitobezarius | It can definitely be used as far as I imagine it | 13:49:01 |
raitobezarius | But what is the size of the deployment you are trying to use it for? | 13:49:12 |
raitobezarius | It won't work very efficiently, will it? | 13:49:20 |
raitobezarius | Except if your biggest annoyance is evaluating nixpkgs | 13:49:31 |
aanderse | raitobezarius: when i evaluate some large things (like config.system.build.toplevel) with colmena eval it is very slow when i run colmena apply (with streaming evaluator) it is very fast
i'd wager if i could run colmena eval with streaming evaluator it would also be fast
| 14:19:32 |
raitobezarius | interesting | 14:19:47 |
raitobezarius | oh but yes | 14:19:50 |
raitobezarius | this is completely the usecase for the streaming evaluator | 14:19:56 |
raitobezarius | But the streaming evaluator may not know how to parallelize the deployment part | 14:20:20 |
raitobezarius | Because it's intertwined | 14:20:26 |
raitobezarius | But if you see this type of perf, this makes sense | 14:20:31 |
aanderse | this runs on ci machines which have plenty of resources... so i think it should all just work magically :) | 14:21:10 |
aanderse | anyways, i'll take your answer as a confirmation that this simply hasn't been added to colmena for whatever reason | 14:21:59 |
raitobezarius | https://github.com/zhaofengli/colmena/blob/main/src/nix/hive/mod.rs#L368-L383 | 14:23:28 |
raitobezarius | use the streaming evaluator here | 14:23:31 |
raitobezarius | instead of a simple nix-instantiate | 14:23:36 |
aanderse | i think i'll open an issue to track this
thanks 😄 | 14:28:49 |
| 20 Sep 2023 |
| @mutantmell:helveticastandard.com joined the room. | 01:27:15 |
| dustee joined the room. | 16:15:00 |
dustee | guys what causes this error
[ERROR] stderr) error: attribute 'inputs' missing
| 16:15:47 |
dustee | the nix flake builds normally, but not with colmena | 16:16:03 |