| 18 Oct 2021 |
 Linux Hackerman | hahaha | 09:43:43 |
 das_j | In reply to @andreas.schraegle:helsinki-systems.de
sent an image. What about notify? 😢 People always forget notify | 09:45:15 |
 ajs124 | and compress-logs(?). or… check-free-space? | 09:45:42 |
| Linux Hackerman | out of frame | 09:45:55 |
| das_j | And update-gc-roots | 09:45:56 |
| das_j | In reply to @linus.heckemann:matrix.mayflower.de
out of frame Fair | 09:46:09 |
| das_j | * Fair point | 09:46:15 |
 @grahamc:nixos.org | I'm pretty sure the compress-logs service can go away now | 13:16:46 |
| das_j | In reply to @grahamc:nixos.org
I'm pretty sure the compress-logs service can go away now The space-check thing also feels a bit weird tbh | 13:17:22 |
| @grahamc:nixos.org | now that I fixed the ~3 year old missing argument... | 13:18:00 |
| @grahamc:nixos.org | that one ... I understand... since recovering a system with zero free inodes or bytes is kinda tricky | 13:18:22 |
| das_j | But it's also a weird UX because your Hydra just stops evaluating stuff and you don't know why until you check systemctl status | 13:18:59 |
| @grahamc:nixos.org | oh yeah good point | 13:19:07 |
| das_j | Could be worked around by the queue runner and evaluator posting their current timestamp into postgres and displaying a warning in the web ui if the difference to the current timestamp is too large | 13:19:44 |
| das_j | That would also show if something bad happened | 13:20:05 |
| @grahamc:nixos.org | I'd like to add a prometheus exporter to the evaluator and queue runner. I've sent a proposal for the queue runner work to a client but they weren't ready to spend the time & money on it | 13:20:11 |
| das_j | Can't you just use the json exporter and pluck /queue-runner-status into that? | 13:21:18 |
| @grahamc:nixos.org | the instrumentation work I proposed was focused on identifying why it gets "stuck" | 13:21:54 |
| @grahamc:nixos.org | but another thing is having the exporter in the runner itself means you get liveness checks for "free" | 13:22:13 |
| das_j | Wouldn't something like opentracing be more suitable for that task? I haven't used it myself but it seems quite fitting and could also be used for more detailed inspection | 13:23:29 |
| @grahamc:nixos.org | I'm open | 13:23:46 |
| das_j | My C++ skills are more limited than my Perl skills :/ | 13:24:06 |
| @grahamc:nixos.org | mine aren't winning any awards but I don't mind diving in | 13:26:38 |
| das_j | I already learned Perl the hard way in the last days, no need to drive myself too insane :D | 13:27:29 |
| das_j | (Disclaimer: I'm not a Perl developer and I have zero training!) | 13:28:00 |
| @grahamc:nixos.org | hehe | 13:29:14 |
| @grahamc:nixos.org | what're you learning perl for?? :) | 13:29:21 |
| das_j | not learning, just doing | 13:30:14 |
| das_j | it's for switch-to-configuration.pl (the link works btw) | 13:30:27 |
| @grahamc:nixos.org | ah | 13:30:34 |
