| 8 Dec 2024 |
hexa | yeah, k900 implied it wasn't yesterday fwiw | 22:42:28 |
hexa | which would make queries much more easy to write in the face of how badly the feedback of the ruler is | 22:43:06 |
hexa | at least I'm now getting fast feedback | 22:46:27 |
hexa | building '/nix/store/3f7ww8pjj8v32w45vcflz6l7lvc767vp-rules.yaml.drv'...
ERRO[0000] unable parse rules file error="could not parse expression for alert 'PostgresqlCollationMismatch' in group 'postgresql': parse error at line 5, col 1: syntax error: unexpected $end, expecting )" file=/nix/store/b90hjjsvamndv0z2a9vqfz91w66lbc43-rules.yaml
lokitool: error: prepare operation unsuccessful, unable to parse rules files: file read error, try --help
error: builder for '/nix/store/3f7ww8pjj8v32w45vcflz6l7lvc767vp-rules.yaml.drv' failed with exit code 1;
last 2 log lines:
> ERRO[0000] unable parse rules file error="could not parse expression for alert 'PostgresqlCollationMismatch' in group 'postgresql': parse error at line 5, col 1: syntax error: unexpected $end, expecting )" file=/nix/store/b90hjjsvamndv0z2a9vqfz91w66lbc43-rules.yaml
> lokitool: error: prepare operation unsuccessful, unable to parse rules files: file read error, try --help
For full logs, run 'nix log /nix/store/3f7ww8pjj8v32w45vcflz6l7lvc767vp-rules.yaml.drv'.
| 22:46:30 |
hexa | finally | 22:50:39 |
hexa |  Download image.png | 22:50:39 |
@adam:robins.wtf | Nice | 23:57:10 |
@adam:robins.wtf | I definitely need that collation mismatch alert ;) | 23:57:41 |
| 9 Dec 2024 |
hexa | pay up! 😄 | 00:00:13 |
@adam:robins.wtf | i gotta set up loki first | 00:00:28 |
hexa | man, I hate how shitty log based alerting is | 00:00:31 |
hexa | it could be so simple afer all | 00:00:39 |
hexa | * it could be so simple after all | 00:00:42 |
hexa | e.g. logwatch | 00:00:53 |
@adam:robins.wtf | what's the whole, working, rule look like? | 00:03:01 |
hexa | count_over_time({unit="postgresql.service"}
|~ "database \"[^\"]+\" has a collation version mismatch"
| regexp "database \"(?<database>[^\"]+)\""
[5m])
| 00:03:47 |
magic_rb | In reply to @hexa:lossy.network sent an image. Alerts through matrix? Bold move | 00:04:14 |
hexa | falls back to pushover when synapse or the bot are not up | 00:04:52 |
hexa | that is why alertmanager support routing 🤷 | 00:05:11 |
hexa | * that is why alertmanager supports routing 🤷 | 00:05:25 |
magic_rb | Ah cool | 00:05:28 |
magic_rb | Hey, i also do matrix notifs, for ssh login and smart stats | 00:05:44 |
magic_rb | So not one to judge | 00:05:58 |
hexa | 🙂 | 00:06:03 |
@adam:robins.wtf |  Download screenshot_2024-12-08-192345.png | 00:24:11 |
@adam:robins.wtf | helpful? i guess. but limiting to ten sections at a time isn't the best use of space | 00:24:51 |
hexa | well | 00:24:58 |
hexa | I have strong opinions about that question | 00:25:03 |
@adam:robins.wtf | heh | 00:25:11 |
hexa | one page has
[ruler: <ruler_config>}
| 00:25:21 |