| 16 Aug 2021 |
 nixinator | my friends a bit of pro matrix hoster. | 16:40:55 |
 andi- | Yeah there are a bunch but they are not really complete. | 16:41:04 |
| andi- | There is purging of empty rooms etc.. | 16:41:14 |
| nixinator | https://levans.fr/shrink-synapse-database.html | 16:43:44 |
| nixinator | i just asked him about this, and he had a meltdown about how crufty the db gets with matrix | 16:44:14 |
| nixinator | and how slow it can become. | 16:44:19 |
| nixinator | storage is the problem!!!! :-) too much state! :-) | 16:44:32 |
| andi- | So, it is a bit different with this server than with the usual homeserver. As this server is also serving logs for all the NixOS channels I can't just go ahead and purge history that is old. | 16:49:27 |
| andi- | Also purging the history of channels with no members (what happens on room version upgrades?) might not be a good idea for archiving purposes. | 16:49:58 |
| nixinator | sure....... | 16:51:21 |
| nixinator | well thanks for your services! | 16:51:31 |
| nixinator | much appeciated. | 16:51:36 |
| nixinator | where are the logs for the nixos channels, i used to use samualsdr's ones... | 16:52:13 |
| nixinator | but they were only for irc. | 16:52:23 |
| nixinator | we need to bring (^-^) back!! :-) | 16:52:34 |
| andi- | on https://nixos.dev/ you can find a list of channels that it provides logs for. The list is incomplete as I have to manually update it.. | 16:53:57 |
| andi- invited  stigo. | 16:56:33 |
| nixinator | nixos.dev, nice piece of code. | 16:59:26 |
| 21 Aug 2021 |
| andi- | I'll do some state compaction work on the server tonight. Usually that shouldn't impact anything but who knows... | 18:11:09 |
| andi- | Also while at it I'll switch the memory allocator from jemalloc to mimalloc. Have been testing that on my private server for a few weeks now. For both borg backups and synapse. Really seems to help with the memory spikes that happen when you join larger channels. | 18:38:07 |
| andi- | The promise of that tool was to compress data...
Number of rows after compression: 847 (123.11%)
| 19:14:48 |
| andi- | on the other extreme:
Number of rows after compression: 944793 (20.07%)
| 19:15:36 |
| 22 Aug 2021 |
|  dusk changed their profile picture. | 15:49:08 |
 evils | hmm, only seeing the "services to the NixOS community" on nixos.dev now
maybe you'd be interested in running an MQTT broker for this?
https://gitlab.com/evils/nix-mqtt
here's the latest output of that
nix/channels/nixpkgs-unstable/commit 14b0f20fa1f56438b74100513c9b1f7c072cf789
nix/channels/nixpkgs-unstable/commit-authored 1629379651
nix/channels/nixpkgs-unstable/age-in-days 2.09
nix/channels/nixpkgs-unstable/advanced 1629476481
nix/channels/nixos-unstable/commit 253aecf69ed7595aaefabde779aa6449195bebb7
nix/channels/nixos-unstable/commit-authored 1629292755
nix/channels/nixos-unstable/age-in-days 3.65
nix/channels/nixos-unstable/advanced 1629341485
nix/channels/nixos-unstable-small/commit 5edf5b60c3d8f82b5fc5e73e822b6f7460584945
nix/channels/nixos-unstable-small/commit-authored 1629417598
nix/channels/nixos-unstable-small/age-in-days 2.50
nix/channels/nixos-unstable-small/advanced 1629441687
nix/channels/meta/commit a38d69fad4d33375ca4343904c481f8af12a95b3
nix/channels/meta/checked 1629657305
nix/channels/meta/data-source https://github.com/grahamc/nix-channel-monitor
nix/channels/meta/script-source https://gitlab.com/evils/nix-mqtt
nix/channels/nixos-21.05/age-in-days 2.36
nix/channels/nixos-21.05/commit-authored 1629379628
nix/channels/nixos-21.05/commit a1007637cea374bd1bafd754cfd5388894c49129
nix/channels/nixos-21.05/advanced 1629453676
nix/channels/nixos-21.05-small/age-in-days 2.17
nix/channels/nixos-21.05-small/commit-authored 1629460250
nix/channels/nixos-21.05-small/advanced 1629469887
nix/channels/nixos-21.05-small/commit bd21f646da8ba60adf8fc36be177ea1ff566ecb3
| 18:37:02 |
| andi- | hmm, that broker would then allow everyone to subscribe to channel updates? | 19:16:36 |
| evils | jup
those topics are persistent so you can also just get the latest value | 19:19:35 |
| andi- | why does that script have a jitter function that is only used once? | 19:25:05 |
| andi- | It does look fairly low-effort to run it. I'd love a mqtt broker config that only allows subscriptions (to a limited set of keys / limited amount to keep memory pressure down) and otherwise only allows localhost to publish stuff. | 19:28:04 |
| evils | In reply to @andi:kack.it
why does that script have a jitter function that is only used once? it's called before any call to github | 19:28:43 |
| andi- | yeah but those raw files are a CDN without ratelimits AFAIK | 19:29:09 |
