| 16 Aug 2021 |
nixinator | :) | 16:40:06 |
nixinator | get a well thought answer. :-) | 16:40:14 |
andi- | Is postgresql the answer you were looking for? | 16:40:35 |
nixinator | apparenty there is a script to do this. | 16:40:48 |
nixinator | my friends a bit of pro matrix hoster. | 16:40:55 |
andi- | Yeah there are a bunch but they are not really complete. | 16:41:04 |
andi- | There is purging of empty rooms etc.. | 16:41:14 |
nixinator | https://levans.fr/shrink-synapse-database.html | 16:43:44 |
nixinator | i just asked him about this, and he had a meltdown about how crufty the db gets with matrix | 16:44:14 |
nixinator | and how slow it can become. | 16:44:19 |
nixinator | storage is the problem!!!! :-) too much state! :-) | 16:44:32 |
andi- | So, it is a bit different with this server than with the usual homeserver. As this server is also serving logs for all the NixOS channels I can't just go ahead and purge history that is old. | 16:49:27 |
andi- | Also purging the history of channels with no members (what happens on room version upgrades?) might not be a good idea for archiving purposes. | 16:49:58 |
nixinator | sure....... | 16:51:21 |
nixinator | well thanks for your services! | 16:51:31 |
nixinator | much appeciated. | 16:51:36 |
nixinator | where are the logs for the nixos channels, i used to use samualsdr's ones... | 16:52:13 |
nixinator | but they were only for irc. | 16:52:23 |
nixinator | we need to bring (^-^) back!! :-) | 16:52:34 |
andi- | on https://nixos.dev/ you can find a list of channels that it provides logs for. The list is incomplete as I have to manually update it.. | 16:53:57 |
| andi- invited stigo. | 16:56:33 |
nixinator | nixos.dev, nice piece of code. | 16:59:26 |
| 21 Aug 2021 |
andi- | I'll do some state compaction work on the server tonight. Usually that shouldn't impact anything but who knows... | 18:11:09 |
andi- | Also while at it I'll switch the memory allocator from jemalloc to mimalloc. Have been testing that on my private server for a few weeks now. For both borg backups and synapse. Really seems to help with the memory spikes that happen when you join larger channels. | 18:38:07 |
andi- | The promise of that tool was to compress data...
Number of rows after compression: 847 (123.11%)
| 19:14:48 |
andi- | on the other extreme:
Number of rows after compression: 944793 (20.07%)
| 19:15:36 |
| 22 Aug 2021 |
| dusk changed their profile picture. | 15:49:08 |
evils | hmm, only seeing the "services to the NixOS community" on nixos.dev now
maybe you'd be interested in running an MQTT broker for this? https://gitlab.com/evils/nix-mqtt
here's the latest output of that
nix/channels/nixpkgs-unstable/commit 14b0f20fa1f56438b74100513c9b1f7c072cf789
nix/channels/nixpkgs-unstable/commit-authored 1629379651
nix/channels/nixpkgs-unstable/age-in-days 2.09
nix/channels/nixpkgs-unstable/advanced 1629476481
nix/channels/nixos-unstable/commit 253aecf69ed7595aaefabde779aa6449195bebb7
nix/channels/nixos-unstable/commit-authored 1629292755
nix/channels/nixos-unstable/age-in-days 3.65
nix/channels/nixos-unstable/advanced 1629341485
nix/channels/nixos-unstable-small/commit 5edf5b60c3d8f82b5fc5e73e822b6f7460584945
nix/channels/nixos-unstable-small/commit-authored 1629417598
nix/channels/nixos-unstable-small/age-in-days 2.50
nix/channels/nixos-unstable-small/advanced 1629441687
nix/channels/meta/commit a38d69fad4d33375ca4343904c481f8af12a95b3
nix/channels/meta/checked 1629657305
nix/channels/meta/data-source https://github.com/grahamc/nix-channel-monitor
nix/channels/meta/script-source https://gitlab.com/evils/nix-mqtt
nix/channels/nixos-21.05/age-in-days 2.36
nix/channels/nixos-21.05/commit-authored 1629379628
nix/channels/nixos-21.05/commit a1007637cea374bd1bafd754cfd5388894c49129
nix/channels/nixos-21.05/advanced 1629453676
nix/channels/nixos-21.05-small/age-in-days 2.17
nix/channels/nixos-21.05-small/commit-authored 1629460250
nix/channels/nixos-21.05-small/advanced 1629469887
nix/channels/nixos-21.05-small/commit bd21f646da8ba60adf8fc36be177ea1ff566ecb3
| 18:37:02 |
andi- | hmm, that broker would then allow everyone to subscribe to channel updates? | 19:16:36 |
evils | jup
those topics are persistent so you can also just get the latest value | 19:19:35 |