| 20 Sep 2024 |
Yorusaka Miyabi | (You can join too I guess) | 09:03:23 |
Yorusaka Miyabi | In reply to@shadowrz:nixos.dev Just asked in https://matrix.to/#/#synapse:matrix.org they suggested to provide reverse proxy config to troubleshoot (And also related worker config) | 09:04:43 |
andi- | It is still syncing :D | 09:13:00 |
Andreas Rammhold | 夜坂雅: did roll back the sendToDevice, read markers, presence and push-rules, account_data, ... overrides. Lets see if this still works. I'll keep the SSO on the main process for now. Given the limited amount of logins we have that isn't a concern right now. | 09:53:24 |
andi- | doing the reverse approach now, I'll only redirect URLs from the document to the workers... that seems like the smaller set of URLs or less work long-term :( | 10:21:43 |
Yorusaka Miyabi | In reply to @andir:nixos.dev 夜坂雅: did roll back the sendToDevice, read markers, presence and push-rules, account_data, ... overrides. Lets see if this still works. I'll keep the SSO on the main process for now. Given the limited amount of logins we have that isn't a concern right now. Mostly works,
[...] the left remaining API requests that failed with M_UNRECOGNIZED on nixos.dev are the pushers API and /_matrix/client/v3/directory/list/room/ (which deals with whether a room is public on the server's public directory), but they're otherwise not important to fix and can be delayed.
(Pushers API goes to the main process)
| 10:22:04 |
Andreas Rammhold | This is now live. Lets see if that remove the need for random overrides that aren't really following a pattern / have a documentation entry. | 10:22:50 |
Andreas Rammhold | test | 10:25:53 |
andi- | Funny part is that the urls for the worker in the doc also include URLs that need to be routed to the respective stream writer... There must be a better way to document that. | 10:24:56 |
andi- | works?! | 10:26:05 |
Andreas Rammhold | seems like it | 10:28:22 |
Yorusaka Miyabi | In reply to @andir:nixos.dev seems like it Indeed. | 10:29:06 |
andi- | Piping the documentation through a regex isn't ideal but well... 2nd try produced the right rules... | 10:29:17 |
| 24 Sep 2024 |
Andreas Rammhold | Any more issues that I might have missed? | 09:04:37 |
Yorusaka Miyabi | In reply to @andir:nixos.dev Any more issues that I might have missed? Currently none, BTW if you only delete media files, Synapse would still believe the media is in the remote media cache, only failed to found in the cache and report error to clients. | 09:06:39 |
andi- | Yeah, I run a purge script less frequent than the actual cleanup. Can probably tweak the timining of that. I was a stop gap because at times people consumed tons of gigabytes of images every day... | 09:07:26 |
| 29 Sep 2024 |
Yorusaka Miyabi | andi- BTW, I've seen reports that https://logs.nixos.dev is mostly broken
| 06:42:31 |
andi- | That shitty go program strikes again. I’m not home until the evening. I used to restart it once an hour with a hackt loop runnning in tmux 🤣 have to make more permanent attempts | 06:48:22 |
andi- | It kicks the bucket after enough requests. | 06:48:31 |
| 4 Oct 2024 |
| yusdacra changed their profile picture. | 04:41:34 |
| 17 Oct 2024 |
Yorusaka Miyabi | Appeareantly I lost many events in !cacbMwUwsLZ6GKac:nichi.co 🤔 | 13:55:07 |
Yorusaka Miyabi | In reply to @shadowrz:nixos.dev Appeareantly I lost many events in !cacbMwUwsLZ6GKac:nichi.co 🤔 For example Event ID $RKy3adIpkxQtqI0TwSFLMMOg8-mYhYARrXWVfrajz34 is strangely unavaliable from nixos.dev Cc @andi:kack.it | 14:20:23 |
andi- | no idea why that would be or how to fix that now.. can't see anything on the server | 14:20:59 |
Yorusaka Miyabi | In reply to @andi:kack.it no idea why that would be or how to fix that now.. can't see anything on the server ? Synapse emited no warnings ? | 14:37:47 |
Yorusaka Miyabi | In reply to @andi:kack.it no idea why that would be or how to fix that now.. can't see anything on the server * | 14:37:52 |
Yorusaka Miyabi | In reply to @shadowrz:nixos.dev ? Synapse emited no warnings or errors? Also I did another one, https://matrix.nixos.dev/_matrix/client/v3/rooms/!cacbMwUwsLZ6GKac%3Anichi.co/event/%24RKy3adIpkxQtqI0TwSFLMMOg8-mYhYARrXWVfrajz34 if you want to troubleshoot | 14:39:16 |
Yorusaka Miyabi | Syncing that room is also missing many events and only few goes in, unsure why it would happen | 14:45:48 |
Andreas Rammhold |
Oct 17 14:34:43 matrix synapse-client_worker2[1163]: synapse.http.server: [PUT-5896459] <XForwardedForRequest at 0x7ff39a3da050 method='PUT' uri='/_matrix/client/v3/rooms/!cacbMwUwsLZ6GKac:nichi.co/event/$RKy3adIpkxQtqI0TwSFLMMOg8Oct 17 14:34:43 matrix synapse-client_worker2[1163]: synapse.http.server: [PUT-5896459] <XForwardedForRequest at 0x7ff39a3da050 method='PUT' uri='/_matrix/client/v3/rooms/!cacbMwUwsLZ6GKac:nichi.co/event/$RKy3adIpkxQtqI0TwSFLMMOg8-mYhYARrXWVfrajz34' clientproto='HTTP/1.1' site='7501'> SynapseError: 405 - Unrecognized request -mYhYARrXWVfrajz34' clientproto='HTTP/1.1' site='7501'> SynapseError: 405 - Unrecognized request
| 14:45:49 |
Yorusaka Miyabi | Redacted or Malformed Event | 14:46:20 |
Yorusaka Miyabi | In reply to @andir:nixos.dev
Oct 17 14:34:43 matrix synapse-client_worker2[1163]: synapse.http.server: [PUT-5896459] <XForwardedForRequest at 0x7ff39a3da050 method='PUT' uri='/_matrix/client/v3/rooms/!cacbMwUwsLZ6GKac:nichi.co/event/$RKy3adIpkxQtqI0TwSFLMMOg8Oct 17 14:34:43 matrix synapse-client_worker2[1163]: synapse.http.server: [PUT-5896459] <XForwardedForRequest at 0x7ff39a3da050 method='PUT' uri='/_matrix/client/v3/rooms/!cacbMwUwsLZ6GKac:nichi.co/event/$RKy3adIpkxQtqI0TwSFLMMOg8-mYhYARrXWVfrajz34' clientproto='HTTP/1.1' site='7501'> SynapseError: 405 - Unrecognized request -mYhYARrXWVfrajz34' clientproto='HTTP/1.1' site='7501'> SynapseError: 405 - Unrecognized request
* | 14:46:23 |