In reply to @andir:nixos.dev
夜坂雅: did roll back the sendToDevice, read markers, presence and push-rules, account_data, ... overrides. Lets see if this still works. I'll keep the SSO on the main process for now. Given the limited amount of logins we have that isn't a concern right now.

Mostly works,

[...] the left remaining API requests that failed with M_UNRECOGNIZED on nixos.dev are the pushers API and /_matrix/client/v3/directory/list/room/ (which deals with whether a room is public on the server's public directory), but they're otherwise not important to fix and can be delayed.

(Pushers API goes to the main process)

In reply to @andir:nixos.dev
seems like it

In reply to @andir:nixos.dev
Any more issues that I might have missed?

andi- BTW, I've seen reports that https://logs.nixos.dev is mostly broken

In reply to @shadowrz:nixos.dev
Appeareantly I lost many events in !cacbMwUwsLZ6GKac:nichi.co 🤔

In reply to @andi:kack.it
no idea why that would be or how to fix that now.. can't see anything on the server

In reply to @andi:kack.it
no idea why that would be or how to fix that now.. can't see anything on the server

In reply to @shadowrz:nixos.dev
? Synapse emited no warnings or errors?

Oct 17 14:34:43 matrix synapse-client_worker2[1163]: synapse.http.server: [PUT-5896459] <XForwardedForRequest at 0x7ff39a3da050 method='PUT' uri='/_matrix/client/v3/rooms/!cacbMwUwsLZ6GKac:nichi.co/event/$RKy3adIpkxQtqI0TwSFLMMOg8Oct 17 14:34:43 matrix synapse-client_worker2[1163]: synapse.http.server: [PUT-5896459] <XForwardedForRequest at 0x7ff39a3da050 method='PUT' uri='/_matrix/client/v3/rooms/!cacbMwUwsLZ6GKac:nichi.co/event/$RKy3adIpkxQtqI0TwSFLMMOg8-mYhYARrXWVfrajz34' clientproto='HTTP/1.1' site='7501'> SynapseError: 405 - Unrecognized request
-mYhYARrXWVfrajz34' clientproto='HTTP/1.1' site='7501'> SynapseError: 405 - Unrecognized request

In reply to @andir:nixos.dev

Oct 17 14:34:43 matrix synapse-client_worker2[1163]: synapse.http.server: [PUT-5896459] <XForwardedForRequest at 0x7ff39a3da050 method='PUT' uri='/_matrix/client/v3/rooms/!cacbMwUwsLZ6GKac:nichi.co/event/$RKy3adIpkxQtqI0TwSFLMMOg8Oct 17 14:34:43 matrix synapse-client_worker2[1163]: synapse.http.server: [PUT-5896459] <XForwardedForRequest at 0x7ff39a3da050 method='PUT' uri='/_matrix/client/v3/rooms/!cacbMwUwsLZ6GKac:nichi.co/event/$RKy3adIpkxQtqI0TwSFLMMOg8-mYhYARrXWVfrajz34' clientproto='HTTP/1.1' site='7501'> SynapseError: 405 - Unrecognized request
-mYhYARrXWVfrajz34' clientproto='HTTP/1.1' site='7501'> SynapseError: 405 - Unrecognized request

In reply to @andir:nixos.dev

Oct 17 14:34:43 matrix synapse-client_worker2[1163]: synapse.http.server: [PUT-5896459] <XForwardedForRequest at 0x7ff39a3da050 method='PUT' uri='/_matrix/client/v3/rooms/!cacbMwUwsLZ6GKac:nichi.co/event/$RKy3adIpkxQtqI0TwSFLMMOg8Oct 17 14:34:43 matrix synapse-client_worker2[1163]: synapse.http.server: [PUT-5896459] <XForwardedForRequest at 0x7ff39a3da050 method='PUT' uri='/_matrix/client/v3/rooms/!cacbMwUwsLZ6GKac:nichi.co/event/$RKy3adIpkxQtqI0TwSFLMMOg8-mYhYARrXWVfrajz34' clientproto='HTTP/1.1' site='7501'> SynapseError: 405 - Unrecognized request
-mYhYARrXWVfrajz34' clientproto='HTTP/1.1' site='7501'> SynapseError: 405 - Unrecognized request

Oct 17 14:37:00 matrix synapse-client_worker2[1163]: synapse.http.server: [GET-5896991] <XForwardedForRequest at 0x7ff3cf4a33d0 method='GET' uri='/_matrix/client/v3/rooms/!cacbMwUwsLZ6GKac%3Anichi.co/event/%24RKy3adIpkxQtqI0TwSFLMMOg8-mYhYARrXWVfrajz34' clientproto='HTTP/1.1' site='7501'> SynapseError: 404 - Event not found.

this?

In reply to @andir:nixos.dev

Oct 17 14:37:00 matrix synapse-client_worker2[1163]: synapse.http.server: [GET-5896991] <XForwardedForRequest at 0x7ff3cf4a33d0 method='GET' uri='/_matrix/client/v3/rooms/!cacbMwUwsLZ6GKac%3Anichi.co/event/%24RKy3adIpkxQtqI0TwSFLMMOg8-mYhYARrXWVfrajz34' clientproto='HTTP/1.1' site='7501'> SynapseError: 404 - Event not found.

this?

Oct 17 13:14:23 matrix synapse-federation_sender2[1165]: synapse.federation.federation_server: [_process_incoming_pdus_in_room_inner-131398] handling received PDU in room !cacbMwUwsLZ6GKac:nichi.co: <FrozenEventV3 event_id=$RKy3adIpkxQtqI0TwSFLMMOg8-mYhYARrXWVfrajz34, type=m.room.message, state_key=None, outlier=False>
Oct 17 13:14:23 matrix synapse-federation_sender2[1165]: synapse.handlers.federation_event: [_process_incoming_pdus_in_room_inner-131398-$RKy3adIpkxQtqI0TwSFLMMOg8-mYhYARrXWVfrajz34] While checking auth of <FrozenEventV3 event_id=$RKy3adIpkxQtqI0TwSFLMMOg8-mYhYARrXWVfrajz34, type=m.room.message, state_key=None, outlier=False> against auth_events: 403: During auth for event $RKy3adIpkxQtqI0TwSFLMMOg8-mYhYARrXWVfrajz34: found rejected event $gptoDaHlOKSxtvJP713Mc0ywTnQDvcDy400d0jCAtfo in the state
Oct 17 13:14:23 matrix synapse-federation_sender2[1165]: synapse.http.client: [_process_incoming_pdus_in_room_inner-131398-$RKy3adIpkxQtqI0TwSFLMMOg8-mYhYARrXWVfrajz34] Received response to POST synapse-replication://master/_synapse/replication/fed_send_events/uLADjbYQlB: 200
Oct 17 13:14:23 matrix synapse-federation_sender2[1165]: synapse.replication.tcp.client: [_process_incoming_pdus_in_room_inner-131398-$RKy3adIpkxQtqI0TwSFLMMOg8-mYhYARrXWVfrajz34] Waiting for repl stream 'events' to reach 21684842 (master); currently at: 21684841
Oct 17 13:14:23 matrix synapse-federation_sender2[1165]: synapse.replication.tcp.client: [_process_incoming_pdus_in_room_inner-131398-$RKy3adIpkxQtqI0TwSFLMMOg8-mYhYARrXWVfrajz34] Finished waiting for repl stream 'events' to reach 21684842 (master)
Oct 17 13:42:31 matrix synapse-client_worker2[1163]: synapse.http.server: [GET-5884919] <XForwardedForRequest at 0x7ff3d7824050 method='GET' uri='/_matrix/client/v3/rooms/!cacbMwUwsLZ6GKac:nichi.co/event/$RKy3adIpkxQtqI0TwSFLMMOg8-mYhYARrXWVfrajz34' clientproto='HTTP/1.1' site='7501'> SynapseError: 404 - Event not found.