!CcTBuBritXGywOEGWJ:matrix.org

NixOS Binary Cache Self-Hosting

169 Members
About how to host a very large-scale binary cache and more58 Servers

Load older messages


SenderMessageTime
23 Aug 2023
@linus:schreibt.jetzt@linus:schreibt.jetztI think it has a 30s timeout11:07:52
@julienmalka:matrix.orgJulienI yes11:16:12
@julienmalka:matrix.orgJulien* Ah yes11:16:21
@julienmalka:matrix.orgJulienIt looks that that’s the problem11:16:29
@julienmalka:matrix.orgJulien* It looks like that’s the problem11:16:39
@linus:schreibt.jetzt@linus:schreibt.jetztI think the suggested chunking params are pretty heavy on the database, so you might need to adjust the chunking, or you might need a more powerful or maybe just better tuned postgres server11:19:24
@linus:schreibt.jetzt@linus:schreibt.jetztthat is, adjust the chunking so that you get fewer chunks, but also less effective deduplication11:19:41
@raitobezarius:matrix.orgraitobezariuspostgres defaults are extremely conservative11:23:32
@raitobezarius:matrix.orgraitobezariustuning postgres is probably the easiest11:23:38
@linus:schreibt.jetzt@linus:schreibt.jetztI'm trying that out now11:30:32
@linus:schreibt.jetzt@linus:schreibt.jetztusing https://pgtune.leopard.in.ua/ and the web application profile11:30:44
@linus:schreibt.jetzt@linus:schreibt.jetztthough maybe desktop is more suitable given that it's not a dedicated machine11:31:39
@linus:schreibt.jetzt@linus:schreibt.jetztwell, I'll find out :)11:31:47
@julienmalka:matrix.orgJulienI’ll use my Raito script to tune postgres11:50:43
@raitobezarius:matrix.orgraitobezariuskrkrkrkrkr11:54:46
@linus:schreibt.jetzt@linus:schreibt.jetzthm, it seems to result in more successes, but doesn't entirely eliminate the failures12:03:42
@raitobezarius:matrix.orgraitobezariuswhat is the nature of pgsql connections that attic does?12:04:52
@raitobezarius:matrix.orgraitobezariusread or write?12:04:55
@linus:schreibt.jetzt@linus:schreibt.jetztI could also imagine that atticd doesn't reuse connections well enough12:05:01
@raitobezarius:matrix.orgraitobezariusin some cases, a pooler could help12:05:04
@raitobezarius:matrix.orgraitobezariusyeah12:05:07
@linus:schreibt.jetzt@linus:schreibt.jetztit does pool them12:05:08
@linus:schreibt.jetzt@linus:schreibt.jetzt
Aug 23 13:58:54 garage-muc atticd[286]: 2023-08-23T11:58:54.590061Z ERROR tower_http::trace::on_failure: response failed classification=Status code: 500 Internal Server Error latency=30003 ms
Aug 23 14:02:44 garage-muc atticd[286]: 2023-08-23T12:02:44.976132Z ERROR attic_server::error: Database error: Failed to acquire connection from pool
12:05:45
@raitobezarius:matrix.orgraitobezariushow many connections do you allow now?12:06:02
@linus:schreibt.jetzt@linus:schreibt.jetztI have no idea :D12:06:08
@linus:schreibt.jetzt@linus:schreibt.jetztmaybe I should just dig into it rather than putting every intermediate thought in here :p12:06:39
@raitobezarius:matrix.orgraitobezarius max_connections is the right knob 12:06:51
@linus:schreibt.jetzt@linus:schreibt.jetztI don't think this is on the postgres side, it's on the attic side12:07:15
@raitobezarius:matrix.orgraitobezariusAh right I agree12:07:27
@raitobezarius:matrix.orgraitobezariushttps://github.com/NixOS/nixos-org-configurations/tree/master/metrics/fastly13:19:45

Show newer messages


Back to Room ListRoom Version: 10