| 23 Aug 2023 |
@linus:schreibt.jetzt | ah, curling the URL does the same thing | 09:17:56 |
@linus:schreibt.jetzt | $ curl -v http://attic.geruest.sphalerite.tech:8080/magic/nar/ja7cry6cb9wwclhlphmffgg4fv0ky4cd.nar >/dev/null
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0* Trying [2a01:4f9:1a:f600:5650::36]:8080...
* Connected to attic.geruest.sphalerite.tech (2a01:4f9:1a:f600:5650::36) port 8080 (#0)
> GET /magic/nar/ja7cry6cb9wwclhlphmffgg4fv0ky4cd.nar HTTP/1.1
> Host: attic.geruest.sphalerite.tech:8080
> User-Agent: curl/8.1.1
> Accept: */*
>
< HTTP/1.1 200 OK
< x-attic-cache-visibility: public
< transfer-encoding: chunked
< date: Wed, 23 Aug 2023 09:17:52 GMT
<
{ [0 bytes data]
* transfer closed with outstanding read data remaining
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
* Closing connection 0
curl: (18) transfer closed with outstanding read data remaining
| 09:18:06 |
@linus:schreibt.jetzt | I guess I'll open an attic issue | 09:18:10 |
@linus:schreibt.jetzt | oh nvm | 09:22:42 |
@linus:schreibt.jetzt | turns out the backing s3 bucket was configured wrong and the chunks were missing | 09:23:30 |
@linus:schreibt.jetzt | though attic should probably recognise that error and report it, at least in its own log ^^ | 09:23:44 |
Julien | I get a lot of « InternalServerError: The server encountered an internal error or misconfiguration. » in the middle of my attic push. Anyone here had the same issue ? | 11:05:56 |
Julien | (Usually if I relaunch the same command it will just work fine) | 11:06:29 |
@linus:schreibt.jetzt | check the atticd logs | 11:07:30 |
@linus:schreibt.jetzt | I've been having that when it fails to acquire a db connection from the pool, probably because all the connections in the pool are busy | 11:07:47 |
@linus:schreibt.jetzt | I think it has a 30s timeout | 11:07:52 |
Julien | I yes | 11:16:12 |
Julien | * Ah yes | 11:16:21 |
Julien | It looks that that’s the problem | 11:16:29 |
Julien | * It looks like that’s the problem | 11:16:39 |
@linus:schreibt.jetzt | I think the suggested chunking params are pretty heavy on the database, so you might need to adjust the chunking, or you might need a more powerful or maybe just better tuned postgres server | 11:19:24 |
@linus:schreibt.jetzt | that is, adjust the chunking so that you get fewer chunks, but also less effective deduplication | 11:19:41 |
raitobezarius | postgres defaults are extremely conservative | 11:23:32 |
raitobezarius | tuning postgres is probably the easiest | 11:23:38 |
@linus:schreibt.jetzt | I'm trying that out now | 11:30:32 |
@linus:schreibt.jetzt | using https://pgtune.leopard.in.ua/ and the web application profile | 11:30:44 |
@linus:schreibt.jetzt | though maybe desktop is more suitable given that it's not a dedicated machine | 11:31:39 |
@linus:schreibt.jetzt | well, I'll find out :) | 11:31:47 |
Julien | I’ll use my Raito script to tune postgres | 11:50:43 |
raitobezarius | krkrkrkrkr | 11:54:46 |
@linus:schreibt.jetzt | hm, it seems to result in more successes, but doesn't entirely eliminate the failures | 12:03:42 |
raitobezarius | what is the nature of pgsql connections that attic does? | 12:04:52 |
raitobezarius | read or write? | 12:04:55 |
@linus:schreibt.jetzt | I could also imagine that atticd doesn't reuse connections well enough | 12:05:01 |
raitobezarius | in some cases, a pooler could help | 12:05:04 |