| 6 Dec 2025 |
aloisw | Uh what? To the contrary it is quite a lot of transactions. The huge volume of tiny transactions is also why there is so much amplification, I think. | 14:37:31 |
Jassuko | Like… you are already writing a bunch of files for each derivation… having to do a SQLite write should be rather trivial in that scope? | 14:37:34 |
Jassuko | Or does it have some weird schema or indexes that are absurdly slow to update..? | 14:38:34 |
raitobezarius | FS writes doesn't have the same performance penalty as a SQLite writes | 14:38:52 |
aloisw | It is not just one write, it is one write transaction where it adds the derivation and its references to the database, plus probably some index updates. And it does not appear "absurdly slow" in general, the problem is the extreme write amplification. | 14:39:58 |
Jassuko | In reply to @raitobezarius:matrix.org FS writes doesn't have the same performance penalty as a SQLite writes On the contrary… properly used the SQLite can exceed the performance of writing same amount of small files to the plain FS… | 14:40:30 |