!CcTBuBritXGywOEGWJ:matrix.org

NixOS Binary Cache Self-Hosting

172 Members
About how to host a very large-scale binary cache and more59 Servers

Load older messages


SenderMessageTime
4 Nov 2025
@gradientvera:matrix.orgVera Gradient joined the room.08:34:39
7 Nov 2025
@emma:rory.gay@emma:rory.gay left the room.22:41:52
12 Nov 2025
@inayet:matrix.orgInayet changed their display name from inayet to Inayet.12:38:19
19 Nov 2025
@j0squ4red:matrix.orgjosqu4red joined the room.22:28:52
20 Nov 2025
@user12592851:matrix.orgJohn joined the room.06:46:09
@vengmark2:matrix.org@vengmark2:matrix.org left the room.12:04:50
11 Dec 2025
@creepinson:matrix.org@creepinson:matrix.org left the room.06:15:55
@tg-x:asra.grTG × ⊙ joined the room.19:54:05
12 Dec 2025
@gkleen:synapse.ligkleen changed their display name from gkleen to Gregor.13:03:22
@gkleen:synapse.ligkleen changed their display name from Gregor to gkleen.13:45:11
13 Dec 2025
@mjolnir:nixos.orgNixOS Moderation Bot unbanned @joepie91:pixie.town@joepie91:pixie.town.05:58:37
14 Dec 2025
@suua:matrix.orgsuua joined the room.13:29:48
15 Dec 2025
@sandro:supersandro.de@sandro:supersandro.de left the room.19:06:37
23 Dec 2025
@hexolexo:matrix.orghexolexo joined the room.23:10:48
26 Dec 2025
@jappie:jappie.devjasper @ 39c3 ☎️ 62749 changed their display name from jappie to jappie @ 39c3.15:49:41
27 Dec 2025
@jappie:jappie.devjasper @ 39c3 ☎️ 62749 changed their display name from jappie @ 39c3 to jasper @ 39c3 ☎️ 62749.13:30:50
21 Aug 2023
@cafkafk:nixos.devChristina Sørensen joined the room.08:50:44
@linus:schreibt.jetzt@linus:schreibt.jetzt
In reply to @julienmalka:matrix.org
Do we have measures of the total deduplication of an attic cache ?
attic doesn't currently have a built-in command for it but it should be pretty easy to get from the db
08:51:14
@linus:schreibt.jetzt@linus:schreibt.jetzt
attic=# select sum(file_size) / (select sum(nar_size) from nar) from chunk;
        ?column?
------------------------
 0.20098691256561418637
(1 row)
08:52:57
@linus:schreibt.jetzt@linus:schreibt.jetztso I guess I'm using 20% as much storage for nars as I would be without dedup08:53:15
@linus:schreibt.jetzt@linus:schreibt.jetzt*and compression08:53:30
@linus:schreibt.jetzt@linus:schreibt.jetztof course that isn't entirely representative of how much space the cache takes up including file metadata and the database08:54:44
@linus:schreibt.jetzt@linus:schreibt.jetztbut I think nars would be the bulk of my binary cache, so that's already a useful number ^^08:55:09
@julienmalka:matrix.orgJulien Given the state of things with AWS hosting it would be interesting to see how much of that dedup we could benefit from in the cache.nixos.org binary cache without asking for demesurate computationnal stress to the server 08:55:07
@linus:schreibt.jetzt@linus:schreibt.jetztyeah08:55:57
@linus:schreibt.jetzt@linus:schreibt.jetztI know some people were interested in looking into options there, do you know if anyone's actually doing anything on that front?08:56:25
@julienmalka:matrix.orgJulien To be honnest I thought that that was what people were doing on the group but I was only following the conversation from afar. I’m interested into doing experiments on that field though. 08:57:40
@linus:schreibt.jetzt@linus:schreibt.jetzt I guess raitobezarius is the most likely to know :D 08:58:26
@elvishjerricco:matrix.org@elvishjerricco:matrix.org Linux Hackerman: Any suggestion on special_small_blocks value? I was thinking 8K since anything <=8K is worst case space efficiency on raidz2 (ashift=12) 09:04:45
@julienmalka:matrix.orgJulien
In reply to @linus:schreibt.jetzt
attic=# select sum(file_size) / (select sum(nar_size) from nar) from chunk;
        ?column?
------------------------
 0.20098691256561418637
(1 row)
On my own attic deployment I get 0.17052771681498935
09:04:49

Show newer messages


Back to Room ListRoom Version: 10