!siOVEzpzgLbkHTjpmA:numtide.com

NixOS Archivists

61 Members
Taking care of NixOS historical build artifacts and GC. Meeting notes: https://pad.lassul.us/nixos-cache-gc For self-hosting, see #binary-cache-selfhosting:nixos.org 19 Servers

Load older messages


SenderMessageTime
6 Mar 2024
@edef1c:matrix.orgedef set a profile picture.23:28:24
7 Mar 2024
@samrose:matrix.orgsamrose joined the room.03:25:38
@edef1c:matrix.orgedef Jonas Chevalier: fwiw i seem to be wrong about the ETags 07:20:08
@edef1c:matrix.orgedefthough if we turn on versioning we might want to tweak the bucket inventory exports07:21:03
@edef1c:matrix.orgedefand while we can't turn off versioning, we can suspend versioning08:46:20
@edef1c:matrix.orgedefthere could be things i'm missing, but i think it's fine to turn it on08:46:55
@zimbatm:numtide.comJonas Chevalierohh that's good news09:02:13
@zimbatm:numtide.comJonas Chevalierok so we can delete the narinfos and not worry about re-generating them09:03:04
@edef1c:matrix.orgedefi'm poking around a bit at the releases bucket, looks like we have like four nixos-15.09-small releases that are just … missing a store-paths.xz?09:42:39
@delroth:delroth.net@delroth:delroth.net Btw archivists folks, analysis request for whenever one of you has time: I think it would be useful to know the answer to "if we kept the last N channel bumps for each active channel in something else than S3, how much would we save in bandwidth". Do you already have the tooling to do this kind of logs analysis? 09:51:43
@delroth:delroth.net@delroth:delroth.net Basically, figuring out how much of the bandwidth costs is driven by the short head vs. the long tail. 09:53:06
@delroth:delroth.net@delroth:delroth.net * Basically, figuring out how much of the bandwidth costs are driven by the short head vs. the long tail. 09:53:16
@edef1c:matrix.orgedefi think i can throw together a join or two for that, and it's a query i've been wanting to put together09:56:27
@flokli:matrix.orgflokliYeah, we have the bucket logs in a format that allows to query for that10:40:10
@edef1c:matrix.orgedef flokli: if you'd like to take this on: you know how to run weave and stuff, and you can grab fetchroots from my CL 10:41:40
@edef1c:matrix.orgedefi'm just kind of crushed/sleep-deprived/underproductive this week and i don't think this'll get done today otherwise10:42:31
@flokli:matrix.orgflokliNot this week, all my mental budget for cache stuff this week got burned already. Let's throw it on the pile and see when we get to it.10:43:52
@edef1c:matrix.orgedefright, ack10:44:57
@delroth:delroth.net@delroth:delroth.netthis is not urgent at all fwiw11:10:31
9 Mar 2024
@mrene:matrix.orgmrene joined the room.16:06:18
10 Mar 2024
@tpw_rules:matrix.orgtpw_rules joined the room.17:51:39
@tpw_rules:matrix.orgtpw_ruleshi17:51:42
14 Mar 2024
@mjolnir:nixos.orgNixOS Moderation Botchanged room power levels.18:44:29
19 Mar 2024
@mjolnir:nixos.orgNixOS Moderation Botchanged room power levels.00:29:55
21 Mar 2024
@mjolnir:nixos.orgNixOS Moderation Botchanged room power levels.18:02:52
26 Mar 2024
@leo60228:matrix.orgleo60228 joined the room.22:53:44
30 Mar 2024
@zimbatm:numtide.comJonas Chevalierjust saw this today, following the xz investigation: https://ghe.clickhouse.tech/ this could be useful to run analytics on the NixOS ecosystem10:40:29
@edef1c:matrix.orgedefyeah, we have the slight problem that we don't necessarily have a good overview of every GH repo we pull source from10:41:14
@edef1c:matrix.orgedefand the obvious problem (and i hope, now obvious to all) that we do not in fact always use the git/GitHub source, but source tarballs, which need not correspond to actual source10:42:00
@zimbatm:numtide.comJonas Chevalieryeah. I was thinking also in terms of better understanding usage patterns from the community, it's a nice data source to have.13:12:36

Show newer messages


Back to Room ListRoom Version: 10