!RROtHmAaQIkiJzJZZE:nixos.org

NixOS Infrastructure

374 Members
Next Infra call: 2024-07-11, 18:00 CEST (UTC+2) | Infra operational issues backlog: https://github.com/orgs/NixOS/projects/52 | See #infra-alerts:nixos.org for real time alerts from Prometheus.115 Servers

Load older messages


SenderMessageTime
16 Oct 2025
@brian:bmcgee.ieBMGimage.png
Download image.png
11:48:30
@brian:bmcgee.ieBMG This is the monthly rollup for %.nar.% 11:48:40
@brian:bmcgee.ieBMGI'm gonna say something naive: shouldn't there be the same number of nars as narinfos?11:49:20
@raitobezarius:matrix.orgraitobezariusi was going to call this out11:49:31
@raitobezarius:matrix.orgraitobezariusi'm confused why #narinfo >>> #nars11:49:40
@raitobezarius:matrix.orgraitobezariusbut perhaps, nar uploads are averted11:49:49
@brian:bmcgee.ieBMGLooks like about 500k or so more narinfos a month than nars11:49:52
@raitobezarius:matrix.orgraitobezariusand narinfos are rewritten no matter what11:49:53
@brian:bmcgee.ieBMGNow I know the upload process is "messy"11:50:01
@raitobezarius:matrix.orgraitobezarius:"D11:50:06
@brian:bmcgee.ieBMGLess messy, more very simple. Not atomic. You can have a nar without a narinfo or vice versa because they are uploaded independently11:50:48
@brian:bmcgee.ieBMGThese numbers would seem to indicate something is not quite right with the upload process.11:51:09
@brian:bmcgee.ieBMGI'm spending my afternoons on this stuff at the min. I'm gonna grab some lunch and dig into this properly. Need to brush up on my clickhouse skills a bit.11:51:58
@brian:bmcgee.ieBMGMight be faster to just finish the postgres import process and poke around it there, cos I'll have parsed the narinfos and have the references etc and be able to relate the nar entries to the nar infos11:53:20
@brian:bmcgee.ieBMG🤔11:53:30
@vcunat:matrix.orgvcunatnarinfo is per derivation. nar is per derivation output. Am I wrong?12:01:57
@brian:bmcgee.ieBMG🤔12:02:09
@vcunat:matrix.orgvcunatWe do use multi-output derivations pretty commonly, at least in the more-core packages.12:02:26
@brian:bmcgee.ieBMGThat would make sense12:02:44
@brian:bmcgee.ieBMGBut woudl that mean more nars than narinfos?12:03:17
@brian:bmcgee.ieBMG* But wouldn't that mean more nars than narinfos?12:03:25
@hexa:lossy.networkhexa (signing key rotation when)yes12:03:31
@brian:bmcgee.ieBMGWe're seeing the opposite12:03:45
@brian:bmcgee.ieBMGIf my clickhouse skills are to be believed12:03:51
@raitobezarius:matrix.orgraitobezarius<confusion intensifies>12:04:02
@vcunat:matrix.orgvcunatAh, I misread that. OK.12:04:20
@vcunat:matrix.orgvcunatIt does happen commonly on Hydra that we build the same-hashed derivation twice in parallel.12:06:02
@vcunat:matrix.orgvcunat* It does happen commonly on Hydra that we build the same-hashed derivation twice in parallel (and both succeed).12:06:09
@vcunat:matrix.orgvcunatI'm not sure what exactly happens in that case. But even so.12:06:26
@brian:bmcgee.ieBMGwhich would account for same nar but multiple narinfos?12:06:29

Show newer messages


Back to Room ListRoom Version: 6