!RROtHmAaQIkiJzJZZE:nixos.org

NixOS Infrastructure

381 Members
Next Infra call: 2024-07-11, 18:00 CEST (UTC+2) | Infra operational issues backlog: https://github.com/orgs/NixOS/projects/52 | See #infra-alerts:nixos.org for real time alerts from Prometheus.118 Servers

Load older messages


SenderMessageTime
16 Oct 2025
@raitobezarius:matrix.orgraitobezarius:"D11:50:06
@brian:bmcgee.ieBMGLess messy, more very simple. Not atomic. You can have a nar without a narinfo or vice versa because they are uploaded independently11:50:48
@brian:bmcgee.ieBMGThese numbers would seem to indicate something is not quite right with the upload process.11:51:09
@brian:bmcgee.ieBMGI'm spending my afternoons on this stuff at the min. I'm gonna grab some lunch and dig into this properly. Need to brush up on my clickhouse skills a bit.11:51:58
@brian:bmcgee.ieBMGMight be faster to just finish the postgres import process and poke around it there, cos I'll have parsed the narinfos and have the references etc and be able to relate the nar entries to the nar infos11:53:20
@brian:bmcgee.ieBMG🤔11:53:30
@vcunat:matrix.orgVladimír Čunátnarinfo is per derivation. nar is per derivation output. Am I wrong?12:01:57
@brian:bmcgee.ieBMG🤔12:02:09
@vcunat:matrix.orgVladimír ČunátWe do use multi-output derivations pretty commonly, at least in the more-core packages.12:02:26
@brian:bmcgee.ieBMGThat would make sense12:02:44
@brian:bmcgee.ieBMGBut woudl that mean more nars than narinfos?12:03:17
@brian:bmcgee.ieBMG* But wouldn't that mean more nars than narinfos?12:03:25
@hexa:lossy.networkhexayes12:03:31
@brian:bmcgee.ieBMGWe're seeing the opposite12:03:45
@brian:bmcgee.ieBMGIf my clickhouse skills are to be believed12:03:51
@raitobezarius:matrix.orgraitobezarius<confusion intensifies>12:04:02
@vcunat:matrix.orgVladimír ČunátAh, I misread that. OK.12:04:20
@vcunat:matrix.orgVladimír ČunátIt does happen commonly on Hydra that we build the same-hashed derivation twice in parallel.12:06:02
@vcunat:matrix.orgVladimír Čunát* It does happen commonly on Hydra that we build the same-hashed derivation twice in parallel (and both succeed).12:06:09
@vcunat:matrix.orgVladimír ČunátI'm not sure what exactly happens in that case. But even so.12:06:26
@brian:bmcgee.ieBMGwhich would account for same nar but multiple narinfos?12:06:29
@brian:bmcgee.ieBMGassuming the build output was bit-wise reproducible12:06:48
@vcunat:matrix.orgVladimír ČunátThey often are not, but I'm not sure that really affects the count of re-uploads.12:07:23
@vcunat:matrix.orgVladimír ČunátIt doesn't affect the (S3/URL) paths.12:07:39
@brian:bmcgee.ieBMGHappy to jump on a call a bit later and poke through this dataset together 12:15:23
@nam3l33ss:matrix.org·☽•Nameless☆•777 · ± joined the room.13:40:10
@nam3l33ss:matrix.org·☽•Nameless☆•777 · ±Hi o/13:41:21
@joerg:thalheim.ioMic92
In reply to @brian:bmcgee.ie
But wouldn't that mean more nars than narinfos?
You can end up with more narinfos if you produce the very same build-output.
15:13:26
@joerg:thalheim.ioMic92Ah vcunat said this already 15:13:48
@dramforever:matrix.orgdramforeveri am pretty sure this is wrong15:14:38

Show newer messages


Back to Room ListRoom Version: 6