!RROtHmAaQIkiJzJZZE:nixos.org

NixOS Infrastructure

463 Members
Next Infra call: 2024-07-11, 18:00 CEST (UTC+2) | Infra operational issues backlog: https://github.com/orgs/NixOS/projects/52 | See #infra-alerts:nixos.org for real time alerts from Prometheus.145 Servers

Load older messages


SenderMessageTime
18 Jun 2026
@joerg:thalheim.ioMic92 Arian: did you just reset a single file in the cache or more than that? 09:56:44
@joerg:thalheim.ioMic92because this seems to be reset now? https://github.com/NixOS/hydra/issues/180409:57:22
@sampointon:matrix.orgsampointon joined the room.10:05:29
@arianvp:matrix.orgArianI didn't do anything. Wrong person tagged?10:05:58
@hexa:lossy.networkhexaNot me either fwiw10:06:21
@gquetel:matrix.orgGrégor joined the room.10:26:44
@vcunat:matrix.orgVladimír ČunátI suppose we'll now keep running into various consequences, e.g. https://hydra.nixos.org/build/331666283/nixlog/26210:29:02
@joerg:thalheim.ioMic92I am scanning the cache10:30:09
@joerg:thalheim.ioMic92To find all candidates10:30:15
@vcunat:matrix.orgVladimír ČunátI keep hating that we have to "build" all constituents to pass the job (they can be huge closures), but that's mostly an independent issue.10:30:38
@joerg:thalheim.ioMic92Just checking the version won't be enough if it also affects new store path10:30:47
@joerg:thalheim.ioMic92* Just checking the bucket version won't be enough if it also affects new store path10:30:59
@joerg:thalheim.ioMic92It will help with recovery a bit though10:31:07
@vcunat:matrix.orgVladimír Čunát* I keep hating that we have to "build" by moving all constituents to a builder - in order to pass the job (they can be huge closures), but that's mostly an independent issue.10:31:05
@vcunat:matrix.orgVladimír ČunátNon-FOD derivations should get obsolete within a month or two.10:32:20
@vcunat:matrix.orgVladimír Čunát* Non-FOD derivations should get "obsolete" within a month or two.10:32:44
@vcunat:matrix.orgVladimír Čunát(because of staging rebuilds)10:32:52
@vcunat:matrix.orgVladimír Čunát* Almost all non-FOD derivations should get "obsolete" within a month or two.10:33:08
@joerg:thalheim.ioMic92 vcunat: didn't see more aborts that was caused by the issue I was trying to fix. will keep watching 10:40:19
@benjaminsparks:chat.alugha.appBen Sparks joined the room.10:48:58
@eyjhb:eyjhb.dkeyJhb joined the room.10:54:53
@joerg:thalheim.ioMic92No new aborts. I am now using the s3 inventory as Arian suggested to get all the narinfos from this point in time10:59:08
@samestep:matrix.orgsame joined the room.11:02:01
@joerg:thalheim.ioMic92I have now a list of 8k nars to check. The inventory is only a snapshot though, so there might be some store paths from today that I have to check when the new snapshot comes in 11:15:27
@dramforever:matrix.orgdramforever

so um, i think it's not just nar files that are affected, like this openssl which looks very wrong
cc hexa (signing key rotation when)

$ curl https://cache.nixos.org/bl7rmhhsy7vjb9qm3jfwgqpv3cn7wfb1.narinfo
StorePath: /nix/store/bl7rmhhsy7vjb9qm3jfwgqpv3cn7wfb1-openssl-3.6.2
URL: nar/1fypgxjwksn6kh2ig4fmaskfnflicjq60zf5il2s9nxblhkkvnww.nar.zst
Compression: zstd
FileHash: sha256:0c2mjp3jk671s6ld10x93g95sdhciljnkb8bngdyxn1lj3rkc5hj
FileSize: 3777677
NarHash: sha256:0nagwij5x8yi54380yw53xy1ksn9jclp98lxmizbqq6hgngqp553
NarSize: 148512
Deriver: 2kabrm3sjvrax28i9n5wl7hzrlf3q8dg-sudo-1.9.17p2.drv
Sig: cache.nixos.org-1:NUIiNu9yrFL1630mONHKpI/av4U7kxUXVgVOWlVZqUo0VOUbMTaBPycP8jLvbIYkNHxAVJ7bpp41HaqJAB7VCw==
11:37:32
@hexa:lossy.networkhexacan you point out what you're seeing?11:37:59
@dramforever:matrix.orgdramforever Deriver: 2kabrm3sjvrax28i9n5wl7hzrlf3q8dg-sudo-1.9.17p2.drv, and no References 11:38:14
@hexa:lossy.networkhexauhhh, yeah. that looks off.11:39:21
@hexa:lossy.networkhexathanks for pointing that out11:39:31
@dramforever:matrix.orgdramforeverDownload bl7rmhhsy7vjb9qm3jfwgqpv3cn7wfb1.narinfo11:41:35

Show newer messages


Back to Room ListRoom Version: 6