!RROtHmAaQIkiJzJZZE:nixos.org

NixOS Infrastructure

415 Members
Next Infra call: 2024-07-11, 18:00 CEST (UTC+2) | Infra operational issues backlog: https://github.com/orgs/NixOS/projects/52 | See #infra-alerts:nixos.org for real time alerts from Prometheus.130 Servers

Load older messages


SenderMessageTime
9 May 2026
@hexa:lossy.networkhexano entries19:47:42
@hexa:lossy.networkhexa5 tries iirc19:48:24
@emilazy:matrix.orgemilyseems like we should just make that infinite?19:50:46
@emilazy:matrix.orgemilyif you give up on uploading and rebuild instead, you then still have to upload the output, so no benefit19:50:58
@emilazy:matrix.orgemily ok, it's actually ffmpeg-headless on unstable, last rebuilt 2026-04-23 19:53:53
@emilazy:matrix.orgemilyare these logs from the old or new queue runner? having trouble chasing code paths20:00:54
@hexa:lossy.networkhexaold20:01:29
@hexa:lossy.networkhexathe new runner isn't live20:01:36
@emilazy:matrix.orgemily ok, so it looks like Nix will retry up to download-attempts (even for uploads) times, unless it gets status 400–500 other than 408, 501, 505, or 511 20:18:09
@hexa:lossy.networkhexaand I assume you only got that from code and not docs20:18:42
@emilazy:matrix.orgemily would it be feasible to set download-attempts = 1024 or something like that on the Nix used by Hydra? 20:18:48
@hexa:lossy.networkhexathat would be hack, right?20:19:00
@emilazy:matrix.orgemilyyes I had to bounce between multiple repositories 🫠20:19:02
@emilazy:matrix.orgemilywell it seems reasonable to say that Hydra giving up on an upload just never makes sense20:19:18
@hexa:lossy.networkhexaI kinda disagree20:19:27
@emilazy:matrix.orgemilyif it gives up on uploading something to the cache, then it's just going to schedule a pointless build for it later, and then try to upload that20:19:29
@hexa:lossy.networkhexathat part is true20:19:44
@emilazy:matrix.orgemilywhich is exactly the same as continuing to try to upload, except that you do a pointless build which happens to also break things on Darwin20:19:46
@hexa:lossy.networkhexabut I also don't want an extended backlog of uploads ideally20:19:55
@emilazy:matrix.orgemilyright, but they'll happen anyway right?20:20:11
@hexa:lossy.networkhexawe can increase the retry amounts20:20:12
@emilazy:matrix.orgemilythey're ultimately part of the jobset20:20:20
@hexa:lossy.networkhexaexcept when the ydon't20:20:22
@emilazy:matrix.orgemilyI guess the difference is it can give up on leafs20:20:26
@hexa:lossy.networkhexahuh20:20:28
@hexa:lossy.networkhexathey?20:20:36
@emilazy:matrix.orgemilythe things being uploaded20:20:48
@hexa:lossy.networkhexaright20:20:52
@emilazy:matrix.orgemily I think a nicer solution is ^ where you just never push out a .narinfo for any output until all the outputs are up 20:21:13
@emilazy:matrix.orgemilybut looking at the C++ code it doesn't seem like that would be trivial to arrange if S3 can even do it20:21:29

Show newer messages


Back to Room ListRoom Version: 6