!RROtHmAaQIkiJzJZZE:nixos.org

NixOS Infrastructure

477 Members
Next Infra call: 2024-07-11, 18:00 CEST (UTC+2) | Infra operational issues backlog: https://github.com/orgs/NixOS/projects/52 | See #infra-alerts:nixos.org for real time alerts from Prometheus.149 Servers

Load older messages


SenderMessageTime
29 Jun 2026
@vcunat:matrix.orgVladimír Čunát * Sigh, 3/4 build slots of hopeful-rivest are stuck after finishing the build (for 22h now). The build logs look like they finished successfully, but the result is not in cache.nixos.org 08:29:56
@vcunat:matrix.orgVladimír ČunátI guess that's why the "running jobs" metric has been lower than usual in the past several hours.08:30:47
@vcunat:matrix.orgVladimír ČunátNow I deployed lockfile updates, which restarted the queue-runner, so this state should go away.08:50:43
@xokdvium:matrix.orgSergei Zimmerman (xokdvium)
In reply to @dramforever:matrix.org
re the still happening gc race, could this possibly be relevant? https://github.com/DeterminateSystems/nix-src/pull/482/changes/734a205d58a559a622ebc98256f4af4d968426b7
No, not really. The queue runner roots stuff itself and interacts with the daemon through harmonia
09:11:48
@xokdvium:matrix.orgSergei Zimmerman (xokdvium)I think the last bits of FFI to nix are gone?09:12:05
@xokdvium:matrix.orgSergei Zimmerman (xokdvium)
In reply to @xokdvium:matrix.org
No, not really. The queue runner roots stuff itself and interacts with the daemon through harmonia
(And I know roughly nothing in that codebase)
09:14:01
@vcunat:matrix.orgVladimír Čunát * Now I deployed lockfile updates, which restarted the queue-runner, so this state should go away. 09:58:58
@vcunat:matrix.orgVladimír ČunátYes, a few minutes ago again, a new ISO fail. The graphical ISOs seem to be quite a reliable test for this, as they have loads of dependencies and run for quite a few minutes (so likely hit the 1h GC interval).11:19:13
@vcunat:matrix.orgVladimír Čunát* Yes, a few minutes ago again, a new ISO fail. The graphical ISOs seem to be quite a reliable test for this, as they have loads of dependencies and run for quite a few minutes (so likely hit the hourly GC runs).11:19:25
@vcunat:matrix.orgVladimír Čunát * Yes, a few minutes ago again (step 97 here, a new ISO fail. The graphical ISOs seem to be quite a reliable test for this, as they have loads of dependencies and run for quite a few minutes (so likely hit the hourly GC runs). 11:20:09
@vcunat:matrix.orgVladimír Čunát * Yes, a few minutes ago again (step 97 here), a new ISO fail. The graphical ISOs seem to be quite a reliable test for this, as they have loads of dependencies and run for quite a few minutes (so likely hit the hourly GC runs). 11:20:18
@hexa:lossy.networkhexawe can gc less but harder on the linux fleet11:20:24
@vcunat:matrix.orgVladimír Čunát * Yes, a few minutes ago again, a new ISO fail (step 97 here). The graphical ISOs seem to be quite a reliable test for this, as they have loads of dependencies and run for quite a few minutes (so likely hit the hourly GC runs). 11:20:36
@hexa:lossy.networkhexaI can also roll out fast-nix-gc there next11:20:59
@vcunat:matrix.orgVladimír ČunátPerhaps that directly.11:21:17
@hexa:lossy.networkhexaok, ensure 30% free hourly11:21:43
@hexa:lossy.networkhexaand keep recent 72h11:21:47
@hexa:lossy.networkhexawe can tune that further as needed11:21:58
@vcunat:matrix.orgVladimír ČunátAt a glance this switch doesn't seem risky in comparison to the current state.11:22:12
@hexa:lossy.networkhexayeah, it isn't11:22:21
@vcunat:matrix.orgVladimír ČunátAnd it seems better in terms of moving the GC improvements forward.11:22:28
@csanthiago:matrix.org@csanthiago:matrix.org joined the room.12:29:14
@flokli:matrix.orgflokliaccording to https://hydra.nixos.org/job/nixos/unstable/tested#tabs-status, the latest jobset did succeed 21m ago, but https://status.nixos.org/ still lists it as 2 days ago. did some of the channel bump scripts fail again?12:30:05
@flokli:matrix.orgfloklior did it not advance because it contains https://hydra.nixos.org/build/332754507 (Cancelled by user), which has a cached failure?12:31:23
@hexa:lossy.networkhexa5207 remaining builds12:36:11
@hexa:lossy.networkhexaRedacted or Malformed Event12:36:18
@flokli:matrix.orgflokliso I'm reading the web interface wrong?12:36:44
@leona:leona.isleona

there are two criterias:

  • tested succeeded
  • no more builds are queued in the eval
12:37:12
@flokli:matrix.orgflokliok, where do I see what's still queued in the eval? :D12:38:04
@hexa:lossy.networkhexahttps://hydra.nixos.org/eval/182669412:38:22

Show newer messages


Back to Room ListRoom Version: 6