!RROtHmAaQIkiJzJZZE:nixos.org

NixOS Infrastructure

412 Members
Next Infra call: 2024-07-11, 18:00 CEST (UTC+2) | Infra operational issues backlog: https://github.com/orgs/NixOS/projects/52 | See #infra-alerts:nixos.org for real time alerts from Prometheus.128 Servers

Load older messages


SenderMessageTime
27 Apr 2026
@cat:antechamber.partycat joined the room.11:11:09
@cat:antechamber.partycat Hopefully this is the right place to mention this sort of thing:
It looks to me that https://hydra.nixos.org/build/327520751 has been running an infinite loop for ~17 hours due to the tests for haskellPackages.lager.x86_64-linux.
11:16:28
@hexa:lossy.networkhexayeah11:16:45
@hexa:lossy.networkhexa sterni? 11:16:54
@sternenseemann:systemli.orgsternibeautiful11:17:44
@sternenseemann:systemli.orgsterniisn’t the timeout 3h though or just if there’s no log output?11:18:03
@hexa:lossy.networkhexano log11:18:09
@hexa:lossy.networkhexa2h on darwin, 3h on linux11:19:13
@hexa:lossy.networkhexawe could add a global timeout, but11:19:21
@hexa:lossy.networkhexaat 24h or so11:19:31
@sternenseemann:systemli.orgsterniah test suite that never passes incredible11:19:47
@hexa:lossy.networkhexawe generally notice extremly long running builds and kill/poke11:20:02
@hexa:lossy.networkhexathey are fairly rare, so it has not been a huge problem11:20:19
@hexa:lossy.networkhexaand having some visiblity is better than ignoring them11:20:36
@corngood:corngood.com@corngood:corngood.com left the room.11:23:34
@mynacol:mynacol.xyzmynacol

Were all the builder very busy the last hours? All the rusty-v8 builds for deno 2.7.13 failed, almost all on timeouts. At that build point in the logs, the major compilation work happens without any log output, but that should only take 30 min at max (more like 20 min IME). Maybe restart these jobs and/or increase the timeout for that derivation?

  • https://hydra.nixos.org/build/327593597
  • https://hydra.nixos.org/build/327607910
  • https://hydra.nixos.org/build/327607913
  • https://hydra.nixos.org/build/327607911
14:22:18
@hexa:lossy.networkhexathey all get stuck at temporal_capi14:23:36
@hexa:lossy.networkhexaso I suspect silent timeout14:23:42
@hexa:lossy.networkhexa^14:23:49
@hexa:lossy.networkhexaare our builders busy? yes, generally they are.14:24:06
@leona:leona.isleonaand they run not on big-parallel, that means very few cores. Compile likely takes longer than you think.14:24:15
@hexa:lossy.networkhexanormal builds get 2 cores14:24:20
@mynacol:mynacol.xyzmynacolAhh, that probably explains it. Shall I move it to big-parallel? (it's still smaller than firefox/chromium)14:25:08
@mynacol:mynacol.xyzmynacol* Ahh, that probably explains it. Shall I move it to big-parallel? (it's still a lot smaller than firefox/chromium)14:25:19
@hexa:lossy.networkhexaright now 59 packages have the big-parallel flag 🤔14:26:34
@vcunat:matrix.orgVladimír ČunátI'd say that if build without the flag takes hours and the flag speeds it up very significantly, we'd better add the flag.14:28:25
@vcunat:matrix.orgVladimír Čunát* I'd say that if a build without the flag takes hours and the flag speeds it up very significantly, we'd better add the flag.14:28:31
@vcunat:matrix.orgVladimír Čunát* I'd say that when a build without the flag takes hours and the flag speeds it up very significantly, we'd better add the flag.14:28:39
@mynacol:mynacol.xyzmynacolOr just increase the the timeout. (My compiles with 32 core somewhat older intel take 30 min for rusty-v8 and 1h for deno, and for comparison 1-2h (depending on pgo double-runs) on mullvad-browser)14:28:53
@mynacol:mynacol.xyzmynacol* Or just increase the timeout. (My compiles with 32 core ~~somewhat older~~ intel Xeon E5-2630 v3 take 30 min for rusty-v8 and 1h for deno, and for comparison 1-2h (depending on pgo double-runs) on mullvad-browser)14:32:20

Show newer messages


Back to Room ListRoom Version: 6