!RROtHmAaQIkiJzJZZE:nixos.org

NixOS Infrastructure

390 Members
Next Infra call: 2024-07-11, 18:00 CEST (UTC+2) | Infra operational issues backlog: https://github.com/orgs/NixOS/projects/52 | See #infra-alerts:nixos.org for real time alerts from Prometheus.120 Servers

Load older messages


SenderMessageTime
10 Feb 2025
@Ericson2314:matrix.orgJohn Ericson @hexa:lossy.network: oh no, better roll back? I'm pretty busy with work today so can't immediately debug 17:21:31
@hexa:lossy.networkhexaok17:21:46
@Ericson2314:matrix.orgJohn Ericson I think the line is my $job = decode_json($out); 17:27:57
@Ericson2314:matrix.orgJohn Ericsonno idea where there would be invalid JSON17:28:32
@Ericson2314:matrix.orgJohn Ericsonbut I guess first step is to log in17:28:40
@Ericson2314:matrix.orgJohn Ericson * but I guess first step is to log it17:28:42
@Ericson2314:matrix.orgJohn Ericson * but I guess first step is to log it somehow17:28:44
@k900:0upti.meK900I'm going to guess that nej is crashing somehow 17:28:55
@k900:0upti.meK900And stopping mid-line17:29:01
@hexa:lossy.networkhexaswitched to a generation before nej17:33:47
@k900:0upti.meK900It ded17:34:23
@hexa:lossy.networkhexait is a the stopping step 😄 17:34:53
@hexa:lossy.networkhexaat least the errory is pretty17:35:12
@hexa:lossy.networkhexaand we're back17:37:20
@k900:0upti.meK900I've restarted the eval again 17:46:49
@hexa:lossy.networkhexahttps://github.com/NixOS/hydra/issues/143717:47:02
@k900:0upti.meK900Well eval hasn't died yet 18:00:05
@k900:0upti.meK900At least 18:00:07
11 Feb 2025
@infinisil:matrix.orginfinisil

From here

Lix is the Nix implementation which runs hydra.nixos.org

I'm doubting the accurancy of that:

  • https://hydra.nixos.org/ says "using nix-2.24.8" at the bottom
  • No mention of Lix in https://github.com/nixos/hydra
  • Only this singular use in infra, but I don't think that's used for actual evals, and that line was introduced without any discussion

Am I missing something?

22:08:15
@k900:0upti.meK900It's used on the builders because cppnix had a weird random segfault bug and that was the easiest thing we could do to get the builds going22:09:52
@k900:0upti.meK900The coordinator has to be cppnix because that's the only thing our hydra branch works with22:10:15
@infinisil:matrix.orginfinisilAh so evals are still done using Nix22:12:04
@infinisil:matrix.orginfinisil K900: Can you link me to the segfault issue? 22:12:26
@k900:0upti.meK900Not off the top of my head22:12:38
@k900:0upti.meK900 @hexa (signing key rotation when) or @John Ericson might have it? 22:13:16
@Ericson2314:matrix.orgJohn Ericson infinisil: K900 I do not know about this segfault issue 22:15:18
@Ericson2314:matrix.orgJohn Ericsonor this mixed lix nix deployment22:15:28
@Ericson2314:matrix.orgJohn Ericsonheh22:15:33
@infinisil:matrix.orginfinisilOpened a PR to document this: https://github.com/NixOS/infra/pull/55422:28:25
@roberthensing:matrix.orgRobert Hensing (roberth)same. A core dump and/or gdb stack trace would be very helpful22:48:31

Show newer messages


Back to Room ListRoom Version: 6