| 14 Jun 2022 |
kayla (she/they) | In reply to @dandellion:dodsorf.as
I'm trying to build a flake in hydra, but I'm having a lot of issues
When I evaluate I get
hydra-eval-jobs returned exit code 1:
Collecting from unknown thread
child process (309593) killed by signal=6
error: unexpected EOF reading a line
Has anyone seen aything like that before?
* Seems like some code in the hydra-eval-jobs worker process is calling abort(). I grepped for the Collecting from unknown thread and variations of that but didn't find anything on my first pass. ' | 09:43:25 |
kayla (she/they) | * Seems like some code in the hydra-eval-jobs worker process is calling abort(). I grepped for the Collecting from unknown thread and variations of that but didn't find anything on my first pass. | 09:43:45 |
Dandellion | When I try it manually in nix repl I get
downloading 'https://api.github.com/repos/vala-lang/tree-sitter-vala/tarball/c9eea93ba2ec4ec1485392db11945819779745b3'error: executing 'git': No such file or directory
error: program 'git' failed with exit code 1
but only when the evaluation is running on aarch64 not on x86_64
| 10:21:36 |
Dandellion | Jun 14 10:52:04 shamshel hydra-evaluator[540641]: received jobset event
Jun 14 10:52:08 shamshel systemd-coredump[584366]: [🡕] Process 572673 (hydra-eval-jobs) of user 122 dumped core.
Module linux-vdso.so.1 with build-id 6c0e862111f28db6e1fc56eeb58d78b3f972b2e9
Module libnss_dns.so.2 with build-id 4cf64d04903f014056834ce4883ee35583bef11e
Module libattr.so.1 without build-id.
Module libresolv.so.2 with build-id beb8c4c02165e47ea56feffb277397c06f0cf358
Module libkeyutils.so.1 without build-id.
Module libkrb5support.so.0 without build-id.
Module libcom_err.so.3 without build-id.
Module libk5crypto.so.3 without build-id.
Module libkrb5.so.3 without build-id.
Module libunistring.so.2 without build-id.
Module libxml2.so.2 without build-id.
Module libbz2.so.1 without build-id.
Module liblzma.so.5 without build-id.
Module libacl.so.1 without build-id.
Module libbrotlicommon.so.1 without build-id.
Module libaws-c-common.so.1 without build-id.
Module libaws-checksums.so.1.0.0 without build-id.
Module libaws-c-sdkutils.so.1.0.0 without build-id.
Module libaws-c-cal.so.1.0.0 without build-id.
Module libaws-c-compression.so.1.0.0 without build-id.
Module libs2n.so without build-id.
Module libaws-c-io.so.1.0.0 without build-id.
Module libaws-c-http.so.1.0.0 without build-id.
Module libaws-c-auth.so.1.0.0 without build-id.
Module libaws-c-s3.so.0unstable without build-id.
Module libaws-c-event-stream.so.1.0.0 without build-id.
Module libaws-c-mqtt.so.1.0.0 without build-id.
Module libaws-crt-cpp.so without build-id.
Module libzstd.so.1 without build-id.
Module libgssapi_krb5.so.2 without build-id.
Module libssl.so.1.1 with build-id c52fc890f3120a4972b33cd903314cab0323932e
Module libssh2.so.1 without build-id.
Module libidn2.so.0 without build-id.
Module libnghttp2.so.14 without build-id.
Module libz.so.1 without build-id.
Module librt.so.1 with build-id da2ef65b69044318885bc7288100812cf11e4f00
Module liblowdown.so.1 without build-id.
Module libarchive.so.13 without build-id.
Module libbrotlidec.so.1 without build-id.
Module libbrotlienc.so.1 without build-id.
Module libseccomp.so.2 without build-id.
Module libaws-cpp-sdk-core.so without build-id.
Module libaws-cpp-sdk-s3.so without build-id.
Module libaws-cpp-sdk-transfer.so without build-id.
Module libsodium.so.23 with build-id 791bb95fbaea66d82c59138bbac5178ebf732c95
Module libcurl.so.4 with build-id 2d528592775b6e4bf6c75cad78e6ecd15acc5a3b
Module libsqlite3.so.0 with build-id ce7af7f4c15d0e15f23f60c7e84578687987f56e
Module libnixfetchers.so with build-id 560d45fc909d81040bb24c2647ab038b9328f249
Module libboost_context.so.1.77.0 without build-id.
Module libcrypto.so.1.1 with build-id 5ab6bca63d85f5a58a5a0f66763b7a7bb02a28c1
Module libc.so.6 with build-id 7f07eb85ad3259c6e3abebcaf5817647034a230f
Module libgcc_s.so.1 without build-id.
Module libm.so.6 with build-id 853b5f6c106ec8f612c7bb20802ad99b3561d459
Module libstdc++.so.6 without build-id.
Module libnixcmd.so with build-id b9f4fe74c453ff01b554c2a4346c8f9e13044b28
Module libnixutil.so with build-id a80058ea0761b27e6ed6709dc720a8663a08a125
Module libnixstore.so with build-id 83a6a20688d4cb82873aa6f2d66a271e20a03d57
Module libdl.so.2 with build-id 509e420935dbc5093022f4bb264241f59fa558f2
Module libpthread.so.0 with build-id b5985ed17fa0c69f503ef0a8f7d2cfb26ba9eed0
Module libgc.so.1 with build-id c2200416104a2e997a1f1473ae4d11961aebc076
Module libnixexpr.so with build-id a58df57b8fa594721cc820b775c8796d8c18ca03
Module libnixmain.so with build-id 3acf4a106ca81223c4c29d53f29f2f9d04b3571b
Module hydra-eval-jobs without build-id.
Stack trace of thread 572673:
#0 0x0000ffffb49958d8 __pthread_kill_implementation (libc.so.6 + 0x7b8d8)
#1 0x0000ffffb49532b4 raise (libc.so.6 + 0x392b4)
#2 0x0000ffffb4940fd8 abort (libc.so.6 + 0x26fd8)
#3 0x0000ffffb52c0f70 GC_push_all_stacks (libgc.so.1 + 0x1cf70)
#4 0x0000ffffb52bc6b4 GC_mark_some (libgc.so.1 + 0x186b4)
#5 0x0000ffffb52bc858 GC_stopped_mark (libgc.so.1 + 0x18858)
#6 0x0000ffffb52bde2c GC_try_to_collect_inner (libgc.so.1 + 0x19e2c)
#7 0x0000ffffb52be234 GC_collect_or_expand (libgc.so.1 + 0x1a234)
#8 0x0000ffffb52be804 GC_alloc_large (libgc.so.1 + 0x1a804)
#9 0x0000ffffb52c2754 GC_generic_malloc (libgc.so.1 + 0x1e754)
#10 0x0000ffffb52c2a20 GC_malloc_kind_global (libgc.so.1 + 0x1ea20)
#11 0x0000ffffb55ccab0 _ZN3nix9EvalState13allocBindingsEm (libnixexpr.so + 0x96ab0)
#12 0x0000ffffb55e65d8 _ZN3nix12ExprOpUpdate4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xb05d8)
#13 0x0000ffffb55e157c _ZN3nix9EvalState12callFunctionERNS_5ValueEmPPS1_S2_RKNS_3PosE (libnixexpr.so + 0xab57c)
#14 0x0000ffffb55e23fc _ZN3nix8ExprCall4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xac3fc)
#15 0x0000ffffb55e6398 _ZN3nix7ExprVar4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xb0398)
#16 0x0000ffffb55e650c _ZN3nix12ExprOpUpdate4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xb050c)
#17 0x0000ffffb55e157c _ZN3nix9EvalState12callFunctionERNS_5ValueEmPPS1_S2_RKNS_3PosE (libnixexpr.so + 0xab57c)
#18 0x0000ffffb55e23fc _ZN3nix8ExprCall4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xac3fc)
#19 0x0000ffffb55e6398 _ZN3nix7ExprVar4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xb0398)
#20 0x0000ffffb55e650c _ZN3nix12ExprOpUpdate4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xb050c)
#21 0x0000ffffb55e157c _ZN3nix9EvalState12callFunctionERNS_5ValueEmPPS1_S2_RKNS_3PosE (libnixexpr.so + 0xab57c)
#22 0x0000ffffb55e23fc _ZN3nix8ExprCall4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xac3fc)
#23 0x0000ffffb55e6398 _ZN3nix7ExprVar4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xb0398)
#24 0x0000ffffb55e157c _ZN3nix9EvalState12callFunctionERNS_5ValueEmPPS1_S2_RKNS_3PosE (libnixexpr.so + 0xab57c)
#25 0x0000ffffb55e23fc _ZN3nix8ExprCall4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xac3fc)
#26 0x0000ffffb55e157c _ZN3nix9EvalState12callFunctionERNS_5ValueEmPPS1_S2_RKNS_3PosE (libnixexpr.so + 0xab57c)
#27 0x0000ffffb55e23fc _ZN3nix8ExprCall4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xac3fc)
#28 0x0000ffffb55e157c _ZN3nix9EvalState12callFunctionERNS_5ValueEmPPS1_S2_RKNS_3PosE (libnixexpr.so + 0xab57c)
#29 0x0000ffffb55e23fc _ZN3nix8ExprCall4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xac3fc)
#30 0x0000ffffb55e346c _ZN3nix6ExprIf4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xad46c)
#31 0x0000ffffb55e6398 _ZN3nix7ExprVar4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xb0398)
#32 0x0000ffffb55e157c _ZN3nix9EvalState12callFunctionERNS_5ValueEmPPS1_S2_RKNS_3PosE (libnixexpr.so + 0xab57c)
#33 0x0000ffffb55e23fc _ZN3nix8ExprCall4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xac3fc)
#34 0x0000ffffb55e6398 _ZN3nix7ExprVar4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xb0398)
#35 0x0000ffffb55e346c _ZN3nix6ExprIf4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xad46c)
#36 0x0000ffffb55e157c _ZN3nix9EvalState12callFunctionERNS_5ValueEmPPS1_S2_RKNS_3PosE (libnixexpr.so + 0xab57c)
#37 0x0000ffffb55e23fc _ZN3nix8ExprCall4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xac3fc)
#38 0x0000ffffb55e6398 _ZN3nix7ExprVar4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xb0398)
#39 0x0000ffffb55e54c4 _ZN3nix10ExprSelect4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xaf4c4)
#40 0x0000ffffb55e2af0 _ZN3nix8ExprOpEq4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xacaf0)
#41 0x0000ffffb55e3420 _ZN3nix6ExprIf4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xad420)
#42 0x0000ffffb55e5ac4 _ZN3nix10ExprSelect4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xafac4)
#43 0x0000ffffb55e36c8 _ZN3nix9ExprOpAnd4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xad6c8)
#44 0x0000ffffb55e6398 _ZN3nix7ExprVar4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xb0398)
#45 0x0000ffffb55e3504 _ZN3nix10ExprOpImpl4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xad504)
#46 0x0000ffffb55e406c _ZN3nix10ExprAssert4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xae06c)
#47 0x0000ffffb55e157c _ZN3nix9EvalState12callFunctionERNS_5ValueEmPPS1_S2_RKNS_3PosE (libnixexpr.so + 0xab57c)
#48 0x0000ffffb55e23fc _ZN3nix8ExprCall4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xac3fc)
#49 0x0000ffffb56769dc _ZN3nixL12prim_isAttrsERNS_9EvalStateERKNS_3PosEPPNS_5ValueERS5_ (libnixexpr.so + 0x1409dc)
#50 0x0000ffffb55e15bc _ZN3nix9EvalState12callFunctionERNS_5ValueEmPPS1_S2_RKNS_3PosE (libnixexpr.so + 0xab5bc)
#51 0x0000ffffb55e23fc _ZN3nix8ExprCall4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xac3fc)
#52 0x0000ffffb55e3420 _ZN3nix6ExprIf4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xad420)
#53 0x0000ffffb55e157c _ZN3nix9EvalState12callFunctionERNS_5ValueEmPPS1_S2_RKNS_3PosE (libnixexpr.so + 0xab57c)
#54 0x0000ffffb55e23fc _ZN3nix8ExprCall4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xac3fc)
#55 0x0000ffffb55e346c _ZN3nix6ExprIf4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xad46c)
#56 0x0000ffffb55e157c _ZN3nix9EvalState12callFunctionERNS_5ValueEmPPS1_S2_RKNS_3PosE (libnixexpr.so + 0xab57c)
#57 0x0000ffffb55e23fc _ZN3nix8ExprCall4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xac3fc)
#58 0x0000ffffb55e157c _ZN3nix9EvalState12callFunctionERNS_5ValueEmPPS1_S2_RKNS_3PosE (libnixexpr.so + 0xab57c)
#59 0x0000ffffb55e23fc _ZN3nix8ExprCall4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xac3fc)
#60 0x0000ffffb55e157c _ZN3nix9EvalState12callFunctionERNS_5ValueEmPPS1_S2_RKNS_3PosE (libnixexpr.so + 0xab57c)
#61 0x0000ffffb55e23fc _ZN3nix8ExprCall4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xac3fc)
#62 0x0000ffffb55e6398 _ZN3nix7ExprVar4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xb0398)
#63 0x0000ffffb55e650c _ZN3nix12ExprOpUpdate4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xb050c)
ELF object binary architecture: AARCH64
| 10:55:39 |
kayla (she/they) | Can you get demangled symbols and line info somehow? Addr2line or alike? | 11:50:11 |
Dandellion | mm, I'm not sure. I managed to get a backtrace with function names though: | 13:15:47 |
Dandellion | https://gist.github.com/dali99/7b26639e7a8d114c70df2d1e8edb2a3e | 13:16:45 |
Dandellion | https://gist.github.com/dali99/3b3a4dd8197508f21dee7c72a0617c9f | 22:10:15 |
Dandellion | mah | 22:10:17 |
Dandellion | * maybe it's related to #177660 | 22:12:58 |
| 15 Jun 2022 |
kenran_ | I'm looking to replace a Hetzner Cloud VM that Hydra is running on with a dedicated server (in order to be able to use /dev/kvm). Do you know if https://nixos.wiki/wiki/Install_NixOS_on_Hetzner_Online is still up to date? | 06:53:52 |
kenran_ | In particular, it links to a script mentioning
# * **Important:** We boot in legacy-BIOS mode, not UEFI, because that's what Hetzner uses.
# * NVMe devices aren't supported for booting (those require EFI boot)
| 06:55:14 |
kenran_ | Hetzner for a while now mentions that they support UEFI boot natively. But I don't know what UEFI Rescue System is currently in the beta stage. means in this context. | 06:57:16 |
kenran_ | I'm wondering if I can now order an small NVMe-using dedicated server there and install NixOS on it without ordering an additional HDD. | 06:57:56 |
kenran_ | * I'm wondering if I can now order a small NVMe-using dedicated server there and install NixOS on it without ordering an additional HDD. | 06:58:03 |
Rick (Mindavi) | In reply to @kenran_:matrix.org Hetzner for a while now mentions that they support UEFI boot natively. But I don't know what UEFI Rescue System is currently in the beta stage. means in this context. Probably that the web-KVM environment is in a beta phase | 07:13:38 |
Rick (Mindavi) | So if you lose access you may run into issues accessing via the web kvm | 07:14:00 |
kenran_ | In reply to @rick:matrix.ciphernetics.nl So if you lose access you may run into issues accessing via the web kvm I haven't ever actually used a dedicated server there, so I'm a bit anxious. I'd probably try the Bootstray from the Rescue System approach described in the Wiki above. Is that a good idea? | 07:15:37 |
kenran_ | In reply to @rick:matrix.ciphernetics.nl So if you lose access you may run into issues accessing via the web kvm * I haven't ever actually used a dedicated server there, so I'm a bit anxious. I'd probably try the Bootstrap from the Rescue System approach described in the Wiki above. Is that a good idea? | 07:22:52 |
Rick (Mindavi) | Hopefully someone else can give some insight, I don't know that much about it otherwise | 07:24:17 |
kenran_ | Thanks! | 07:31:47 |
kenran_ | I'm just a little hesitant right now, but since the servers are payed hourly, there's probably not that much of a risk to just trying. | 07:44:50 |
Sandro | I would just give it a try 🙃 Worst case you need to rebuild your cache but there shouldn't be any data loss. | 08:11:35 |
kenran_ | Seems to have worked with some tiny changes (sudo wasn't there, slightly different commands and such). Woo! | 08:29:38 |
| Florian | W3F changed their display name from Florian | W3F to Florian | OoO till 20.06.. | 09:21:15 |
@linus:schreibt.jetzt | kenran_: huh, the dedicated servers aren't billed hourly..? | 12:37:50 |
@linus:schreibt.jetzt | kenran_: are you talking about "dedicated" Hetzner Cloud instances? Because those aren't actually dedicated machines, they're just VMs with reserved CPU capacity | 12:39:17 |
@linus:schreibt.jetzt | in any case, if you want UEFI boot on the "real" dedicated servers (ordered via robot.your-server.de, not console.hetzner.cloud, billed monthly) you need to open a support ticket iirc. | 12:40:30 |
ajs124 | In reply to @linus:schreibt.jetzt in any case, if you want UEFI boot on the "real" dedicated servers (ordered via robot.your-server.de, not console.hetzner.cloud, billed monthly) you need to open a support ticket iirc. you can enable it yourself through the remote kvm. you need to get access to the kvm through a ticket, though. | 12:41:08 |
@linus:schreibt.jetzt | Either to get support to enable UEFI boot for you, or to get a KVM console through which you can access the firmware settings | 12:41:13 |