| 14 Jun 2022 |
 Dandellion | Jun 14 10:52:04 shamshel hydra-evaluator[540641]: received jobset event
Jun 14 10:52:08 shamshel systemd-coredump[584366]: [🡕] Process 572673 (hydra-eval-jobs) of user 122 dumped core.
Module linux-vdso.so.1 with build-id 6c0e862111f28db6e1fc56eeb58d78b3f972b2e9
Module libnss_dns.so.2 with build-id 4cf64d04903f014056834ce4883ee35583bef11e
Module libattr.so.1 without build-id.
Module libresolv.so.2 with build-id beb8c4c02165e47ea56feffb277397c06f0cf358
Module libkeyutils.so.1 without build-id.
Module libkrb5support.so.0 without build-id.
Module libcom_err.so.3 without build-id.
Module libk5crypto.so.3 without build-id.
Module libkrb5.so.3 without build-id.
Module libunistring.so.2 without build-id.
Module libxml2.so.2 without build-id.
Module libbz2.so.1 without build-id.
Module liblzma.so.5 without build-id.
Module libacl.so.1 without build-id.
Module libbrotlicommon.so.1 without build-id.
Module libaws-c-common.so.1 without build-id.
Module libaws-checksums.so.1.0.0 without build-id.
Module libaws-c-sdkutils.so.1.0.0 without build-id.
Module libaws-c-cal.so.1.0.0 without build-id.
Module libaws-c-compression.so.1.0.0 without build-id.
Module libs2n.so without build-id.
Module libaws-c-io.so.1.0.0 without build-id.
Module libaws-c-http.so.1.0.0 without build-id.
Module libaws-c-auth.so.1.0.0 without build-id.
Module libaws-c-s3.so.0unstable without build-id.
Module libaws-c-event-stream.so.1.0.0 without build-id.
Module libaws-c-mqtt.so.1.0.0 without build-id.
Module libaws-crt-cpp.so without build-id.
Module libzstd.so.1 without build-id.
Module libgssapi_krb5.so.2 without build-id.
Module libssl.so.1.1 with build-id c52fc890f3120a4972b33cd903314cab0323932e
Module libssh2.so.1 without build-id.
Module libidn2.so.0 without build-id.
Module libnghttp2.so.14 without build-id.
Module libz.so.1 without build-id.
Module librt.so.1 with build-id da2ef65b69044318885bc7288100812cf11e4f00
Module liblowdown.so.1 without build-id.
Module libarchive.so.13 without build-id.
Module libbrotlidec.so.1 without build-id.
Module libbrotlienc.so.1 without build-id.
Module libseccomp.so.2 without build-id.
Module libaws-cpp-sdk-core.so without build-id.
Module libaws-cpp-sdk-s3.so without build-id.
Module libaws-cpp-sdk-transfer.so without build-id.
Module libsodium.so.23 with build-id 791bb95fbaea66d82c59138bbac5178ebf732c95
Module libcurl.so.4 with build-id 2d528592775b6e4bf6c75cad78e6ecd15acc5a3b
Module libsqlite3.so.0 with build-id ce7af7f4c15d0e15f23f60c7e84578687987f56e
Module libnixfetchers.so with build-id 560d45fc909d81040bb24c2647ab038b9328f249
Module libboost_context.so.1.77.0 without build-id.
Module libcrypto.so.1.1 with build-id 5ab6bca63d85f5a58a5a0f66763b7a7bb02a28c1
Module libc.so.6 with build-id 7f07eb85ad3259c6e3abebcaf5817647034a230f
Module libgcc_s.so.1 without build-id.
Module libm.so.6 with build-id 853b5f6c106ec8f612c7bb20802ad99b3561d459
Module libstdc++.so.6 without build-id.
Module libnixcmd.so with build-id b9f4fe74c453ff01b554c2a4346c8f9e13044b28
Module libnixutil.so with build-id a80058ea0761b27e6ed6709dc720a8663a08a125
Module libnixstore.so with build-id 83a6a20688d4cb82873aa6f2d66a271e20a03d57
Module libdl.so.2 with build-id 509e420935dbc5093022f4bb264241f59fa558f2
Module libpthread.so.0 with build-id b5985ed17fa0c69f503ef0a8f7d2cfb26ba9eed0
Module libgc.so.1 with build-id c2200416104a2e997a1f1473ae4d11961aebc076
Module libnixexpr.so with build-id a58df57b8fa594721cc820b775c8796d8c18ca03
Module libnixmain.so with build-id 3acf4a106ca81223c4c29d53f29f2f9d04b3571b
Module hydra-eval-jobs without build-id.
Stack trace of thread 572673:
#0 0x0000ffffb49958d8 __pthread_kill_implementation (libc.so.6 + 0x7b8d8)
#1 0x0000ffffb49532b4 raise (libc.so.6 + 0x392b4)
#2 0x0000ffffb4940fd8 abort (libc.so.6 + 0x26fd8)
#3 0x0000ffffb52c0f70 GC_push_all_stacks (libgc.so.1 + 0x1cf70)
#4 0x0000ffffb52bc6b4 GC_mark_some (libgc.so.1 + 0x186b4)
#5 0x0000ffffb52bc858 GC_stopped_mark (libgc.so.1 + 0x18858)
#6 0x0000ffffb52bde2c GC_try_to_collect_inner (libgc.so.1 + 0x19e2c)
#7 0x0000ffffb52be234 GC_collect_or_expand (libgc.so.1 + 0x1a234)
#8 0x0000ffffb52be804 GC_alloc_large (libgc.so.1 + 0x1a804)
#9 0x0000ffffb52c2754 GC_generic_malloc (libgc.so.1 + 0x1e754)
#10 0x0000ffffb52c2a20 GC_malloc_kind_global (libgc.so.1 + 0x1ea20)
#11 0x0000ffffb55ccab0 _ZN3nix9EvalState13allocBindingsEm (libnixexpr.so + 0x96ab0)
#12 0x0000ffffb55e65d8 _ZN3nix12ExprOpUpdate4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xb05d8)
#13 0x0000ffffb55e157c _ZN3nix9EvalState12callFunctionERNS_5ValueEmPPS1_S2_RKNS_3PosE (libnixexpr.so + 0xab57c)
#14 0x0000ffffb55e23fc _ZN3nix8ExprCall4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xac3fc)
#15 0x0000ffffb55e6398 _ZN3nix7ExprVar4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xb0398)
#16 0x0000ffffb55e650c _ZN3nix12ExprOpUpdate4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xb050c)
#17 0x0000ffffb55e157c _ZN3nix9EvalState12callFunctionERNS_5ValueEmPPS1_S2_RKNS_3PosE (libnixexpr.so + 0xab57c)
#18 0x0000ffffb55e23fc _ZN3nix8ExprCall4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xac3fc)
#19 0x0000ffffb55e6398 _ZN3nix7ExprVar4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xb0398)
#20 0x0000ffffb55e650c _ZN3nix12ExprOpUpdate4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xb050c)
#21 0x0000ffffb55e157c _ZN3nix9EvalState12callFunctionERNS_5ValueEmPPS1_S2_RKNS_3PosE (libnixexpr.so + 0xab57c)
#22 0x0000ffffb55e23fc _ZN3nix8ExprCall4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xac3fc)
#23 0x0000ffffb55e6398 _ZN3nix7ExprVar4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xb0398)
#24 0x0000ffffb55e157c _ZN3nix9EvalState12callFunctionERNS_5ValueEmPPS1_S2_RKNS_3PosE (libnixexpr.so + 0xab57c)
#25 0x0000ffffb55e23fc _ZN3nix8ExprCall4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xac3fc)
#26 0x0000ffffb55e157c _ZN3nix9EvalState12callFunctionERNS_5ValueEmPPS1_S2_RKNS_3PosE (libnixexpr.so + 0xab57c)
#27 0x0000ffffb55e23fc _ZN3nix8ExprCall4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xac3fc)
#28 0x0000ffffb55e157c _ZN3nix9EvalState12callFunctionERNS_5ValueEmPPS1_S2_RKNS_3PosE (libnixexpr.so + 0xab57c)
#29 0x0000ffffb55e23fc _ZN3nix8ExprCall4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xac3fc)
#30 0x0000ffffb55e346c _ZN3nix6ExprIf4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xad46c)
#31 0x0000ffffb55e6398 _ZN3nix7ExprVar4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xb0398)
#32 0x0000ffffb55e157c _ZN3nix9EvalState12callFunctionERNS_5ValueEmPPS1_S2_RKNS_3PosE (libnixexpr.so + 0xab57c)
#33 0x0000ffffb55e23fc _ZN3nix8ExprCall4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xac3fc)
#34 0x0000ffffb55e6398 _ZN3nix7ExprVar4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xb0398)
#35 0x0000ffffb55e346c _ZN3nix6ExprIf4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xad46c)
#36 0x0000ffffb55e157c _ZN3nix9EvalState12callFunctionERNS_5ValueEmPPS1_S2_RKNS_3PosE (libnixexpr.so + 0xab57c)
#37 0x0000ffffb55e23fc _ZN3nix8ExprCall4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xac3fc)
#38 0x0000ffffb55e6398 _ZN3nix7ExprVar4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xb0398)
#39 0x0000ffffb55e54c4 _ZN3nix10ExprSelect4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xaf4c4)
#40 0x0000ffffb55e2af0 _ZN3nix8ExprOpEq4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xacaf0)
#41 0x0000ffffb55e3420 _ZN3nix6ExprIf4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xad420)
#42 0x0000ffffb55e5ac4 _ZN3nix10ExprSelect4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xafac4)
#43 0x0000ffffb55e36c8 _ZN3nix9ExprOpAnd4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xad6c8)
#44 0x0000ffffb55e6398 _ZN3nix7ExprVar4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xb0398)
#45 0x0000ffffb55e3504 _ZN3nix10ExprOpImpl4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xad504)
#46 0x0000ffffb55e406c _ZN3nix10ExprAssert4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xae06c)
#47 0x0000ffffb55e157c _ZN3nix9EvalState12callFunctionERNS_5ValueEmPPS1_S2_RKNS_3PosE (libnixexpr.so + 0xab57c)
#48 0x0000ffffb55e23fc _ZN3nix8ExprCall4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xac3fc)
#49 0x0000ffffb56769dc _ZN3nixL12prim_isAttrsERNS_9EvalStateERKNS_3PosEPPNS_5ValueERS5_ (libnixexpr.so + 0x1409dc)
#50 0x0000ffffb55e15bc _ZN3nix9EvalState12callFunctionERNS_5ValueEmPPS1_S2_RKNS_3PosE (libnixexpr.so + 0xab5bc)
#51 0x0000ffffb55e23fc _ZN3nix8ExprCall4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xac3fc)
#52 0x0000ffffb55e3420 _ZN3nix6ExprIf4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xad420)
#53 0x0000ffffb55e157c _ZN3nix9EvalState12callFunctionERNS_5ValueEmPPS1_S2_RKNS_3PosE (libnixexpr.so + 0xab57c)
#54 0x0000ffffb55e23fc _ZN3nix8ExprCall4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xac3fc)
#55 0x0000ffffb55e346c _ZN3nix6ExprIf4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xad46c)
#56 0x0000ffffb55e157c _ZN3nix9EvalState12callFunctionERNS_5ValueEmPPS1_S2_RKNS_3PosE (libnixexpr.so + 0xab57c)
#57 0x0000ffffb55e23fc _ZN3nix8ExprCall4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xac3fc)
#58 0x0000ffffb55e157c _ZN3nix9EvalState12callFunctionERNS_5ValueEmPPS1_S2_RKNS_3PosE (libnixexpr.so + 0xab57c)
#59 0x0000ffffb55e23fc _ZN3nix8ExprCall4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xac3fc)
#60 0x0000ffffb55e157c _ZN3nix9EvalState12callFunctionERNS_5ValueEmPPS1_S2_RKNS_3PosE (libnixexpr.so + 0xab57c)
#61 0x0000ffffb55e23fc _ZN3nix8ExprCall4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xac3fc)
#62 0x0000ffffb55e6398 _ZN3nix7ExprVar4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xb0398)
#63 0x0000ffffb55e650c _ZN3nix12ExprOpUpdate4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xb050c)
ELF object binary architecture: AARCH64
| 10:55:39 |
 kayla (she/they) | Can you get demangled symbols and line info somehow? Addr2line or alike? | 11:50:11 |
| Dandellion | mm, I'm not sure. I managed to get a backtrace with function names though: | 13:15:47 |
| Dandellion | https://gist.github.com/dali99/7b26639e7a8d114c70df2d1e8edb2a3e | 13:16:45 |
| Dandellion | https://gist.github.com/dali99/3b3a4dd8197508f21dee7c72a0617c9f | 22:10:15 |
| Dandellion | mah | 22:10:17 |
| Dandellion | * maybe it's related to #177660 | 22:12:58 |
| 15 Jun 2022 |
 kenran_ | I'm looking to replace a Hetzner Cloud VM that Hydra is running on with a dedicated server (in order to be able to use /dev/kvm). Do you know if https://nixos.wiki/wiki/Install_NixOS_on_Hetzner_Online is still up to date? | 06:53:52 |
| kenran_ | In particular, it links to a script mentioning
# * **Important:** We boot in legacy-BIOS mode, not UEFI, because that's what Hetzner uses.
# * NVMe devices aren't supported for booting (those require EFI boot)
| 06:55:14 |
| kenran_ | Hetzner for a while now mentions that they support UEFI boot natively. But I don't know what UEFI Rescue System is currently in the beta stage. means in this context. | 06:57:16 |
| kenran_ | I'm wondering if I can now order an small NVMe-using dedicated server there and install NixOS on it without ordering an additional HDD. | 06:57:56 |
| kenran_ | * I'm wondering if I can now order a small NVMe-using dedicated server there and install NixOS on it without ordering an additional HDD. | 06:58:03 |
 Rick (Mindavi) | In reply to @kenran_:matrix.org
Hetzner for a while now mentions that they support UEFI boot natively. But I don't know what UEFI Rescue System is currently in the beta stage. means in this context. Probably that the web-KVM environment is in a beta phase | 07:13:38 |
| Rick (Mindavi) | So if you lose access you may run into issues accessing via the web kvm | 07:14:00 |
| kenran_ | In reply to @rick:matrix.ciphernetics.nl
So if you lose access you may run into issues accessing via the web kvm I haven't ever actually used a dedicated server there, so I'm a bit anxious. I'd probably try the Bootstray from the Rescue System approach described in the Wiki above. Is that a good idea? | 07:15:37 |
| kenran_ | In reply to @rick:matrix.ciphernetics.nl
So if you lose access you may run into issues accessing via the web kvm * I haven't ever actually used a dedicated server there, so I'm a bit anxious. I'd probably try the Bootstrap from the Rescue System approach described in the Wiki above. Is that a good idea? | 07:22:52 |
| Rick (Mindavi) | Hopefully someone else can give some insight, I don't know that much about it otherwise | 07:24:17 |
| kenran_ | Thanks! | 07:31:47 |
| kenran_ | I'm just a little hesitant right now, but since the servers are payed hourly, there's probably not that much of a risk to just trying. | 07:44:50 |
 Sandro | I would just give it a try 🙃
Worst case you need to rebuild your cache but there shouldn't be any data loss. | 08:11:35 |
| kenran_ | Seems to have worked with some tiny changes (sudo wasn't there, slightly different commands and such). Woo! | 08:29:38 |
|  Florian | W3F changed their display name from Florian | W3F to Florian | OoO till 20.06.. | 09:21:15 |
 @linus:schreibt.jetzt | kenran_: huh, the dedicated servers aren't billed hourly..? | 12:37:50 |
| @linus:schreibt.jetzt | kenran_: are you talking about "dedicated" Hetzner Cloud instances? Because those aren't actually dedicated machines, they're just VMs with reserved CPU capacity | 12:39:17 |
| @linus:schreibt.jetzt | in any case, if you want UEFI boot on the "real" dedicated servers (ordered via robot.your-server.de, not console.hetzner.cloud, billed monthly) you need to open a support ticket iirc. | 12:40:30 |
 ajs124 | In reply to @linus:schreibt.jetzt
in any case, if you want UEFI boot on the "real" dedicated servers (ordered via robot.your-server.de, not console.hetzner.cloud, billed monthly) you need to open a support ticket iirc. you can enable it yourself through the remote kvm. you need to get access to the kvm through a ticket, though. | 12:41:08 |
| @linus:schreibt.jetzt | Either to get support to enable UEFI boot for you, or to get a KVM console through which you can access the firmware settings | 12:41:13 |
| @linus:schreibt.jetzt | I think if you get support to enable it for you, they might also do something with their netboot setup so that the rescue system still works for you? I'm not sure if that's needed or not | 12:41:50 |
| @linus:schreibt.jetzt | I'd recommend ordering a KVM console for the setup either way, because especially if you're doing it for the first time you're likely to end up needing it and it's nice not to have to wait for it in those situations :) | 12:42:38 |
| kenran_ | In reply to @linus:schreibt.jetzt
kenran_: huh, the dedicated servers aren't billed hourly..? Hum, are you sure? I could cancel the first one I ordered, it was removed instantly and a German FAQ entry seemed to say that we wouldn't have to pay the full amount. | 13:21:20 |
