| 12 Jun 2022 |
 lewo | kenran_: having kvm in system-features is not enough to ensure Nix have enough permissions on /dev/kvm (if nested KVM is provided by your cloud provider) | 19:36:15 |
 kenran_ | In reply to @ulrikstrid:matrix.org
I manage my computers with flakes and want to have my hydra build the configurations and ideally I would deploy from that Oh, that sounds very nice! I'm interested in knowing more now, too!
Is the building part just adding a hydraJobs.my-host.${system} = self.nixosConfigurations.my-host? | 19:36:28 |
 das_j | In reply to @lewo:matrix.org
kenran_: having kvm in system-features is not enough to ensure Nix have enough permissions on /dev/kvm (if nested KVM is provided by your cloud provider) Adding kvm to the system features is already wrong. Nix autodetects kvm and adds the feature | 19:36:46 |
| lewo | kenran_: and if KVM is not available, it can be pretty hard to get NixOS test working. | 19:37:08 |
| das_j | In reply to @janne.hess:helsinki-systems.de
Adding kvm to the system features is already wrong. Nix autodetects kvm and adds the feature https://github.com/NixOS/nix/blob/master/src/libstore/globals.cc#L128-L129 | 19:37:33 |
| kenran_ | In reply to @lewo:matrix.org
kenran_: having kvm in system-features is not enough to ensure Nix have enough permissions on /dev/kvm (if nested KVM is provided by your cloud provider) I probably know way too little about kvm, but I was under the impression (someone in the nixos channel told me) that they should be running even without "actual" kvm support.
Surely you're right of course. I'm just trying to understand: does that explain why some versions of the tests work, but others don't? | 19:38:35 |
 ajs124 | vm tests should run, just very very veeeeeryyyy slow | 19:39:07 |
| lewo | KVM provide hardware acceleration of virtualization functions. So, if you don't have it, it can be really slow (order of magnitude)... | 19:39:50 |
| lewo | * KVM provides hardware acceleration of virtualization functions. So, if you don't have it, it can be really slow (order of magnitude)... | 19:40:00 |
| kenran_ | In reply to @andreas.schraegle:helsinki-systems.de
vm tests should run, just very very veeeeeryyyy slow Yeah, that's what I saw happening :D veeeeerry slow indeed! The same 5-minute test runs in like 15 seconds on my machine. | 19:40:09 |
| lewo | So, fisrt, you need to be sure KVM is available. | 19:41:52 |
| kenran_ | Ok, so thanks! I know what I can try first: this hydra instance is something I set up to test how things work, and if you can use it for some projects at work, and I'm loving it so far (except for those NixOS tests).
I don't think the provider enables kvm for that kind of virtual machine, though, so I'll have to see what other options there are to set it up on. | 19:41:56 |
| kenran_ | * Ok, so thanks! I know what I can try first: this hydra instance is something I set up to test how things work, and if we can use it for some projects at work, and I'm loving it so far (except for those NixOS tests).
I don't think the provider enables kvm for that kind of virtual machine, though, so I'll have to see what other options there are to set it up on. | 19:42:15 |
| kenran_ | And when that's done and the tests run: fine! If not, I can come here and try to pester you with questions again :) | 19:42:54 |
 @ulrikstrid:matrix.org | In reply to @kenran_:matrix.org
Oh, that sounds very nice! I'm interested in knowing more now, too!
Is the building part just adding a hydraJobs.my-host.${system} = self.nixosConfigurations.my-host? servern = self.nixosConfigurations.servern.config.system.build.toplevel;
This seems to build it, but it looks very hacky and I'm not sure I can use it to deploy anything 🤪 | 20:13:12 |
| @ulrikstrid:matrix.org | From here https://github.com/ulrikstrid/nix-config/blob/main/flake.nix#L119-L122 | 20:13:30 |
| kenran_ | In reply to @ulrikstrid:matrix.org
servern = self.nixosConfigurations.servern.config.system.build.toplevel;
This seems to build it, but it looks very hacky and I'm not sure I can use it to deploy anything 🤪 Oh yeah, this looks awful :D but have you tried doing anything with it? Say, nixos-rebuild switch --flake .#hydraJobs.servern.x86_64-linux, for science? | 20:15:07 |
| @ulrikstrid:matrix.org | Not at my computer but can try out tomorrow morning | 20:21:34 |
| @ulrikstrid:matrix.org | My hydra builds or btw, but the output is < 1mb | 20:22:17 |
| @ulrikstrid:matrix.org | The closure is in the GB range so I'm pretty sure it's building | 20:22:43 |
| 13 Jun 2022 |
 Dandellion | I'm trying to build a flake in hydra, but I'm having a lot of issues
When I evaluate I get
hydra-eval-jobs returned exit code 1:
Collecting from unknown thread
child process (309593) killed by signal=6
error: unexpected EOF reading a line
Has anyone seen aything like that before?
| 21:16:03 |
| 14 Jun 2022 |
 kayla (she/they) | In reply to @dandellion:dodsorf.as
I'm trying to build a flake in hydra, but I'm having a lot of issues
When I evaluate I get
hydra-eval-jobs returned exit code 1:
Collecting from unknown thread
child process (309593) killed by signal=6
error: unexpected EOF reading a line
Has anyone seen aything like that before?
Seems like some code in the hydra-eval-jobs worker thread is calling abort(). I grepped for the Collecting from unknown thread and variations of that but didn't find anything on my first pass. ' | 09:43:11 |
| kayla (she/they) | In reply to @dandellion:dodsorf.as
I'm trying to build a flake in hydra, but I'm having a lot of issues
When I evaluate I get
hydra-eval-jobs returned exit code 1:
Collecting from unknown thread
child process (309593) killed by signal=6
error: unexpected EOF reading a line
Has anyone seen aything like that before?
* Seems like some code in the hydra-eval-jobs worker process is calling abort(). I grepped for the Collecting from unknown thread and variations of that but didn't find anything on my first pass. ' | 09:43:25 |
| kayla (she/they) | * Seems like some code in the hydra-eval-jobs worker process is calling abort(). I grepped for the Collecting from unknown thread and variations of that but didn't find anything on my first pass. | 09:43:45 |
| Dandellion | When I try it manually in nix repl I get
downloading 'https://api.github.com/repos/vala-lang/tree-sitter-vala/tarball/c9eea93ba2ec4ec1485392db11945819779745b3'error: executing 'git': No such file or directory
error: program 'git' failed with exit code 1
but only when the evaluation is running on aarch64 not on x86_64
| 10:21:36 |
| Dandellion | Jun 14 10:52:04 shamshel hydra-evaluator[540641]: received jobset event
Jun 14 10:52:08 shamshel systemd-coredump[584366]: [🡕] Process 572673 (hydra-eval-jobs) of user 122 dumped core.
Module linux-vdso.so.1 with build-id 6c0e862111f28db6e1fc56eeb58d78b3f972b2e9
Module libnss_dns.so.2 with build-id 4cf64d04903f014056834ce4883ee35583bef11e
Module libattr.so.1 without build-id.
Module libresolv.so.2 with build-id beb8c4c02165e47ea56feffb277397c06f0cf358
Module libkeyutils.so.1 without build-id.
Module libkrb5support.so.0 without build-id.
Module libcom_err.so.3 without build-id.
Module libk5crypto.so.3 without build-id.
Module libkrb5.so.3 without build-id.
Module libunistring.so.2 without build-id.
Module libxml2.so.2 without build-id.
Module libbz2.so.1 without build-id.
Module liblzma.so.5 without build-id.
Module libacl.so.1 without build-id.
Module libbrotlicommon.so.1 without build-id.
Module libaws-c-common.so.1 without build-id.
Module libaws-checksums.so.1.0.0 without build-id.
Module libaws-c-sdkutils.so.1.0.0 without build-id.
Module libaws-c-cal.so.1.0.0 without build-id.
Module libaws-c-compression.so.1.0.0 without build-id.
Module libs2n.so without build-id.
Module libaws-c-io.so.1.0.0 without build-id.
Module libaws-c-http.so.1.0.0 without build-id.
Module libaws-c-auth.so.1.0.0 without build-id.
Module libaws-c-s3.so.0unstable without build-id.
Module libaws-c-event-stream.so.1.0.0 without build-id.
Module libaws-c-mqtt.so.1.0.0 without build-id.
Module libaws-crt-cpp.so without build-id.
Module libzstd.so.1 without build-id.
Module libgssapi_krb5.so.2 without build-id.
Module libssl.so.1.1 with build-id c52fc890f3120a4972b33cd903314cab0323932e
Module libssh2.so.1 without build-id.
Module libidn2.so.0 without build-id.
Module libnghttp2.so.14 without build-id.
Module libz.so.1 without build-id.
Module librt.so.1 with build-id da2ef65b69044318885bc7288100812cf11e4f00
Module liblowdown.so.1 without build-id.
Module libarchive.so.13 without build-id.
Module libbrotlidec.so.1 without build-id.
Module libbrotlienc.so.1 without build-id.
Module libseccomp.so.2 without build-id.
Module libaws-cpp-sdk-core.so without build-id.
Module libaws-cpp-sdk-s3.so without build-id.
Module libaws-cpp-sdk-transfer.so without build-id.
Module libsodium.so.23 with build-id 791bb95fbaea66d82c59138bbac5178ebf732c95
Module libcurl.so.4 with build-id 2d528592775b6e4bf6c75cad78e6ecd15acc5a3b
Module libsqlite3.so.0 with build-id ce7af7f4c15d0e15f23f60c7e84578687987f56e
Module libnixfetchers.so with build-id 560d45fc909d81040bb24c2647ab038b9328f249
Module libboost_context.so.1.77.0 without build-id.
Module libcrypto.so.1.1 with build-id 5ab6bca63d85f5a58a5a0f66763b7a7bb02a28c1
Module libc.so.6 with build-id 7f07eb85ad3259c6e3abebcaf5817647034a230f
Module libgcc_s.so.1 without build-id.
Module libm.so.6 with build-id 853b5f6c106ec8f612c7bb20802ad99b3561d459
Module libstdc++.so.6 without build-id.
Module libnixcmd.so with build-id b9f4fe74c453ff01b554c2a4346c8f9e13044b28
Module libnixutil.so with build-id a80058ea0761b27e6ed6709dc720a8663a08a125
Module libnixstore.so with build-id 83a6a20688d4cb82873aa6f2d66a271e20a03d57
Module libdl.so.2 with build-id 509e420935dbc5093022f4bb264241f59fa558f2
Module libpthread.so.0 with build-id b5985ed17fa0c69f503ef0a8f7d2cfb26ba9eed0
Module libgc.so.1 with build-id c2200416104a2e997a1f1473ae4d11961aebc076
Module libnixexpr.so with build-id a58df57b8fa594721cc820b775c8796d8c18ca03
Module libnixmain.so with build-id 3acf4a106ca81223c4c29d53f29f2f9d04b3571b
Module hydra-eval-jobs without build-id.
Stack trace of thread 572673:
#0 0x0000ffffb49958d8 __pthread_kill_implementation (libc.so.6 + 0x7b8d8)
#1 0x0000ffffb49532b4 raise (libc.so.6 + 0x392b4)
#2 0x0000ffffb4940fd8 abort (libc.so.6 + 0x26fd8)
#3 0x0000ffffb52c0f70 GC_push_all_stacks (libgc.so.1 + 0x1cf70)
#4 0x0000ffffb52bc6b4 GC_mark_some (libgc.so.1 + 0x186b4)
#5 0x0000ffffb52bc858 GC_stopped_mark (libgc.so.1 + 0x18858)
#6 0x0000ffffb52bde2c GC_try_to_collect_inner (libgc.so.1 + 0x19e2c)
#7 0x0000ffffb52be234 GC_collect_or_expand (libgc.so.1 + 0x1a234)
#8 0x0000ffffb52be804 GC_alloc_large (libgc.so.1 + 0x1a804)
#9 0x0000ffffb52c2754 GC_generic_malloc (libgc.so.1 + 0x1e754)
#10 0x0000ffffb52c2a20 GC_malloc_kind_global (libgc.so.1 + 0x1ea20)
#11 0x0000ffffb55ccab0 _ZN3nix9EvalState13allocBindingsEm (libnixexpr.so + 0x96ab0)
#12 0x0000ffffb55e65d8 _ZN3nix12ExprOpUpdate4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xb05d8)
#13 0x0000ffffb55e157c _ZN3nix9EvalState12callFunctionERNS_5ValueEmPPS1_S2_RKNS_3PosE (libnixexpr.so + 0xab57c)
#14 0x0000ffffb55e23fc _ZN3nix8ExprCall4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xac3fc)
#15 0x0000ffffb55e6398 _ZN3nix7ExprVar4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xb0398)
#16 0x0000ffffb55e650c _ZN3nix12ExprOpUpdate4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xb050c)
#17 0x0000ffffb55e157c _ZN3nix9EvalState12callFunctionERNS_5ValueEmPPS1_S2_RKNS_3PosE (libnixexpr.so + 0xab57c)
#18 0x0000ffffb55e23fc _ZN3nix8ExprCall4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xac3fc)
#19 0x0000ffffb55e6398 _ZN3nix7ExprVar4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xb0398)
#20 0x0000ffffb55e650c _ZN3nix12ExprOpUpdate4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xb050c)
#21 0x0000ffffb55e157c _ZN3nix9EvalState12callFunctionERNS_5ValueEmPPS1_S2_RKNS_3PosE (libnixexpr.so + 0xab57c)
#22 0x0000ffffb55e23fc _ZN3nix8ExprCall4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xac3fc)
#23 0x0000ffffb55e6398 _ZN3nix7ExprVar4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xb0398)
#24 0x0000ffffb55e157c _ZN3nix9EvalState12callFunctionERNS_5ValueEmPPS1_S2_RKNS_3PosE (libnixexpr.so + 0xab57c)
#25 0x0000ffffb55e23fc _ZN3nix8ExprCall4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xac3fc)
#26 0x0000ffffb55e157c _ZN3nix9EvalState12callFunctionERNS_5ValueEmPPS1_S2_RKNS_3PosE (libnixexpr.so + 0xab57c)
#27 0x0000ffffb55e23fc _ZN3nix8ExprCall4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xac3fc)
#28 0x0000ffffb55e157c _ZN3nix9EvalState12callFunctionERNS_5ValueEmPPS1_S2_RKNS_3PosE (libnixexpr.so + 0xab57c)
#29 0x0000ffffb55e23fc _ZN3nix8ExprCall4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xac3fc)
#30 0x0000ffffb55e346c _ZN3nix6ExprIf4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xad46c)
#31 0x0000ffffb55e6398 _ZN3nix7ExprVar4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xb0398)
#32 0x0000ffffb55e157c _ZN3nix9EvalState12callFunctionERNS_5ValueEmPPS1_S2_RKNS_3PosE (libnixexpr.so + 0xab57c)
#33 0x0000ffffb55e23fc _ZN3nix8ExprCall4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xac3fc)
#34 0x0000ffffb55e6398 _ZN3nix7ExprVar4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xb0398)
#35 0x0000ffffb55e346c _ZN3nix6ExprIf4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xad46c)
#36 0x0000ffffb55e157c _ZN3nix9EvalState12callFunctionERNS_5ValueEmPPS1_S2_RKNS_3PosE (libnixexpr.so + 0xab57c)
#37 0x0000ffffb55e23fc _ZN3nix8ExprCall4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xac3fc)
#38 0x0000ffffb55e6398 _ZN3nix7ExprVar4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xb0398)
#39 0x0000ffffb55e54c4 _ZN3nix10ExprSelect4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xaf4c4)
#40 0x0000ffffb55e2af0 _ZN3nix8ExprOpEq4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xacaf0)
#41 0x0000ffffb55e3420 _ZN3nix6ExprIf4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xad420)
#42 0x0000ffffb55e5ac4 _ZN3nix10ExprSelect4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xafac4)
#43 0x0000ffffb55e36c8 _ZN3nix9ExprOpAnd4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xad6c8)
#44 0x0000ffffb55e6398 _ZN3nix7ExprVar4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xb0398)
#45 0x0000ffffb55e3504 _ZN3nix10ExprOpImpl4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xad504)
#46 0x0000ffffb55e406c _ZN3nix10ExprAssert4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xae06c)
#47 0x0000ffffb55e157c _ZN3nix9EvalState12callFunctionERNS_5ValueEmPPS1_S2_RKNS_3PosE (libnixexpr.so + 0xab57c)
#48 0x0000ffffb55e23fc _ZN3nix8ExprCall4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xac3fc)
#49 0x0000ffffb56769dc _ZN3nixL12prim_isAttrsERNS_9EvalStateERKNS_3PosEPPNS_5ValueERS5_ (libnixexpr.so + 0x1409dc)
#50 0x0000ffffb55e15bc _ZN3nix9EvalState12callFunctionERNS_5ValueEmPPS1_S2_RKNS_3PosE (libnixexpr.so + 0xab5bc)
#51 0x0000ffffb55e23fc _ZN3nix8ExprCall4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xac3fc)
#52 0x0000ffffb55e3420 _ZN3nix6ExprIf4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xad420)
#53 0x0000ffffb55e157c _ZN3nix9EvalState12callFunctionERNS_5ValueEmPPS1_S2_RKNS_3PosE (libnixexpr.so + 0xab57c)
#54 0x0000ffffb55e23fc _ZN3nix8ExprCall4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xac3fc)
#55 0x0000ffffb55e346c _ZN3nix6ExprIf4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xad46c)
#56 0x0000ffffb55e157c _ZN3nix9EvalState12callFunctionERNS_5ValueEmPPS1_S2_RKNS_3PosE (libnixexpr.so + 0xab57c)
#57 0x0000ffffb55e23fc _ZN3nix8ExprCall4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xac3fc)
#58 0x0000ffffb55e157c _ZN3nix9EvalState12callFunctionERNS_5ValueEmPPS1_S2_RKNS_3PosE (libnixexpr.so + 0xab57c)
#59 0x0000ffffb55e23fc _ZN3nix8ExprCall4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xac3fc)
#60 0x0000ffffb55e157c _ZN3nix9EvalState12callFunctionERNS_5ValueEmPPS1_S2_RKNS_3PosE (libnixexpr.so + 0xab57c)
#61 0x0000ffffb55e23fc _ZN3nix8ExprCall4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xac3fc)
#62 0x0000ffffb55e6398 _ZN3nix7ExprVar4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xb0398)
#63 0x0000ffffb55e650c _ZN3nix12ExprOpUpdate4evalERNS_9EvalStateERNS_3EnvERNS_5ValueE (libnixexpr.so + 0xb050c)
ELF object binary architecture: AARCH64
| 10:55:39 |
| kayla (she/they) | Can you get demangled symbols and line info somehow? Addr2line or alike? | 11:50:11 |
| Dandellion | mm, I'm not sure. I managed to get a backtrace with function names though: | 13:15:47 |
| Dandellion | https://gist.github.com/dali99/7b26639e7a8d114c70df2d1e8edb2a3e | 13:16:45 |
| Dandellion | https://gist.github.com/dali99/3b3a4dd8197508f21dee7c72a0617c9f | 22:10:15 |
