| 15 Jan 2022 |
Zhaofeng Li | Let's first try invoking Nix manually and see if we can directly reproduce the segfault | 13:38:31 |
angerman | so the host nixpkgs & the target nixpgks need to align? | 13:38:41 |
Zhaofeng Li | There should just be one nixpkgs version. How are you pinning nixpkgs in your config? | 13:39:31 |
angerman | meta.nixpkgs = import (fetchTarball { ... }); | 13:40:00 |
angerman | with nixops, I used to just set NIX_PATH=nixpgks=<pin> | 13:40:19 |
angerman | NIX_PATH=nixpkgs=https://github.com/NixOs/nixpkgs/archive/65c9cc79f1d179713c227bf447fb0dac384cdcda.tar.gz:colmena=https://github.com/zhaofengli/colmena/archive/main.tar.gz nix-instantiate -E 'let eval = import <colmena/src/nix/hive/eval.nix>; hive = eval { rawHive = import ./hive.nix; }; in hive.nodes.helios64.config.system.build.toplevel' | 13:40:26 |
angerman | * NIX_PATH=nixpkgs=https://github.com/NixOs/nixpkgs/archive/65c9cc79f1d179713c227bf447fb0dac384cdcda.tar.gz:colmena=https://github.com/zhaofengli/colmena/archive/main.tar.gz nix-instantiate -E 'let eval = import <colmena/src/nix/hive/eval.nix>; hive = eval { rawHive = import ./hive.nix; }; in hive.nodes.helios64.config.system.build.toplevel' keeps segfaulting | 13:40:35 |
angerman | * NIX_PATH=nixpkgs=https://github.com/NixOs/nixpkgs/archive/65c9cc79f1d179713c227bf447fb0dac384cdcda.tar.gz:colmena=https://github.com/zhaofengli/colmena/archive/main.tar.gz nix-instantiate -E 'let eval = import <colmena/src/nix/hive/eval.nix>; hive = eval { rawHive = import ./hive.nix; }; in hive.nodes.helios64.config.system.build.toplevel' keeps segfaulting | 13:40:41 |
angerman | last thing it prints prior to segfaulting is evaluating file '/nix/store/0gqvlf61cyjavvalfql96jxykrf0q0nb-source/pkgs/build-support/kernel/modules-closure.nix'. | 13:41:03 |
angerman | GC_DONT_GC... | 13:41:51 |
angerman | god i hate this nix binary. | 13:41:55 |
Zhaofeng Li | In reply to @angerman:matrix.org
meta.nixpkgs = import (fetchTarball { ... }); With this there <nixpkgs> in NIX_PATH shouldn't have matterered, but apparently something in the config is trying to use <nixpkgs>. But I think that's a red herring | 13:41:57 |
angerman | GC_DONT_GC=1 NIX_PATH=nixpkgs=https://github.com/NixOs/nixpkgs/archive/65c9cc79f1d179713c227bf447fb0dac384cdcda.tar.gz:colmena=https://github.com/zhaofengli/colmena/archive/main.tar.gz nix-instantiate -E 'let eval = import <colmena/src/nix/hive/eval.nix>; hive = eval { rawHive = import ./hive.nix; }; in hive.nodes.helios64.config.system.build.toplevel'
trace: warning: The following Nixpkgs configuration keys set in meta.nixpkgs will be ignored: allowBroken allowUnsupportedSystem
warning: you did not specify '--add-root'; the result might be removed by the garbage collector
/nix/store/jaccla0pvhfr9wy5vf4l0kdd1qdr7a26-nixos-system-nixos-20.09pre-git.drv
| 13:42:16 |
Zhaofeng Li | In reply to @angerman:matrix.org
NIX_PATH=nixpkgs=https://github.com/NixOs/nixpkgs/archive/65c9cc79f1d179713c227bf447fb0dac384cdcda.tar.gz:colmena=https://github.com/zhaofengli/colmena/archive/main.tar.gz nix-instantiate -E 'let eval = import <colmena/src/nix/hive/eval.nix>; hive = eval { rawHive = import ./hive.nix; }; in hive.nodes.helios64.config.system.build.toplevel' keeps segfaulting If you can get a backtrace, that may be valuable in submitting an issue upstream to Nix | 13:42:17 |
angerman | nix (Nix) 2.5pre20211007_844dd90 | 13:42:41 |
angerman | I guess I could break out my debugger now, and figure out why the GC keeps failing... or I'll just use GC_DONT_GC for now, and ignore the failure. | 13:43:12 |
Zhaofeng Li | In reply to @angerman:matrix.org GC_DONT_GC... Ah, I didn't know about https://github.com/NixOS/nix/issues/4893 | 13:44:03 |
Zhaofeng Li | Yeah, that is indeed pretty annoying 🙁 | 13:44:28 |
Zhaofeng Li | But it should be fixed in the release version of 2.5 I guess | 13:44:48 |
angerman | in this case it does help; I just hate this nix binary for the amount of issues I have with it too much. | 13:44:56 |
angerman | and for its slowness. | 13:45:22 |
Zhaofeng Li | Slightly tangential, but 2.5 also has another regression that has yet to be fixed: https://github.com/NixOS/nix/issues/5816 | 13:47:16 |
angerman | great. and now it fails to find my build... | 13:53:18 |
angerman | * great. and now it fails to find my builders... | 13:53:21 |
Zhaofeng Li | It should use whatever is configured in nix.conf, or you can also set it in your config with meta.machinesFile: https://zhaofengli.github.io/colmena/unstable/features/remote-builds.html | 13:55:32 |
Zhaofeng Li | You can also use deployment.buildOnTarget to have it build on the remote node directly, but if IFD is in play you still need to set builders for evaluation | 13:56:40 |
angerman | whee, I got it to build. Let's see if it applies. | 14:28:22 |
angerman | Zhaofeng Li: sorry for the trouble that wasn't even yours really. | 14:28:40 |
Zhaofeng Li | No worries. I'm always happy to help 🙂 | 14:29:21 |
angerman | dealing with these kinds of indirect errors is tough. | 14:31:12 |