| 4 Dec 2025 |
DavHau | It is kind of tiring to fix the same stuff over and over again. Broken cross builds should be a blocker in CI. Too much dev power is wasted on this. | 13:09:30 |
K900 | We have some | 13:24:33 |
K900 | It can't block all the builds | 13:24:41 |
K900 | That would break very badly | 13:24:52 |
| Nicolas Goudry joined the room. | 14:10:37 |
Nicolas Goudry | Hi there, I’m posting here (maybe wrong room, dunno) because I’m having an issue with compiling an aarch64-linux package from a darwin remote builder.
To further explain, I've set up the darwin.linux-builder on an M4 Macbook with the goal of being able to build aarch64-linux packages as I don't have any real aarch64-linux machine lying around.
After following the steps from the manual, I have an aarch64-linux builder VM running and have updated the Mac Nix conf with the following:
extra-experimental-features = nix-command flakes
build-users-group = nixbld
extra-trusted-users = nicolas
builders = ssh-ng://builder@linux-builder aarch64-linux /etc/nix/builder_ed25519 8 - - - c3NoLWVkMjU1MTkgQUFBQUMzTnphQzFsWkRJMU5URTVBQUFBSUpCV2N4Yi9CbGFxdDFhdU90RStGOFFVV3JVb3RpQzVxQkorVXVFV2RWQ2Igcm9vdEBuaXhvcwo=
builders-use-substitutes = true
When I try to build the package, after a few seconds I get the following error: error: creating pipe: Too many open files. I can see the remote builder is used from the brief log messages. Restarting the build does continue the build where it left (well, the built/retrieved dependencies are in the remote store so that's normal) so I guess that if I run the build enough times, it will end up producing the final build output, but it's quite annoying in the meantime.
I looked around a bit (surely not enough) but the only resources I found were referring to systemd. Since MacOS is using launchd, this is not of any help to my issue, or so I think. It's unclear if the error is from the local host or the remote builder.
Does anyone has an idea as to how to fix this?
| 14:27:15 |
K900 | Try ssh-ng://builder@linux-builder?store=daemon | 14:44:41 |
Nicolas Goudry | Got not an absolute path: 'daemon'. Is this setting trying to set a different store location than /nix/store? | 14:52:56 |
K900 | Ugh | 14:53:40 |
Sergei Zimmerman (xokdvium) | In reply to @k900:0upti.me Try ssh-ng://builder@linux-builder?store=daemon Not store build remote-store | 14:54:11 |
Sergei Zimmerman (xokdvium) | In reply to @k900:0upti.me Try ssh-ng://builder@linux-builder?store=daemon * Not store but remote-store | 14:54:16 |
K900 | Oh | 14:54:22 |
K900 | Yeah | 14:54:23 |
Sergei Zimmerman (xokdvium) | Yeah store should be called storeDir or something. Very confusing | 14:54:45 |
Nicolas Goudry | Btw is there a reference of all available query-param-style options? Couldn't find one the other day | 14:55:30 |
Nicolas Goudry | Works now, I’m hitting an OOM but that's something else, ty! | 14:55:53 |
Sergei Zimmerman (xokdvium) | https://nix.dev/manual/nix/2.32/store/types/experimental-ssh-store.html#settings | 14:56:17 |
Nicolas Goudry | Nice! Thx a lot | 14:56:49 |
| Jaafar joined the room. | 18:02:33 |
Jaafar | Can I add a native compiler as well as one or more cross compilers to the same dev shell? | 19:49:16 |
rosssmyth | Yes, it is pretty common to do so for build->build project artifacts | 19:50:23 |
rosssmyth | For multiple cross-compilers, I do not see anything particularly wrong but you'll have to be careful with your build system config to make sure it choose the correct compiler(s) | 19:51:25 |
rosssmyth | * For multiple cross-compilers, I do not see anything particularly wrong but you'll have to be careful with your build system config to make sure it chooses the correct compiler(s) | 19:51:33 |
rosssmyth | Generally a native compiler will be accessed via pkgsBuildBuild.stdenv.cc, which should be the same across all nixpkgs instances you make for each cross compiler | 19:54:24 |
matthewcroughan @ 39c3 (DECT 94667 or 97340 or 67192) | FAIL: tests/split/line-bytes.sh for coreutils on musl | 22:54:16 |
matthewcroughan @ 39c3 (DECT 94667 or 97340 or 67192) | damnit | 22:54:17 |
| 5 Dec 2025 |
| winston joined the room. | 16:04:07 |
| 6 Dec 2025 |
matthewcroughan @ 39c3 (DECT 94667 or 97340 or 67192) | hercules-ci.com/accounts/github/MatthewCroughan/derivations/%2Fnix%2Fstore%2Fzgwfi5b3g9jz98l2dcgmyxmqwwixynh6-nghttp2-1.67.1.drv/log?via-job=fd45ac98-e62d-4090-9ae9-4161885e3a6e | 00:15:18 |
matthewcroughan @ 39c3 (DECT 94667 or 97340 or 67192) | for some reason this nghttp2 is failing in the case of native compilation? | 00:15:32 |
matthewcroughan @ 39c3 (DECT 94667 or 97340 or 67192) | * for some reason this nghttp2 is failing in the case of native compilation with exec format error? | 00:15:36 |