!RROtHmAaQIkiJzJZZE:nixos.org

NixOS Infrastructure

422 Members
Next Infra call: 2024-07-11, 18:00 CEST (UTC+2) | Infra operational issues backlog: https://github.com/orgs/NixOS/projects/52 | See #infra-alerts:nixos.org for real time alerts from Prometheus.132 Servers

Load older messages


SenderMessageTime
12 Oct 2021
@vcunat:matrix.orgVladimír ČunátSo again, we seem to be long-term stuck in state with relatively long queue but no runnable step (for this platform).06:32:31
@andi:kack.itandi-I'd love to know what the bottlneck on the infra team side here is. Is it hardware? Is it time? Is it lack of interest (in that platform)? What can be done from the wider community to support your work? Should we give up on darwin?12:46:05
@toonn:matrix.orgtoonn What seems weird is none of the jobs on the builders that are actually still building (3 out of 14) looks like a show-stopper. There's no stdenv jobs everything else could be waiting on for example. 13:25:53
@lukegb:zxcvbnm.ninjalukegb (he/him)Why is there a machine named # with type "Vladimir's" :P13:32:25
@hexa:lossy.networkhexa Vladimír Čunát: 🙂 13:36:44
@hexa:lossy.networkhexa * probably belongs to Vladimír Čunát 13:37:15
@vcunat:matrix.orgVladimír Čunát t??.cunat.cz machines are mine. (location, ownership, management) 13:54:19
@vcunat:matrix.orgVladimír ČunátIt's really just one small machine at this moment only, though I hope to repair the one for metrics.13:54:58
@hexa:lossy.networkhexaimage.png
Download image.png
13:55:11
13 Oct 2021
@piper:lutris.engineeringPiper McCorkle (she/her or they/them) joined the room.05:34:55
@piper:lutris.engineeringPiper McCorkle (she/her or they/them)What would the hurdles be to add qemu-binfmt to Hydra builders? I'm working on sparc64 and ppc64le bootstrap seeds and investigating the possibility of running the 3-stage build entirely on Hydra, so that they're actually just derived from the x86_64-linux seeds05:37:27
@r-burns:matrix.orgRyan BurnsThe one thing I would worry about is poorly written cross packages "working" on hydra because of binfmt, because executable from the wrong arch are being run via qemu. It's good for the builders to mirror a "vanilla" NixOS install for the sake of local reproducibility.05:47:05
@r-burns:matrix.orgRyan BurnsThis isn't an issue if it's possible to make binfmt opt-in on a per-package basis. Idk if that's possible or how hard that would be05:47:36
@piper:lutris.engineeringPiper McCorkle (she/her or they/them)Sadly you can't namespace binfmt definitions. Hmm...05:48:34
@piper:lutris.engineeringPiper McCorkle (she/her or they/them)I guess one way of namespacing would be do spin up an x86_64-linux NixOS VM with binfmt-misc inside, that way those systems don't need to have NixOS building05:54:42
@r-burns:matrix.orgRyan BurnsI wonder if it would be possible to do that and still get KVM accel05:56:30
@piper:lutris.engineeringPiper McCorkle (she/her or they/them)Should be, it's just a regular NixOS VM that happens to have binfmt_misc configured05:56:49
@piper:lutris.engineeringPiper McCorkle (she/her or they/them)Granted the KVM accel won't do much for the binary emulation, but things like Nix would be accelerated05:57:11
@piper:lutris.engineeringPiper McCorkle (she/her or they/them) * Granted the KVM accel won't do much for the binary emulation of the other arch, but things like Nix would be accelerated05:57:22
@r-burns:matrix.orgRyan BurnsTrue, probably wouldn't make much difference for total build time05:57:48
@piper:lutris.engineeringPiper McCorkle (she/her or they/them)Yep, especially if we spin up a VM and run the whole bootstrap process inside it05:58:31
@piper:lutris.engineeringPiper McCorkle (she/her or they/them) * Yep, especially if we spin up a VM and run the whole bootstrap process inside it, that way there's no boot overhead05:58:47
@vcunat:matrix.orgVladimír Čunát
In reply to @hexa:lossy.network
sent an image.
Oh, now I see... at the top of https://hydra.nixos.org/machines That looks like Hydra interpreting something meant as a comment.
07:46:07
@sternenseemann:systemli.orgsterni
In reply to @piper:lutris.engineering
What would the hurdles be to add qemu-binfmt to Hydra builders? I'm working on sparc64 and ppc64le bootstrap seeds and investigating the possibility of running the 3-stage build entirely on Hydra, so that they're actually just derived from the x86_64-linux seeds
you can build cross packages on hydra as well, I think that would be more worthwhile actually
08:08:22
@sternenseemann:systemli.orgsterniof course you then can't get binary cache for any native packages from hydra08:08:38
@piper:lutris.engineeringPiper McCorkle (she/her or they/them)The first stage of building bootstrap-tools is cross, but the second two stages are native08:09:01
@sternenseemann:systemli.orgsterniah right, yeah08:09:23
@sternenseemann:systemli.orgsterniI wonder how noticeable the performance cost of binfmt_misc would be for us; I think it would hurt us more than e. g. alpine which build riscv64 packages using it since we rebuild everything a lot08:10:37
@rick:matrix.ciphernetics.nlRick (Mindavi)There's also a chance of miscompilation due to bugs in the emulator or mismatched feature support, I think. Anyway, afaik it's also very slow08:22:22
@piper:lutris.engineeringPiper McCorkle (she/her or they/them)I am realizing from experience how slow it is... unfortunately I don't know if there's a better option without having a native buildbox, and it would be hard to get a dedicated buildbox for these exotic architectures08:23:32

Show newer messages


Back to Room ListRoom Version: 6