| 7 Jul 2023 |
 oddlama | Any ideas? | 00:39:02 |
 @elvishjerricco:matrix.org | Well that's especially odd because mounting an FS should implicitly load its kernel module if it isn't loaded already | 00:40:00 |
| @elvishjerricco:matrix.org | so ordering with systemd-modules-load shouldn't matter | 00:40:15 |
| @elvishjerricco:matrix.org | in fact I don't even think we load FS drivers with that | 00:40:24 |
| oddlama | I had a similar thought, but it's definitely an issue with the modules. If you enter the emergency shell you can just mount them without any issue | 00:40:52 |
| @elvishjerricco:matrix.org | Hm. Would love to see a minimal repro nixos tests | 00:41:08 |
| @elvishjerricco:matrix.org | * Hm. Would love to see a minimal repro nixos test | 00:41:09 |
| @elvishjerricco:matrix.org | regardless | 00:41:14 |
| @elvishjerricco:matrix.org | you can do x-systemd.after=systemd-modules-load.service as a workaround | 00:41:30 |
| oddlama | It's especially hard to reproduce, because I can only reliably hit the bug when restarting 6 vms at once, and even then only 20% of the time | 00:41:46 |
| @elvishjerricco:matrix.org | luckily nixos tests let you define arbitrarily many machines and start them all with start_all() :) | 00:42:26 |
| oddlama | I can try isolating this tomorrow. It's already past bedtime for me | 00:45:36 |
| oddlama | My best explanation for this right now is that the virtiofs module is loaded but not virtio_blk or some other module required for to see the actual shares. The initial mounts fail with virtio-fs: tag <ro-store> not found (the share is called ro-store), suggesting that the virtiofs module is loaded but some underlying module is missing to communicate with the hypervisor | 00:49:12 |
| @elvishjerricco:matrix.org | oh that's interesting | 00:49:46 |
| @elvishjerricco:matrix.org | yea there's probably another module or something involved | 00:49:56 |
| oddlama | The last post here has logs in case you are interested https://github.com/astro/microvm.nix/issues/114 .
(At first I though this might be a virtiofsd bug, ignore all of that :P) | 00:50:50 |
| oddlama | Anyhow gotta sleep now. I'll isolate this tomorrow. | 00:51:09 |
 @lily:lily.flowers | I only skimmed your messages, but this sounds like it could be the same issue the tmpfs-on-root qemu-vm test had with systemd-initrd, where the 9pfs filesystem would attempt to be mounted before the virtfs channels were ready. There's a nixpkgs issue somewhere for that | 07:21:44 |
| oddlama | Thanks for the notice, do you mean this one https://github.com/NixOS/nixpkgs/issues/240175 ? | 09:42:13 |
| @lily:lily.flowers | In reply to @oddlama:matrix.org
Thanks for the notice, do you mean this one https://github.com/NixOS/nixpkgs/issues/240175 ? Yep, that's the one! | 09:43:53 |
| @lily:lily.flowers | Not sure if it's related, but it sounded similar | 09:44:09 |
| oddlama | Definitely! I'll have to see how exactly microvms differ from qemu in that case, but the underlying issue sounds similar :D | 09:47:38 |
| @elvishjerricco:matrix.org | Do you all think we're near/at the point that we can retire this matrix room and fold it into #systemd:nixos.org? | 09:48:16 |
| @lily:lily.flowers | In reply to @elvishjerricco:matrix.org
Do you all think we're near/at the point that we can retire this matrix room and fold it into #systemd:nixos.org? Tbh, yeah I think it probably is | 09:52:24 |
 @janne.hess:helsinki-systems.de | So tombstone this one? | 10:15:51 |
| @elvishjerricco:matrix.org | I think I'd be in favor. It's not like either room gets a ton of traffic, so folding this one in shouldn't harm anything | 10:16:40 |
| @janne.hess:helsinki-systems.de | See you around then ;) | 10:16:51 |
| @elvishjerricco:matrix.org | oh you're not in the other room | 10:17:15 |
| @janne.hess:helsinki-systems.de | I might join | 10:17:21 |
| @janne.hess:helsinki-systems.de | Thanks everyone here for your great work 🥳 | 10:17:44 |
