| 1 Aug 2021 |
 David Arnold (blaggacao) | THere have been a few other relevant fixes: https://github.com/divnix/digga/commits/main/modules/bootstrap-iso.nix | 20:01:22 |
| David Arnold (blaggacao) | (I'm also currently trying to boostrap a new set of hosts) | 20:01:41 |
 @kraftnix:matrix.org | In reply to @blaggacao:matrix.org
(I'm also currently trying to boostrap a new set of hosts) was this typo on purpose this time? | 20:32:41 |
| @kraftnix:matrix.org | In reply to @timdeh:matrix.org
whoa boy, building a squashfs image is no joke, even for an i9 😅 squashfs is also largely dependent on your IO speed as well, so how quick is your NVMe :) | 20:33:46 |
| @kraftnix:matrix.org | In reply to @blaggacao:matrix.org
kraftnix: w.r.t. test-driver.py: let me know what you've concluded. I'm currently doing a refactoring ("over the eons") with tfc to get a better testing experience. Any insights will be really helpful. w.r.t. home-manager, there are now "portable" profiles that work completely without setting up any nixos hosts at all. This addition makes the use case easier where you want to start onboarding all-out with hm but without any NixOS. Here is the implementation in digga conclusion is test-driver.py just needs an sys.exit(0) at the end and then it doesn't randomly fail sometimes if one of the tests doesn't want to fully exit instantly once killed. otherwise i haven't had an issue since patching nixpkgs with the change | 20:35:20 |
| @kraftnix:matrix.org | another one for David Arnold , i'm having issues with an install since moving to bud, I'm getting
/nix/store/abyqbjsxk7bfccig7jvvzjjdz2c5xpa0-nixos-install/bin/nixos-install: line 93: realpath: command not found
when I try to run bud install host
| 20:36:05 |
| @kraftnix:matrix.org | so I am not install from /iso/devos, but instead I copy /iso/devos/ to the homedir of w/e user I have, make some modifications and then run the install, never had an issue with doing this with flk but bud doesn't like it | 20:37:08 |
| @kraftnix:matrix.org | the reason I do the above is because you can't modify /iso/devos, and afaik (unless someone can correct me), there is no reasonable way to install nixos without having some stateful-ness when you boot the ISO, e.g. I need to know what the /dev/disk/by-uuid/ paths are, and those are generated after creating partitions, which makes /iso/devos not ready for install because even if I get a new host ready before creating the iso, i still need to add filesystems etc. after partitioning | 20:39:07 |
 @timdeh:matrix.org | In reply to @kraftnix:matrix.org
squashfs is also largely dependent on your IO speed as well, so how quick is your NVMe :) hmm, last time I benched it, it was really fast, but that might have been before I switched to zfs 🤷♂️ | 20:40:00 |
| @kraftnix:matrix.org | yeah, i know how you feel with zfs, i am seriously hating zfs-on-root almost everyday and have starting reinstalling all my systems to use btrfs instead :/ | 20:40:46 |
| @timdeh:matrix.org | hmm really? I wasn't necessarily complain, I remember squashfs taking forever even before my zfs ventures 😆 | 20:41:16 |
| @timdeh:matrix.org | * hmm really? I wasn't necessarily complaining, I remember squashfs taking forever even before my zfs ventures 😆 | 20:41:28 |
| @kraftnix:matrix.org | i still love zfs for my server with a ton of drives + raid requirements, but zfs on root has caused me many issues :/ | 20:41:37 |
| @timdeh:matrix.org | I lost some data to btrfs early on so I've been very reluctant ever since | 20:41:40 |
| @timdeh:matrix.org | I'm holding out for bcachefs | 20:41:58 |
| @kraftnix:matrix.org | In reply to @timdeh:matrix.org
I'm holding out for bcachefs wheres the skeleton meme when i need it? | 20:42:10 |
| @kraftnix:matrix.org | i just want a FS the bells and whistles of ZFS without the pain of ZFS | 20:42:39 |
| @kraftnix:matrix.org | particularly right now what is causing me massive headaches with ZFS is https://github.com/rfjakob/earlyoom/pull/191 | 20:42:59 |
| @timdeh:matrix.org | could you expand on some of the those pain points? I think the only major issue I've run into so far is that when I tried a zram swap it crashed my system because of the zfs arc (or so I assumed at least). | 20:43:20 |
| @timdeh:matrix.org | oh yeah, I guess that's kinda the same issue as I just mentioned 😆 | 20:43:46 |
| @kraftnix:matrix.org | so yeah, basically the same as you, except this regularly causes my VMs to be killed, my running services to be killed. it's a massive pain | 20:43:55 |
| David Arnold (blaggacao) | In reply to @kraftnix:matrix.org
the reason I do the above is because you can't modify /iso/devos, and afaik (unless someone can correct me), there is no reasonable way to install nixos without having some stateful-ness when you boot the ISO, e.g. I need to know what the /dev/disk/by-uuid/ paths are, and those are generated after creating partitions, which makes /iso/devos not ready for install because even if I get a new host ready before creating the iso, i still need to add filesystems etc. after partitioning maybe this can be settled around using well-known labels during formatting? /dev/disk/by-label | 20:44:27 |
| David Arnold (blaggacao) | Still, realpath should be there | 20:44:38 |
| @kraftnix:matrix.org | if i have to tune all my laptops + desktops just so ZFS doesn't nuke my important processes thats a no deal, also you can't really do swap with zfs without deadlocks (issue has been open for yeeears), so thats also a no deal. means you need to provision your disk/pool with a set amount of swap in advance, and then you can never change it! because you can't change zfs pools after creation, its kinda shit | 20:45:42 |
| @kraftnix:matrix.org | In reply to @blaggacao:matrix.org
maybe this can be settled around using well-known labels during formatting? /dev/disk/by-label doesn't work well with ZFS on root... | 20:46:20 |
| @timdeh:matrix.org | well zram swap is just a compressed swap in ram so that's not really the issue. I fixed it by simply drastically reducing the size. I was just trying to get more space out of my RAM 😆 | 20:46:28 |
| @kraftnix:matrix.org | In reply to @blaggacao:matrix.org
maybe this can be settled around using well-known labels during formatting? /dev/disk/by-label * doesn't work well with ZFS on root..
EDIT: ZFS on root is such a massive pain | 20:46:34 |
| @timdeh:matrix.org | but I have 54GB so I may not have run into many of these things just yet. | 20:46:52 |
| @kraftnix:matrix.org | i'm not even trying to get more space out of my RAM, I just want ZFS to give up some ARC space when needed... | 20:47:18 |
| @kraftnix:matrix.org | i have these issues with ZFS on root with a system that has 128GB RAM... | 20:47:29 |
