!UUqahLbShAYkkrXmKs:matrix.org

DevOS

33 Members
Seeking help and geeking out together on https://github.com/divnix/devos & https://github.com/divnix/digga10 Servers

Load older messages


SenderMessageTime
1 Aug 2021
@timdeh:matrix.org@timdeh:matrix.orgoh yeah, I guess that's kinda the same issue as I just mentioned 😆20:43:46
@kraftnix:matrix.org@kraftnix:matrix.orgso yeah, basically the same as you, except this regularly causes my VMs to be killed, my running services to be killed. it's a massive pain20:43:55
@blaggacao:matrix.orgDavid Arnold (blaggacao)
In reply to @kraftnix:matrix.org
the reason I do the above is because you can't modify /iso/devos, and afaik (unless someone can correct me), there is no reasonable way to install nixos without having some stateful-ness when you boot the ISO, e.g. I need to know what the /dev/disk/by-uuid/ paths are, and those are generated after creating partitions, which makes /iso/devos not ready for install because even if I get a new host ready before creating the iso, i still need to add filesystems etc. after partitioning
maybe this can be settled around using well-known labels during formatting? /dev/disk/by-label
20:44:27
@blaggacao:matrix.orgDavid Arnold (blaggacao)Still, realpath should be there20:44:38
@kraftnix:matrix.org@kraftnix:matrix.orgif i have to tune all my laptops + desktops just so ZFS doesn't nuke my important processes thats a no deal, also you can't really do swap with zfs without deadlocks (issue has been open for yeeears), so thats also a no deal. means you need to provision your disk/pool with a set amount of swap in advance, and then you can never change it! because you can't change zfs pools after creation, its kinda shit20:45:42
@kraftnix:matrix.org@kraftnix:matrix.org
In reply to @blaggacao:matrix.org
maybe this can be settled around using well-known labels during formatting? /dev/disk/by-label
doesn't work well with ZFS on root...
20:46:20
@timdeh:matrix.org@timdeh:matrix.orgwell zram swap is just a compressed swap in ram so that's not really the issue. I fixed it by simply drastically reducing the size. I was just trying to get more space out of my RAM 😆20:46:28
@kraftnix:matrix.org@kraftnix:matrix.org
In reply to @blaggacao:matrix.org
maybe this can be settled around using well-known labels during formatting? /dev/disk/by-label
* doesn't work well with ZFS on root..
EDIT: ZFS on root is such a massive pain
20:46:34
@timdeh:matrix.org@timdeh:matrix.orgbut I have 54GB so I may not have run into many of these things just yet.20:46:52
@kraftnix:matrix.org@kraftnix:matrix.orgi'm not even trying to get more space out of my RAM, I just want ZFS to give up some ARC space when needed...20:47:18
@kraftnix:matrix.org@kraftnix:matrix.orgi have these issues with ZFS on root with a system that has 128GB RAM...20:47:29
@timdeh:matrix.org@timdeh:matrix.orgoh wow20:47:43
@timdeh:matrix.org@timdeh:matrix.orgI mostly work remotely, so that might be why, I haven't really run into a situation where my ram is stressed to close to max20:48:00
@kraftnix:matrix.org@kraftnix:matrix.orgit's not even by a stressful event, your RAM will eventually fill, then ZFS will not release some ARC memory, and earlyoom will kill your processes while ARC stays full..20:48:36
@timdeh:matrix.org@timdeh:matrix.orgIt would be nice to be able to fine tune the arc more, but I also like that it's saving writes on my nvme. So I guess it's a tradeoff like everything else 20:48:51
@timdeh:matrix.org@timdeh:matrix.orghmm, my arc never seems to reach more than about half my RAM, or maybe I haven't left my laptop on long enough 😕20:49:33
@kraftnix:matrix.org@kraftnix:matrix.orgi guess im sick of having to make tradeoffs and tune ZFS properly for each system, it's a massive pia, i don't mind tuning for my server with many disks in RAID, but it's such a pain otherwise20:49:48
@kraftnix:matrix.org@kraftnix:matrix.orgjust run a few local VMs on your laptop while doing nix builds20:49:56
@timdeh:matrix.org@timdeh:matrix.orgyeah I agree, zfs may be overkill without several drives anyway 😆20:50:07
@kraftnix:matrix.org@kraftnix:matrix.orgyou also have nasty interactions of ZFS with VMs when you are trying to set resource limits for VMs, ARC can be completely filled by storage for your VM. meaning a VM can take (2GB RAM that you gave it + all your ARC), so you have little control over resource utilisation.20:51:33
@kraftnix:matrix.org@kraftnix:matrix.orgdeath by a thousand cuts20:51:57
@kraftnix:matrix.org@kraftnix:matrix.org
In reply to @blaggacao:matrix.org
Still, realpath should be there
any ideas about this one?
20:52:29
@kraftnix:matrix.org@kraftnix:matrix.orgi can access realpath fine in my shell20:54:13
@blaggacao:matrix.orgDavid Arnold (blaggacao) https://github.com/divnix/bud/blob/main/scripts/hosts-install.bash seems to (tacitly) require additional inputs 20:55:28
@blaggacao:matrix.orgDavid Arnold (blaggacao) like coreutils, I guess in this case. 20:55:44
@blaggacao:matrix.orgDavid Arnold (blaggacao)I'm disappointed on how "reproducible" most of those things are20:56:09
@kraftnix:matrix.org@kraftnix:matrix.org on a semi-related debugging note, it would be really nice if i could set a debug command on bud which tells me what commands it actually ends up running after all the substitutions 20:57:00
@blaggacao:matrix.orgDavid Arnold (blaggacao) bud scripts have a very limited environment: https://github.com/divnix/bud/blob/231fa20ed93944e5b484cb5d820c60c17f4dfc35/writeBashWithPaths.nix#L4 20:57:30
@blaggacao:matrix.orgDavid Arnold (blaggacao)
In reply to @kraftnix:matrix.org
on a semi-related debugging note, it would be really nice if i could set a debug command on bud which tells me what commands it actually ends up running after all the substitutions
It get's a bit tricky if you'd use a different writer, such as haskell or rust or python or go for any subcommand.
20:58:38
@blaggacao:matrix.orgDavid Arnold (blaggacao) We'd be able to map a BUD_DEBUG to the script environment, though. 20:59:43

Show newer messages


Back to Room ListRoom Version: 6