!coeAONBrWyDJnYMbMi:nixos.org

NixOS System Operations

604 Members
About system administration for running NixOS systems in production. Declaratively manage your operations. | Room recommendations: #networking:nixos.org165 Servers

Load older messages


SenderMessageTime
2 Apr 2024
@elvishjerricco:matrix.orgElvishJerriccoyea, the fact that nix thinks everything is fine indicates a more innocuous FS bug in btrfs07:24:13
@raitobezarius:matrix.orgraitobezarius
In reply to @hexa:lossy.network
I tell people how I feel about btrfs, but they also tend not to listen
As we all do
07:24:15
@elvishjerricco:matrix.orgElvishJerriccostill scary07:24:19
@elvishjerricco:matrix.orgElvishJerriccobut I bet it's fine07:24:22
@elvishjerricco:matrix.orgElvishJerricco(it's not my data; I am obviously less incentivized to care about it)07:25:15
@K900:matrix.orgK900 broke the homeserverIt's not even that important data07:25:27
@K900:matrix.orgK900 broke the homeserverRealistically07:25:49
@raitobezarius:matrix.orgraitobezariusAn EIO should have minimally generated a trace in the kernel log07:26:02
@raitobezarius:matrix.orgraitobezariusIt's really disconcerting 07:26:06
@hexa:lossy.networkhexaagreed07:26:11
@K900:matrix.orgK900 broke the homeserverRunning another scrub from the rescue image07:26:44
@K900:matrix.orgK900 broke the homeserverJust to make sure I'm not going insane07:26:47
@elvishjerricco:matrix.orgElvishJerriccoyea good idea07:26:58
@K900:matrix.orgK900 broke the homeserverNope still clean07:26:58
@elvishjerricco:matrix.orgElvishJerriccoSeems like there's two options to me. 1) Trust it because you have other tools (nix) saying there's nothing wrong. 2) Nuke it because wow is it scary07:28:23
@K900:matrix.orgK900 broke the homeserverYeah I think I'm moving it to bcachefs07:29:01
@elvishjerricco:matrix.orgElvishJerriccoI'm excited for bcachefs to get more testing but I cannot recommend it if you find this incident concerning07:29:35
@elvishjerricco:matrix.orgElvishJerriccobcachefs is early enough that I would find an incident much like this very unsurprising07:29:50
@K900:matrix.orgK900 broke the homeserverI trust bcachefs to at least log things properly07:30:24
@raitobezarius:matrix.orgraitobezariusBcachefs log07:33:10
@raitobezarius:matrix.orgraitobezariusBut we rely on fsck for fuckup avoidance07:33:30
@K900:matrix.orgK900 broke the homeserverOK I have a problem07:33:36
@raitobezarius:matrix.orgraitobezariusThough new powerful repair code is landing07:33:49
@K900:matrix.orgK900 broke the homeserverHetzner doesn't have any images I can find that can actually run bcachefs07:33:49
@K900:matrix.orgK900 broke the homeserver
In reply to @raitobezarius:matrix.org
But we rely on fsck for fuckup avoidance
Thing is, I don't expect this to fuck up
07:34:08
@raitobezarius:matrix.orgraitobezariusWe can send you a backdoor 07:34:09
@K900:matrix.orgK900 broke the homeserverIF the hardware is actually bad07:34:14
@K900:matrix.orgK900 broke the homeserverWhich is possible but unlikely07:34:19
@K900:matrix.orgK900 broke the homeserverI'll just show the logs to the Hetzner people and they'll fix it07:34:31
@K900:matrix.orgK900 broke the homeserver But I don't expect anything really weird to happen 07:34:51

Show newer messages


Back to Room ListRoom Version: 10