| 3 Apr 2026 |
 emily | I guess seconding others that 1 TiB feels probably excessive for a build machine where outputs are basically ephemeral | 22:41:38 |
| emily | 256 GiB hurts because macOS is like 45 GiB by itself and Nix without any slack is a pain; it's just barely tolerable if you're manually babysitting a machine but not great for a builder. but 1 TiB feels like maybe an overcorrection from that | 22:42:43 |
| emily | OTOH I don't know what the life of a Hydra builder is like or what disk space the Linux builders have | 22:43:12 |
 hexa | I managed to reclaim 60GiB from /var/db/uuidtext today | 22:43:20 |
| emily | past a certain point it might be more efficient to use network storage or Thunderbolt-attached disks or something | 22:43:24 |
| hexa | maybe someone needs to come and check out the space usage of our builders with me | 22:43:33 |
 viraptor | I get it. I've got 1142 GH notifications now and should just declare a bankruptcy or something 🤦♂️ | 22:44:02 |
| hexa | the linux builders are 80C/96Cand come with 2x2ATB | 22:44:04 |
| hexa | Redacted or Malformed Event | 22:44:07 |
| hexa | Redacted or Malformed Event | 22:44:16 |
| emily | log erase as booxter said, though it's at least nominally meant to clean itself up (lower granularity of old records etc.) so it's surprising to me that it's so huge
IIRC the log gets spammed with every sandbox denial on macOS, but I assume that's not really a problem for Hydra since it has the sandbox disabled…
| 22:44:26 |
| hexa | Redacted or Malformed Event | 22:44:28 |
| hexa | Redacted or Malformed Event | 22:44:31 |
| hexa | I found nix store paths in there | 22:44:49 |
| hexa | and weird javascript stuff that looked like from a build | 22:44:59 |
| hexa | I'm frankly not sure how they end up in there | 22:45:05 |
 Ihar Hrachyshka | maybe we generate too many binaries (I wonder why!) and it records every symbolication per binary uuid and doesn't keep up with expunging | 22:45:07 |
| hexa | maybe from crashes? | 22:45:08 |
| emily | can you remote desktop in and fire up DaisyDisk? :P | 22:45:09 |
| hexa | on the m1s after ordering a remote console | 22:45:34 |
| hexa | on the m2s easily | 22:45:37 |
| emily | (ncdu or equivalent should work at a pinch given Full Disk Access but I think might fail to find some Weird Apple Stuff) | 22:45:40 |
| hexa | I did use ncdu fwiw | 22:45:48 |
| emily | https://daisydiskapp.com/download/DaisyDisk.zip + full disk access + scan as administrator will probably help. weird things can include stuff like Time Machine snapshots | 22:47:05 |
| emily | that said, if you were saying they previously were at ~100 GB minimum and you saved ~65 GB | 22:47:41 |
| emily | then that leaves … basically the size of the OS | 22:47:57 |
| emily | so there's probably nothing more to find | 22:48:07 |
| hexa | nah, they previously had like 60GB headroom max | 22:48:08 |
| hexa | if I gced everything | 22:48:18 |
| emily | I see, so still some ~85 GB unaccounted for? | 22:48:55 |
