| 20 Sep 2021 |
nix-community-bot | [firing] uptime: Uptime monster: nix-community-build02 has been up for more than 30 days.
[firing] systemd_service_failed: nix-community-build02 failed to (re)start service nixpkgs-update-updatescript.service.
| 21:48:31 |
ryantm | I'll reboot build02. | 23:07:12 |
nix-community-bot | [resolved] uptime: Uptime monster: nix-community-build02 has been up for more than 30 days.
[resolved] systemd_service_failed: nix-community-build02 failed to (re)start service nixpkgs-update-updatescript.service.
| 23:08:31 |
nix-community-bot | [firing] telegraf_down: build02.nix-community.org:9273: telegraf telegraf exporter from is down.
| 23:16:30 |
colemickens 🏳️🌈 | Can I utilize sops-nix from GitHub Actions somehow? | 23:19:32 |
colemickens 🏳️🌈 | That would be really slick. | 23:19:36 |
ryantm | Hmm build02 still hasn't rebooted. | 23:33:13 |
ryantm | colemickens 🏳️🌈: What way do you want to use it? | 23:34:31 |
colemickens 🏳️🌈 | ryantm: put a SOPS_NIX_KEY in my github secrets, and add that to sops, now whenever the Action runs, it can mount my secrets so the job can use them. | 23:36:25 |
colemickens 🏳️🌈 | Many of the secrets mounted are specifically the secrets used for remote building, signing, etc, and so it'd be perfect to re-use it for CI. I basically caught myself duplicating too many of my sop's secrets into GitHub secrets that I have to track/update/etc. | 23:37:09 |
colemickens 🏳️🌈 | I guess I could script the GH secret update, that's not a terrible idea, but single-source-of-truth would be ideal. | 23:37:25 |
ryantm | I tried doing an automatic hardware reset on build02 and it still seems to be inaccessible. I guess last time this happened it randomly became accessible a lot later. Maybe it is doing something really slow like checking the disk. | 23:40:28 |
| 21 Sep 2021 |
colemickens 🏳️🌈 | skimming the sops issues again, maybe it's just time to move on | 01:31:13 |
colemickens 🏳️🌈 | age just isn't there though. still in this inbetween state | 01:31:38 |
nix-community-bot | [firing] telegraf_down: build02.nix-community.org:9273: telegraf telegraf exporter from is down.
| 03:21:30 |
Mic92 | colemickens: the author just will do some final test with age, but should be merged soon | 05:46:45 |
Mic92 | @ryantm do you have a KVM option in the hetzner web interface in the "Rescue" tab? | 05:53:57 |
Mic92 | it's usually there but I cannot see it from my admin login? | 05:54:10 |
Mic92 | in chrome it works ... | 05:57:17 |
colemickens 🏳️🌈 | idk, age just worked for me, my GHA job just used the sops-nix activation script to place the secrets its needs for the job, using an AGE key. I'm quite happy with this actually. | 06:00:15 |
Mic92 | fair enough | 06:18:51 |
Mic92 | @ryantm: I rebooted into a recovery system that boots the OS with KVM. Looks like the f2fs filesystem takes ages to do fsck.. | 06:19:45 |
Mic92 | That might be the reason why takes so long to reboot | 06:20:01 |
Mic92 | Still doing fsck. | 06:48:01 |
Mic92 | ryantm: I just did a normal restart again - I suppose non-kvm fsck would be faster than this. I suppose it might take ages until the server come back but I don't see a way around this. | 07:04:48 |
nix-community-bot | [firing] telegraf_down: build02.nix-community.org:9273: telegraf telegraf exporter from is down.
| 07:26:30 |
nix-community-bot | [firing] telegraf_down: build02.nix-community.org:9273: telegraf telegraf exporter from is down.
| 11:31:30 |
nix-community-bot | [resolved] telegraf_down: build02.nix-community.org:9273: telegraf telegraf exporter from is down.
| 15:01:31 |
nix-community-bot | [firing] systemd_service_failed: nix-community-build02 failed to (re)start service cachix-watch-store.service.
| 15:06:30 |
nix-community-bot | [firing] systemd_service_failed: nix-community-build02 failed to (re)start service cachix-watch-store.service.
| 19:11:30 |