NixOS AWS | 64 Members | |
| 15 Servers |
| Sender | Message | Time |
|---|---|---|
| 21 Sep 2024 | ||
| Anyhow we need to play with this and document what is possible. Please write down what you find in your experiments so that we can add it to the NixOS wiki :) | 07:40:16 | |
| yeah in its current state we can only really use it for distribution and cleanup of the distributed AMI (not the base). I'll see if I get to experiment with it anytime soon to figure out other weird quirks. I'll likely have to do a placeholder solution at my company where we first only offer Linux + Docker GitLab Runners (use Image Builder with an Amazon Linux base) that are originally intended to be the bootstrap runners to build NixOS images. If Image Builder finally works on the ImportVmImage + Cfn feature request, then we'd be able to expand our supervisor offerings to include NixOS, Mac, Windows, and various hypervisors (e.g. KVM, Hyper-V, Apple Virtualization Framework) to cover both bring-your-own-userspace and bring-your-own-kernel | 19:53:53 | |
| * yeah in its current state we can only really use it for distribution of the base AMI and cleanup of the distributed AMI (not the base). I'll see if I get to experiment with it anytime soon to figure out other weird quirks. I'll likely have to do a placeholder solution at my company where we first only offer Linux + Docker GitLab Runners (use Image Builder with an Amazon Linux base) that are originally intended to be the bootstrap runners to build NixOS images. If Image Builder finally works on the ImportVmImage + Cfn feature request, then we'd be able to expand our supervisor offerings to include NixOS, Mac, Windows, and various hypervisors (e.g. KVM, Hyper-V, Apple Virtualization Framework) to cover both bring-your-own-userspace and bring-your-own-kernel | 19:55:13 | |
| * yeah in its current state we can only really use it for distribution of the base AMI and cleanup of the distributed AMI (not the base). I'll see if I get to experiment with it anytime soon to figure out other weird quirks. I'll likely have to do a placeholder solution at my company where we first only offer Linux + Docker GitLab Runners (use Image Builder with an Amazon Linux base) that are originally intended to be the bootstrap runners to build NixOS images. If Image Builder finally works on the ImportVmImage + Cfn feature request, then we'd be able to expand our supervisor offerings to include NixOS, Mac, Windows, Windows + Docker + runhcs, and various hypervisors (e.g. KVM, Hyper-V, Apple Virtualization Framework) to cover both bring-your-own-userspace and bring-your-own-kernel | 20:23:28 | |
| 23 Sep 2024 | ||
| * yeah in its current state we can only really use it for distribution of the base AMI and cleanup of the distributed AMI (not the base). I'll see if I get to experiment with it anytime soon to figure out other weird quirks. I'll likely have to do a placeholder solution at my company where we first only offer Linux + Docker GitLab Runners (use Image Builder with an Amazon Linux base) that are originally intended to be the bootstrap runners to build NixOS images. If Image Builder finally works on the ImportVmImage + Cfn feature request, then we'd be able to expand our supervisor offerings to include things that prefer local image build like NixOS and various hypervisors (e.g. KVM-based options) to cover both bring-your-own-userspace and bring-your-own-kernel | 02:18:46 | |
| 24 Sep 2024 | ||
We don't have any NixOS module that polls IMDS's autoscaling/target-lifecycle-status for Terminating and issues a shutdown right? | 22:09:41 | |
* We don't have any NixOS module that polls IMDS's autoscaling/target-lifecycle-status for Terminated and issues a shutdown right? | 22:10:02 | |
| Nope. We have something internally at work though. Wanted to generalise it to support systemd-inhibit | 23:06:28 | |
| 25 Sep 2024 | ||
| 06:39:11 | ||
| Before I bother another EC2 PM or engineer, you know if instance-initiated shutdown (e.g. E.g. If I let a systemd unit have a 1 hour shutdown timeout, will an instance-initiated shutdown get to wait that full hour or does is it still subject to the ~10 min timeout? | 17:55:19 | |
| It will die after 10 minutes | 19:29:47 | |
| If you don't want that you need lifecycle hooks | 19:29:55 | |
| And send heart beats | 19:29:59 | |
| That's the default case for an EC2-initiated shutdown. What the docs aren't clear about is an instance-initiated shutdown (e.g. we poll IMDS's They also aren't clear about what they do if the instance goes into terminated before the lifecycle hook timeout and we don't call | 20:27:34 | |
| * That's the default case for an EC2-initiated shutdown. What the docs aren't clear about is an instance-initiated shutdown (e.g. we poll IMDS's They also aren't clear about what they do if the instance goes into terminated before the lifecycle hook timeout and we don't call | 20:27:50 | |
| * That's the default case for an EC2-initiated shutdown. What the docs aren't clear about is an instance-initiated shutdown (e.g. we poll IMDS's They also aren't clear about what they do if the instance goes into terminated before the lifecycle hook timeout and we don't call | 20:36:50 | |
| I think for instance instanitated shutdown it's just the Lifecycle hook timeout that matters | 21:11:02 | |
| Like systemd doesn't send any signal to the hardware when you call systemctl poweroff. It will only do the poweroff after all the services actually stopped | 21:11:34 | |
| If you have a systemd inhibit or a service that just takes an hour to shut down. There is no way for EC2 to know the machine is shutting down | 21:12:07 | |
| So the machine will be shut down my ec2 after the lifecycle hook timeout | 21:12:45 | |
| kk. I'm checking with ASG and EC2 just in case but that's what I'm suspecting as well. | 21:52:46 | |
| 1 Oct 2024 | ||
| 21:03:49 | ||
| 6 Oct 2024 | ||
| I have a WIP new image builder that uses grub in hybrid mode | 16:16:23 | |
| So we can have 1 image for EFI and BIOS | 16:16:31 | |
| Eventually I wanna drop bios completely. But too many image types still around that don't support nitro.. | 16:17:09 | |
| 10 Oct 2024 | ||
| I'm in a bit of a pickle. So I want to stop uploading However existing EC2 instances that were booted with an old AMI will not have an ESP... So I can't outright remove the code. | 12:50:16 | |
I guess I can make it depend on stateVersion but it's so ugly... However forcing people to create their AWS instances to update to 24.11 seems harsh. | 12:50:43 | |
| 13:25:15 | ||
| 11 Oct 2024 | ||
| Would it matter given that to use the new AMI, they're either replacing the root volume or launching a new instance? | 02:33:55 | |
| * Would it matter given that to use the new AMI, they're either replacing the root volume (which has both the ESP and root partitions) or launching a new instance? | 02:39:19 | |