!atvIbxHoEqNcAIxYpN:nixos.org

NixOS AWS

65 Members
16 Servers

Load older messages


SenderMessageTime
21 Sep 2024
@arianvp:matrix.orgArianAnyhow we need to play with this and document what is possible. Please write down what you find in your experiments so that we can add it to the NixOS wiki :)07:40:16
@commiterate:matrix.orgcommiterateyeah in its current state we can only really use it for distribution and cleanup of the distributed AMI (not the base). I'll see if I get to experiment with it anytime soon to figure out other weird quirks. I'll likely have to do a placeholder solution at my company where we first only offer Linux + Docker GitLab Runners (use Image Builder with an Amazon Linux base) that are originally intended to be the bootstrap runners to build NixOS images. If Image Builder finally works on the ImportVmImage + Cfn feature request, then we'd be able to expand our supervisor offerings to include NixOS, Mac, Windows, and various hypervisors (e.g. KVM, Hyper-V, Apple Virtualization Framework) to cover both bring-your-own-userspace and bring-your-own-kernel19:53:53
@commiterate:matrix.orgcommiterate * yeah in its current state we can only really use it for distribution of the base AMI and cleanup of the distributed AMI (not the base). I'll see if I get to experiment with it anytime soon to figure out other weird quirks. I'll likely have to do a placeholder solution at my company where we first only offer Linux + Docker GitLab Runners (use Image Builder with an Amazon Linux base) that are originally intended to be the bootstrap runners to build NixOS images. If Image Builder finally works on the ImportVmImage + Cfn feature request, then we'd be able to expand our supervisor offerings to include NixOS, Mac, Windows, and various hypervisors (e.g. KVM, Hyper-V, Apple Virtualization Framework) to cover both bring-your-own-userspace and bring-your-own-kernel19:55:13
@commiterate:matrix.orgcommiterate * yeah in its current state we can only really use it for distribution of the base AMI and cleanup of the distributed AMI (not the base). I'll see if I get to experiment with it anytime soon to figure out other weird quirks. I'll likely have to do a placeholder solution at my company where we first only offer Linux + Docker GitLab Runners (use Image Builder with an Amazon Linux base) that are originally intended to be the bootstrap runners to build NixOS images. If Image Builder finally works on the ImportVmImage + Cfn feature request, then we'd be able to expand our supervisor offerings to include NixOS, Mac, Windows, Windows + Docker + runhcs, and various hypervisors (e.g. KVM, Hyper-V, Apple Virtualization Framework) to cover both bring-your-own-userspace and bring-your-own-kernel20:23:28
23 Sep 2024
@commiterate:matrix.orgcommiterate * yeah in its current state we can only really use it for distribution of the base AMI and cleanup of the distributed AMI (not the base). I'll see if I get to experiment with it anytime soon to figure out other weird quirks. I'll likely have to do a placeholder solution at my company where we first only offer Linux + Docker GitLab Runners (use Image Builder with an Amazon Linux base) that are originally intended to be the bootstrap runners to build NixOS images. If Image Builder finally works on the ImportVmImage + Cfn feature request, then we'd be able to expand our supervisor offerings to include things that prefer local image build like NixOS and various hypervisors (e.g. KVM-based options) to cover both bring-your-own-userspace and bring-your-own-kernel02:18:46
24 Sep 2024
@commiterate:matrix.orgcommiterate We don't have any NixOS module that polls IMDS's autoscaling/target-lifecycle-status for Terminating and issues a shutdown right? 22:09:41
@commiterate:matrix.orgcommiterate * We don't have any NixOS module that polls IMDS's autoscaling/target-lifecycle-status for Terminated and issues a shutdown right? 22:10:02
@arianvp:matrix.orgArianNope. We have something internally at work though. Wanted to generalise it to support systemd-inhibit23:06:28
25 Sep 2024
@luna-null:matrix.org@luna-null:matrix.org changed their display name from luna-null to Autumn.06:39:11
@commiterate:matrix.orgcommiterate

Before I bother another EC2 PM or engineer, you know if instance-initiated shutdown (e.g. shutdown inside the OS) is subject to the EC2-initiated stop/terminate time limits?

E.g. If I let a systemd unit have a 1 hour shutdown timeout, will an instance-initiated shutdown get to wait that full hour or does is it still subject to the ~10 min timeout?

17:55:19
@arianvp:matrix.orgArianIt will die after 10 minutes 19:29:47
@arianvp:matrix.orgArianIf you don't want that you need lifecycle hooks19:29:55
@arianvp:matrix.orgArianAnd send heart beats 19:29:59
@commiterate:matrix.orgcommiterate

That's the default case for an EC2-initiated shutdown. What the docs aren't clear about is an instance-initiated shutdown (e.g. we poll IMDS's autoscaling/target-lifecycle-status and do an instance-initiated shutdown when we see Terminated as the target state).

They also aren't clear about what they do if the instance goes into terminated before the lifecycle hook timeout and we don't call CompleteLifecycleAction).

20:27:34
@commiterate:matrix.orgcommiterate *

That's the default case for an EC2-initiated shutdown. What the docs aren't clear about is an instance-initiated shutdown (e.g. we poll IMDS's autoscaling/target-lifecycle-status and do an instance-initiated shutdown by running shutdown when we see Terminated as the target state).

They also aren't clear about what they do if the instance goes into terminated before the lifecycle hook timeout and we don't call CompleteLifecycleAction).

20:27:50
@commiterate:matrix.orgcommiterate *

That's the default case for an EC2-initiated shutdown. What the docs aren't clear about is an instance-initiated shutdown (e.g. we poll IMDS's autoscaling/target-lifecycle-status and do an instance-initiated shutdown by running shutdown when we see Terminated as the target state).

They also aren't clear about what they do if the instance goes into terminated before the lifecycle hook timeout and we don't call CompleteLifecycleAction.

20:36:50
@arianvp:matrix.orgArianI think for instance instanitated shutdown it's just the Lifecycle hook timeout that matters 21:11:02
@arianvp:matrix.orgArianLike systemd doesn't send any signal to the hardware when you call systemctl poweroff. It will only do the poweroff after all the services actually stopped21:11:34
@arianvp:matrix.orgArianIf you have a systemd inhibit or a service that just takes an hour to shut down. There is no way for EC2 to know the machine is shutting down21:12:07
@arianvp:matrix.orgArianSo the machine will be shut down my ec2 after the lifecycle hook timeout21:12:45
@commiterate:matrix.orgcommiteratekk. I'm checking with ASG and EC2 just in case but that's what I'm suspecting as well.21:52:46
1 Oct 2024
@-_o:matrix.org-_o joined the room.21:03:49
6 Oct 2024
@arianvp:matrix.orgArianI have a WIP new image builder that uses grub in hybrid mode16:16:23
@arianvp:matrix.orgArianSo we can have 1 image for EFI and BIOS16:16:31
@arianvp:matrix.orgArianEventually I wanna drop bios completely. But too many image types still around that don't support nitro..16:17:09
10 Oct 2024
@arianvp:matrix.orgArian

I'm in a bit of a pickle. So I want to stop uploading legacy-bios AMIs and always have a EFI System Partition. (So the bootmode of the AMIs will change to uefi-preferred).

However existing EC2 instances that were booted with an old AMI will not have an ESP... So I can't outright remove the code.

12:50:16
@arianvp:matrix.orgArian I guess I can make it depend on stateVersion but it's so ugly... However forcing people to create their AWS instances to update to 24.11 seems harsh. 12:50:43
@p4cmanus3r:matrix.orgp4cmanus3r joined the room.13:25:15
11 Oct 2024
@commiterate:matrix.orgcommiterateWould it matter given that to use the new AMI, they're either replacing the root volume or launching a new instance?02:33:55
@commiterate:matrix.orgcommiterate * Would it matter given that to use the new AMI, they're either replacing the root volume (which has both the ESP and root partitions) or launching a new instance?02:39:19

Show newer messages


Back to Room ListRoom Version: 10