!atvIbxHoEqNcAIxYpN:nixos.org

NixOS AWS

64 Members
14 Servers

Load older messages


SenderMessageTime
21 Sep 2024
@arianvp:matrix.orgArianSo I would still need to write a manual garbage collector 07:12:35
@arianvp:matrix.orgArian
In reply to @commiterate:matrix.org
Do we need a base image for a workflow? I thought only recipes needed it and that parent image can be an AMI ID (i.e. not tracked by Image Builder) or an Image ARN (tracked by Image Builder).
The recipe argument seems mandatory and its base image argument . The other recipe arguments are optional. Which I assume are then managed by the workflow argument
07:13:40
@arianvp:matrix.orgArianSo I agree this is useful. E.g. we can use this for image testing. And in general people might like using image builder to change the base image 07:14:23
@arianvp:matrix.orgArianJust doesn't solve my specific usecase of I want to clean up base images from the NixOS Foundation account after 9 months07:14:59
@arianvp:matrix.orgArianAnyhow we need to play with this and document what is possible. Please write down what you find in your experiments so that we can add it to the NixOS wiki :)07:40:16
@commiterate:matrix.orgcommiterateyeah in its current state we can only really use it for distribution and cleanup of the distributed AMI (not the base). I'll see if I get to experiment with it anytime soon to figure out other weird quirks. I'll likely have to do a placeholder solution at my company where we first only offer Linux + Docker GitLab Runners (use Image Builder with an Amazon Linux base) that are originally intended to be the bootstrap runners to build NixOS images. If Image Builder finally works on the ImportVmImage + Cfn feature request, then we'd be able to expand our supervisor offerings to include NixOS, Mac, Windows, and various hypervisors (e.g. KVM, Hyper-V, Apple Virtualization Framework) to cover both bring-your-own-userspace and bring-your-own-kernel19:53:53
@commiterate:matrix.orgcommiterate * yeah in its current state we can only really use it for distribution of the base AMI and cleanup of the distributed AMI (not the base). I'll see if I get to experiment with it anytime soon to figure out other weird quirks. I'll likely have to do a placeholder solution at my company where we first only offer Linux + Docker GitLab Runners (use Image Builder with an Amazon Linux base) that are originally intended to be the bootstrap runners to build NixOS images. If Image Builder finally works on the ImportVmImage + Cfn feature request, then we'd be able to expand our supervisor offerings to include NixOS, Mac, Windows, and various hypervisors (e.g. KVM, Hyper-V, Apple Virtualization Framework) to cover both bring-your-own-userspace and bring-your-own-kernel19:55:13
@commiterate:matrix.orgcommiterate * yeah in its current state we can only really use it for distribution of the base AMI and cleanup of the distributed AMI (not the base). I'll see if I get to experiment with it anytime soon to figure out other weird quirks. I'll likely have to do a placeholder solution at my company where we first only offer Linux + Docker GitLab Runners (use Image Builder with an Amazon Linux base) that are originally intended to be the bootstrap runners to build NixOS images. If Image Builder finally works on the ImportVmImage + Cfn feature request, then we'd be able to expand our supervisor offerings to include NixOS, Mac, Windows, Windows + Docker + runhcs, and various hypervisors (e.g. KVM, Hyper-V, Apple Virtualization Framework) to cover both bring-your-own-userspace and bring-your-own-kernel20:23:28
23 Sep 2024
@commiterate:matrix.orgcommiterate * yeah in its current state we can only really use it for distribution of the base AMI and cleanup of the distributed AMI (not the base). I'll see if I get to experiment with it anytime soon to figure out other weird quirks. I'll likely have to do a placeholder solution at my company where we first only offer Linux + Docker GitLab Runners (use Image Builder with an Amazon Linux base) that are originally intended to be the bootstrap runners to build NixOS images. If Image Builder finally works on the ImportVmImage + Cfn feature request, then we'd be able to expand our supervisor offerings to include things that prefer local image build like NixOS and various hypervisors (e.g. KVM-based options) to cover both bring-your-own-userspace and bring-your-own-kernel02:18:46
24 Sep 2024
@commiterate:matrix.orgcommiterate We don't have any NixOS module that polls IMDS's autoscaling/target-lifecycle-status for Terminating and issues a shutdown right? 22:09:41
@commiterate:matrix.orgcommiterate * We don't have any NixOS module that polls IMDS's autoscaling/target-lifecycle-status for Terminated and issues a shutdown right? 22:10:02
@arianvp:matrix.orgArianNope. We have something internally at work though. Wanted to generalise it to support systemd-inhibit23:06:28
25 Sep 2024
@luna-null:matrix.org@luna-null:matrix.org changed their display name from luna-null to Autumn.06:39:11
@commiterate:matrix.orgcommiterate

Before I bother another EC2 PM or engineer, you know if instance-initiated shutdown (e.g. shutdown inside the OS) is subject to the EC2-initiated stop/terminate time limits?

E.g. If I let a systemd unit have a 1 hour shutdown timeout, will an instance-initiated shutdown get to wait that full hour or does is it still subject to the ~10 min timeout?

17:55:19
@arianvp:matrix.orgArianIt will die after 10 minutes 19:29:47
@arianvp:matrix.orgArianIf you don't want that you need lifecycle hooks19:29:55
@arianvp:matrix.orgArianAnd send heart beats 19:29:59
@commiterate:matrix.orgcommiterate

That's the default case for an EC2-initiated shutdown. What the docs aren't clear about is an instance-initiated shutdown (e.g. we poll IMDS's autoscaling/target-lifecycle-status and do an instance-initiated shutdown when we see Terminated as the target state).

They also aren't clear about what they do if the instance goes into terminated before the lifecycle hook timeout and we don't call CompleteLifecycleAction).

20:27:34
@commiterate:matrix.orgcommiterate *

That's the default case for an EC2-initiated shutdown. What the docs aren't clear about is an instance-initiated shutdown (e.g. we poll IMDS's autoscaling/target-lifecycle-status and do an instance-initiated shutdown by running shutdown when we see Terminated as the target state).

They also aren't clear about what they do if the instance goes into terminated before the lifecycle hook timeout and we don't call CompleteLifecycleAction).

20:27:50
@commiterate:matrix.orgcommiterate *

That's the default case for an EC2-initiated shutdown. What the docs aren't clear about is an instance-initiated shutdown (e.g. we poll IMDS's autoscaling/target-lifecycle-status and do an instance-initiated shutdown by running shutdown when we see Terminated as the target state).

They also aren't clear about what they do if the instance goes into terminated before the lifecycle hook timeout and we don't call CompleteLifecycleAction.

20:36:50
@arianvp:matrix.orgArianI think for instance instanitated shutdown it's just the Lifecycle hook timeout that matters 21:11:02
@arianvp:matrix.orgArianLike systemd doesn't send any signal to the hardware when you call systemctl poweroff. It will only do the poweroff after all the services actually stopped21:11:34
@arianvp:matrix.orgArianIf you have a systemd inhibit or a service that just takes an hour to shut down. There is no way for EC2 to know the machine is shutting down21:12:07
@arianvp:matrix.orgArianSo the machine will be shut down my ec2 after the lifecycle hook timeout21:12:45
@commiterate:matrix.orgcommiteratekk. I'm checking with ASG and EC2 just in case but that's what I'm suspecting as well.21:52:46
1 Oct 2024
@-_o:matrix.org-_o joined the room.21:03:49
6 Oct 2024
@arianvp:matrix.orgArianI have a WIP new image builder that uses grub in hybrid mode16:16:23
@arianvp:matrix.orgArianSo we can have 1 image for EFI and BIOS16:16:31
@arianvp:matrix.orgArianEventually I wanna drop bios completely. But too many image types still around that don't support nitro..16:17:09
10 Oct 2024
@arianvp:matrix.orgArian

I'm in a bit of a pickle. So I want to stop uploading legacy-bios AMIs and always have a EFI System Partition. (So the bootmode of the AMIs will change to uefi-preferred).

However existing EC2 instances that were booted with an old AMI will not have an ESP... So I can't outright remove the code.

12:50:16

Show newer messages


Back to Room ListRoom Version: 10