14 Jul 2025 |
dramforever | to handle like pagination and stuff | 19:38:48 |
Arian | `aws s3 ls s3://nix-releases --region us-east-1 --no-sign-request` should work | 19:40:24 |
Zhaofeng Li | Yeah, that's why I asked whether listing is fine | 19:41:09 |
dramforever | just pull it less often | 19:41:35 |
Arian | Yeh should be totally fine
It's $0.005 per 1000 ListObject requests.
Each ListObject returns 1000 results.
| 19:46:19 |
Arian | So listing a million objects costs us half a cent | 19:46:54 |
| Matthew Kenigsberg joined the room. | 20:23:20 |
Matthew Kenigsberg | Mic92: thanks for the help on https://github.com/NixOS/nixos-homepage/issues/1614! We'll need a GH action to upload artifacts to gh-releases.nixos.org - how should I authenticate to gh-releases.nixos.org? | 20:26:13 |
Mic92 | @matthewkenigsberg:matrix.org: we renamed it to artifacts.nixos.org | 21:24:35 |
Mic92 | One just upload to GitHub | 21:24:51 |
Matthew Kenigsberg | Like with actions/upload-artifact@v4? And that will end up on http://artifacts.nixos.org/? | 21:27:51 |
hexa (signing key rotation when) | shock-wave: mail delivery seems to be working again | 21:38:33 |
Mic92 | @matthewkenigsberg:matrix.org: https://github.com/NixOS/infra/blob/b2cb376a37b84e82c9a2dd16a575a02b445b8b41/terraform/artifacts.tf#L3 | 21:53:03 |
15 Jul 2025 |
shock-wave | Yep its working, thanks to everyone who helped out. | 07:03:44 |
17 Jul 2025 |
Arian | Fun fact. We're gonna hit 1 billion objects in our S3 bucket very soon. we're at 99997034 now | 10:29:18 |
vcunat | We shouldn't restart the current nixpkgs:cross-trunk jobs, as the queue-runner gets stuck in a loop and doesn't do anything else:
https://github.com/NixOS/nixpkgs/pull/426071 | 11:35:26 |
hexa (signing key rotation when) | amazing | 11:37:23 |
dgrig | In case anyone else felt the need to double check if there's a limit to the number of objects you can have in a bucket:
There is no max bucket size or limit to the number of objects that you can store in a bucket. You can store all of your objects in a single bucket
via https://docs.aws.amazon.com/AmazonS3/latest/userguide/BucketRestrictions.html
| 12:26:43 |
emily | You can store all of your eggs in a single basket | 12:27:46 |
hexa (signing key rotation when) | we still need a new release of https://github.com/nix-community/nix-index ideally | 12:32:42 |
dgrig | (and unless that's a bad copy paste, it's missing a digit for billion, it's 100m) | 13:35:17 |
raitobezarius | In reply to @hexa:lossy.network we still need a new release of https://github.com/nix-community/nix-index ideally https://github.com/nix-community/nix-index/releases/tag/v0.1.9 | 14:31:01 |
18 Jul 2025 |
fricklerhandwerk | shameless plug, PR reviews appreciated | 07:24:25 |
fricklerhandwerk | * shameless plug, PR reviews appreciated raitobezarius | 07:24:31 |
19 Jul 2025 |
| Cobalt joined the room. | 19:20:32 |
Cobalt | Hey would the creation of a European nix cache mirror be of interest? $work has somewhat recently had a few hundred TB of free flash storage available after a storage system was decomissioned (and HDDs were sold).
We would plan for a pull through cache, i. e., likely only pull from upstream once for the first request of a file and store on disk afterwards. | 19:27:34 |
K900 | Bandwidth is more of a concern than storage | 19:27:55 |
K900 | For an operation like this | 19:27:57 |
dramforever | is there any reason fastly isn't, well, fastly enough in europe? | 19:28:36 |
emily | my experience is that Fastly maxes out my connection on the second download | 19:28:59 |