!CcTBuBritXGywOEGWJ:matrix.org

NixOS Binary Cache Self-Hosting

158 Members
About how to host a very large-scale binary cache and more54 Servers

Load older messages


SenderMessageTime
20 Oct 2023
@ninjatrappeur:alternativebit.fr@ninjatrappeur:alternativebit.fr changed their display name from NinjaTrappeur to PicNoir (was Ninjatrappeur).10:34:52
22 Oct 2023
@janik0:matrix.org@janik0:matrix.org

Did anyone here ever deploy a nix binary cache inside a docker container?
Why I'm asking is:
The CI I'm using for most of my stuff woodpecker has a feature called services where it can basically deploy containers along side which are not persistent (I think they can be made persistent mounting volumes) but live until the runner get's restarted and I basically want to replicate magic-nix-cache by having a service container running which acts as a nix-cache so my CI build steps can use it.

I'm probably going to build my own nix-docker-cache image If no one did something like this before, just wanted to ask before doing the same work multiple times. Also I hope this is the right channel, because this setup would not be "very large-scale" but the name still fit the best.

21:15:11
@raitobezarius:matrix.orgraitobezariusif you can make garage's state persistent21:15:50
@raitobezarius:matrix.orgraitobezariusyou can just deploy a garage+attic21:15:53
@raitobezarius:matrix.orgraitobezariusmaybe attic state too21:15:59
@janik0:matrix.org@janik0:matrix.orgI wouldn't even need garage for a s3 storage, local container storage would be just fine. I also don't mind if I have to rebuild the cache every once in a while since I wouldn't want this to be my main binary cache anyways. 21:20:23
@raitobezarius:matrix.orgraitobezariusI'm not exactly sure what do you want to optimize for therefore21:20:54
@janik0:matrix.org@janik0:matrix.orgBut I don't think anyone has setup attic in a docker container before? So I'll probably have to write the dockerfile for that21:20:55
@raitobezarius:matrix.orgraitobezariusYeah but it's really just using Nix to build a Docker container with the entrypoint set to attic, no?21:21:11
@raitobezarius:matrix.orgraitobezariusMaybe the database stuff I guess21:21:16
@janik0:matrix.org@janik0:matrix.orgIt would basically be converting https://github.com/zhaofengli/attic/blob/main/nixos/atticd.nix this module into a dockerfile which for sure is doable, I just wanted to ask if anyone else did something similar to this before 21:23:42
@janik0:matrix.org@janik0:matrix.orgthere actually is a attic docker image upstream: https://github.com/zhaofengli/attic/blob/main/flake.nix#L90 it's just not documented quite yet https://github.com/zhaofengli/attic/pull/47/files21:37:29
25 Oct 2023
@federicodschonborn:matrix.org@federicodschonborn:matrix.org changed their profile picture.00:13:28
26 Oct 2023
@lehmanator:gnulinux.club@lehmanator:gnulinux.club joined the room.20:34:07
27 Oct 2023
@federicodschonborn:matrix.org@federicodschonborn:matrix.org changed their profile picture.01:24:58
29 Oct 2023
@cathalmullan:matrix.org@cathalmullan:matrix.org changed their display name from Cathal Mullan to Cathal.14:48:32
3 Nov 2023
@mib:kanp.aimib 🥐 changed their profile picture.13:51:27
10 Nov 2023
@pfz4:zettoit.eupaul / pfz4 joined the room.16:45:23
11 Nov 2023
@picnoir:alternativebit.frPicnoir joined the room.07:11:26
@ninjatrappeur:alternativebit.fr@ninjatrappeur:alternativebit.fr left the room.07:11:28
@picnoir:alternativebit.frPicnoir changed their profile picture.13:10:41
15 Nov 2023
@qyliss:fairydust.spaceAlyssa Ross joined the room.17:20:26
@mjolnir:nixos.orgNixOS Moderation Botchanged room power levels.18:11:54
@eisfunke:eisfunke.com@eisfunke:eisfunke.com changed their profile picture.22:40:56
19 Nov 2023
@zxgu:matrix.orgZXGU joined the room.10:59:33
21 Nov 2023
@pfz4:zettoit.eupaul / pfz4 left the room.21:24:50
26 Nov 2023
@julienmalka:matrix.orgJulienTo people running attic, what kind of performance are you getting on upload ? For some reason I am getting very poor performance, like less than 1MiB/s. I am using local storage and postgresql, and I am seeing that my io is at 100% read when uploading13:48:35
@ajs124:ajs124.deajs124iirc my performance is better, but I don't use local storage15:49:07
29 Nov 2023
@linus:schreibt.jetzt@linus:schreibt.jetzt
In reply to @julienmalka:matrix.org
To people running attic, what kind of performance are you getting on upload ? For some reason I am getting very poor performance, like less than 1MiB/s. I am using local storage and postgresql, and I am seeing that my io is at 100% read when uploading
It was really slow for me too until I changed the chunking params to get bigger chunks
06:38:08
@linus:schreibt.jetzt@linus:schreibt.jetztThe suggested numbers go pretty hard on the database and file metadata06:38:56

Show newer messages


Back to Room ListRoom Version: 10