| 13 May 2024 |
@tc424:glasgow.social | The sqlite backend is VERY fsync-y, if it's on a weird storage stack like mine was that may cause timeouts | 17:46:34 |
strawberry🍓 (it/pup/she/they) 🏳️⚧️ 💜 🦴 (puppygock.gay) | * attic for me just likes to decide to explode in memory usage after some days of uptime, and i cant tell if that's my fault or not | 17:46:34 |
Charles | And some actual jank | 17:46:38 |
Charles | I use attic with garage and postgres fwiw | 17:47:06 |
@tc424:glasgow.social | But switching to pg didn't solve the weird auth race | 17:47:14 |
@tc424:glasgow.social | https://bmcgee.ie/posts/2023/06/nats-building-a-nix-binary-cache/ was intriguing | 17:48:57 |
@tc424:glasgow.social | Need to add NATS to my ever growing "things to check out" list | 17:49:17 |
jkachmar | bento too, as far as pull-based deploy systems go | 18:21:12 |
| DolceTriade joined the room. | 18:34:18 |
DolceTriade | attic has been rock solid for me at work | 18:37:14 |
DolceTriade | I run it on k8s with an https proxy in front to integrate with our existing atuh | 18:37:46 |
DolceTriade | * I run it on k8s with an https proxy in front to integrate with our existing auth | 18:37:48 |
DolceTriade | * I run it on k8s with an https proxy in front to integrate with our existing auth (sqlite + filesystem storage) | 18:38:00 |
| Paddi ⚡️ joined the room. | 19:01:22 |
danielle | In reply to @tc424:glasgow.social Need to add NATS to my ever growing "things to check out" list I've been using nats a bit lately and it's pretty solid | 19:12:33 |
raitobezarius | In reply to @charles:computer.surgery "write a binary cache" is on my to do list you could also just use tvix or make it a thing in lix | 19:13:23 |
raitobezarius | i think the binary cache impl should be more or less very sibling to the nix impl | 19:13:41 |
Charles | not sure what you mean | 19:13:43 |
raitobezarius | I think most of the features of a binary cache should be in a Nix implementation | 19:14:47 |
raitobezarius | And then you can carve out various frontends / slight customizations on the top of it IMHO | 19:15:13 |
danielle | In reply to @raitobezarius:matrix.org I think most of the features of a binary cache should be in a Nix implementation only if you want your storage and your logic to be the same thing tho | 19:15:37 |
raitobezarius | Ideally, I'd like to see a way to expose any store as a binary cache in frictionless way | 19:15:40 |
raitobezarius | In reply to @danielle:fairydust.space only if you want your storage and your logic to be the same thing tho Your logic can be added on the top IMHO | 19:16:10 |
raitobezarius | Like if you want authnz, auth, etc. There should be a way to compose existing tools? | 19:16:27 |
Qyriad | technically a binary cache can take multiple forms; at least one of them should be built in to Nix | 19:16:43 |
raitobezarius | (generally, I'd like to see the concept of cache combinators) | 19:16:44 |
samrose | If there is anything people can do to help that are not part of the core team, please let us know. | 19:19:50 |
raitobezarius | to expand on my thoughts, indeed, binary cache means so many things, I think what would be interesting is:
-
nix has interesting and strong store backends: filesystem, S3, etc.
-
each one of them can be exposed on a reasonable protocol (HTTP/3, etc. whatever) using nix itself
-
nix can handle certain operations by itself which are reasonable: signing store paths (via PKCS#11 or local signing stuff), etc.
-
deduplication should be fundamental & baked-in
-
multi-tenancy should ideally be just multiple nix stores (maybe they can share blocks or something whatever)
-
you can bring your own reverse proxy for auth, authnz based on your "usecase" logic
-
etc.
| 19:20:41 |
raitobezarius | obviously, you can run a S3 binary cache without nix being around | 19:21:04 |
raitobezarius | In reply to @samrose:matrix.org If there is anything people can do to help that are not part of the core team, please let us know. I recommend looking at https://git.lix.systems/lix-project/lix/issues?q=&type=all&state=open&labels=154&milestone=0&assignee=0&poster=0 | 19:21:28 |