!PbtOpdWBSRFbEZRLIf:numtide.com

Nix Community Projects

653 Members
Meta discussions related to https://nix-community.org. (For project specific discussions use github issues or projects own matrix channel). Need help from an admin? Open an issue on https://github.com/nix-community/infra/issues166 Servers

Load older messages


SenderMessageTime
3 Jul 2023
@br4ch1st0chr0n3:matrix.orgDanila Danko * Somehow, on macOS runners, the assumption that a job always accesses approximately the same set of paths doesn't work.19:09:33
@br4ch1st0chr0n3:matrix.orgDanila DankoMoreover, I don't know how to enforce such access behavior.19:11:17
@br4ch1st0chr0n3:matrix.orgDanila Danko * Moreover, I don't know how to enforce such access behavior because I don't really know how Nix works.19:11:47
@br4ch1st0chr0n3:matrix.orgDanila Danko * Moreover, I don't know how to enforce such access behavior because I don't really know how nix package manager internally works on macOS.19:12:23
@br4ch1st0chr0n3:matrix.orgDanila Danko * I'd like to transfer it to nix-community. It works OK on Linux. However, there is an issue https://github.com/deemp/cache-nix-too/issues/1 with macOS runners. On macOS runners, a restored and newly created cache size bounces. First time, a new cache is large. In the next run, a created cache is small. Then, the cycle repeats, i.e. the newly created cache is big. I have no expertise to explain this behavior so I decided to ask here. Any ideas why does it happen?19:13:57
@br4ch1st0chr0n3:matrix.orgDanila Danko *

I'd like to transfer it to nix-community. It works OK on Linux. However, there is an issue https://github.com/deemp/cache-nix-too/issues/1 with macOS runners.

In this action, I just nix copy from a cache, run other steps, at the end look what paths were accessed (by atime) and nix copy them to cache. Finally, I save a single cache entry.

On macOS runners, a restored and newly created cache size bounces. First time, a new cache is large. In the next run, a created cache is small. Then, the cycle repeats, i.e. the newly created cache is big. I have no expertise to explain this behavior so I decided to ask here.

Any ideas why does it happen?

19:14:33
@br4ch1st0chr0n3:matrix.orgDanila Danko *

I'd like to transfer it to nix-community. It works OK on Linux. However, there is an issue https://github.com/deemp/cache-nix-too/issues/1 with macOS runners.

In this action, I just nix copy from a cache, run other steps, at the end look what paths were accessed (by atime) and nix copy them to cache. Finally, I save a single cache entry.

On macOS runners, a restored and saved cache size bounces. First time, a saved cache is large. In the next run, a saved cache is small. Then, the cycle repeats. I have no expertise to explain this behavior so I decided to ask here.

Any ideas why does it happen?

19:17:13
@br4ch1st0chr0n3:matrix.orgDanila Danko * Moreover, I don't know how to enforce such access behavior because I don't know how nix package manager internally works on macOS.19:17:37
@hanleym:matrix.orghanleym joined the room.19:24:28
@br4ch1st0chr0n3:matrix.orgDanila Danko * Moreover, I don't know how to enforce such an access behavior because I don't know how nix package manager internally works on macOS.19:25:23
4 Jul 2023
@kranzes:matrix.orgIlan Joselevich (Kranzes)What does the infra repo use for deploying to nixos hosts?22:17:33
@kranzes:matrix.orgIlan Joselevich (Kranzes)oh it seems to just use nixos-rebuild22:18:58
5 Jul 2023
@joerg:thalheim.ioMic92it uses https://github.com/numtide/deploykit to run rsync + nixos-rebuild in parallel. 07:19:30
@hsngrmpf:matrix.orgDavHau Con someone give me admin access to all nix-community repos starting with dream2nix-? 09:13:41
@zimbatm:numtide.comJonas Chevalierdone, except the archived one because it wouldn't let me09:23:51
@zimbatm:numtide.comJonas Chevalierlet me know if you need that one too09:24:14
@kranzes:matrix.orgIlan Joselevich (Kranzes)
In reply to @joerg:thalheim.io
it uses https://github.com/numtide/deploykit to run rsync + nixos-rebuild in parallel.
Why don't we use something like Cachix Deploy in CI?
14:23:07
@joerg:thalheim.ioMic92We used cachix deploy but it failed from time to time and it wasn't possible to integrate deployment failure in our ci.14:35:42
@joerg:thalheim.ioMic92s/ci/monitoring/14:35:50
@joerg:thalheim.ioMic92so instead we just use the auto-upgrade service from nixos14:37:34
@domenkozar:matrix.orgDomen Kožarwe fixed all the stability issues :)14:45:18
@domenkozar:matrix.orgDomen Kožar also cachix deploy activate now prints the log for each agent and exists if any deployments fail 14:45:38
@kranzes:matrix.orgIlan Joselevich (Kranzes)what Domen said ^14:51:36
@kranzes:matrix.orgIlan Joselevich (Kranzes)Since you are already using Hercules-CI this should be really easy14:53:14
@kranzes:matrix.orgIlan Joselevich (Kranzes) https://github.com/Kranzes/nix-config/commit/05e3e024535108094cb990e5e830f219e4cc73f7#diff-972262892a9f0dbfdc5d494f914d70e930693b664613ce982c35f1b4b144ad28 14:53:40
@kranzes:matrix.orgIlan Joselevich (Kranzes)This uses async, but you can disable that in the boolean14:54:11
@kranzes:matrix.orgIlan Joselevich (Kranzes)The default behavior for cachix deploy used to be async but now it's "sync" as Domen explained14:55:05
@roberthensing:matrix.orgRobert Hensing (roberth)You probably do want async if you're going to make hercules-ci-agent redeploy itself15:39:31
@kranzes:matrix.orgIlan Joselevich (Kranzes)
In reply to @roberthensing:matrix.org
You probably do want async if you're going to make hercules-ci-agent redeploy itself
Do HCI agents not survive a new generation activation?
15:49:49
@hsngrmpf:matrix.orgDavHauThanks16:45:36

Show newer messages


Back to Room ListRoom Version: 6