| 4 Jan 2024 |
Mic92 | It's good to see that the UI somewhat scales | 09:55:39 |
Mic92 | Do you have numbers how fast github is able to build those 1000 derivations? | 09:56:47 |
Gaétan Lepage | In reply to @joerg:thalheim.io Do you have numbers how fast github is able to build those 1000 derivations? Recently, we switch to my own self-hosted github runner (Ryzen 5600X 6C/12T, 16GB) and it takes a few minutes at most (depends on what is already available on cachix) | 10:40:26 |
Mic92 | Ok. but how long does a full rebuild takes? | 10:51:50 |
Mic92 | There is also some caching done after a second build | 10:52:30 |
Gaétan Lepage | It took 1 hour and 48 minutes | 11:13:58 |
Mic92 | How long on your server? | 11:33:02 |
Gaétan Lepage | <10min | 12:26:53 |
Mic92 | You probably also didn't had to do any remote builds, which also seem a bottleneck | 12:36:39 |
Gaétan Lepage | Yes, it looks like I could run nix flake check --all-systems locally even though I had no remote-builders | 12:43:00 |
Mic92 | what are those module- packages? | 12:49:27 |
Mic92 | It looks like nix-eval-jobs report those to be not cached. | 12:49:40 |
Mic92 | Also cachix than says during upload they are. | 12:50:05 |
Mic92 | mhm locally they are considered cached | 12:56:44 |
Mic92 | Another bottleneck might be also that it update's the job status on github for every derivation. | 13:08:49 |
Mic92 | All in all as of today, I haven't really optimized it for these types of workloads. Hydra might be still the better choice for large package sets. | 13:15:21 |
| 5 Jan 2024 |
| obsqrprjkt joined the room. | 14:08:52 |
| 6 Jan 2024 |
| eyJhb set a profile picture. | 14:00:35 |
| 8 Jan 2024 |
K900 | Does anyone have a build this entire flake and push to cache action I can steal? | 08:33:46 |
raitobezarius | a single action or a github action code to do both? | 09:01:44 |
K900 | Either works | 09:06:57 |
K900 | Basically I just want something I can drop into kde2nix to have a binary cache for it | 09:07:06 |
K900 | Without spending half a day on figuring out github actions | 09:07:15 |
aidalgol | I think that's what cachix-action does with a post hook. | 09:28:32 |
aidalgol | We use it in the GH action for vs-overlay. I think it uploads everything that got built in your action, so it should work with the flake build command, not just nix-build. | 09:30:48 |
aidalgol | So I think this would do what you want.
name: Steal this action
jobs:
build:
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@v3
- uses: cachix/install-nix-action@v22
with:
nix_path: nixpkgs=channel:nixos-unstable
- uses: cachix/cachix-action@v12
with:
name: nix-community
authToken: '${{ secrets.CACHIX_AUTH_TOKEN }}'
- run: nix build
| 09:31:35 |
K900 | Hmm | 09:31:57 |
K900 | Yeah looks stealable | 09:31:59 |
aidalgol | Er, that would only build the default package, won't it... How do you build an entire flake? | 09:32:45 |
aidalgol | * Er, that would only build the default package, would't it... How do you build an entire flake? | 09:33:09 |