!PbtOpdWBSRFbEZRLIf:numtide.com

Nix Community Projects

643 Members
Meta discussions related to https://nix-community.org. (For project specific discussions use github issues or projects own matrix channel). Need help from an admin? Open an issue on https://github.com/nix-community/infra/issues163 Servers

Load older messages


SenderMessageTime
4 Jan 2024
@joerg:thalheim.ioMic92It's good to see that the UI somewhat scales09:55:39
@joerg:thalheim.ioMic92Do you have numbers how fast github is able to build those 1000 derivations?09:56:47
@glepage:matrix.orgGaétan Lepage
In reply to @joerg:thalheim.io
Do you have numbers how fast github is able to build those 1000 derivations?
Recently, we switch to my own self-hosted github runner (Ryzen 5600X 6C/12T, 16GB) and it takes a few minutes at most (depends on what is already available on cachix)
10:40:26
@joerg:thalheim.ioMic92Ok. but how long does a full rebuild takes?10:51:50
@joerg:thalheim.ioMic92There is also some caching done after a second build10:52:30
@glepage:matrix.orgGaétan LepageIt took 1 hour and 48 minutes11:13:58
@joerg:thalheim.ioMic92How long on your server?11:33:02
@glepage:matrix.orgGaétan Lepage<10min 12:26:53
@joerg:thalheim.ioMic92You probably also didn't had to do any remote builds, which also seem a bottleneck12:36:39
@glepage:matrix.orgGaétan Lepage Yes, it looks like I could run nix flake check --all-systems locally even though I had no remote-builders 12:43:00
@joerg:thalheim.ioMic92what are those module- packages?12:49:27
@joerg:thalheim.ioMic92It looks like nix-eval-jobs report those to be not cached.12:49:40
@joerg:thalheim.ioMic92Also cachix than says during upload they are.12:50:05
@joerg:thalheim.ioMic92mhm locally they are considered cached12:56:44
@joerg:thalheim.ioMic92Another bottleneck might be also that it update's the job status on github for every derivation. 13:08:49
@joerg:thalheim.ioMic92All in all as of today, I haven't really optimized it for these types of workloads. Hydra might be still the better choice for large package sets.13:15:21
5 Jan 2024
@obsqrprjkt:matrix.orgobsqrprjkt joined the room.14:08:52
6 Jan 2024
@eyjhb:eyjhb.dkeyJhb set a profile picture.14:00:35
8 Jan 2024
@k900:0upti.meK900Does anyone have a build this entire flake and push to cache action I can steal?08:33:46
@raitobezarius:matrix.orgraitobezariusa single action or a github action code to do both?09:01:44
@k900:0upti.meK900Either works09:06:57
@k900:0upti.meK900Basically I just want something I can drop into kde2nix to have a binary cache for it09:07:06
@k900:0upti.meK900Without spending half a day on figuring out github actions09:07:15
@aidalgol:matrix.orgaidalgol I think that's what cachix-action does with a post hook. 09:28:32
@aidalgol:matrix.orgaidalgol We use it in the GH action for vs-overlay. I think it uploads everything that got built in your action, so it should work with the flake build command, not just nix-build. 09:30:48
@aidalgol:matrix.orgaidalgol

So I think this would do what you want.

name: Steal this action
jobs:
  build:
    runs-on: ubuntu-latest
    steps:
    - uses: actions/checkout@v3
    - uses: cachix/install-nix-action@v22
      with:
        nix_path: nixpkgs=channel:nixos-unstable
    - uses: cachix/cachix-action@v12
      with:
        name: nix-community
        authToken: '${{ secrets.CACHIX_AUTH_TOKEN }}'
    - run: nix build
09:31:35
@k900:0upti.meK900Hmm09:31:57
@k900:0upti.meK900Yeah looks stealable09:31:59
@aidalgol:matrix.orgaidalgol Er, that would only build the default package, won't it... How do you build an entire flake? 09:32:45
@aidalgol:matrix.orgaidalgol * Er, that would only build the default package, would't it... How do you build an entire flake? 09:33:09

Show newer messages


Back to Room ListRoom Version: 6