!VRULIdgoKmKPzJZzjj:nixos.org

Nix Hackers

909 Members
For people hacking on the Nix package manager itself190 Servers

Load older messages


SenderMessageTime
2 Apr 2025
@fzakaria:one.ems.hostfzakaria

I asked this on twitter but maybe here is a better place.
On my MacOS Nix installation (2.26) I'm surprised in my flake project how often I hit:

unpacking 'github:NixOS/nixpkgs/b7ba7f9f45c5cd0d8625e9e217c28f8eb6a19a76' into the Git cache.

22:55:51
@fzakaria:one.ems.hostfzakariaIs this a bug in Nix or something I'm missing.22:56:04
3 Apr 2025
@Ericson2314:matrix.orgJohn Ericson* so we are not in this same position come november03:12:00
@mjolnir:nixos.orgmjolnir banned @cafkafk:fem.gg@cafkafk:fem.gg (<no reason supplied>).11:41:55
@joerg:thalheim.ioMic92 fzakaria: what do you mean by often? is this for the same commit? 12:16:39
@joerg:thalheim.ioMic92 I can also recommend: nixpkgs.url = "git+https://github.com/Mic92/nixpkgs?shallow=1&ref=main"; 12:17:10
@2xsaiko:tchncs.de@2xsaiko:tchncs.de changed their display name from 2xsaiko to 2xsaiko (moved! @saiko:knifepoint.net).12:52:04
@keiichi:matrix.orgteto does the shallow do anything ? I would suspect it's the default 17:50:38
@emilazy:matrix.orgemilyGitHub really doesn't like people doing shallow clones of the same repo repeatedly, fwiw. (they've had other package managers change their update mechanism because of that in the past)19:22:16
@jade_:matrix.orgjade_i would never recommend this over a tarball input. if it's a nix bug, nix should fix it.20:44:34
@jade_:matrix.orgjade_ * i would never recommend this over a tarball input. if it's a nix bug, nix should fix it. git clone is very slow and resource intensive compared to a tarball fetch such as the github: flake URL scheme. 20:45:00
4 Apr 2025
@redrield:matrix.orgredrield joined the room.00:17:02
@mjolnir:nixos.orgmjolnir unbanned @cafkafk:fem.gg@cafkafk:fem.gg.06:12:58
@joerg:thalheim.ioMic92Shallow clones are significantly faster for me than downloading tarballs and it's not slower than downloading tarballs for an initial clone.10:56:02
@joerg:thalheim.ioMic92* Shallow clones when updating are significantly faster for me than downloading tarballs and it's not slower than downloading tarballs for an initial clone.10:56:14
@joerg:thalheim.ioMic92No it's not the default because git inputs have a revcount flag that cannot be computed when doing a shallow clone.10:58:58
@keiichi:matrix.orgtetodo you know a reference talking about this : is it a CPU vs bandwidth tradeoff (shallow clones being more CPU intensive) ?11:01:14
@keiichi:matrix.orgtetois revcount that useful ? I never used that I think11:01:38
@joerg:thalheim.ioMic92Github uses them in their official checkout action ...11:01:49
@joerg:thalheim.ioMic92Agreed but removing it would change evaluation of existing flake.locks11:02:31
@emilazy:matrix.orgemilyI think it was CocoaPods or Homebrew or both11:19:42
@emilazy:matrix.orgemilyI believe serving shallow clones is expensive, I guess because it is the CPU cost of the Git protocol without the network savings?11:19:59
@emilazy:matrix.orgemilyI think they prefer a permanent non-shallow clone that gets fetched normally, or tarball downloads11:20:14
@joerg:thalheim.ioMic92Ok. but why is there CI not downloading tarballs?13:02:59
@emilazy:matrix.orgemilyno idea :) but I guess CI probably runs a lot less than people hit package indexes13:06:03
@joerg:thalheim.ioMic92I think it also makes a big difference if you just do this for nixpkgs instead of many small repos13:06:34
@joerg:thalheim.ioMic92Which I think is what CocoaPods is doing13:07:11
@qyliss:fairydust.spaceAlyssa RossCocoaPods at the time was one big repo13:08:06
@qyliss:fairydust.spaceAlyssa RossI'd imagine it's a lot more expensive with one big repo than with many small ones13:08:30
@qyliss:fairydust.spaceAlyssa Rosshttps://blog.cocoapods.org/Master-Spec-Repo-Rate-Limiting-Post-Mortem/13:08:59

Show newer messages


Back to Room ListRoom Version: 6