| 6 Dec 2024 |
 p14 | In reply to @joerg:thalheim.io
Do you know what change introduces this? I do not, sorry, my time budget blew and I am now afk for a bit. Seems master is ok but not staging. | 16:16:50 |
 Mic92 | Maybe give a heads up in the staging channel at least. | 16:17:23 |
| Mic92 | The pull request is only improving the error message, but not fixing the root cause, which is on the nixpkgs side. | 16:17:55 |
 Lach | I believe I have once fixed illegal utf8 logs, it is not correct to skip those lines entirely: https://github.com/NixOS/nix/pull/5160 | 17:46:50 |
| Lach | There would always be those errors on nixpkgs side, because builder scripts aren't forced to output utf8-only logs, yet nix is converting those logs to json, and json library only expects utf8 strings | 17:50:02 |
| 7 Dec 2024 |
 rhelmot | Is it even possible to use garbage collection with a diverted store? No matter what I do, gc roots get created as /nix/store symlinks and the garbage collector deletes out of /nix/store | 03:47:06 |
|  upidapi joined the room. | 16:59:55 |
|  cy joined the room. | 20:58:08 |
| 8 Dec 2024 |
|  @marinelli:matrix.org left the room. | 09:35:00 |
 tomberek | That feels like a bug. | 20:10:19 |
| 9 Dec 2024 |
| Mic92 | Lach: isn't json supposed to be either unicode or ascii with escaped chars? | 12:16:33 |
| Lach | Ascii with escaped chars shouldn't include invalid unicode sequences (Unpaired surrogates are allowed at max), yet builder scripts might output invalid unicode sequences, and nix worker protocol requires this output to be encoded to json, which is impossible in general, invalid utf-8 sequences must be replaced | 12:48:07 |
| 10 Dec 2024 |
|  Sandro 🐧 joined the room. | 15:24:22 |
| Sandro 🐧 | 👉️👈️ Can I motivate someone to fix https://github.com/NixOS/nix/issues/8074 ? 🥺 | 15:25:14 |
| 11 Dec 2024 |
| cy changed their profile picture. | 05:09:28 |
|  kat ⛧ they/them joined the room. | 12:05:42 |
|  marijan changed their profile picture. | 14:20:17 |
| p14 | I'm having an issue that in my org, the simple invocation nix build nixpkgs#hello fails. The github API requests fail unless authenticated, since there are a large number of users going through the same IP address. Of course the 'obvious' solution is to get everyone to authenticate, but this creates problems on remote machines of where to store the token.
I'd like instead to point flake:nixpkgs at an internal mirror (via nix registry pin or equivalent), but AFAICT there is no efficient way to do this? The reason it's efficient for github is the existence of the download API which is special cased to github. Is there a way to achieve the same effect?
I've tried for example to point it at a local git repository, but this results in nix trying to clone the nixpkgs git repository, which is incredibly expensive in time, CPU time, disk and bandwidth.
How do others handle this, or does everyone simply supply a github token? I'm just not sure this is a scalable approach, and it would be nice to drop the requirement of github being visible to the machine invoking nix.
| 14:56:05 |
| Sandro 🐧 | http_proxy envs and the like? | 14:57:34 |
| Sandro 🐧 | or just copy the downloaded store entry to the machine | 14:57:48 |
| Sandro 🐧 | the one place where this happens to me, I just have tokens | 14:58:02 |
| p14 | I'm not clear how a http proxy helps matters? Wouldn't that again have the effect of concentrating requests to go through one IP and requiring that they're authenticated? Since it uses https I don't see how the proxy could even provide the authentication if I was inclined to go that route. | 14:59:36 |
| p14 | Having a store on the machine could work, but I need to persuade nix not to query the github API at all. | 14:59:55 |
| p14 | (a store = a copy of a nixpkgs tree) | 15:00:08 |
| p14 | But there is still the secondary problem of user flakes: those will contain references to nixpkgs, and those references also need to be acquired. This also generates a similar problem that needs solving | 15:00:44 |
| Sandro 🐧 | I personally follow nixpkgs on every flake input | 15:01:45 |
| p14 | I suppose in this latter case, at if the user has a locked flake, it's possible (maybe?) to substitute the nixpkgs tree from a substituter, which would be acceptable. But that's only fine so long as they have a locked flake and breaks if they want to nix flake update. | 15:01:49 |
| p14 | Right, but nixpkgs will still be locked into the flake as github:nixos/nixpkgs, no? | 15:02:02 |
| Sandro 🐧 | yeah, basically | 15:02:12 |
| p14 | Really I need some way of telling nix 'these things are available from this other place'; and for nix to query for example what the latest commit is from that place, and not github. | 15:03:30 |
