| 6 Dec 2024 |
 p14 | * I just hit what looks like this old issue: https://github.com/NixOS/nixpkgs/issues/138157
It appears to repro on nixpkgs staging (b8a6909c649634b9ef2183dd2848dfd52e49d305) with nix 2.24.10 doing nix develop -f . hello. I get:
error: [json.exception.parse_error.101] parse error at line 38, column 445: syntax error while parsing value - invalid string: control character U+001E (RS) must be escaped to \u001E; last read: '" \n local sep=\"$1\";\n local name=\"$2\";\n local type oldifs;\n if type=$(declare -p \"$name\" 2> /dev/null); then\n local -n nameref=\"$name\";\n case \"${type#* }\" in \n -A*)\n echo \"concatStringsSep(): ERROR: trying to use concatStringsSep on an associative array.\" 1>&2;\n return 1\n ;;\n -a*)\n local IFS='<U+001E>'
| 14:41:23 |
| p14 | I see a handful of issues of this style open against nix as well. https://github.com/NixOS/nix/issues?q=is%3Aissue+json+json.exception.parse_error+is%3Aopen
Is this a recently introduced stdenv issue | 14:44:37 |
 Mic92 | p14: https://github.com/NixOS/nix/pull/11921 | 15:53:27 |
| p14 | This is while running 'nix develop' though, there is no indication of any build taking place | 15:54:37 |
| p14 | * This is while running 'nix develop' on any package in staging though, there is no indication of any build taking place | 15:54:55 |
| Mic92 | p14: I have the feeling if all packages are doing that, we should also fix this in nixpkgs. It should not echo invalid json | 16:11:30 |
| Mic92 | Do you know what change introduces this? | 16:11:46 |
| p14 | In reply to @joerg:thalheim.io
Do you know what change introduces this? I do not, sorry, my time budget blew and I am now afk for a bit. Seems master is ok but not staging. | 16:16:50 |
| Mic92 | Maybe give a heads up in the staging channel at least. | 16:17:23 |
| Mic92 | The pull request is only improving the error message, but not fixing the root cause, which is on the nixpkgs side. | 16:17:55 |
 Lach | I believe I have once fixed illegal utf8 logs, it is not correct to skip those lines entirely: https://github.com/NixOS/nix/pull/5160 | 17:46:50 |
| Lach | There would always be those errors on nixpkgs side, because builder scripts aren't forced to output utf8-only logs, yet nix is converting those logs to json, and json library only expects utf8 strings | 17:50:02 |
| 7 Dec 2024 |
 rhelmot | Is it even possible to use garbage collection with a diverted store? No matter what I do, gc roots get created as /nix/store symlinks and the garbage collector deletes out of /nix/store | 03:47:06 |
|  upidapi joined the room. | 16:59:55 |
|  cy joined the room. | 20:58:08 |
| 8 Dec 2024 |
|  @marinelli:matrix.org left the room. | 09:35:00 |
 tomberek | That feels like a bug. | 20:10:19 |
| 9 Dec 2024 |
| Mic92 | Lach: isn't json supposed to be either unicode or ascii with escaped chars? | 12:16:33 |
| Lach | Ascii with escaped chars shouldn't include invalid unicode sequences (Unpaired surrogates are allowed at max), yet builder scripts might output invalid unicode sequences, and nix worker protocol requires this output to be encoded to json, which is impossible in general, invalid utf-8 sequences must be replaced | 12:48:07 |
| 10 Dec 2024 |
|  Sandro 🐧 joined the room. | 15:24:22 |
| Sandro 🐧 | 👉️👈️ Can I motivate someone to fix https://github.com/NixOS/nix/issues/8074 ? 🥺 | 15:25:14 |
| 11 Dec 2024 |
| cy changed their profile picture. | 05:09:28 |
|  kat ⛧ they/them joined the room. | 12:05:42 |
|  marijan changed their profile picture. | 14:20:17 |
| p14 | I'm having an issue that in my org, the simple invocation nix build nixpkgs#hello fails. The github API requests fail unless authenticated, since there are a large number of users going through the same IP address. Of course the 'obvious' solution is to get everyone to authenticate, but this creates problems on remote machines of where to store the token.
I'd like instead to point flake:nixpkgs at an internal mirror (via nix registry pin or equivalent), but AFAICT there is no efficient way to do this? The reason it's efficient for github is the existence of the download API which is special cased to github. Is there a way to achieve the same effect?
I've tried for example to point it at a local git repository, but this results in nix trying to clone the nixpkgs git repository, which is incredibly expensive in time, CPU time, disk and bandwidth.
How do others handle this, or does everyone simply supply a github token? I'm just not sure this is a scalable approach, and it would be nice to drop the requirement of github being visible to the machine invoking nix.
| 14:56:05 |
| Sandro 🐧 | http_proxy envs and the like? | 14:57:34 |
| Sandro 🐧 | or just copy the downloaded store entry to the machine | 14:57:48 |
| Sandro 🐧 | the one place where this happens to me, I just have tokens | 14:58:02 |
| p14 | I'm not clear how a http proxy helps matters? Wouldn't that again have the effect of concentrating requests to go through one IP and requiring that they're authenticated? Since it uses https I don't see how the proxy could even provide the authentication if I was inclined to go that route. | 14:59:36 |
| p14 | Having a store on the machine could work, but I need to persuade nix not to query the github API at all. | 14:59:55 |
