| 12 Feb 2025 |
atemu12 | I've never done it myself but it ought to be possible using ROBOTNIX_MIRRORS | 07:14:16 |
waltmck | I capped the number of jobs to 4 and it appears to be chugging along, I'll see if it works. Might be smart to adjust the code so it works on CPUs with many cores | 07:18:34 |
waltmck | * I capped the number of jobs to 4 and it appears to be chugging along, I'll see if it works. Might be smart to adjust the default so it works on CPUs with many cores | 07:18:50 |
atemu12 | Sounds like a good idea | 07:18:56 |
waltmck | it's line 251 of mk_repo_file.py, just change default=4 or some other small number | 07:19:22 |
waltmck | I can file a PR later for it if that's easier | 07:19:31 |
atemu12 | You probably don't gain anything after a few cores because you become network-bound | 07:19:46 |
atemu12 | Just PR it | 07:20:00 |
waltmck | huh it's still throttling with 4 jobs, just takes longer. I'll try 2. | 07:33:33 |
atemu12 | Well you've already been limited | 07:34:05 |
waltmck | ah, how long does the cooldown last? | 07:56:09 |
atemu12 | Your guess is as good as mine | 07:56:42 |
waltmck | wow that's annoying | 07:57:52 |
waltmck | someone should let richard stallman know about this | 07:58:01 |
waltmck | okay, it is not failing even with only 1 thread. Could you tell me more about this? Searching the repo for ROBOTNIX_MIRRORS doesn't give anything | 08:06:30 |
waltmck | * okay, it is now failing even with only 1 thread. Could you tell me more about this? Searching the repo for ROBOTNIX_MIRRORS doesn't give anything | 08:06:38 |
atemu12 | There's a doc on local mirroring | 08:06:54 |
atemu12 | I don't remember the exact env var name | 08:07:08 |
atemu12 | You can just use a remote mirror instead | 08:07:32 |
waltmck | found it | 08:07:32 |
waltmck | okay, I followed the instructions to set a local git mirror at /cache/mirror and but got the following error:
subprocess.CalledProcessError: Command '['git', 'ls-remote', '/cache/mirror/platform/external/android-key-attestation']' returned non-zero exit status 128.
This also fails from the command line, sine it is the wrong location: the correct location is /cache/mirror/external/android-key-attestation. I tried moving /cache/mirror to /cache/mirror/platform so that it would find the correct location, but then it fails with
subprocess.CalledProcessError: Command '['git', 'ls-remote', '/cache/mirror/device/generic/goldfish-opengl']' returned non-zero exit status 128
It seems like it is looking in the wrong location for external/*, any idea what the reason for this could be?
| 21:09:36 |
waltmck | BTW this error happens even before I add my device to supported_devices, so I don't think it's particular to that | 21:11:15 |
waltmck | * okay, I followed the instructions to set a local git mirror at /cache/mirror and but got the following error:
subprocess.CalledProcessError: Command '['git', 'ls-remote', '/cache/mirror/platform/external/android-key-attestation']' returned non-zero exit status 128.
This also fails from the command line, since it is the wrong location: the correct location is /cache/mirror/external/android-key-attestation. I tried moving /cache/mirror to /cache/mirror/platform so that it would find the correct location, but then it fails with
subprocess.CalledProcessError: Command '['git', 'ls-remote', '/cache/mirror/device/generic/goldfish-opengl']' returned non-zero exit status 128
It seems like it is looking in the wrong location for external/*, any idea what the reason for this could be?
| 21:12:18 |
atemu12 | Wait, you actually set up a mirror? | 22:04:09 |
atemu12 | As in the full 1.4TiB? | 22:04:26 |
atemu12 | What I meant was to use the github mirror | 22:04:49 |
atemu12 | Though thinking about it again, it has a different structure because it can't do sub-paths, only owner/repo | 22:05:49 |
waltmck | It's only 126GB. I followed these instructions | 22:28:21 |
atemu12 | That's just a local checkout | 22:29:04 |
atemu12 | The full mirror has separate instructions and is enormous | 22:29:29 |