| 6 Nov 2023 |
 matthewcroughan | this is the installPhase for it | 19:37:38 |
| matthewcroughan | also
python3.11-tiktoken> ⚠ Warning: `build-backend` in pyproject.toml is not set to `maturin`, packaging tools such as pip will not use maturin to build this project.
| 19:38:02 |
| matthewcroughan | I included the maturin hook when it was not necessary | 19:39:41 |
| matthewcroughan | this lead to the failure, only included dist-info in the site-packages | 19:40:04 |
| matthewcroughan | pkgs.rustPlatform.cargoSetupHook
pkgs.rustc
pkgs.cargo
| 19:40:09 |
| matthewcroughan | instead, if I remove pkgs.rustPlatform.maturinBuildHook and just add rustc and cargo, it works | 19:40:24 |
| matthewcroughan | Ah good | 19:41:30 |
| matthewcroughan | python -m private_gpt
19:41:21.103 [INFO ] private_gpt.settings.settings_loader - Starting application with profiles=['default']
2023-11-06 19:41:21.194091237 [W:onnxruntime:Default, onnxruntime_pybind_state.cc:1987 CreateInferencePybindStateModule] Init provider bridge failed.
Traceback (most recent call last):
File "<frozen runpy>", line 198, in _run_module_as_main
File "<frozen runpy>", line 88, in _run_code
File "/home/matthew/git/privateGPT/private_gpt/__main__.py", line 5, in <module>
from private_gpt.main import app
File "/home/matthew/git/privateGPT/private_gpt/main.py", line 106, in <module>
from private_gpt.ui.ui import mount_in_app
File "/home/matthew/git/privateGPT/private_gpt/ui/ui.py", line 7, in <module>
import gradio as gr # type: ignore
^^^^^^^^^^^^^^^^^^^
ModuleNotFoundError: No module named 'gradio
| 19:41:34 |
| matthewcroughan | now we enter the undeclared dependencies phase | 19:41:41 |
| matthewcroughan | How are you supposed to add new dependencies to self? | 19:58:18 |
| matthewcroughan | This is a situation I've ran into at least 3 times, and I always forget how I solve it | 20:01:05 |
| matthewcroughan | ...
packages = {
default = mkPoetryApplication {
projectDir = self;
propagatedBuildInputs = [
pkgs.python3Packages.gradio
];
overrides = defaultPoetryOverrides.extend
(self: super: {
chroma-hnswlib = super.chroma-hnswlib.override { preferWheel = true; };
chromadb = super.chromadb.override { preferWheel = true; };
pypika = super.pypika.overridePythonAttrs
(
...
| 20:01:15 |
| matthewcroughan | you see how line 5 to 7 is never going to work | 20:01:23 |
| matthewcroughan | what I want access to is the overrides of self | 20:01:32 |
| matthewcroughan | yeah you can't do it, damnit | 20:08:03 |
| matthewcroughan | mkPoetryEnv has extraPackages | 20:12:57 |
| matthewcroughan |
| 20:13:06 |
| matthewcroughan | * default = mkPoetryEnv rec {
projectDir = self;
extraPackages = p: with p; [ gradio ];
| 20:13:10 |
| matthewcroughan | There seems to be no logs to suggest that preferWheels is doinga nything | 20:15:06 |
| matthewcroughan | * There seems to be no logs to suggest that preferWheels is doing anything | 20:15:09 |
| matthewcroughan | the only time I get any success with preferWheels is when I turn it on for the function call mkPoetryApplication or mkPoetryEnv | 20:15:31 |
| matthewcroughan | error: builder for '/nix/store/lgvs95z5g2fqm6flhybn295276mcz4f7-python3.11-watchfiles-0.21.0.drv' failed with exit code 1;
last 10 log lines:
> Using wheelUnpackPhase
> Sourcing pypa-install-hook
> Using pypaInstallPhase
> Sourcing python-imports-check-hook.sh
> Using pythonImportsCheckPhase
> Sourcing python-namespaces-hook
> Sourcing python-catch-conflicts-hook.sh
> unpacking sources
> Executing wheelUnpackPhase
> cp: -r not specified; omitting directory '/nix/store/q3zw45mf49af911hphcpb8ng348m3qfq-source'
For full logs, run 'nix log /nix/store/lgvs95z5g2fqm6flhybn295276mcz4f7-python3.11-watchfiles-0.21.0.drv'.
``
| 20:15:33 |
| matthewcroughan | then when I turn it on, I get issues with cp -r | 20:15:44 |
| matthewcroughan | * then when I turn it on, I get issues with cp | 20:15:48 |
| matthewcroughan | now this dependency on gradio has introduced 9 more broken dependencies to my chain :( | 20:17:21 |
| matthewcroughan | if I turn wheels on globally, I can't turn it off on a per package basis, .override { preferWheel = false; } seems to have no impact | 20:18:34 |
| matthewcroughan | specifically, cmake is giving me a lot of grief | 20:22:31 |
| matthewcroughan | > File "<frozen importlib._bootstrap>", line 1204, in _gcd_import
> File "<frozen importlib._bootstrap>", line 1176, in _find_and_load
> File "<frozen importlib._bootstrap>", line 1126, in _find_and_load_unlocked
> File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
> File "<frozen importlib._bootstrap>", line 1204, in _gcd_import
> File "<frozen importlib._bootstrap>", line 1176, in _find_and_load
> File "<frozen importlib._bootstrap>", line 1140, in _find_and_load_unlocked
> ModuleNotFoundError: No module named 'setuptools'
| 20:22:43 |
| matthewcroughan | So I'll give it setuptools, then all hell breaks loose | 20:23:31 |
| matthewcroughan | tools/build_meta.py", line 341, in run_setup
python3.11-cmake> exec(code, locals())
python3.11-cmake> File "<string>", line 8, in <module>
python3.11-cmake> ModuleNotFoundError: No module named 'skbuild'
| 20:23:37 |
