!rWxyQqNqMUDLECdsIf:blad.is

Poetry2nix

314 Members
https://github.com/nix-community/poetry2nix59 Servers

Load older messages

SenderMessageTime
9 Nov 2023
@matthewcroughan:defenestrate.itmatthewcroughanDoes anybody know what to do when a package crashes at runtime claiming it can't find the metadata for a package via importlib?19:04:59
@matthewcroughan:defenestrate.itmatthewcroughan 
Traceback (most recent call last):
  File "/nix/store/rbn2h73md39dk9gzn19vqy6abnsskb2b-python3.11-injector-0.21.0/lib/python3.11/site-packages/injector/__init__.py", line 798, in get
    return self._context[key]
           ~~~~~~~~~~~~~^^^^^
KeyError: <class 'private_gpt.server.ingest.ingest_service.IngestService'>

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/nix/store/rbn2h73md39dk9gzn19vqy6abnsskb2b-python3.11-injector-0.21.0/lib/python3.11/site-packages/injector/__init__.py", line 798, in get
    return self._context[key]
           ~~~~~~~~~~~~~^^^^^
KeyError: <class 'private_gpt.components.embedding.embedding_component.EmbeddingComponent'>

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/nix/store/ffll6glz3gwx342z0ch8wx30p5cnqz1z-python3-3.11.5/lib/python3.11/importlib/metadata/__init__.py", line 563, in from_name
    return next(cls.discover(name=name))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
StopIteration

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/nix/store/a06nxms3mfa6fwv1mr4zbh0fcxq6pcx0-python3.11-transformers-4.35.0/lib/python3.11/site-packages/transformers/utils/versions.py", line 102, in require_version
    got_ver = importlib.metadata.version(pkg)
              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/nix/store/ffll6glz3gwx342z0ch8wx30p5cnqz1z-python3-3.11.5/lib/python3.11/importlib/metadata/__init__.py", line 1008, in version
    return distribution(distribution_name).version
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/nix/store/ffll6glz3gwx342z0ch8wx30p5cnqz1z-python3-3.11.5/lib/python3.11/importlib/metadata/__init__.py", line 981, in distribution
    return Distribution.from_name(distribution_name)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/nix/store/ffll6glz3gwx342z0ch8wx30p5cnqz1z-python3-3.11.5/lib/python3.11/importlib/metadata/__init__.py", line 565, in from_name
    raise PackageNotFoundError(name)
importlib.metadata.PackageNotFoundError: No package metadata was found for safetensors

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/nix/store/44bq984wgklj234y3pshd1y4hlwfns68-python3.11-llama-index-0.8.47/lib/python3.11/site-packages/llama_index/embeddings/huggingface.py", line 50, in __init__
    from transformers import AutoModel, AutoTokenizer
  File "/nix/store/a06nxms3mfa6fwv1mr4zbh0fcxq6pcx0-python3.11-transformers-4.35.0/lib/python3.11/site-packages/transformers/__init__.py", line 26, in <module>
    from . import dependency_versions_check
  File "/nix/store/a06nxms3mfa6fwv1mr4zbh0fcxq6pcx0-python3.11-transformers-4.35.0/lib/python3.11/site-packages/transformers/dependency_versions_check.py", line 57, in <module>
    require_version_core(deps[pkg])
  File "/nix/store/a06nxms3mfa6fwv1mr4zbh0fcxq6pcx0-python3.11-transformers-4.35.0/lib/python3.11/site-packages/transformers/utils/versions.py", line 117, in require_version_core
    return require_version(requirement, hint)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/nix/store/a06nxms3mfa6fwv1mr4zbh0fcxq6pcx0-python3.11-transformers-4.35.0/lib/python3.11/site-packages/transformers/utils/versions.py", line 104, in require_version
    raise importlib.metadata.PackageNotFoundError(
importlib.metadata.PackageNotFoundError: No package metadata was found for The 'safetensors>=0.3.1' distribution was not found and is required by this application. 
Try: pip install transformers -U or pip install -e '.[dev]' if you're working with git main

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<frozen runpy>", line 198, in _run_module_as_main
  File "<frozen runpy>", line 88, in _run_code
  File "/home/matthew/git/privateGPT/private_gpt/__main__.py", line 5, in <module>
    from private_gpt.main import app
  File "/home/matthew/git/privateGPT/private_gpt/main.py", line 106, in <module>
    from private_gpt.ui.ui import mount_in_app
  File "/home/matthew/git/privateGPT/private_gpt/ui/ui.py", line 19, in <module>
    ingest_service = root_injector.get(IngestService)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/nix/store/rbn2h73md39dk9gzn19vqy6abnsskb2b-python3.11-injector-0.21.0/lib/python3.11/site-packages/injector/__init__.py", line 91, in wrapper
    return function(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/nix/store/rbn2h73md39dk9gzn19vqy6abnsskb2b-python3.11-injector-0.21.0/lib/python3.11/site-packages/injector/__init__.py", line 974, in get
    provider_instance = scope_instance.get(interface, binding.provider)
                        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/nix/store/rbn2h73md39dk9gzn19vqy6abnsskb2b-python3.11-injector-0.21.0/lib/python3.11/site-packages/injector/__init__.py", line 91, in wrapper
    return function(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/nix/store/rbn2h73md39dk9gzn19vqy6abnsskb2b-python3.11-injector-0.21.0/lib/python3.11/site-packages/injector/__init__.py", line 800, in get
    instance = self._get_instance(key, provider, self.injector)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/nix/store/rbn2h73md39dk9gzn19vqy6abnsskb2b-python3.11-injector-0.21.0/lib/python3.11/site-packages/injector/__init__.py", line 811, in _get_instance
    return provider.get(injector)
           ^^^^^^^^^^^^^^^^^^^^^^
  File "/nix/store/rbn2h73md39dk9gzn19vqy6abnsskb2b-python3.11-injector-0.21.0/lib/python3.11/site-packages/injector/__init__.py", line 264, in get
    return injector.create_object(self._cls)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/nix/store/rbn2h73md39dk9gzn19vqy6abnsskb2b-python3.11-injector-0.21.0/lib/python3.11/site-packages/injector/__init__.py", line 998, in create_object
    self.call_with_injection(init, self_=instance, kwargs=additional_kwargs)
  File "/nix/store/rbn2h73md39dk9gzn19vqy6abnsskb2b-python3.11-injector-0.21.0/lib/python3.11/site-packages/injector/__init__.py", line 1031, in call_with_injection
    dependencies = self.args_to_inject(
                   ^^^^^^^^^^^^^^^^^^^^
  File "/nix/store/rbn2h73md39dk9gzn19vqy6abnsskb2b-python3.11-injector-0.21.0/lib/python3.11/site-packages/injector/__init__.py", line 91, in wrapper
    return function(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/nix/store/rbn2h73md39dk9gzn19vqy6abnsskb2b-python3.11-injector-0.21.0/lib/python3.11/site-packages/injector/__init__.py", line 1079, in args_to_inject
    instance: Any = self.get(interface)
                    ^^^^^^^^^^^^^^^^^^^
  File "/nix/store/rbn2h73md39dk9gzn19vqy6abnsskb2b-python3.11-injector-0.21.0/lib/python3.11/site-packages/injector/__init__.py", line 91, in wrapper
    return function(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/nix/store/rbn2h73md39dk9gzn19vqy6abnsskb2b-python3.11-injector-0.21.0/lib/python3.11/site-packages/injector/__init__.py", line 974, in get
    provider_instance = scope_instance.get(interface, binding.provider)
                        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/nix/store/rbn2h73md39dk9gzn19vqy6abnsskb2b-python3.11-injector-0.21.0/lib/python3.11/site-packages/injector/__init__.py", line 91, in wrapper
    return function(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/nix/store/rbn2h73md39dk9gzn19vqy6abnsskb2b-python3.11-injector-0.21.0/lib/python3.11/site-packages/injector/__init__.py", line 800, in get
    instance = self._get_instance(key, provider, self.injector)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/nix/store/rbn2h73md39dk9gzn19vqy6abnsskb2b-python3.11-injector-0.21.0/lib/python3.11/site-packages/injector/__init__.py", line 811, in _get_instance
    return provider.get(injector)
           ^^^^^^^^^^^^^^^^^^^^^^
  File "/nix/store/rbn2h73md39dk9gzn19vqy6abnsskb2b-python3.11-injector-0.21.0/lib/python3.11/site-packages/injector/__init__.py", line 264, in get
    return injector.create_object(self._cls)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/nix/store/rbn2h73md39dk9gzn19vqy6abnsskb2b-python3.11-injector-0.21.0/lib/python3.11/site-packages/injector/__init__.py", line 998, in create_object
    self.call_with_injection(init, self_=instance, kwargs=additional_kwargs)
  File "/nix/store/rbn2h73md39dk9gzn19vqy6abnsskb2b-python3.11-injector-0.21.0/lib/python3.11/site-packages/injector/__init__.py", line 1040, in call_with_injection
    return callable(*full_args, **dependencies)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/matthew/git/privateGPT/private_gpt/components/embedding/embedding_component.py", line 19, in __init__
    self.embedding_model = HuggingFaceEmbedding(
                           ^^^^^^^^^^^^^^^^^^^^^
  File "/nix/store/44bq984wgklj234y3pshd1y4hlwfns68-python3.11-llama-index-0.8.47/lib/python3.11/site-packages/llama_index/embeddings/huggingface.py", line 52, in __init__
    raise ImportError(
ImportError: HuggingFaceEmbedding requires transformers to be installed.
Please install transformers with `pip install transformers`.
19:05:01
@k900:0upti.meK900importlib.metadata.PackageNotFoundError: No package metadata was found for The 'safetensors>=0.3.1' distribution was not found and is required by this application.19:08:16
@k900:0upti.meK900
importlib.metadata.PackageNotFoundError: No package metadata was found for The 'safetensors>=0.3.1' distribution was not found and is required by this application.
19:08:18
@k900:0upti.meK900The actual package it's complaining about is not transformers19:08:26
@matthewcroughan:defenestrate.itmatthewcroughan
In reply to @k900:0upti.me
The actual package it's complaining about is not transformers
it's llama-index right? 		19:15:37
@k900:0upti.meK900No?19:15:42
@k900:0upti.meK900Read the error19:15:44
@matthewcroughan:defenestrate.itmatthewcroughanI have, how are you figuring this out?19:15:50
@matthewcroughan:defenestrate.itmatthewcroughan

No package metadata was found for safetensors

19:16:19
@matthewcroughan:defenestrate.itmatthewcroughan

ImportError: HuggingFaceEmbedding requires transformers to be installed.

19:16:24
@k900:0upti.meK900
In reply to@k900:0upti.me
importlib.metadata.PackageNotFoundError: No package metadata was found for The 'safetensors>=0.3.1' distribution was not found and is required by this application.
^ 		19:17:07
@matthewcroughan:defenestrate.itmatthewcroughanOh sorry, I didn't realise that was a quote in my client19:17:19
@matthewcroughan:defenestrate.itmatthewcroughanI thought it was juat a reply to my big log 19:17:26
@matthewcroughan:defenestrate.itmatthewcroughanThere are other programs in this python chain, that use the safetensors that is being provided correctly19:17:52
@matthewcroughan:defenestrate.itmatthewcroughanThe first thing I did was put safetensors in the propagatedBuildInputs of eveyrthing I could think of19:18:12
@matthewcroughan:defenestrate.itmatthewcroughanit did not seem to change anything 19:18:17
@matthewcroughan:defenestrate.itmatthewcroughan * The first thing I did was put safetensors in the propagatedBuildInputs of everything I could think of19:18:31
@matthewcroughan:defenestrate.itmatthewcroughan Why does safetensors have no metadata? That's what I don't understand. And how do I give it the metadata it needs? K900 ⚡️ 19:21:49
@matthewcroughan:defenestrate.itmatthewcroughan 
                safetensors = super.safetensors.overridePythonAttrs
                  (
                    old: {
                      sourceRoot = "safetensors-0.4.0/bindings/python";
                      cargoDeps = pkgs.rustPlatform.importCargoLock {
                        lockFile = ./nix/safetensors/Cargo.lock;
                      };
                      nativeBuildInputs = (old.nativeBuildInputs or [ ]) ++ [
                        pkgs.rustPlatform.cargoSetupHook
                        pkgs.rustPlatform.maturinBuildHook
                      ];
                    }
                  );
19:21:54
@k900:0upti.meK900It doesn't have "no metadata"19:21:58
@k900:0upti.meK900 It's missing something 19:22:06
@matthewcroughan:defenestrate.itmatthewcroughanOh, it can't find the package 19:22:17
@matthewcroughan:defenestrate.itmatthewcroughan * Oh, it can't find the package?19:22:19
@k900:0upti.meK900 You can try calling importlib.metadata.version("safetensors") in a Python shell yourself 19:22:20
@matthewcroughan:defenestrate.itmatthewcroughan PackageNotFoundError 19:22:23
@k900:0upti.meK900And see why it fails19:22:24
@matthewcroughan:defenestrate.itmatthewcroughan 
ls result/lib/python3.11/site-packages/safetensors_
safetensors_python-0.4.0.dist-info/ safetensors_rust/
19:24:05
@matthewcroughan:defenestrate.itmatthewcroughangrrr19:24:21
@matthewcroughan:defenestrate.itmatthewcroughanit's not ending up in the site-packages 19:24:26

Show newer messages

Back to Room ListRoom Version: 6