!rWxyQqNqMUDLECdsIf:blad.is

Poetry2nix

313 Members
https://github.com/nix-community/poetry2nix58 Servers

Load older messages

SenderMessageTime
9 Nov 2023
@adis:blad.isadisbladis
In reply to @matthewcroughan:defenestrate.it
I ran into this case just now where I had to set the preConfigure for scipy to "", because it doesn't work with the newer version, is that a common thing that has to be done?
Trying to make a package set that works is hard, trying to make one that works with ranges of versions even more so. 		02:54:18
@adis:blad.isadisbladishttps://github.com/adisbladis/pdm2nix/blob/master/tests/trivial/default.nix 🎉04:00:25
@matthewcroughan:defenestrate.itmatthewcroughan
In reply to @adis:blad.is
Trying to make a package set that works is hard, trying to make one that works with ranges of versions even more so.
Is it sustainable to have people vendor cargo.locks when the cargo.locks are already present in the srcs? 		14:09:22
@matthewcroughan:defenestrate.itmatthewcroughanThese are the two main problems I've encountered when using poetry2nix, having to vendor cargo.locks redundantly, and fighting with existing overrides14:10:05
@adis:blad.isadisbladisDoing ifd by default is not an option14:10:27
@matthewcroughan:defenestrate.itmatthewcroughanI know it's a new issue however, and I've read the edge cases doc14:10:32
@matthewcroughan:defenestrate.itmatthewcroughan
In reply to @adis:blad.is
Doing ifd by default is not an option
could be an option though right? 		14:10:43
@matthewcroughan:defenestrate.itmatthewcroughanmkPoetryApplication { allowIfd = true; }14:11:04
@matthewcroughan:defenestrate.itmatthewcroughanwhat is the main reason to not have IFD? Is it just to be compatible with nixpkgs?14:11:27
@matthewcroughan:defenestrate.itmatthewcroughanwhat dream2nix is doing, is having a lock file that can be generated and that could be put into nixpkgs14:11:45
@matthewcroughan:defenestrate.itmatthewcroughanvendoring one lock file for everything is more maintainable than vendoring x N lockfiles for N dependencie14:12:10
@matthewcroughan:defenestrate.itmatthewcroughan * vendoring one lock file for everything is more maintainable than vendoring x N lockfiles for N dependencies14:12:11
@adis:blad.isadisbladisGeneral slowness, surprising gc behaviour 14:12:29
@adis:blad.isadisbladisAnd so on and so forth14:12:45
@matthewcroughan:defenestrate.itmatthewcroughanI swear I saw something you made that was pure nix packaging for python projects14:13:06
@matthewcroughan:defenestrate.itmatthewcroughanlike an alternative to poetry14:13:12
@matthewcroughan:defenestrate.itmatthewcroughandid I not see that14:13:15
@matthewcroughan:defenestrate.itmatthewcroughanmaybe it was a dream14:13:26
@adis:blad.isadisbladishttps://github.com/nix-community/pyproject.nix14:13:51
@adis:blad.isadisbladisProbably14:13:56
@matthewcroughan:defenestrate.itmatthewcroughanthat's it14:14:35
@matthewcroughan:defenestrate.itmatthewcroughan btw, I got the privateGPT project working in this flake, but still can't figure out how to get rid of the dependency on pkgs.python3Packages.cmake 14:14:57
@matthewcroughan:defenestrate.itmatthewcroughanhttps://github.com/MatthewCroughan/privateGPT/blob/main/flake.nix#L3014:14:58
@matthewcroughan:defenestrate.itmatthewcroughanother things seem to depend on it, like pybind11 and I couldn't figure out how to build cmake itself properly14:15:28
@adis:blad.isadisbladisIt's not really an alternative to poetry. It doesn't do lock files. 14:15:35
@adis:blad.isadisbladisI'm building something completely new for pdm with a new interface based on overlay composition14:20:13
@adis:blad.isadisbladisSee the test case I linked a bit further up14:23:36
@matthewcroughan:defenestrate.itmatthewcroughanDoes anybody know what to do when a package crashes at runtime claiming it can't find the metadata for a package via importlib?19:04:59
@matthewcroughan:defenestrate.itmatthewcroughan 
Traceback (most recent call last):
  File "/nix/store/rbn2h73md39dk9gzn19vqy6abnsskb2b-python3.11-injector-0.21.0/lib/python3.11/site-packages/injector/__init__.py", line 798, in get
    return self._context[key]
           ~~~~~~~~~~~~~^^^^^
KeyError: <class 'private_gpt.server.ingest.ingest_service.IngestService'>

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/nix/store/rbn2h73md39dk9gzn19vqy6abnsskb2b-python3.11-injector-0.21.0/lib/python3.11/site-packages/injector/__init__.py", line 798, in get
    return self._context[key]
           ~~~~~~~~~~~~~^^^^^
KeyError: <class 'private_gpt.components.embedding.embedding_component.EmbeddingComponent'>

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/nix/store/ffll6glz3gwx342z0ch8wx30p5cnqz1z-python3-3.11.5/lib/python3.11/importlib/metadata/__init__.py", line 563, in from_name
    return next(cls.discover(name=name))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
StopIteration

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/nix/store/a06nxms3mfa6fwv1mr4zbh0fcxq6pcx0-python3.11-transformers-4.35.0/lib/python3.11/site-packages/transformers/utils/versions.py", line 102, in require_version
    got_ver = importlib.metadata.version(pkg)
              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/nix/store/ffll6glz3gwx342z0ch8wx30p5cnqz1z-python3-3.11.5/lib/python3.11/importlib/metadata/__init__.py", line 1008, in version
    return distribution(distribution_name).version
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/nix/store/ffll6glz3gwx342z0ch8wx30p5cnqz1z-python3-3.11.5/lib/python3.11/importlib/metadata/__init__.py", line 981, in distribution
    return Distribution.from_name(distribution_name)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/nix/store/ffll6glz3gwx342z0ch8wx30p5cnqz1z-python3-3.11.5/lib/python3.11/importlib/metadata/__init__.py", line 565, in from_name
    raise PackageNotFoundError(name)
importlib.metadata.PackageNotFoundError: No package metadata was found for safetensors

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/nix/store/44bq984wgklj234y3pshd1y4hlwfns68-python3.11-llama-index-0.8.47/lib/python3.11/site-packages/llama_index/embeddings/huggingface.py", line 50, in __init__
    from transformers import AutoModel, AutoTokenizer
  File "/nix/store/a06nxms3mfa6fwv1mr4zbh0fcxq6pcx0-python3.11-transformers-4.35.0/lib/python3.11/site-packages/transformers/__init__.py", line 26, in <module>
    from . import dependency_versions_check
  File "/nix/store/a06nxms3mfa6fwv1mr4zbh0fcxq6pcx0-python3.11-transformers-4.35.0/lib/python3.11/site-packages/transformers/dependency_versions_check.py", line 57, in <module>
    require_version_core(deps[pkg])
  File "/nix/store/a06nxms3mfa6fwv1mr4zbh0fcxq6pcx0-python3.11-transformers-4.35.0/lib/python3.11/site-packages/transformers/utils/versions.py", line 117, in require_version_core
    return require_version(requirement, hint)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/nix/store/a06nxms3mfa6fwv1mr4zbh0fcxq6pcx0-python3.11-transformers-4.35.0/lib/python3.11/site-packages/transformers/utils/versions.py", line 104, in require_version
    raise importlib.metadata.PackageNotFoundError(
importlib.metadata.PackageNotFoundError: No package metadata was found for The 'safetensors>=0.3.1' distribution was not found and is required by this application. 
Try: pip install transformers -U or pip install -e '.[dev]' if you're working with git main

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<frozen runpy>", line 198, in _run_module_as_main
  File "<frozen runpy>", line 88, in _run_code
  File "/home/matthew/git/privateGPT/private_gpt/__main__.py", line 5, in <module>
    from private_gpt.main import app
  File "/home/matthew/git/privateGPT/private_gpt/main.py", line 106, in <module>
    from private_gpt.ui.ui import mount_in_app
  File "/home/matthew/git/privateGPT/private_gpt/ui/ui.py", line 19, in <module>
    ingest_service = root_injector.get(IngestService)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/nix/store/rbn2h73md39dk9gzn19vqy6abnsskb2b-python3.11-injector-0.21.0/lib/python3.11/site-packages/injector/__init__.py", line 91, in wrapper
    return function(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/nix/store/rbn2h73md39dk9gzn19vqy6abnsskb2b-python3.11-injector-0.21.0/lib/python3.11/site-packages/injector/__init__.py", line 974, in get
    provider_instance = scope_instance.get(interface, binding.provider)
                        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/nix/store/rbn2h73md39dk9gzn19vqy6abnsskb2b-python3.11-injector-0.21.0/lib/python3.11/site-packages/injector/__init__.py", line 91, in wrapper
    return function(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/nix/store/rbn2h73md39dk9gzn19vqy6abnsskb2b-python3.11-injector-0.21.0/lib/python3.11/site-packages/injector/__init__.py", line 800, in get
    instance = self._get_instance(key, provider, self.injector)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/nix/store/rbn2h73md39dk9gzn19vqy6abnsskb2b-python3.11-injector-0.21.0/lib/python3.11/site-packages/injector/__init__.py", line 811, in _get_instance
    return provider.get(injector)
           ^^^^^^^^^^^^^^^^^^^^^^
  File "/nix/store/rbn2h73md39dk9gzn19vqy6abnsskb2b-python3.11-injector-0.21.0/lib/python3.11/site-packages/injector/__init__.py", line 264, in get
    return injector.create_object(self._cls)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/nix/store/rbn2h73md39dk9gzn19vqy6abnsskb2b-python3.11-injector-0.21.0/lib/python3.11/site-packages/injector/__init__.py", line 998, in create_object
    self.call_with_injection(init, self_=instance, kwargs=additional_kwargs)
  File "/nix/store/rbn2h73md39dk9gzn19vqy6abnsskb2b-python3.11-injector-0.21.0/lib/python3.11/site-packages/injector/__init__.py", line 1031, in call_with_injection
    dependencies = self.args_to_inject(
                   ^^^^^^^^^^^^^^^^^^^^
  File "/nix/store/rbn2h73md39dk9gzn19vqy6abnsskb2b-python3.11-injector-0.21.0/lib/python3.11/site-packages/injector/__init__.py", line 91, in wrapper
    return function(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/nix/store/rbn2h73md39dk9gzn19vqy6abnsskb2b-python3.11-injector-0.21.0/lib/python3.11/site-packages/injector/__init__.py", line 1079, in args_to_inject
    instance: Any = self.get(interface)
                    ^^^^^^^^^^^^^^^^^^^
  File "/nix/store/rbn2h73md39dk9gzn19vqy6abnsskb2b-python3.11-injector-0.21.0/lib/python3.11/site-packages/injector/__init__.py", line 91, in wrapper
    return function(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/nix/store/rbn2h73md39dk9gzn19vqy6abnsskb2b-python3.11-injector-0.21.0/lib/python3.11/site-packages/injector/__init__.py", line 974, in get
    provider_instance = scope_instance.get(interface, binding.provider)
                        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/nix/store/rbn2h73md39dk9gzn19vqy6abnsskb2b-python3.11-injector-0.21.0/lib/python3.11/site-packages/injector/__init__.py", line 91, in wrapper
    return function(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/nix/store/rbn2h73md39dk9gzn19vqy6abnsskb2b-python3.11-injector-0.21.0/lib/python3.11/site-packages/injector/__init__.py", line 800, in get
    instance = self._get_instance(key, provider, self.injector)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/nix/store/rbn2h73md39dk9gzn19vqy6abnsskb2b-python3.11-injector-0.21.0/lib/python3.11/site-packages/injector/__init__.py", line 811, in _get_instance
    return provider.get(injector)
           ^^^^^^^^^^^^^^^^^^^^^^
  File "/nix/store/rbn2h73md39dk9gzn19vqy6abnsskb2b-python3.11-injector-0.21.0/lib/python3.11/site-packages/injector/__init__.py", line 264, in get
    return injector.create_object(self._cls)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/nix/store/rbn2h73md39dk9gzn19vqy6abnsskb2b-python3.11-injector-0.21.0/lib/python3.11/site-packages/injector/__init__.py", line 998, in create_object
    self.call_with_injection(init, self_=instance, kwargs=additional_kwargs)
  File "/nix/store/rbn2h73md39dk9gzn19vqy6abnsskb2b-python3.11-injector-0.21.0/lib/python3.11/site-packages/injector/__init__.py", line 1040, in call_with_injection
    return callable(*full_args, **dependencies)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/matthew/git/privateGPT/private_gpt/components/embedding/embedding_component.py", line 19, in __init__
    self.embedding_model = HuggingFaceEmbedding(
                           ^^^^^^^^^^^^^^^^^^^^^
  File "/nix/store/44bq984wgklj234y3pshd1y4hlwfns68-python3.11-llama-index-0.8.47/lib/python3.11/site-packages/llama_index/embeddings/huggingface.py", line 52, in __init__
    raise ImportError(
ImportError: HuggingFaceEmbedding requires transformers to be installed.
Please install transformers with `pip install transformers`.
19:05:01
@k900:0upti.meK900importlib.metadata.PackageNotFoundError: No package metadata was found for The 'safetensors>=0.3.1' distribution was not found and is required by this application.19:08:16

Show newer messages

Back to Room ListRoom Version: 6