My context is a nix shell where I am loading in the poetry2nix overlay.nix and my (ineffective) attempted fix is to apply an overlay for tiktoken there as well - like so:

  pkgs = import <nixpkgs> {
    overlays = [
      (import "${poetry2nix}/overlay.nix")
      (self: super: {
        tiktoken = super.tiktoken.overridePythonAttrs (
          old: {
            nativeBuildInputs = (old.nativeBuildInputs or [ ]) ++ [ self.setuptools-rust ];
          }
        );
      })
    ];
  };

anyone seen this error with watchfiles before?

test

anyone seen this error with watchfiles before?

% nix-shell --show-trace third_party/dag/shell.nix
these 7 derivations will be built:
  /nix/store/6njdnf1nf2z5rc2ib1hvjm22b4z7ra6h-python3.11-gql-3.5.0.drv
  /nix/store/hs6abwalf22xnn8kqpalxc9w5ix7bz00-python3.11-watchfiles-0.21.0.drv
  /nix/store/alvr3iyfbv53wa4wwcc8g65pdzzhz1si-python3.11-uvicorn-0.27.0.drv
  /nix/store/g8kyg19jb72a4y3biq2lykky5bhgzfyi-python3.11-dagster-1.6.1.drv
  /nix/store/xz9f6g1g1x8r4ci6nmryzv6hgcr9sfzg-python3.11-starlette-0.36.1.drv
  /nix/store/kszbyxkhx1bng2nr92860kl71nci7qfn-python3.11-dagster-graphql-1.6.1.drv
  /nix/store/fv1126dh0khbw5bdr9x213qg5dz56k95-python3.11-dagster-webserver-1.6.1.drv
building '/nix/store/g8kyg19jb72a4y3biq2lykky5bhgzfyi-python3.11-dagster-1.6.1.drv'...
building '/nix/store/xz9f6g1g1x8r4ci6nmryzv6hgcr9sfzg-python3.11-starlette-0.36.1.drv'...
building '/nix/store/6njdnf1nf2z5rc2ib1hvjm22b4z7ra6h-python3.11-gql-3.5.0.drv'...
building '/nix/store/hs6abwalf22xnn8kqpalxc9w5ix7bz00-python3.11-watchfiles-0.21.0.drv'...
...
Executing wheelUnpackPhase
configuring
cp: -r not specified; omitting directory '/nix/store/q3zw45mf49af911hphcpb8ng348m3qfq-source'
error: builder for '/nix/store/hs6abwalf22xnn8kqpalxc9w5ix7bz00-python3.11-watchfiles-0.21.0.drv' failed with exit code 1;
       last 10 log lines:
       > Using wheelUnpackPhase
       > Sourcing pypa-install-hook
       > Using pypaInstallPhase
       > Sourcing python-imports-check-hook.sh
       > Using pythonImportsCheckPhase
       > Sourcing python-namespaces-hook
       > Sourcing python-catch-conflicts-hook.sh
       > unpacking sources
       > Executing wheelUnpackPhase

anyone seen this error with watchfiles before?

sreec@Sreekaras-MacBook-Pro data-warehouse % nix-shell --show-trace third_party/dag/shell.nix
...
patching sources
no configure script, doing nothing
building
no Makefile or custom buildPhase, doing nothing
installing
Executing pypaInstallPhase
updateAutotoolsGnuConfigScriptsPhase
unpacking sources
configuring
Executing wheelUnpackPhase
cp: -r not specified; omitting directory '/nix/store/q3zw45mf49af911hphcpb8ng348m3qfq-source'

anyone seen this error with the watchfiles package before?

sreec@Sreekaras-MacBook-Pro data-warehouse % nix-shell --show-trace third_party/dag/shell.nix
...
patching sources
no configure script, doing nothing
building
no Makefile or custom buildPhase, doing nothing
installing
Executing pypaInstallPhase
updateAutotoolsGnuConfigScriptsPhase
unpacking sources
configuring
Executing wheelUnpackPhase
cp: -r not specified; omitting directory '/nix/store/q3zw45mf49af911hphcpb8ng348m3qfq-source'

anyone seen this error with the watchfiles package before?

% nix log /nix/store/hs6abwalf22xnn8kqpalxc9w5ix7bz00-python3.11-watchfiles-0.21.0.drv
warning: The interpretation of store paths arguments ending in `.drv` recently changed. If this command is now failing try again with '/nix/store/hs6abwalf22xnn8kqpalxc9w5ix7bz00-python3.11-watchfiles-0.21.0.drv^*'
Sourcing python-remove-tests-dir-hook
Sourcing python-catch-conflicts-hook.sh
Sourcing python-remove-bin-bytecode-hook.sh
Sourcing wheel setup hook
Using wheelUnpackPhase
Sourcing pypa-install-hook
Using pypaInstallPhase
Sourcing python-imports-check-hook.sh
Using pythonImportsCheckPhase
Sourcing python-namespaces-hook
Sourcing python-catch-conflicts-hook.sh
@nix { "action": "setPhase", "phase": "unpackPhase" }
unpacking sources
Executing wheelUnpackPhase
cp: -r not specified; omitting directory '/nix/store/q3zw45mf49af911hphcpb8ng348m3qfq-source

In reply to @angryant:envs.net
I am having trouble building a Poetry project which has tiktoken as a dependency. I am assuming the issue is related to https://github.com/nix-community/poetry2nix/issues/261 - but I am unsure how to fix it.

I think your issue is that your overlay is expecing there to be a <nixpkgs>.tiktoken, when it would be at least <nixpkgs>.python310Packages.tiktoken or such.

Are you using mkPoetryApplication or the like?
here's a minimal example taht does this for autograd-gamma (and setuptools) in a project of mine

{
  description = "Application packaged using poetry2nix";

  inputs = {
    flake-utils.url = "github:numtide/flake-utils";
    nixpkgs.url = "github:NixOS/nixpkgs/nixos-unstable";
    poetry2nix = {
      url = "github:TyberiusPrime/poetry2nix/rpds-py";
      inputs.nixpkgs.follows = "nixpkgs";
    };
  };

  outputs = {
    self,
    nixpkgs,
    flake-utils,
    poetry2nix,
  }:
    flake-utils.lib.eachDefaultSystem (system: let
      # see https://github.com/nix-community/poetry2nix/tree/master#api for more functions and examples.
      pkgs = nixpkgs.legacyPackages.${system};
      inherit (poetry2nix.lib.mkPoetry2Nix {inherit pkgs;}) mkPoetryApplication overrides;
    in {
      packages = {
        myapp = mkPoetryApplication {
          projectDir = self;
          preferWheels = true;
          overrides =
            overrides.withDefaults
            (
              self: super: {
                autograd-gamma = super.autograd-gamma.overridePythonAttrs (old: {
                  propagatedBuildInputs = (old.propagatedBuildInputs or []) ++ [self.setuptools];
                });
                           }
            );
        };
        default = self.packages.${system}.myapp;
      };

      devShells.default = pkgs.mkShell {
        inputsFrom = [self.packages.${system}.myapp];
        packages = [pkgs.poetry];
      };
    });
}

In reply to @tyberius_prime:matrix.org

I think your issue is that your overlay is expecing there to be a <nixpkgs>.tiktoken, when it would be at least <nixpkgs>.python310Packages.tiktoken or such.

Are you using mkPoetryApplication or the like?
here's a minimal example taht does this for autograd-gamma (and setuptools) in a project of mine

{
  description = "Application packaged using poetry2nix";

  inputs = {
    flake-utils.url = "github:numtide/flake-utils";
    nixpkgs.url = "github:NixOS/nixpkgs/nixos-unstable";
    poetry2nix = {
      url = "github:TyberiusPrime/poetry2nix/rpds-py";
      inputs.nixpkgs.follows = "nixpkgs";
    };
  };

  outputs = {
    self,
    nixpkgs,
    flake-utils,
    poetry2nix,
  }:
    flake-utils.lib.eachDefaultSystem (system: let
      # see https://github.com/nix-community/poetry2nix/tree/master#api for more functions and examples.
      pkgs = nixpkgs.legacyPackages.${system};
      inherit (poetry2nix.lib.mkPoetry2Nix {inherit pkgs;}) mkPoetryApplication overrides;
    in {
      packages = {
        myapp = mkPoetryApplication {
          projectDir = self;
          preferWheels = true;
          overrides =
            overrides.withDefaults
            (
              self: super: {
                autograd-gamma = super.autograd-gamma.overridePythonAttrs (old: {
                  propagatedBuildInputs = (old.propagatedBuildInputs or []) ++ [self.setuptools];
                });
                           }
            );
        };
        default = self.packages.${system}.myapp;
      };

      devShells.default = pkgs.mkShell {
        inputsFrom = [self.packages.${system}.myapp];
        packages = [pkgs.poetry];
      };
    });
}

Thanks! I am using mkPoetryPackages as I just need the packages in a composite environment where the Poetry setup is only part of things. For now I have bypassed the issue via preferWheels, but I'll give your setup a closer look to see if I can sort things out without.

  poetry = pkgs.poetry2nix.mkPoetryPackages {
    projectDir = pythonPath;
    python = pkgs.python311;
    preferWheels = true;
  };

Thanks! I am using mkPoetryPackages as I just need the packages in a composite environment where the Poetry setup is only part of things. For now I have bypassed the issue via preferWheels, but I'll give your setup a closer look to see if I can sort things out without.

  poetry = pkgs.poetry2nix.mkPoetryPackages {
    projectDir = pythonPath;
    python = pkgs.python311;
    preferWheels = true;
  };

In reply to @angryant:envs.net

Thanks! I am using mkPoetryPackages as I just need the packages in a composite environment where the Poetry setup is only part of things. For now I have bypassed the issue via preferWheels, but I'll give your setup a closer look to see if I can sort things out without.

  poetry = pkgs.poetry2nix.mkPoetryPackages {
    projectDir = pythonPath;
    python = pkgs.python311;
    preferWheels = true;
  };

Hi, I'm a novice nix user. I’m trying to write a flake for a poetry project at work. The existing project has gnureadline in the pyproject.toml dev dependencies:

[tool.poetry.group.dev.dependencies]
gnureadline = "^8.1.2"

When I try to build the flake, I get the following error:

  ld: library not found for -lncurses
  clang-16: error: linker command failed with exit code 1 (use -v to see invocation)
  error: command '/nix/store/2k44jw0kwqnymimzfwq1p53s59rvbvzr-clang-wrapper-16.0.6/bin/clang' failed with exit code 1

A stripped-down example of the issue is here: https://github.com/amrox/poetry2nix-gnureadline

Any ideas how to resolve this?

In reply to @mroxatron:matrix.org

Hi, I'm a novice nix user. I’m trying to write a flake for a poetry project at work. The existing project has gnureadline in the pyproject.toml dev dependencies:

[tool.poetry.group.dev.dependencies]
gnureadline = "^8.1.2"

When I try to build the flake, I get the following error:

  ld: library not found for -lncurses
  clang-16: error: linker command failed with exit code 1 (use -v to see invocation)
  error: command '/nix/store/2k44jw0kwqnymimzfwq1p53s59rvbvzr-clang-wrapper-16.0.6/bin/clang' failed with exit code 1

A stripped-down example of the issue is here: https://github.com/amrox/poetry2nix-gnureadline

Any ideas how to resolve this?

I'm getting this error when trying to enter a poetry2nix environment with latest poetry2nix master and gitlint 0.19.1:

ValueError: Unable to determine which files to ship inside the wheel using the following heuristics: https://hatch.pypa.io/latest/plugins/builder/wheel/#default-file-selection

I'm getting this error when trying to enter a poetry2nix environment with latest poetry2nix master and gitlint 0.19.1:

ValueError: Unable to determine which files to ship inside the wheel using the following heuristics: https://hatch.pypa.io/latest/plugins/builder/wheel/#default-file-selection

Not sure how to deal with that.