In reply to @vengmark2:matrix.org
Does anyone know what to do with "unexpected argument 'flit-core'"? I can't reproduce locally and I have tried nixpkgs 23.05, 23.11, and unstable.

error: builder for '/nix/store/a84cmdbixl66fpwaabpv00824rf91srs-python3.11-sphinxcontrib-jquery-4.1.drv' failed with exit code 1;
       last 10 log lines:
       >            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
       >   File "<frozen importlib._bootstrap>", line 1204, in _gcd_import
       >   File "<frozen importlib._bootstrap>", line 1176, in _find_and_load
       >   File "<frozen importlib._bootstrap>", line 1147, in _find_and_load_unlocked
       >   File "<frozen importlib._bootstrap>", line 690, in _load_unlocked
       >   File "<frozen importlib._bootstrap_external>", line 940, in exec_module
       >   File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
       >   File "/nix/store/pbx86iidhb639fpw5v5dzqb11r30vr3a-python3.11-sphinxcontrib-jquery-4.1/lib/python3.11/site-packages/sphinxcontrib/jquery/__init__.py", line 4, in <module>
       >     import sphinx
       > ModuleNotFoundError: No module named 'sphinx'
       For full logs, run 'nix log /nix/store/a84cmdbixl66fpwaabpv00824rf91srs-python3.11-sphinxcontrib-jquery-4.1.drv'.
error: 1 dependencies of derivation '/nix/store/dd20427qcp8hzk366xbgkfjy074ay5ql-python3.11-sphinx-rtd-theme-1.3.0.drv' failed to build
error: 1 dependencies of derivation '/nix/store/4clrd2bi31nllninx3jprabv0w0z502p-python3.11-wrapt-1.14.1.drv' failed to build
error: 1 dependencies of derivation '/nix/store/3dcm1pp23pk8x88i7rp7xyds6ddjy7g6-python3.11-astroid-2.15.6.drv' failed to build
error: 1 dependencies of derivation '/nix/store/d318vswd0cs42c48j96kl9drp5xbxwhn-python3.11-pylint-2.17.5.drv' failed to build
error: 1 dependencies of derivation '/nix/store/61ynh7cwk569sccjvii1rdlpwh2lz2zj-python3.11-setuptools-lint-0.6.0.drv' failed to build
error: 1 dependencies of derivation '/nix/store/h60vj9ivfwxlxydxqr8hbdyc2q3wi1lz-python3.11-pynput-1.7.6.drv' failed to build
error: 1 dependencies of derivation '/nix/store/isz6x5mx30pxvrs7kj1n8c8mmw7x0hmw-nix-shell-env.drv' failed to build
direnv: export +AR +AS +CC +CONFIG_SHELL +CXX +DETERMINISTIC_BUILD +HOST_PATH +IN_NIX_SHELL +LD +NIX_BINTOOLS +NIX_BINTOOLS_WRAPPER_TARGET_HOST_x86_64_unknown_linux_gnu +NIX_BUILD_CORES +NIX_CC +NIX_CC_WRAPPER_TARGET_HOST_x86_64_unknown_linux_gnu +NIX_CFLAGS_COMPILE +NIX_ENFORCE_NO_NATIVE +NIX_HARDENING_ENABLE +NIX_LDFLAGS +NIX_STORE +NM +OBJCOPY +OBJDUMP +PYTHONHASHSEED +PYTHONNOUSERSITE +PYTHONPATH +RANLIB +READELF +SIZE +SOURCE_DATE_EPOCH +STRINGS +STRIP +_PYTHON_HOST_PLATFORM +_PYTHON_SYSCONFIGDATA_NAME +__structuredAttrs +buildInputs +buildPhase +builder +cmakeFlags +configureFlags +depsBuildBuild +depsBuildBuildPropagated +depsBuildTarget +depsBuildTargetPropagated +depsHostHost +depsHostHostPropagated +depsTargetTarget +depsTargetTargetPropagated +doCheck +doInstallCheck +dontAddDisableDepTrack +mesonFlags +name +nativeBuildInputs +out +outputs +patches +phases +preferLocalBuild +propagatedBuildInputs +propagatedNativeBuildInputs +shell +shellHook +stdenv +strictDeps +system ~PATH ~XDG_DATA_DIRS

Even though I have the following piece of text inside my flake.nix?

pypkgs-build-requirements = {
          # discord = [ "setuptools" ];
          pynput = [ "sphinx" ];
        };

error: builder for '/nix/store/a84cmdbixl66fpwaabpv00824rf91srs-python3.11-sphinxcontrib-jquery-4.1.drv' failed with exit code 1;
       last 10 log lines:
       >            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
       >   File "<frozen importlib._bootstrap>", line 1204, in _gcd_import
       >   File "<frozen importlib._bootstrap>", line 1176, in _find_and_load
       >   File "<frozen importlib._bootstrap>", line 1147, in _find_and_load_unlocked
       >   File "<frozen importlib._bootstrap>", line 690, in _load_unlocked
       >   File "<frozen importlib._bootstrap_external>", line 940, in exec_module
       >   File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
       >   File "/nix/store/pbx86iidhb639fpw5v5dzqb11r30vr3a-python3.11-sphinxcontrib-jquery-4.1/lib/python3.11/site-packages/sphinxcontrib/jquery/__init__.py", line 4, in <module>
       >     import sphinx
       > ModuleNotFoundError: No module named 'sphinx'
       For full logs, run 'nix log /nix/store/a84cmdbixl66fpwaabpv00824rf91srs-python3.11-sphinxcontrib-jquery-4.1.drv'.
error: 1 dependencies of derivation '/nix/store/dd20427qcp8hzk366xbgkfjy074ay5ql-python3.11-sphinx-rtd-theme-1.3.0.drv' failed to build
error: 1 dependencies of derivation '/nix/store/4clrd2bi31nllninx3jprabv0w0z502p-python3.11-wrapt-1.14.1.drv' failed to build
error: 1 dependencies of derivation '/nix/store/3dcm1pp23pk8x88i7rp7xyds6ddjy7g6-python3.11-astroid-2.15.6.drv' failed to build
error: 1 dependencies of derivation '/nix/store/d318vswd0cs42c48j96kl9drp5xbxwhn-python3.11-pylint-2.17.5.drv' failed to build
error: 1 dependencies of derivation '/nix/store/61ynh7cwk569sccjvii1rdlpwh2lz2zj-python3.11-setuptools-lint-0.6.0.drv' failed to build
error: 1 dependencies of derivation '/nix/store/h60vj9ivfwxlxydxqr8hbdyc2q3wi1lz-python3.11-pynput-1.7.6.drv' failed to build
error: 1 dependencies of derivation '/nix/store/isz6x5mx30pxvrs7kj1n8c8mmw7x0hmw-nix-shell-env.drv' failed to build
direnv: export +AR +AS +CC +CONFIG_SHELL +CXX +DETERMINISTIC_BUILD +HOST_PATH +IN_NIX_SHELL +LD +NIX_BINTOOLS +NIX_BINTOOLS_WRAPPER_TARGET_HOST_x86_64_unknown_linux_gnu +NIX_BUILD_CORES +NIX_CC +NIX_CC_WRAPPER_TARGET_HOST_x86_64_unknown_linux_gnu +NIX_CFLAGS_COMPILE +NIX_ENFORCE_NO_NATIVE +NIX_HARDENING_ENABLE +NIX_LDFLAGS +NIX_STORE +NM +OBJCOPY +OBJDUMP +PYTHONHASHSEED +PYTHONNOUSERSITE +PYTHONPATH +RANLIB +READELF +SIZE +SOURCE_DATE_EPOCH +STRINGS +STRIP +_PYTHON_HOST_PLATFORM +_PYTHON_SYSCONFIGDATA_NAME +__structuredAttrs +buildInputs +buildPhase +builder +cmakeFlags +configureFlags +depsBuildBuild +depsBuildBuildPropagated +depsBuildTarget +depsBuildTargetPropagated +depsHostHost +depsHostHostPropagated +depsTargetTarget +depsTargetTargetPropagated +doCheck +doInstallCheck +dontAddDisableDepTrack +mesonFlags +name +nativeBuildInputs +out +outputs +patches +phases +preferLocalBuild +propagatedBuildInputs +propagatedNativeBuildInputs +shell +shellHook +stdenv +strictDeps +system ~PATH ~XDG_DATA_DIRS

Even though I have the following piece of text inside my flake.nix?

pypkgs-build-requirements = {
  # discord = [ "setuptools" ];
  pynput = [ "sphinx" ];
};

In reply to @ryoschin:matrix.org

error: builder for '/nix/store/a84cmdbixl66fpwaabpv00824rf91srs-python3.11-sphinxcontrib-jquery-4.1.drv' failed with exit code 1;
       last 10 log lines:
       >            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
       >   File "<frozen importlib._bootstrap>", line 1204, in _gcd_import
       >   File "<frozen importlib._bootstrap>", line 1176, in _find_and_load
       >   File "<frozen importlib._bootstrap>", line 1147, in _find_and_load_unlocked
       >   File "<frozen importlib._bootstrap>", line 690, in _load_unlocked
       >   File "<frozen importlib._bootstrap_external>", line 940, in exec_module
       >   File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
       >   File "/nix/store/pbx86iidhb639fpw5v5dzqb11r30vr3a-python3.11-sphinxcontrib-jquery-4.1/lib/python3.11/site-packages/sphinxcontrib/jquery/__init__.py", line 4, in <module>
       >     import sphinx
       > ModuleNotFoundError: No module named 'sphinx'
       For full logs, run 'nix log /nix/store/a84cmdbixl66fpwaabpv00824rf91srs-python3.11-sphinxcontrib-jquery-4.1.drv'.
error: 1 dependencies of derivation '/nix/store/dd20427qcp8hzk366xbgkfjy074ay5ql-python3.11-sphinx-rtd-theme-1.3.0.drv' failed to build
error: 1 dependencies of derivation '/nix/store/4clrd2bi31nllninx3jprabv0w0z502p-python3.11-wrapt-1.14.1.drv' failed to build
error: 1 dependencies of derivation '/nix/store/3dcm1pp23pk8x88i7rp7xyds6ddjy7g6-python3.11-astroid-2.15.6.drv' failed to build
error: 1 dependencies of derivation '/nix/store/d318vswd0cs42c48j96kl9drp5xbxwhn-python3.11-pylint-2.17.5.drv' failed to build
error: 1 dependencies of derivation '/nix/store/61ynh7cwk569sccjvii1rdlpwh2lz2zj-python3.11-setuptools-lint-0.6.0.drv' failed to build
error: 1 dependencies of derivation '/nix/store/h60vj9ivfwxlxydxqr8hbdyc2q3wi1lz-python3.11-pynput-1.7.6.drv' failed to build
error: 1 dependencies of derivation '/nix/store/isz6x5mx30pxvrs7kj1n8c8mmw7x0hmw-nix-shell-env.drv' failed to build
direnv: export +AR +AS +CC +CONFIG_SHELL +CXX +DETERMINISTIC_BUILD +HOST_PATH +IN_NIX_SHELL +LD +NIX_BINTOOLS +NIX_BINTOOLS_WRAPPER_TARGET_HOST_x86_64_unknown_linux_gnu +NIX_BUILD_CORES +NIX_CC +NIX_CC_WRAPPER_TARGET_HOST_x86_64_unknown_linux_gnu +NIX_CFLAGS_COMPILE +NIX_ENFORCE_NO_NATIVE +NIX_HARDENING_ENABLE +NIX_LDFLAGS +NIX_STORE +NM +OBJCOPY +OBJDUMP +PYTHONHASHSEED +PYTHONNOUSERSITE +PYTHONPATH +RANLIB +READELF +SIZE +SOURCE_DATE_EPOCH +STRINGS +STRIP +_PYTHON_HOST_PLATFORM +_PYTHON_SYSCONFIGDATA_NAME +__structuredAttrs +buildInputs +buildPhase +builder +cmakeFlags +configureFlags +depsBuildBuild +depsBuildBuildPropagated +depsBuildTarget +depsBuildTargetPropagated +depsHostHost +depsHostHostPropagated +depsTargetTarget +depsTargetTargetPropagated +doCheck +doInstallCheck +dontAddDisableDepTrack +mesonFlags +name +nativeBuildInputs +out +outputs +patches +phases +preferLocalBuild +propagatedBuildInputs +propagatedNativeBuildInputs +shell +shellHook +stdenv +strictDeps +system ~PATH ~XDG_DATA_DIRS

Even though I have the following piece of text inside my flake.nix?

pypkgs-build-requirements = {
  # discord = [ "setuptools" ];
  pynput = [ "sphinx" ];
};

Since it's essential to use override to set the value of preferWheel as described in #948, how can you override both preferWheel and, for example, nativeBuildInputs? In this case

              dm-tree = super.dm-tree.override (
                old: {
                  preferWheel = false;
                  nativeBuildInputs = (old.nativeBuildInputs or [ ]) ++ [ pkgs.cmake ];
                }
              );

successfully disables the global setting of preferWheels = true for the target package but it seems nativeBuildInputs may not be successful ( or possibly cmake needs to be provided elsewhere or with additional configuration since the build fails where the target package setup.py calls cmake via subprocess to check that cmake is available on the PATH )

Since it's essential to use override to set the value of preferWheel as described in #948, how can you override both preferWheel and, for example, nativeBuildInputs? In this case

              dm-tree = super.dm-tree.override (
                old: {
                  preferWheel = false;
                  nativeBuildInputs = (old.nativeBuildInputs or [ ]) ++ [ pkgs.cmake ];
                }
              );

successfully disables the global setting of preferWheels = true for the target package but it seems nativeBuildInputs may not be successful ( or possibly cmake needs to be provided elsewhere or with additional configuration since the build fails where the target package setup.py calls cmake via subprocess to check that cmake is available on the PATH ).

Since it's essential to use override instead of overridePythonAttrs to set the value of preferWheel as described in #948, how can you override both preferWheel and, for example, nativeBuildInputs? In this case

              dm-tree = super.dm-tree.override (
                old: {
                  preferWheel = false;
                  nativeBuildInputs = (old.nativeBuildInputs or [ ]) ++ [ pkgs.cmake ];
                }
              );

successfully disables the global setting of preferWheels = true for the target package but it seems nativeBuildInputs may not be successful ( or possibly cmake needs to be provided elsewhere or with additional configuration since the build fails where the target package setup.py calls cmake via subprocess to check that cmake is available on the PATH ).

Thank you! ... that seems like what I tried, but maybe I didn't get it quite right or there's a more subtle issue with this particular package ... I'll try again

For example

              dm-tree = (super.dm-tree.override {preferWheel = false;}).overridePythonAttrs (
                old: {
                  nativeBuildInputs = (old.nativeBuildInputs or []) ++ [pkgs.cmake];
                }
              );

downloads the wheel and fails with "does not appear to contain CMakeLists.txt". That is successfully disabled, leading to the source download with dm-tree = super.dm-tree.override {preferWheel = false;}, but then the latter lacks cmake in the build env and fails for that reason.

Thank you! ... that seems like what I tried, but maybe I didn't get it quite right or there's a more subtle issue with this particular package ... I'll try again

For example

              dm-tree = (super.dm-tree.override {preferWheel = false;}).overridePythonAttrs (
                old: {
                  nativeBuildInputs = (old.nativeBuildInputs or []) ++ [pkgs.cmake];
                }
              );

downloads the wheel and fails with "does not appear to contain CMakeLists.txt" because it has downloaded the wheel instead of the source. That is successfully disabled, leading to the source download with dm-tree = super.dm-tree.override {preferWheel = false;}, but then the latter lacks cmake in the build env and fails for that reason.

Thank you! ... that seems like what I tried, but maybe I didn't get it quite right or there's a more subtle issue with this particular package ... I'll try again

For example

              dm-tree = (super.dm-tree.override {preferWheel = false;}).overridePythonAttrs (
                old: {
                  nativeBuildInputs = (old.nativeBuildInputs or []) ++ [pkgs.cmake];
                }
              );

downloads the wheel and fails with "does not appear to contain CMakeLists.txt" because it has downloaded the wheel instead of the source. That is successfully disabled, leading to the source download with dm-tree = super.dm-tree.override {preferWheel = false;}, but then the latter lacks cmake in the build env and fails for that reason at the point linked above.

here's a little more context

        pyPkgsBuildRequirements = {
          cloudpickle = ["flit-core"];
          feather-format = ["setuptools"];
          hydra-core = ["setuptools"];
          hydra-joblib-launcher = ["setuptools"];
          hydra-zen = ["setuptools"];
          marshmallow-jsonschema = ["setuptools"];
          numba = [pkgs.tbb_2021_8];
          session-info = ["setuptools"];
          xdoctest = ["setuptools"];
        };

        poetry2nixOverrides = pkgs.poetry2nix.overrides.withDefaults (
          self: super: let
            buildInputsOverrides =
              builtins.mapAttrs (
                package: buildRequirements:
                  (builtins.getAttr package super).overridePythonAttrs (old: {
                    buildInputs =
                      (old.buildInputs or [])
                      ++ (builtins.map (pkg:
                        if builtins.isString pkg
                        then builtins.getAttr pkg super
                        else pkg)
                      buildRequirements);
                  })
              )
              pyPkgsBuildRequirements;
            conditionalOverrides =
              if pkgs.stdenv.isDarwin
              then {
                grpcio = super.grpcio.override {preferWheel = false;};
              }
              else {};
          in
            buildInputsOverrides
            // {
              dm-tree = (super.dm-tree.override {preferWheel = false;}).overridePythonAttrs (
                old: {
                  nativeBuildInputs = (old.nativeBuildInputs or []) ++ [pkgs.cmake];
                }
              );
              hydra-core = super.hydra-core.override {preferWheel = true;};
              hydra-joblib-launcher = super.hydra-joblib-launcher.override {preferWheel = true;};
              mkdocs-material = super.mkdocs-material.override {preferWheel = false;};
              scipy = super.scipy.override {preferWheel = true;};
              yarl = super.yarl.override {preferWheel = true;};
              optax = super.optax.overridePythonAttrs (
                _old: {
                  postInstall = ''
                    rm -f $out/lib/python3.10/site-packages/docs/conf.py
                    # rm -fr $out/lib/python3.10/site-packages/docs/__pycache__/conf.cpython-310.pyc
                    rm -fr $out/lib/python3.10/site-packages/docs/__pycache__
                  '';
                }
              );
            }
            // conditionalOverrides
        );

Thank you! ... that seems like what I tried, but maybe I didn't get it quite right or there's a more subtle issue with this particular package ... I'll try again

For example

              dm-tree = (super.dm-tree.override {preferWheel = false;}).overridePythonAttrs (
                old: {
                  nativeBuildInputs = (old.nativeBuildInputs or []) ++ [pkgs.cmake];
                }
              );

downloads the wheel and fails with "does not appear to contain CMakeLists.txt" because it has downloaded the wheel instead of the source. That is successfully disabled, leading to the source download with dm-tree = super.dm-tree.override {preferWheel = false;}, but then the latter lacks cmake in the build env and fails for that reason at the point linked above. I put a bit more context in the thread

Thank you! ... that seems like what I tried, but maybe I didn't get it quite right or there's a more subtle issue with this particular package ... I'll try again

For example

              dm-tree = (super.dm-tree.override {preferWheel = false;}).overridePythonAttrs (
                old: {
                  nativeBuildInputs = (old.nativeBuildInputs or []) ++ [pkgs.cmake];
                }
              );

downloads the wheel and fails with "does not appear to contain CMakeLists.txt" because it has downloaded the wheel instead of the source. That is successfully disabled, leading to the source download with dm-tree = super.dm-tree.override {preferWheel = false;}, but then the latter lacks cmake in the build env and fails for that reason at the point linked above. I put a bit more context in the thread above.

here's a little more context for the attempted usage

        pyPkgsBuildRequirements = {
          cloudpickle = ["flit-core"];
          feather-format = ["setuptools"];
          hydra-core = ["setuptools"];
          hydra-joblib-launcher = ["setuptools"];
          hydra-zen = ["setuptools"];
          marshmallow-jsonschema = ["setuptools"];
          numba = [pkgs.tbb_2021_8];
          session-info = ["setuptools"];
          xdoctest = ["setuptools"];
        };

        poetry2nixOverrides = pkgs.poetry2nix.overrides.withDefaults (
          self: super: let
            buildInputsOverrides =
              builtins.mapAttrs (
                package: buildRequirements:
                  (builtins.getAttr package super).overridePythonAttrs (old: {
                    buildInputs =
                      (old.buildInputs or [])
                      ++ (builtins.map (pkg:
                        if builtins.isString pkg
                        then builtins.getAttr pkg super
                        else pkg)
                      buildRequirements);
                  })
              )
              pyPkgsBuildRequirements;
            conditionalOverrides =
              if pkgs.stdenv.isDarwin
              then {
                grpcio = super.grpcio.override {preferWheel = false;};
              }
              else {};
          in
            buildInputsOverrides
            // {
              dm-tree = (super.dm-tree.override {preferWheel = false;}).overridePythonAttrs (
                old: {
                  nativeBuildInputs = (old.nativeBuildInputs or []) ++ [pkgs.cmake];
                }
              );
              hydra-core = super.hydra-core.override {preferWheel = true;};
              hydra-joblib-launcher = super.hydra-joblib-launcher.override {preferWheel = true;};
              mkdocs-material = super.mkdocs-material.override {preferWheel = false;};
              scipy = super.scipy.override {preferWheel = true;};
              yarl = super.yarl.override {preferWheel = true;};
              optax = super.optax.overridePythonAttrs (
                _old: {
                  postInstall = ''
                    rm -f $out/lib/python3.10/site-packages/docs/conf.py
                    # rm -fr $out/lib/python3.10/site-packages/docs/__pycache__/conf.cpython-310.pyc
                    rm -fr $out/lib/python3.10/site-packages/docs/__pycache__
                  '';
                }
              );
            }
            // conditionalOverrides
        );

here's a little more context for the attempted usage

        pyPkgsBuildRequirements = {
          cloudpickle = ["flit-core"];
          feather-format = ["setuptools"];
          hydra-core = ["setuptools"];
          hydra-joblib-launcher = ["setuptools"];
          hydra-zen = ["setuptools"];
          marshmallow-jsonschema = ["setuptools"];
          numba = [pkgs.tbb_2021_8];
          session-info = ["setuptools"];
          xdoctest = ["setuptools"];
        };

        poetry2nixOverrides = pkgs.poetry2nix.overrides.withDefaults (
          self: super: let
            buildInputsOverrides =
              builtins.mapAttrs (
                package: buildRequirements:
                  (builtins.getAttr package super).overridePythonAttrs (old: {
                    buildInputs =
                      (old.buildInputs or [])
                      ++ (builtins.map (pkg:
                        if builtins.isString pkg
                        then builtins.getAttr pkg super
                        else pkg)
                      buildRequirements);
                  })
              )
              pyPkgsBuildRequirements;
            conditionalOverrides =
              if pkgs.stdenv.isDarwin
              then {
                grpcio = super.grpcio.override {preferWheel = false;};
              }
              else {};
          in
            buildInputsOverrides
            // {
              dm-tree = (super.dm-tree.override {preferWheel = false;}).overridePythonAttrs (
                old: {
                  nativeBuildInputs = (old.nativeBuildInputs or []) ++ [pkgs.cmake];
                }
              );
              mkdocs-material = super.mkdocs-material.override {preferWheel = false;};
              optax = super.optax.overridePythonAttrs (
                _old: {
                  postInstall = ''
                    rm -f $out/lib/python3.10/site-packages/docs/conf.py
                    rm -fr $out/lib/python3.10/site-packages/docs/__pycache__
                  '';
                }
              );
            }
            // conditionalOverrides
        );

        mkPoetryAttrs = {
          projectDir = ./.;
          overrides = poetry2nixOverrides;
          python = pkgs.python310;
    
          preferWheels = true;
          groups = [
            "test"
          ];
          checkGroups = ["test"];
          extras = [];
        };

        poetryEnv = pkgs.poetry2nix.mkPoetryEnv (
          mkPoetryAttrs
          // {
            extraPackages = ps:
              with pkgs; [
                python310Packages.pip
              ];
          }
        );