!rWxyQqNqMUDLECdsIf:blad.is

Poetry2nix

319 Members
https://github.com/nix-community/poetry2nix63 Servers

Load older messages


SenderMessageTime
12 Jul 2024
@tyberius_prime:matrix.orgTyberiusPrime (smilodon inopinatus)perhaps08:34:20
@tyberius_prime:matrix.orgTyberiusPrime (smilodon inopinatus)though there is one for 4.1.3, hm.08:34:56
@tyberius_prime:matrix.orgTyberiusPrime (smilodon inopinatus)I know I build it with python 3.12, bcrypt 4.1.3 and the poetry2nix master like 2 weeks ago.. if you want I can drop you the flake.nix/pyproject.toml/poetry.lock08:36:51
@tyberius_prime:matrix.orgTyberiusPrime (smilodon inopinatus)there's some deep dark magic in the way the poetry2nix overrides work10:47:58
@tyberius_prime:matrix.orgTyberiusPrime (smilodon inopinatus)(deep dark magic = i don't grok it)10:50:33
@pepe:runas.rockspeppino Thanks TyberiusPrime (smilodon inopinatus), I really appreciate it 16:45:07
@pepe:runas.rockspeppinoI'm gonna try and report back16:45:11
@pepe:runas.rockspeppinoThis thing is driving me crazy @_@16:45:18
@pepe:runas.rockspeppinoI'm trying to get a dev env fully reproducible for a paper I submitted to a conference16:45:35
@pepe:runas.rockspeppinoAnd Python is making everything explode badly16:45:42
@pepe:runas.rockspeppino😭16:45:47
@tyberius_prime:matrix.orgTyberiusPrime (smilodon inopinatus)
In reply to @pepe:runas.rocks
😭
it does do that..
19:33:23
14 Jul 2024
@pepe:runas.rockspeppino Funnily enough, switching to Python 3.12 seems to alleviate the issue with bcrypt but now I get the same exact error with diffutils... 19:53:10
@pepe:runas.rockspeppino Actually, no. bcrypt fails in the same way... 19:53:38
@pepe:runas.rockspeppino
In reply to @tyberius_prime:matrix.org
I know I build it with python 3.12, bcrypt 4.1.3 and the poetry2nix master like 2 weeks ago.. if you want I can drop you the flake.nix/pyproject.toml/poetry.lock
Can you please give me your files? I am going crazy here
19:53:58
@pepe:runas.rockspeppino Is there a way to use bcrypt from nixpkgs instead? 19:56:42
16 Jul 2024
@tyberius_prime:matrix.orgTyberiusPrime (smilodon inopinatus) peppino: send you a PM 11:08:53
@pepe:runas.rockspeppino Is there a way to force a package - in my case bcrypt - not to use preferWheels = true? 20:12:56
@pepe:runas.rockspeppino

I tried with this:

                overrides = defaultPoetryOverrides.extend (self: super: {
                  bcrypt = super.bcrypt.overridePythonAttrs (old: {
                    preferWheels = false;
                  });

But it doesn't work :-(

20:13:23
@pepe:runas.rockspeppinoDelete delete delete, I RTFM20:26:45
@pepe:runas.rockspeppino🤦‍♂️20:26:51
18 Jul 2024
@notwren:matrix.orgnotwren joined the room.21:40:02
@notwren:matrix.orgnotwren

I have a monorepo structured like so:

repo/
    services/
        a/
            pyproject.toml
         b/
            pyproject.toml

Where a imports b as editable with b = {path="../b", develop=true} in the pyproject.toml. I'm having trouble getting my nix development derivation to import b correctly into the shell.

I've tried:

  1. a/flake.nix with a derivation like:
        devShells.default = let 
            envShell = mkPoetryEnv {
              projectDir = self;
              overrides = p2n-overrides;
              preferWheels = true;
              editablePackageSources = {
                b = ../b;
              };
            }; 
          in
          pkgs.mkShell {
            name = "A";
            buildInputs = [ envShell ];
            #inputsFrom = [ self.packages.${system}.a ];
            packages = with pkgs; [ poetry docker-compose unzip ruff-lsp stdenv.cc.cc.lib zip awscli2 postgresql];
            LD_LIBRARY_PATH = "${pkgs.stdenv.cc.cc.lib}/lib";
        };
      });

My understanding was that nix (like docker) copies the entire sub-directory structure, so it might be missing "sibling" folders (i.e. w/ same parent directory)
2. I've also tried putting flake.nix in services/ with something like

        devShells.default = let 
            envShell = mkPoetryEnv {
              projectDir = ./a;
              overrides = p2n-overrides;
              preferWheels = true;
              editablePackageSources = {
                b = ./b;
                a = ./a;
              };
            }; 
          in
          pkgs.mkShell {
            name = "A";
            buildInputs = [ envShell ];
            packages = with pkgs; [ poetry docker-compose unzip ruff-lsp stdenv.cc.cc.lib zip awscli2 postgresql];
            LD_LIBRARY_PATH = "${pkgs.stdenv.cc.cc.lib}/lib";
        };
      });

But I still get the ModuleNotFoundError for b.

What's the expected way for me to make this structure work?

21:42:09
19 Jul 2024
@picog:matrix.orgPico
In reply to @notwren:matrix.org

I have a monorepo structured like so:

repo/
    services/
        a/
            pyproject.toml
         b/
            pyproject.toml

Where a imports b as editable with b = {path="../b", develop=true} in the pyproject.toml. I'm having trouble getting my nix development derivation to import b correctly into the shell.

I've tried:

  1. a/flake.nix with a derivation like:
        devShells.default = let 
            envShell = mkPoetryEnv {
              projectDir = self;
              overrides = p2n-overrides;
              preferWheels = true;
              editablePackageSources = {
                b = ../b;
              };
            }; 
          in
          pkgs.mkShell {
            name = "A";
            buildInputs = [ envShell ];
            #inputsFrom = [ self.packages.${system}.a ];
            packages = with pkgs; [ poetry docker-compose unzip ruff-lsp stdenv.cc.cc.lib zip awscli2 postgresql];
            LD_LIBRARY_PATH = "${pkgs.stdenv.cc.cc.lib}/lib";
        };
      });

My understanding was that nix (like docker) copies the entire sub-directory structure, so it might be missing "sibling" folders (i.e. w/ same parent directory)
2. I've also tried putting flake.nix in services/ with something like

        devShells.default = let 
            envShell = mkPoetryEnv {
              projectDir = ./a;
              overrides = p2n-overrides;
              preferWheels = true;
              editablePackageSources = {
                b = ./b;
                a = ./a;
              };
            }; 
          in
          pkgs.mkShell {
            name = "A";
            buildInputs = [ envShell ];
            packages = with pkgs; [ poetry docker-compose unzip ruff-lsp stdenv.cc.cc.lib zip awscli2 postgresql];
            LD_LIBRARY_PATH = "${pkgs.stdenv.cc.cc.lib}/lib";
        };
      });

But I still get the ModuleNotFoundError for b.

What's the expected way for me to make this structure work?

I have some thing like

        devShells.a = pkgs.mkShell {
          packages = with pkgs; [
            (mkPoetryEnv {
              projectDir = a/.;
              python=pkgs.python39;
            })
          ];
        };

        devShells.b = pkgs.mkShell {
          packages = with pkgs; [
            (mkPoetryEnv {
              projectDir = b/.;
              python=pkgs.python39;
            })
          ];
        };
08:27:26
@picog:matrix.orgPico

I'm wondering if poetry2nix could be used to build wheels of all my dependencies?
Currently, I use poetry2nix for a lovely dev environment but now I want to build wheels for my production environment.
I'm using docker currently by exporting my poetry.lock to a requirements.txt and then for each package doing
python wheel <packageName==Version>

I have to maintain dependencies manually in the Docker file :(
Feels like I should be able to do this with nix because it already created a reproducible environment to build those packages.
I just need the wheel output?

08:36:40
@k900:0upti.meK900And your production environment consumes what, wheels directly?08:43:53
@picog:matrix.orgPicoYep, I just install them. Production environment installer, will just setup a virtualenv and use pip --no-index --find-link to install all the packages. Not using nix in production (yet) 08:50:58
@picog:matrix.orgPico * Yep, Production environment installer, will just setup a virtualenv and use pip --no-index --find-link to install all the packages. Not using nix in production (yet) 08:51:35
@k900:0upti.meK900Yeah the problem with doing that is that Nix-built wheels will reference Nix store paths08:51:41
@k900:0upti.meK900So you can't just install them08:51:44

Show newer messages


Back to Room ListRoom Version: 6