!rWxyQqNqMUDLECdsIf:blad.is

Poetry2nix

300 Members
https://github.com/nix-community/poetry2nix | Poetry2nix is unmaintained https://github.com/nix-community/poetry2nix/issues/186553 Servers

Load older messages


SenderMessageTime
2 Jan 2024
@kennethkoski:matrix.orgknkski joined the room.21:40:07
@kennethkoski:matrix.orgknkski Hey, I 've got an issue with recent versions of pytorch-lightning, and I'm wondering if anyone can help me figure out what's going on 21:41:36
@kennethkoski:matrix.orgknkski

Here's the gist of it:

$ nix log /nix/store/r01bqrznkq4bm9q29qwlrwr7f5vx7q3h-python3.11-pytorch-lightning-2.1.3.drv
Sourcing python-remove-tests-dir-hook
Sourcing python-catch-conflicts-hook.sh
Sourcing python-remove-bin-bytecode-hook.sh
Sourcing wheel setup hook
Sourcing pypa-install-hook
Using pypaInstallPhase
Sourcing python-imports-check-hook.sh
Using pythonImportsCheckPhase
Sourcing python-namespaces-hook
Sourcing python-catch-conflicts-hook.sh
@nix { "action": "setPhase", "phase": "unpackPhase" }
unpacking sources
tar: This does not look like a tar archive
tar: Skipping to next header
tar: Exiting with failure status due to previous errors
21:41:59
@kennethkoski:matrix.orgknkski

I've tried a couple different overrides, but none of them seem to take:

pytorch-lightning = pkgs.python311Packages.pytorch-lightning;
pytorch-lightning = super.pytorch-lightning.override { preferWheel = false; };
pytorch-lightning = super.pytorch-lightning.overridePythonAttrs (old: {
  unpackPhase = ''
    set -eux
    echo "THIS SHOULD NOT BUILD!"
    exit 1
  '';
});
21:43:51
@kennethkoski:matrix.orgknkski Those not having an effect might be related to this issue? I tried setting preferWheels = false;, but then cmake was having issues building and I couldn't get that working 21:44:57
@kennethkoski:matrix.orgknkskiI'm building on linux x86-64 for the same platform, so that issue might not be relevant21:45:26
@kennethkoski:matrix.orgknkski

I've tried specifying the dependency as both of these ways:

pytorch-lightning = "2.1.3"
pytorch-lightning = { url = "https://files.pythonhosted.org/packages/f6/95/a662bd12b255ee3b59c975277c67398410b5810ee72ff11e34134e10cc9a/pytorch_lightning-2.1.3-py3-none-any.whl" }

Even when directly pointing it directly at the wheel file, it still gives the same error

21:46:52
@kennethkoski:matrix.orgknkskiI can wrap this all up into a github issue if that would work better, the github issue template pointed towards this room as a start21:49:29
@kennethkoski:matrix.orgknkski I just tried manually removing cmake from my poetry.lock file, so that I could try out preferWheels = false;. Strangely, that doesn't seem to have any effect either, I get the same error 22:15:09
@cameronraysmith:matrix.org@cameronraysmith:matrix.org knkski: there are default overrides for pytorch-lightning that attempt to handle what must have previously been something like a nested tarball. I removed these from a test fork https://github.com/cameronraysmith/poetry2nix/commit/aab624b6f49b5974a57a4be5d034613d6b65c79f and things work as expected when I source it in my flake. I was going to discuss submitting these upstream but it might be necessary to retain them with version guards for backward compatibility 22:28:51
@kennethkoski:matrix.orgknkski cameronraysmith: that worked, thank you! 22:30:28
@cameronraysmith:matrix.org@cameronraysmith:matrix.org* knkski: there are default overrides for pytorch-lightning that attempt to handle what must have previously been something like a nested tarball. I removed these from a test fork https://github.com/cameronraysmith/poetry2nix/commit/aab624b6f49b5974a57a4be5d034613d6b65c79f and things work as expected when I source it in my flake. I was going to discuss submitting these upstream but it might be necessary to retain them with version guards for backward compatibility I didn't manage to bisect where this must have changed in the pytorch-lightning release history but I tried as far back as 1.9.4 or so.22:30:58
@cameronraysmith:matrix.org@cameronraysmith:matrix.org* knkski: there are default overrides for pytorch-lightning that attempt to handle what must have previously been something like a nested tarball. I removed these from a test fork https://github.com/cameronraysmith/poetry2nix/commit/aab624b6f49b5974a57a4be5d034613d6b65c79f and things work as expected when I source it in my flake. I was going to discuss submitting these upstream, but it might be necessary to retain them with version guards for backward compatibility. I didn't manage to bisect where this must have changed in the pytorch-lightning release history but I tried as far back as 1.9.4 or so.22:31:39
@cameronraysmith:matrix.org@cameronraysmith:matrix.org* knkski: there are default overrides for `pytorch-lightning` that attempt to handle what must have previously been something like a nested tarball. I removed these from a test fork https://github.com/cameronraysmith/poetry2nix/commit/aab624b6f49b5974a57a4be5d034613d6b65c79f and things work as expected when I source it in my flake. I was going to discuss submitting these upstream, but it might be necessary to retain them with version guards for backward compatibility. I didn't manage to bisect where this must have changed in the pytorch-lightning release history but I tried as far back as 1.9.4 or so.22:32:01
@torhex-pasmul:alteck.clubTorhex Pasmul left the room.22:32:15
@cameronraysmith:matrix.org@cameronraysmith:matrix.org* knkski: there are default overrides for  pytorch-lightning  that attempt to handle what must have previously been something like a nested tarball. I removed these from a test branch on my fork https://github.com/cameronraysmith/poetry2nix/commit/aab624b6f49b5974a57a4be5d034613d6b65c79f and things work as expected when I source it in my flake. I was going to discuss submitting these upstream, but it might be necessary to retain them with version guards for backward compatibility. I didn't manage to bisect where this must have changed in the pytorch-lightning release history but I tried as far back as 1.9.4 or so.22:34:26
@cameronraysmith:matrix.org@cameronraysmith:matrix.org *

knkski: there are default overrides for  pytorch-lightning  that attempt to handle what must have previously been something like a nested tarball. I removed these from a test branch on my fork

https://github.com/cameronraysmith/poetry2nix/commit/aab624b6f49b5974a57a4be5d034613d6b65c79f

and things work as expected when I source it in my flake. I was going to discuss submitting these upstream, but it might be necessary to retain them with version guards for backward compatibility.

I didn't manage to bisect where this must have changed in the pytorch-lightning release history but I tried as far back as 1.9.4.

22:45:39
@cameronraysmith:matrix.org@cameronraysmith:matrix.org *

knkski: there are default overrides for  pytorch-lightning  that attempt to handle what must have previously been something like a nested tarball. I removed these from an experimental branch on my fork
and things work as expected when I source it in my flake. I was going to discuss submitting these upstream, but it might be necessary to retain the with version guards for backward compatibility.

I didn't manage to bisect where this must have changed in the pytorch-lightning release history but I tried as far back as 1.9.4.

22:46:48
@cameronraysmith:matrix.org@cameronraysmith:matrix.org *

knkski: there are default overrides for  pytorch-lightning  that attempt to handle what must have previously been something like a nested tarball. I removed these from an experimental branch on my fork
and things work as expected when I source it in my flake. I was going to discuss submitting these upstream, but it might be necessary to retain these unpackPhase customizations with version guards for backward compatibility.

I could add these if I knew where things changed, but I didn't manage to bisect where this in the pytorch-lightning release history after trying as far back as 1.9.4 and sporadically downloading a few of the very early source distributions to inspect their structure.

22:48:37
@cameronraysmith:matrix.org@cameronraysmith:matrix.org *

knkski: there are default overrides for  pytorch-lightning  that attempt to handle what must have previously been something like a nested tarball. I removed these from an experimental branch on my fork
and things work as expected when I source it in my flake. I was going to discuss submitting these upstream, but it might be necessary to retain these unpackPhase customizations with version guards for backward compatibility.

I could add these if I knew where things changed, but I didn't manage to bisect where that is in the pytorch-lightning release history after trying as far back as 1.9.4 and sporadically downloading a few of the very early source distributions to inspect their structure.

22:49:09
@cameronraysmith:matrix.org@cameronraysmith:matrix.org *

knkski: there are default overrides for  pytorch-lightning  that attempt to handle what must have previously been something like a nested tarball. I removed these from an experimental branch on my fork
and things work as expected when I source it in my flake. I was going to discuss submitting these upstream, but it might be necessary to retain these unpackPhase customizations with version guards for backward compatibility.

I could add these if I knew where things changed, but I didn't manage to bisect where that is in the pytorch-lightning release history after trying as far back as 1.9.4 and sporadically downloading a few of the very early source distributions from PyPI to inspect their structure.

22:49:32
@cameronraysmith:matrix.org@cameronraysmith:matrix.org *

knkski: there are default overrides for  pytorch-lightning  that attempt to handle what must have previously been something like a nested tarball. I removed these from an experimental branch on my fork and things work as expected when I source it in my flake. I was going to discuss submitting these upstream, but it might be necessary to retain these unpackPhase customizations with version guards for backward compatibility.

I could add these if I knew where things changed, but I didn't manage to bisect where that is in the pytorch-lightning release history after trying as far back as 1.9.4 and sporadically downloading a few of the very early source distributions from PyPI to inspect their structure.

22:50:10
@kennethkoski:matrix.orgknkskiI'll see if I can help bisect exactly where. I do remember that 1.5.3 installed with no issue, and 1.5.4 had some issue. I don't remember if it was the same one though22:50:27
@cameronraysmith:matrix.org@cameronraysmith:matrix.orgThat sounds like a good start. I'll take a look around that time. 22:51:02
@cameronraysmith:matrix.org@cameronraysmith:matrix.org *

That sounds like a good start. I'll take a look around that time.

Since the unpackPhase was added Oct 31 2022 it should be somewhere in the 1.7.7 to 1.9.4 range.

22:58:15
@cameronraysmith:matrix.org@cameronraysmith:matrix.org *

That sounds like a good start. I'll take a look around that time.

Since the unpackPhase was added Oct 31 2022 it should be somewhere in the Sep 22 2022 1.7.7 to 1.9.4 range.

22:59:06
@cameronraysmith:matrix.org@cameronraysmith:matrix.org *

That sounds like a good start. I'll take a look around that time.

Since the unpackPhase was added Oct 31 2022 it should be somewhere in the release prior to that Sep 22 2022 1.7.7 and the last one 1.9.4 I checked manually.

23:00:06
@cameronraysmith:matrix.org@cameronraysmith:matrix.org *

That sounds like a good start. I'll take a look around that time.

Since the unpackPhase was added in #786 Oct 31 2022 it should be somewhere in the release prior to that Sep 22 2022 1.7.7 and the last one 1.9.4 I checked manually.

23:00:32
@cameronraysmith:matrix.org@cameronraysmith:matrix.org *

That sounds like a good start. I'll take a look around that time.

Since the unpackPhase was added in #786 Oct 31 2022 it should be somewhere in the release prior to that Sep 22 2022 1.7.7 and the last one 1.9.4 I checked manually.

23:00:45
@cameronraysmith:matrix.org@cameronraysmith:matrix.org *

That sounds like a good start. I'll take a look around that time.

Since the unpackPhase was added in #786 Oct 31 2022 it should be somewhere in the release prior to that Sep 22 2022 1.7.7 and the last one, 1.9.4, I checked manually.

23:01:09

Show newer messages


Back to Room ListRoom Version: 6