10 Jul 2024 |
TyberiusPrime (smilodon inopinatus) | we've all been there. | 10:38:01 |
TyberiusPrime (smilodon inopinatus) | and you can't download the logs before all tests have finished | 10:38:11 |
TyberiusPrime (smilodon inopinatus) | and the github gui dosn't really work well with those megabytes of output^^ | 10:38:24 |
TyberiusPrime (smilodon inopinatus) | so I'll wait for the next one to fail and then we'll look agai.n | 10:38:33 |
TyberiusPrime (smilodon inopinatus) | * so I'll wait for the next one to fail and then we'll look again. | 10:38:35 |
truh | I wish there was a way to cache the stuff that didn't fail to build. | 10:39:54 |
TyberiusPrime (smilodon inopinatus) | "This step has been truncated due to its large size. Download the full logs from the menu once the workflow run has completed. ".
Thank you github. | 10:45:18 |
TyberiusPrime (smilodon inopinatus) | and since it's -darwin, I can't run it locally. | 10:47:33 |
truh | If Github truncates code diffs in PR, no wonder they do it for logs as well | 10:48:36 |
TyberiusPrime (smilodon inopinatus) | the other job that's still running is now at 3h and 49 minutes. | 12:10:04 |
TyberiusPrime (smilodon inopinatus) | lol, now github fails to actually download the log | 13:31:11 |
TyberiusPrime (smilodon inopinatus) | ok,... 'raw log' individual log... 166 MB of logs, at 600kbyte a second... rofl | 13:37:33 |
TyberiusPrime (smilodon inopinatus) | ok, it seems to be something scipy, xcrun?... | 13:45:38 |
TyberiusPrime (smilodon inopinatus) | ah, I accidentially the prePatch in this derivation | 13:49:02 |
11 Jul 2024 |
| peppino joined the room. | 20:54:59 |
peppino | Hello everyone!
I'm going crazy with a single dependency for my flake / dev env: bcrypt | 20:56:14 |
peppino | I cannot figure - in any way - how to make my environment work. This is my flake:
{
inputs = {
nixpkgs.url = "github:nixos/nixpkgs/release-24.05";
powerlifted-flake.url = "github:peperunas/planner8";
flake-utils.url = "github:numtide/flake-utils";
poetry2nix = {
url = "github:nix-community/poetry2nix";
inputs.nixpkgs.follows = "nixpkgs";
};
};
outputs = { self, nixpkgs, flake-utils, powerlifted-flake, poetry2nix }:
flake-utils.lib.eachDefaultSystem (system:
let
inherit (poetry2nix.lib.mkPoetry2Nix { inherit pkgs; }) mkPoetryEnv defaultPoetryOverrides;
pkgs = import nixpkgs {
inherit system;
config.allowUnfree = true;
};
powerlifted = powerlifted-flake.packages.${system}.powerlifted;
shellWithPkgs = packages:
pkgs.mkShell {
inherit packages;
buildInputs = [
pkgs.bashInteractive
(mkPoetryEnv {
projectDir = ./.;
preferWheels = true;
overrides = defaultPoetryOverrides.extend (self: super: {
gcs-oauth2-boto-plugin = super.gcs-oauth2-boto-plugin.overridePythonAttrs (old: {
buildInputs = (old.buildInputs or [ ]) ++ [ super.setuptools ];
});
gsutil = super.gsutil.overridePythonAttrs (old: {
buildInputs = (old.buildInputs or [ ]) ++ [ super.setuptools ];
});
python-gflags = super.python-gflags.overridePythonAttrs (old: {
buildInputs = (old.buildInputs or [ ]) ++ [ super.setuptools ];
});
});
})
];
};
shell = with pkgs; shellWithPkgs [
powerlifted
parallel-full
sqlite
];
in
{
devShell = shell;
defaultPackage = shell;
});
}
And this is the error I get back when the compilation gets to bcrypt :
error: builder for '/nix/store/lqfg86v33h64hi1dj3ib3i2dr1p0b7q6-python3.11-bcrypt-4.1.3.drv' failed with exit code 1;
last 10 log lines:
> Running phase: unpackPhase
> Executing wheelUnpackPhase
> Finished executing wheelUnpackPhase
> Running phase: patchPhase
> Executing cargoSetupPostPatchHook
> Validating consistency between /build/src/_bcrypt/Cargo.lock and /Cargo.lock
> /nix/store/0fw4a3z849azkhyjxnpxbygj4g5qhd0v-diffutils-3.10/bin/diff: /build/src/_bcrypt/Cargo.lock: No such file or directory
> /nix/store/0fw4a3z849azkhyjxnpxbygj4g5qhd0v-diffutils-3.10/bin/diff: /Cargo.lock: No such file or directory
> ERROR: Missing Cargo.lock from src. Expected to find it at: /build/src/_bcrypt/Cargo.lock
> Hint: You can use the cargoPatches attribute to add a Cargo.lock manually to the build.
For full logs, run 'nix log /nix/store/lqfg86v33h64hi1dj3ib3i2dr1p0b7q6-python3.11-bcrypt-4.1.3.drv'.
error: 1 dependencies of derivation '/nix/store/swgnvl8v6ia6c0xljqgmrdnvqwpk5byc-python3.11-paramiko-3.4.0.drv' failed to build
error: 1 dependencies of derivation '/nix/store/dk5k1wk3ms188q5v30045ijam6lwnhs5-python3.11-pwntools-4.11.1.drv' failed to build
error: 3 dependencies of derivation '/nix/store/agw1nq1w6756lml1dmn189zb7xil9r0x-python3-3.11.9-env.drv' failed to build
error: 1 dependencies of derivation '/nix/store/72cyph2439whiqn07xkar3100217n3n8-nix-shell-env.drv' failed to build
I tried multiple approaches - either having the shell not using poetry2nix and just call poetry shell (but then I get into weird libc++ linking issues) and trying to toggle preferWheels on and off. Nothing.
Do you have any pointers on how to make bcrypt / the python environment work? Thank you!
| 20:58:18 |
12 Jul 2024 |
TyberiusPrime (smilodon inopinatus) | In reply to @pepe:runas.rocks
I cannot figure - in any way - how to make my environment work. This is my flake:
{
inputs = {
nixpkgs.url = "github:nixos/nixpkgs/release-24.05";
powerlifted-flake.url = "github:peperunas/planner8";
flake-utils.url = "github:numtide/flake-utils";
poetry2nix = {
url = "github:nix-community/poetry2nix";
inputs.nixpkgs.follows = "nixpkgs";
};
};
outputs = { self, nixpkgs, flake-utils, powerlifted-flake, poetry2nix }:
flake-utils.lib.eachDefaultSystem (system:
let
inherit (poetry2nix.lib.mkPoetry2Nix { inherit pkgs; }) mkPoetryEnv defaultPoetryOverrides;
pkgs = import nixpkgs {
inherit system;
config.allowUnfree = true;
};
powerlifted = powerlifted-flake.packages.${system}.powerlifted;
shellWithPkgs = packages:
pkgs.mkShell {
inherit packages;
buildInputs = [
pkgs.bashInteractive
(mkPoetryEnv {
projectDir = ./.;
preferWheels = true;
overrides = defaultPoetryOverrides.extend (self: super: {
gcs-oauth2-boto-plugin = super.gcs-oauth2-boto-plugin.overridePythonAttrs (old: {
buildInputs = (old.buildInputs or [ ]) ++ [ super.setuptools ];
});
gsutil = super.gsutil.overridePythonAttrs (old: {
buildInputs = (old.buildInputs or [ ]) ++ [ super.setuptools ];
});
python-gflags = super.python-gflags.overridePythonAttrs (old: {
buildInputs = (old.buildInputs or [ ]) ++ [ super.setuptools ];
});
});
})
];
};
shell = with pkgs; shellWithPkgs [
powerlifted
parallel-full
sqlite
];
in
{
devShell = shell;
defaultPackage = shell;
});
}
And this is the error I get back when the compilation gets to bcrypt :
error: builder for '/nix/store/lqfg86v33h64hi1dj3ib3i2dr1p0b7q6-python3.11-bcrypt-4.1.3.drv' failed with exit code 1;
last 10 log lines:
> Running phase: unpackPhase
> Executing wheelUnpackPhase
> Finished executing wheelUnpackPhase
> Running phase: patchPhase
> Executing cargoSetupPostPatchHook
> Validating consistency between /build/src/_bcrypt/Cargo.lock and /Cargo.lock
> /nix/store/0fw4a3z849azkhyjxnpxbygj4g5qhd0v-diffutils-3.10/bin/diff: /build/src/_bcrypt/Cargo.lock: No such file or directory
> /nix/store/0fw4a3z849azkhyjxnpxbygj4g5qhd0v-diffutils-3.10/bin/diff: /Cargo.lock: No such file or directory
> ERROR: Missing Cargo.lock from src. Expected to find it at: /build/src/_bcrypt/Cargo.lock
> Hint: You can use the cargoPatches attribute to add a Cargo.lock manually to the build.
For full logs, run 'nix log /nix/store/lqfg86v33h64hi1dj3ib3i2dr1p0b7q6-python3.11-bcrypt-4.1.3.drv'.
error: 1 dependencies of derivation '/nix/store/swgnvl8v6ia6c0xljqgmrdnvqwpk5byc-python3.11-paramiko-3.4.0.drv' failed to build
error: 1 dependencies of derivation '/nix/store/dk5k1wk3ms188q5v30045ijam6lwnhs5-python3.11-pwntools-4.11.1.drv' failed to build
error: 3 dependencies of derivation '/nix/store/agw1nq1w6756lml1dmn189zb7xil9r0x-python3-3.11.9-env.drv' failed to build
error: 1 dependencies of derivation '/nix/store/72cyph2439whiqn07xkar3100217n3n8-nix-shell-env.drv' failed to build
I tried multiple approaches - either having the shell not using poetry2nix and just call poetry shell (but then I get into weird libc++ linking issues) and trying to toggle preferWheels on and off. Nothing.
Do you have any pointers on how to make bcrypt / the python environment work? Thank you!
try picking a bcrypt version for which there currently is an override?
"4.0.0" ,
"4.0.1,
"4.1.1" ,
"4.1.2" ,
"4.1.3"
| 08:34:19 |
TyberiusPrime (smilodon inopinatus) | perhaps | 08:34:20 |
TyberiusPrime (smilodon inopinatus) | though there is one for 4.1.3, hm. | 08:34:56 |
TyberiusPrime (smilodon inopinatus) | I know I build it with python 3.12, bcrypt 4.1.3 and the poetry2nix master like 2 weeks ago.. if you want I can drop you the flake.nix/pyproject.toml/poetry.lock | 08:36:51 |
TyberiusPrime (smilodon inopinatus) | there's some deep dark magic in the way the poetry2nix overrides work | 10:47:58 |
TyberiusPrime (smilodon inopinatus) | (deep dark magic = i don't grok it) | 10:50:33 |
peppino | Thanks TyberiusPrime (smilodon inopinatus), I really appreciate it | 16:45:07 |
peppino | I'm gonna try and report back | 16:45:11 |
peppino | This thing is driving me crazy @_@ | 16:45:18 |
peppino | I'm trying to get a dev env fully reproducible for a paper I submitted to a conference | 16:45:35 |
peppino | And Python is making everything explode badly | 16:45:42 |
peppino | 😠| 16:45:47 |
TyberiusPrime (smilodon inopinatus) | In reply to @pepe:runas.rocks 😠it does do that.. | 19:33:23 |