| 1 Dec 2023 |
|  ollito joined the room. | 05:33:53 |
|  @lotte:chir.rs changed their profile picture. | 09:39:58 |
| 4 Dec 2023 |
|  Enoch Root joined the room. | 19:20:56 |
| Enoch Root set a profile picture. | 19:50:38 |
| 5 Dec 2023 |
|  @federicodschonborn:matrix.org changed their profile picture. | 00:39:03 |
| 7 Dec 2023 |
|  @kandread_umass.edu:matrix.org joined the room. | 23:56:18 |
| 9 Dec 2023 |
|  dbrw set a profile picture. | 02:39:53 |
|  @softinio:matrix.org changed their profile picture. | 05:18:52 |
| ollito set a profile picture. | 20:03:49 |
| ollito changed their display name from okwalleye to OldBlackHen. | 20:09:14 |
| ollito changed their profile picture. | 20:15:54 |
| 12 Dec 2023 |
 Felix | If I'm understanding correctly the new jupyenv is using poetry2nix under the hood, in contrast to the old jupyterWith behaviour, relying on Nixpkgs, right? Did somebody alternatively try this to get back to the old behaviour? https://discourse.nixos.org/t/criticism-of-the-new-jupyterwith/28494/5 | 23:40:35 |
| 14 Dec 2023 |
 maupind | Does anyone have a good flake that works with python? I feel like I have had so many issues to get one that just works. Never could get poetry working well, and thought I figured one but when I moved it to a different computer everything broke either due to update to some of the python packages, or the flake wasn't actually that reproducible | 16:33:38 |
 Edmund Miller | In reply to @maupind:matrix.org
Does anyone have a good flake that works with python? I feel like I have had so many issues to get one that just works. Never could get poetry working well, and thought I figured one but when I moved it to a different computer everything broke either due to update to some of the python packages, or the flake wasn't actually that reproducible https://github.com/tweag/python-nix-flake-template Here's a quick one https://github.com/tweag/python-nix-flake-template | 19:36:29 |
| Edmund Miller | In reply to @maupind:matrix.org
Does anyone have a good flake that works with python? I feel like I have had so many issues to get one that just works. Never could get poetry working well, and thought I figured one but when I moved it to a different computer everything broke either due to update to some of the python packages, or the flake wasn't actually that reproducible Here's one with poetry2nix | 19:36:50 |
| Edmund Miller | In reply to @maupind:matrix.org
Does anyone have a good flake that works with python? I feel like I have had so many issues to get one that just works. Never could get poetry working well, and thought I figured one but when I moved it to a different computer everything broke either due to update to some of the python packages, or the flake wasn't actually that reproducible nix-init changed my life though | 19:37:20 |
| Edmund Miller | In reply to @maupind:matrix.org
Does anyone have a good flake that works with python? I feel like I have had so many issues to get one that just works. Never could get poetry working well, and thought I figured one but when I moved it to a different computer everything broke either due to update to some of the python packages, or the flake wasn't actually that reproducible * nix-init changed my life though https://github.com/nix-community/nix-init | 19:37:26 |
| 15 Dec 2023 |
| maupind | I'll have a look at these thank you! always had some issues with poetry2nix building some packages. But I my environment just broke recently. Not sure why, but it seems like shap package updated and is now trying to install lightgbm as a dependency but this doesn't build due to a newer gnu version 😂 | 17:21:08 |
| 18 Dec 2023 |
|  phaebz changed their profile picture. | 23:21:32 |
| 20 Dec 2023 |
|  @username:yatrix.org joined the room. | 10:30:58 |
| 23 Dec 2023 |
|  raitobezarius changed their display name from raitobezarius to raitobezarius (DECT 2128). | 22:22:37 |
| 27 Dec 2023 |
|  @atrius:matrix.org left the room. | 01:53:48 |
| @lotte:chir.rs changed their profile picture. | 09:14:53 |
| 30 Dec 2023 |
|  benoitdr joined the room. | 09:37:52 |
| benoitdr | Hi all, here is my shell.nix for jupyter lab environment (I'm not a flake user so I keep it as shell.nix for the moment).
I'm now trying to add ctransformers library but the build fails miserability (see the log, problem to locate setup.py as I understand, although I see it at the project root). Would anyone have an idea ?
let
nixpkgs = fetchTarball "https://github.com/NixOS/nixpkgs/archive/04220ed6763637e5899980f98d5c8424b1079353.tar.gz";
pkgs = import nixpkgs { config = {}; overlays = []; };
ctransformers = pkgs.python310.pkgs.buildPythonPackage rec {
pname = "ctransformers";
version = "0.2.27";
format = "pyproject";
src = pkgs.python310.pkgs.fetchPypi {
inherit pname version;
sha256 = "25653d4be8a5ed4e2d3756544c1e9881bf95404be5371c3ed506a256c28663d5";
};
doCheck = false;
nativeBuildInputs = [
pkgs.python310Packages.setuptools
pkgs.python310Packages.scikit-build
pkgs.python310Packages.ninja
pkgs.python310Packages.cmake
pkgs.python310Packages.huggingface-hub
pkgs.python310Packages.py-cpuinfo
pkgs.python310Packages.huggingface-hub
pkgs.python310Packages.py-cpuinfo
];
};
in
pkgs.mkShell {
packages = with pkgs; [
(python310.withPackages (ps: with ps; [
numpy
pandas
matplotlib
scipy
jupyterlab
ipympl
jupyterlab-git
ctransformers
]))
];
shellHook = ''
jupyter lab
exit
'';
}
and here is the error message :
-- Build files have been written to: /build/ctransformers-0.2.27/build
cmake: enabled parallel building
cmake: enabled parallel installing
building
Executing pypaBuildPhase
Creating a wheel...
ERROR Source /build/ctransformers-0.2.27/build does not appear to be a Python project: no pyproject.toml or setup.py
error: builder for '/nix/store/cwk0kjniclqcskv3i5gxfw5nihld0md9-python3.10-ctransformers-0.2.27.drv' failed with exit code 1;
last 10 log lines:
> CMAKE_POLICY_DEFAULT_CMP0025
>
>
> -- Build files have been written to: /build/ctransformers-0.2.27/build
> cmake: enabled parallel building
> cmake: enabled parallel installing
> building
> Executing pypaBuildPhase
> Creating a wheel...
> ERROR Source /build/ctransformers-0.2.27/build does not appear to be a Python project: no pyproject.toml or setup.py
For full logs, run 'nix log /nix/store/cwk0kjniclqcskv3i5gxfw5nihld0md9-python3.10-ctransformers-0.2.27.drv'.
error: 1 dependencies of derivation '/nix/store/r07h95i2csyx80f0lsf05v7i4jciqxg2-python3-3.10.13-env.drv' failed to build
| 09:45:01 |
 @trexd:matrix.org | In reply to @benoitdr:matrix.org
Hi all, here is my shell.nix for jupyter lab environment (I'm not a flake user so I keep it as shell.nix for the moment).
I'm now trying to add ctransformers library but the build fails miserability (see the log, problem to locate setup.py as I understand, although I see it at the project root). Would anyone have an idea ?
let
nixpkgs = fetchTarball "https://github.com/NixOS/nixpkgs/archive/04220ed6763637e5899980f98d5c8424b1079353.tar.gz";
pkgs = import nixpkgs { config = {}; overlays = []; };
ctransformers = pkgs.python310.pkgs.buildPythonPackage rec {
pname = "ctransformers";
version = "0.2.27";
format = "pyproject";
src = pkgs.python310.pkgs.fetchPypi {
inherit pname version;
sha256 = "25653d4be8a5ed4e2d3756544c1e9881bf95404be5371c3ed506a256c28663d5";
};
doCheck = false;
nativeBuildInputs = [
pkgs.python310Packages.setuptools
pkgs.python310Packages.scikit-build
pkgs.python310Packages.ninja
pkgs.python310Packages.cmake
pkgs.python310Packages.huggingface-hub
pkgs.python310Packages.py-cpuinfo
pkgs.python310Packages.huggingface-hub
pkgs.python310Packages.py-cpuinfo
];
};
in
pkgs.mkShell {
packages = with pkgs; [
(python310.withPackages (ps: with ps; [
numpy
pandas
matplotlib
scipy
jupyterlab
ipympl
jupyterlab-git
ctransformers
]))
];
shellHook = ''
jupyter lab
exit
'';
}
and here is the error message :
-- Build files have been written to: /build/ctransformers-0.2.27/build
cmake: enabled parallel building
cmake: enabled parallel installing
building
Executing pypaBuildPhase
Creating a wheel...
ERROR Source /build/ctransformers-0.2.27/build does not appear to be a Python project: no pyproject.toml or setup.py
error: builder for '/nix/store/cwk0kjniclqcskv3i5gxfw5nihld0md9-python3.10-ctransformers-0.2.27.drv' failed with exit code 1;
last 10 log lines:
> CMAKE_POLICY_DEFAULT_CMP0025
>
>
> -- Build files have been written to: /build/ctransformers-0.2.27/build
> cmake: enabled parallel building
> cmake: enabled parallel installing
> building
> Executing pypaBuildPhase
> Creating a wheel...
> ERROR Source /build/ctransformers-0.2.27/build does not appear to be a Python project: no pyproject.toml or setup.py
For full logs, run 'nix log /nix/store/cwk0kjniclqcskv3i5gxfw5nihld0md9-python3.10-ctransformers-0.2.27.drv'.
error: 1 dependencies of derivation '/nix/store/r07h95i2csyx80f0lsf05v7i4jciqxg2-python3-3.10.13-env.drv' failed to build
Looks like ctransformers is failing to build. I have a working implementation of ctransformers here https://github.com/collinarnett/LLM-VM/blob/nix/nix/packages/ctransformers/default.nix which is adapted from https://github.com/jpetrucciani/nix/blob/fab25e6f22a76439754bc04d80a5d70d45a76ec1/mods/python/ai/bindings.nix#L462 | 17:00:48 |
| raitobezarius changed their display name from raitobezarius (DECT 2128) to raitobezarius. | 19:53:16 |
| 31 Dec 2023 |
| benoitdr | Redacted or Malformed Event | 08:30:54 |
| @trexd:matrix.org | In reply to @benoitdr:matrix.org
Thanks, dontUseCmakeConfigure = true was the missing piece Yeah protip, if you're looking for AI packages, use github search and do language:Nix PACKAGE_NAME buildPythonPackage and there's a good chance someone has already packaged it. That saves me so much time :D | 17:04:35 |
| 2 Jan 2024 |
| benoitdr | In reply to @trexd:matrix.org
Yeah protip, if you're looking for AI packages, use github search and do language:Nix PACKAGE_NAME buildPythonPackage and there's a good chance someone has already packaged it. That saves me so much time :D Great, thanks ! | 08:35:38 |
