!fXpAvneDgyJuYMZSwO:nixos.org

Nix Data Science

223 Members
56 Servers

Load older messages


SenderMessageTime
27 Nov 2023
@dbrw:matrix.orgdbrw joined the room.02:16:29
28 Nov 2023
@a-n-n-a-l-e-e:matrix.orga-n-n-a-l-e-e joined the room.03:18:36
@a-n-n-a-l-e-e:matrix.orga-n-n-a-l-e-efix for python cvxopt on macOS could use a review. was using the wrong linear algebra library. https://github.com/NixOS/nixpkgs/pull/27001622:52:19
30 Nov 2023
@benmkw:matrix.orgbenmkw joined the room.06:47:47
1 Dec 2023
@okwalleye:matrix.orgollito joined the room.05:33:53
@lotte:chir.rsCharlotte 🦝 (it/its) changed their profile picture.09:39:58
4 Dec 2023
@enoch_roots:matrix.orgEnoch Root joined the room.19:20:56
@enoch_roots:matrix.orgEnoch Root set a profile picture.19:50:38
5 Dec 2023
@federicodschonborn:matrix.orgFederico Damián Schonborn changed their profile picture.00:39:03
7 Dec 2023
@kandread_umass.edu:matrix.orgKostas Andreadis joined the room.23:56:18
9 Dec 2023
@dbrw:matrix.orgdbrw set a profile picture.02:39:53
@softinio:matrix.orgSalar Rahmanian (softinio) changed their profile picture.05:18:52
@okwalleye:matrix.orgollito set a profile picture.20:03:49
@okwalleye:matrix.orgollito changed their display name from okwalleye to OldBlackHen.20:09:14
@okwalleye:matrix.orgollito changed their profile picture.20:15:54
12 Dec 2023
@flxai:envs.netFelix If I'm understanding correctly the new jupyenv is using poetry2nix under the hood, in contrast to the old jupyterWith behaviour, relying on Nixpkgs, right? Did somebody alternatively try this to get back to the old behaviour? https://discourse.nixos.org/t/criticism-of-the-new-jupyterwith/28494/5 23:40:35
14 Dec 2023
@maupind:matrix.orgmaupindDoes anyone have a good flake that works with python? I feel like I have had so many issues to get one that just works. Never could get poetry working well, and thought I figured one but when I moved it to a different computer everything broke either due to update to some of the python packages, or the flake wasn't actually that reproducible16:33:38
@emiller:beeper.comEdmund Miller
In reply to @maupind:matrix.org
Does anyone have a good flake that works with python? I feel like I have had so many issues to get one that just works. Never could get poetry working well, and thought I figured one but when I moved it to a different computer everything broke either due to update to some of the python packages, or the flake wasn't actually that reproducible
https://github.com/tweag/python-nix-flake-template Here's a quick one https://github.com/tweag/python-nix-flake-template
19:36:29
@emiller:beeper.comEdmund Miller
In reply to @maupind:matrix.org
Does anyone have a good flake that works with python? I feel like I have had so many issues to get one that just works. Never could get poetry working well, and thought I figured one but when I moved it to a different computer everything broke either due to update to some of the python packages, or the flake wasn't actually that reproducible
Here's one with poetry2nix
19:36:50
@emiller:beeper.comEdmund Miller
In reply to @maupind:matrix.org
Does anyone have a good flake that works with python? I feel like I have had so many issues to get one that just works. Never could get poetry working well, and thought I figured one but when I moved it to a different computer everything broke either due to update to some of the python packages, or the flake wasn't actually that reproducible
nix-init changed my life though
19:37:20
@emiller:beeper.comEdmund Miller
In reply to @maupind:matrix.org
Does anyone have a good flake that works with python? I feel like I have had so many issues to get one that just works. Never could get poetry working well, and thought I figured one but when I moved it to a different computer everything broke either due to update to some of the python packages, or the flake wasn't actually that reproducible
* nix-init changed my life though https://github.com/nix-community/nix-init
19:37:26
15 Dec 2023
@maupind:matrix.orgmaupindI'll have a look at these thank you! always had some issues with poetry2nix building some packages. But I my environment just broke recently. Not sure why, but it seems like shap package updated and is now trying to install lightgbm as a dependency but this doesn't build due to a newer gnu version 😂17:21:08
18 Dec 2023
@phaebz:matrix.orgphaebz changed their profile picture.23:21:32
20 Dec 2023
@username:yatrix.org@username:yatrix.org joined the room.10:30:58
23 Dec 2023
@raitobezarius:matrix.orgraitobezarius changed their display name from raitobezarius to raitobezarius (DECT 2128).22:22:37
27 Dec 2023
@atrius:matrix.orgmjlbach left the room.01:53:48
@lotte:chir.rsCharlotte 🦝 (it/its) changed their profile picture.09:14:53
30 Dec 2023
@benoitdr:matrix.orgbenoitdr joined the room.09:37:52
@benoitdr:matrix.orgbenoitdr

Hi all, here is my shell.nix for jupyter lab environment (I'm not a flake user so I keep it as shell.nix for the moment).
I'm now trying to add ctransformers library but the build fails miserability (see the log, problem to locate setup.py as I understand, although I see it at the project root). Would anyone have an idea ?

let
  nixpkgs = fetchTarball "https://github.com/NixOS/nixpkgs/archive/04220ed6763637e5899980f98d5c8424b1079353.tar.gz";
  pkgs = import nixpkgs { config = {}; overlays = []; };
  ctransformers = pkgs.python310.pkgs.buildPythonPackage rec {
      pname = "ctransformers";
      version = "0.2.27";
      format = "pyproject";
      src = pkgs.python310.pkgs.fetchPypi {
        inherit pname version;
        sha256 = "25653d4be8a5ed4e2d3756544c1e9881bf95404be5371c3ed506a256c28663d5";
      };
      doCheck = false;
      nativeBuildInputs = [
        pkgs.python310Packages.setuptools
        pkgs.python310Packages.scikit-build
        pkgs.python310Packages.ninja
        pkgs.python310Packages.cmake
        pkgs.python310Packages.huggingface-hub
        pkgs.python310Packages.py-cpuinfo
        pkgs.python310Packages.huggingface-hub
        pkgs.python310Packages.py-cpuinfo
      ];
    };
in
  pkgs.mkShell {
    packages = with pkgs; [
      (python310.withPackages (ps: with ps; [
        numpy
        pandas
        matplotlib
        scipy
        jupyterlab
        ipympl
        jupyterlab-git
        ctransformers
      ]))
    ];

  shellHook = ''
    jupyter lab
    exit
  '';
  }

and here is the error message :

-- Build files have been written to: /build/ctransformers-0.2.27/build
cmake: enabled parallel building
cmake: enabled parallel installing
building
Executing pypaBuildPhase
Creating a wheel...
ERROR Source /build/ctransformers-0.2.27/build does not appear to be a Python project: no pyproject.toml or setup.py
error: builder for '/nix/store/cwk0kjniclqcskv3i5gxfw5nihld0md9-python3.10-ctransformers-0.2.27.drv' failed with exit code 1;
       last 10 log lines:
       >     CMAKE_POLICY_DEFAULT_CMP0025
       >
       > 
       > -- Build files have been written to: /build/ctransformers-0.2.27/build
       > cmake: enabled parallel building
       > cmake: enabled parallel installing
       > building
       > Executing pypaBuildPhase
       > Creating a wheel...
       > ERROR Source /build/ctransformers-0.2.27/build does not appear to be a Python project: no pyproject.toml or setup.py
       For full logs, run 'nix log /nix/store/cwk0kjniclqcskv3i5gxfw5nihld0md9-python3.10-ctransformers-0.2.27.drv'.
error: 1 dependencies of derivation '/nix/store/r07h95i2csyx80f0lsf05v7i4jciqxg2-python3-3.10.13-env.drv' failed to build
09:45:01
@trexd:matrix.orgtrexd
In reply to @benoitdr:matrix.org

Hi all, here is my shell.nix for jupyter lab environment (I'm not a flake user so I keep it as shell.nix for the moment).
I'm now trying to add ctransformers library but the build fails miserability (see the log, problem to locate setup.py as I understand, although I see it at the project root). Would anyone have an idea ?

let
  nixpkgs = fetchTarball "https://github.com/NixOS/nixpkgs/archive/04220ed6763637e5899980f98d5c8424b1079353.tar.gz";
  pkgs = import nixpkgs { config = {}; overlays = []; };
  ctransformers = pkgs.python310.pkgs.buildPythonPackage rec {
      pname = "ctransformers";
      version = "0.2.27";
      format = "pyproject";
      src = pkgs.python310.pkgs.fetchPypi {
        inherit pname version;
        sha256 = "25653d4be8a5ed4e2d3756544c1e9881bf95404be5371c3ed506a256c28663d5";
      };
      doCheck = false;
      nativeBuildInputs = [
        pkgs.python310Packages.setuptools
        pkgs.python310Packages.scikit-build
        pkgs.python310Packages.ninja
        pkgs.python310Packages.cmake
        pkgs.python310Packages.huggingface-hub
        pkgs.python310Packages.py-cpuinfo
        pkgs.python310Packages.huggingface-hub
        pkgs.python310Packages.py-cpuinfo
      ];
    };
in
  pkgs.mkShell {
    packages = with pkgs; [
      (python310.withPackages (ps: with ps; [
        numpy
        pandas
        matplotlib
        scipy
        jupyterlab
        ipympl
        jupyterlab-git
        ctransformers
      ]))
    ];

  shellHook = ''
    jupyter lab
    exit
  '';
  }

and here is the error message :

-- Build files have been written to: /build/ctransformers-0.2.27/build
cmake: enabled parallel building
cmake: enabled parallel installing
building
Executing pypaBuildPhase
Creating a wheel...
ERROR Source /build/ctransformers-0.2.27/build does not appear to be a Python project: no pyproject.toml or setup.py
error: builder for '/nix/store/cwk0kjniclqcskv3i5gxfw5nihld0md9-python3.10-ctransformers-0.2.27.drv' failed with exit code 1;
       last 10 log lines:
       >     CMAKE_POLICY_DEFAULT_CMP0025
       >
       > 
       > -- Build files have been written to: /build/ctransformers-0.2.27/build
       > cmake: enabled parallel building
       > cmake: enabled parallel installing
       > building
       > Executing pypaBuildPhase
       > Creating a wheel...
       > ERROR Source /build/ctransformers-0.2.27/build does not appear to be a Python project: no pyproject.toml or setup.py
       For full logs, run 'nix log /nix/store/cwk0kjniclqcskv3i5gxfw5nihld0md9-python3.10-ctransformers-0.2.27.drv'.
error: 1 dependencies of derivation '/nix/store/r07h95i2csyx80f0lsf05v7i4jciqxg2-python3-3.10.13-env.drv' failed to build
Looks like ctransformers is failing to build. I have a working implementation of ctransformers here https://github.com/collinarnett/LLM-VM/blob/nix/nix/packages/ctransformers/default.nix which is adapted from https://github.com/jpetrucciani/nix/blob/fab25e6f22a76439754bc04d80a5d70d45a76ec1/mods/python/ai/bindings.nix#L462
17:00:48

Show newer messages


Back to Room ListRoom Version: 6