In reply to @collinarnett:matrix.org
How do people deal with packages trying to download models at runtime to the nix store? This is more of a general question since I've noticed that a lot of data science libraries nowadays are just downloading dependencies at runtime.

In reply to @FRidh:matrix.org
I think all you can do is contact upstream to fix where they install to. If they need models, that could be fine, but then they should probably go to ~/.cache

In reply to @flxai:matrix.org
I am new to NixOS and wondering what's a good way to set up Jupyter. Are there opinions on JupyterWith or maybe some general recommendations?

In reply to @jboy:utwente.io
These days I use a shell.nix with poetry and a venvHook, and then I just manage project dependencies (including jupyter) using poetry. It would be nice to do everything with nix packages, but inevitably I get to the point where I want to use something that isn't packaged.

In reply to @carlthome:matrix.org
Could you share an example of such a shell.nix? I'm interested in how to use a venvHook.

I've been dabbling with jupyterWith but feeling that poetry2nix is easier when one just needs to get stuff done.

But I've only tried poetry2nix for making a library so far, not a notebook environment: https://github.com/carlthome/poetry2nix-test/blob/main/flake.nix

with import <nixpkgs> {};

mkShell {
  venvDir = "./VENV";
  buildInputs = [
    cairo
    graphviz
    zlib
    poetry
    python3.pkgs.venvShellHook
  ];
  postShellHook = ''
    export LD_LIBRARY_PATH=${stdenv.cc.cc.lib}/lib/:${cairo}/lib/:${zlib}/lib:$LD_LIBRARY_PATH
    poetry install
  '';
}

with import <nixpkgs> {};

mkShell {
  venvDir = "./VENV";
  buildInputs = [
    cairo
    zlib
    poetry
    python3.pkgs.venvShellHook
  ];
  postShellHook = ''
    export LD_LIBRARY_PATH=${stdenv.cc.cc.lib}/lib/:${cairo}/lib/:${zlib}/lib:$LD_LIBRARY_PATH
    poetry install
  '';
}

In reply to @jboy:utwente.io

with import <nixpkgs> {};

mkShell {
  venvDir = "./VENV";
  buildInputs = [
    cairo
    zlib
    poetry
    python3.pkgs.venvShellHook
  ];
  postShellHook = ''
    export LD_LIBRARY_PATH=${stdenv.cc.cc.lib}/lib/:${cairo}/lib/:${zlib}/lib:$LD_LIBRARY_PATH
    poetry install
  '';
}

In reply to @flxai:matrix.org
carlthome: Have you also a nix file that uses jupyterWith? Where do you see friction with jupyterWith?

TBH not sure what I'm doing really. 🫡

Figured it could be convenient to have a set of regular ipykernels (one for PyTorch, one for scikit-learn, etc.), ready for playing around with ML modelling ideas.

Thus I started just throwing in them as devShells in my ongoing home flake to learn more about jupyterWith.

Here's a wip commit:

https://github.com/carlthome/dotfiles/pull/3/files#diff-206b9ce276ab5971a2489d75eb1b12999d4bf3843b7988cbe8d687cfde61dea0R57