!rWxyQqNqMUDLECdsIf:blad.is

Poetry2nix

322 Members
https://github.com/nix-community/poetry2nix62 Servers

Load older messages

SenderMessageTime
24 Mar 2024
@cloudcomputer:matrix.orgcloudcomputerI am trying to update poetry2nix to work with a more recent nixpkgs, and I need some help with the darwin builds. I don't have access to a mac.13:19:51
@cloudcomputer:matrix.orgcloudcomputerhttps://github.com/nix-community/poetry2nix/pull/1559 is the PR13:20:16
@cloudcomputer:matrix.orgcloudcomputerIt looks like there's some issues with function pointer signatures with lxml, scipy and matplotlib (or some transitive dependency thereof)13:21:20
@leonardp:matrix.orgleonardp latenighticecream: welcome to dependency hell 🫠
if you can provide a minimal example repo (i.e. flake with drjit+mitsuba packages) i'd be willing to help
but i only have time to work on such projects on weekends 		13:37:14
@leonardp:matrix.orgleonardpi wanted to try out mitsuba for photogrammetry13:37:35
@cloudcomputer:matrix.orgcloudcomputerRelated to this, all the cloud providers I've tried to use, including Scaleway and MacStadium seem to prohibit me from doing anything without first undergoing an account review. I'm using masked email address via fastmail, and I'm guessing they flag that or something.13:43:44
@cloudcomputer:matrix.orgcloudcomputer * Related to this, all the cloud providers I've tried to use, including Scaleway and MacStadium seem to prohibit me from doing anything without first undergoing an account review. I'm using masked email addresses via fastmail, and I'm guessing they flag that or something. 13:44:02
@cloudcomputer:matrix.orgcloudcomputerScaleway in particular was horrendous. They locked my account after I spun up an instance and continued to charge me for the instance after locking my account.13:45:13
@latenighticecream:matrix.orglatenighticecream
In reply to@leonardp:matrix.org
latenighticecream: welcome to dependency hell 🫠
if you can provide a minimal example repo (i.e. flake with drjit+mitsuba packages) i'd be willing to help
but i only have time to work on such projects on weekends
here it is: https://github.com/LateNightIceCream/poetry2nix-mitsuba 		13:51:41
@leonardp:matrix.orgleonardpcool i'll look into it13:57:07
@latenighticecream:matrix.orglatenighticecream
In reply to@leonardp:matrix.org
cool i'll look into it
thank you !! 		13:58:37
@leonardp:matrix.orgleonardp latenighticecream: i think your problems go deeper 15:11:13
@leonardp:matrix.orgleonardp:/15:11:18
@leonardp:matrix.orgleonardpi do not think the dependencies are built correctly at all15:11:55
@leonardp:matrix.orgleonardp

id basically did:

nix develop
cd src
poetry add drjit
poetry remove mitsuba
15:12:37
@leonardp:matrix.orgleonardpan the tried an example from: https://drjit.readthedocs.io/en/latest/firststeps-py.html#signed-distance-functions-and-sphere-tracing15:12:59
@leonardp:matrix.orgleonardpeverything seems to be fine (i.e. importing) until you execute some function15:13:44
@leonardp:matrix.orgleonardp RuntimeError: jit_init_thread_state(): the LLVM backend is inactive because the LLVM shared library ("libLLVM.so") could not be found! Set the DRJIT_LIBLLVM_PATH environment variable to specify its path.
then you will see some errors like this 		15:14:12
@leonardp:matrix.orgleonardp

which also kind of happens when trying to use mitsuba from your example:

Python 3.10.13 (main, Aug 24 2023, 12:59:26) [GCC 12.3.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import mitsuba
Traceback (most recent call last):
  File "/nix/store/l5r75mhpmmnw4d02mb4gcl9s19qz5da7-python3-3.10.13-env/lib/python3.10/site-packages/mitsuba/__init__.py", line 39, in <module>
    _import('mitsuba.mitsuba_ext')
  File "/nix/store/50kabpj0s79040a42b7jj2dxn85wmbfd-python3-3.10.13/lib/python3.10/importlib/__init__.py", line 126, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "<frozen importlib._bootstrap>", line 1050, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1027, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1006, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 674, in _load_unlocked
  File "<frozen importlib._bootstrap>", line 571, in module_from_spec
  File "<frozen importlib._bootstrap_external>", line 1176, in create_module
  File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
ImportError: libz.so.1: cannot open shared object file: No such file or directory
15:14:50
@leonardp:matrix.orgleonardpi think you will have to build some dependencies by hand15:18:45
@leonardp:matrix.orgleonardpi would start by trying to build drjit15:20:58
@leonardp:matrix.orgleonardpfor example you can look at: https://github.com/NixOS/nixpkgs/blob/master/pkgs/development/python-modules/h3/default.nix and https://github.com/NixOS/nixpkgs/blob/master/pkgs/development/python-modules/blosc2/default.nix15:21:23
@leonardp:matrix.orgleonardpand maybe: https://github.com/NixOS/nixpkgs/blob/master/pkgs/development/python-modules/lightgbm/default.nix15:22:33
@latenighticecream:matrix.orglatenighticecream
In reply to@leonardp:matrix.org
RuntimeError: jit_init_thread_state(): the LLVM backend is inactive because the LLVM shared library ("libLLVM.so") could not be found! Set the DRJIT_LIBLLVM_PATH environment variable to specify its path.
then you will see some errors like this
ahh I had this error before, as well.. I don't remember how I resolved it though.. Anyways, I will try building it by hand. I already built drjit before by hand, which worked on its own (although I also only tested importing). Mitsuba should then also not be too bloated as its only real dependency is drjit.
Thank you for your help! I will let you know when I made some progress :) 		15:24:37
@latenighticecream:matrix.orglatenighticecreamI am wondering though if this "hybrid" approach will work with poetry2nix? Do I just put the python packages inside the packages of my shell? Since they wont be listed in my pyproject.toml15:26:45
@leonardp:matrix.orgleonardpnot so sure about that aswell, but i haven't done too much with poetry2nix you said that you don't really need the packages so you might get away with it15:28:28
@leonardp:matrix.orgleonardpdepending on how little you actually need the packages.. but i suspect only passing the import test will not suffice -.-15:30:23
@leonardp:matrix.orgleonardpbest of luck :)15:31:02
@latenighticecream:matrix.orglatenighticecreamthank you ! I will need that :D15:31:39
@latenighticecream:matrix.orglatenighticecreamSoo.. I'm kind of giving up. In the end I received the same LLVM library error as you showed before and am unable to get rid of it. drjit on its own works when built by hand, even with the sdf example you provided (mitsuba still produces the same error). But when I try to import sionna (the thing I actually need) said error appears. Unfortunately, it has already eaten way too much time without producing anything useful. But I learned a lot of nix on the way :) So I'm now going back to the impure versions with pip + venvs inside a shell18:26:03

Show newer messages

Back to Room ListRoom Version: 6