!rWxyQqNqMUDLECdsIf:blad.is

Poetry2nix

306 Members
https://github.com/nix-community/poetry2nix56 Servers

Load older messages

SenderMessageTime
24 Mar 2024
@latenighticecream:matrix.orglatenighticecream Thanks, I will try that out !
I don't have a repo for this, but i will create a temporary one for this. Currently, this is for my masters thesis which is a private repo for the time I work on it. The stupid thing is, I don't really want to use any of mitsuba - I am just trying to get a shell with sionna which requires this package, but only for things that I dont even need xD 		12:51:12
@cloudcomputer:matrix.orgcloudcomputer joined the room.13:18:41
@cloudcomputer:matrix.orgcloudcomputerI am trying to update poetry2nix to work with a more recent nixpkgs, and I need some help with the darwin builds. I don't have access to a mac.13:19:51
@cloudcomputer:matrix.orgcloudcomputerhttps://github.com/nix-community/poetry2nix/pull/1559 is the PR13:20:16
@cloudcomputer:matrix.orgcloudcomputerIt looks like there's some issues with function pointer signatures with lxml, scipy and matplotlib (or some transitive dependency thereof)13:21:20
@leonardp:matrix.orgleonardp latenighticecream: welcome to dependency hell 🫠
if you can provide a minimal example repo (i.e. flake with drjit+mitsuba packages) i'd be willing to help
but i only have time to work on such projects on weekends 		13:37:14
@leonardp:matrix.orgleonardpi wanted to try out mitsuba for photogrammetry13:37:35
@cloudcomputer:matrix.orgcloudcomputerRelated to this, all the cloud providers I've tried to use, including Scaleway and MacStadium seem to prohibit me from doing anything without first undergoing an account review. I'm using masked email address via fastmail, and I'm guessing they flag that or something.13:43:44
@cloudcomputer:matrix.orgcloudcomputer * Related to this, all the cloud providers I've tried to use, including Scaleway and MacStadium seem to prohibit me from doing anything without first undergoing an account review. I'm using masked email addresses via fastmail, and I'm guessing they flag that or something. 13:44:02
@cloudcomputer:matrix.orgcloudcomputerScaleway in particular was horrendous. They locked my account after I spun up an instance and continued to charge me for the instance after locking my account.13:45:13
@latenighticecream:matrix.orglatenighticecream
In reply to@leonardp:matrix.org
latenighticecream: welcome to dependency hell 🫠
if you can provide a minimal example repo (i.e. flake with drjit+mitsuba packages) i'd be willing to help
but i only have time to work on such projects on weekends
here it is: https://github.com/LateNightIceCream/poetry2nix-mitsuba 		13:51:41
@leonardp:matrix.orgleonardpcool i'll look into it13:57:07
@latenighticecream:matrix.orglatenighticecream
In reply to@leonardp:matrix.org
cool i'll look into it
thank you !! 		13:58:37
@leonardp:matrix.orgleonardp latenighticecream: i think your problems go deeper 15:11:13
@leonardp:matrix.orgleonardp:/15:11:18
@leonardp:matrix.orgleonardpi do not think the dependencies are built correctly at all15:11:55
@leonardp:matrix.orgleonardp

id basically did:

nix develop
cd src
poetry add drjit
poetry remove mitsuba
15:12:37
@leonardp:matrix.orgleonardpan the tried an example from: https://drjit.readthedocs.io/en/latest/firststeps-py.html#signed-distance-functions-and-sphere-tracing15:12:59
@leonardp:matrix.orgleonardpeverything seems to be fine (i.e. importing) until you execute some function15:13:44
@leonardp:matrix.orgleonardp RuntimeError: jit_init_thread_state(): the LLVM backend is inactive because the LLVM shared library ("libLLVM.so") could not be found! Set the DRJIT_LIBLLVM_PATH environment variable to specify its path.
then you will see some errors like this 		15:14:12
@leonardp:matrix.orgleonardp

which also kind of happens when trying to use mitsuba from your example:

Python 3.10.13 (main, Aug 24 2023, 12:59:26) [GCC 12.3.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import mitsuba
Traceback (most recent call last):
  File "/nix/store/l5r75mhpmmnw4d02mb4gcl9s19qz5da7-python3-3.10.13-env/lib/python3.10/site-packages/mitsuba/__init__.py", line 39, in <module>
    _import('mitsuba.mitsuba_ext')
  File "/nix/store/50kabpj0s79040a42b7jj2dxn85wmbfd-python3-3.10.13/lib/python3.10/importlib/__init__.py", line 126, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "<frozen importlib._bootstrap>", line 1050, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1027, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1006, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 674, in _load_unlocked
  File "<frozen importlib._bootstrap>", line 571, in module_from_spec
  File "<frozen importlib._bootstrap_external>", line 1176, in create_module
  File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
ImportError: libz.so.1: cannot open shared object file: No such file or directory
15:14:50
@leonardp:matrix.orgleonardpi think you will have to build some dependencies by hand15:18:45
@leonardp:matrix.orgleonardpi would start by trying to build drjit15:20:58
@leonardp:matrix.orgleonardpfor example you can look at: https://github.com/NixOS/nixpkgs/blob/master/pkgs/development/python-modules/h3/default.nix and https://github.com/NixOS/nixpkgs/blob/master/pkgs/development/python-modules/blosc2/default.nix15:21:23
@leonardp:matrix.orgleonardpand maybe: https://github.com/NixOS/nixpkgs/blob/master/pkgs/development/python-modules/lightgbm/default.nix15:22:33
@latenighticecream:matrix.orglatenighticecream
In reply to@leonardp:matrix.org
RuntimeError: jit_init_thread_state(): the LLVM backend is inactive because the LLVM shared library ("libLLVM.so") could not be found! Set the DRJIT_LIBLLVM_PATH environment variable to specify its path.
then you will see some errors like this
ahh I had this error before, as well.. I don't remember how I resolved it though.. Anyways, I will try building it by hand. I already built drjit before by hand, which worked on its own (although I also only tested importing). Mitsuba should then also not be too bloated as its only real dependency is drjit.
Thank you for your help! I will let you know when I made some progress :) 		15:24:37
@latenighticecream:matrix.orglatenighticecreamI am wondering though if this "hybrid" approach will work with poetry2nix? Do I just put the python packages inside the packages of my shell? Since they wont be listed in my pyproject.toml15:26:45
@leonardp:matrix.orgleonardpnot so sure about that aswell, but i haven't done too much with poetry2nix you said that you don't really need the packages so you might get away with it15:28:28
@leonardp:matrix.orgleonardpdepending on how little you actually need the packages.. but i suspect only passing the import test will not suffice -.-15:30:23
@leonardp:matrix.orgleonardpbest of luck :)15:31:02

Show newer messages

Back to Room ListRoom Version: 6