!fXpAvneDgyJuYMZSwO:nixos.org

Nix Data Science

282 Members
62 Servers

Load older messages


SenderMessageTime
6 Sep 2022
@hinklejd:matrix.orghacobjinkleapologies if there is an existing solution to this kind of data handling with nix that I'm unaware of15:35:12
@hinklejd:matrix.orghacobjinklei guess the splitting could of course be done with symlinks. main question is then is there any hope of handling large datasets at rest on some storage outside /nix15:39:06
@FRidh:matrix.orgFRidhNix master supports impure derivations. Impure derivations have network access, so you could write your result somewhere else. I have not tried this yet, but I imagine this going to be very useful also in CI/CD.17:04:49
@FRidh:matrix.orgFRidhhttps://github.com/NixOS/nix/pull/622717:05:19
@hinklejd:matrix.orghacobjinklethanks. I currently use --impure on non-NixOS with nixGL to get cuda working anyway, so that may be the ticket17:07:24
@FRidh:matrix.orgFRidhthat's not the same though, that's impure evaluation17:08:40
@hinklejd:matrix.orghacobjinklei see that now. should've read before replying..17:09:23
7 Sep 2022
@ss:someonex.netSomeone S

Has anyone got a working example of micromamba environment?
I've tried using it in a bulidFHSUserEnv(Bubblewrap) with this in /etc/profile:

    eval "$(micromamba shell hook --shell=bash)"
    micromamba activate

...but it keeps segfaulting later when I prompt micromamba activate $envName

What helps is running the eval "$(...)" in the shell manually

12:43:40
15 Sep 2022
@m_algery:leohoo.xyz@m_algery:leohoo.xyz joined the room.12:10:46
@m_algery:leohoo.xyz@m_algery:leohoo.xyz left the room.12:10:49
16 Sep 2022
@tyberius_prime:matrix.orgTyberiusPrime changed their display name from TyberiusPrime to TyberiusPrime (fiber at home when).07:37:08
@sepiabrown:matrix.orgSuwon Park joined the room.18:17:04
@sepiabrown:matrix.orgSuwon Park
In reply to @flxai:matrix.org
I am new to NixOS and wondering what's a good way to set up Jupyter. Are there opinions on JupyterWith or maybe some general recommendations?
Try using jupyterWith + poetry2nix with flake.nix! It's hard but fun!
18:33:55
@flxai:matrix.orgFelixsepiabrown: Thanks, this sounds like a good mix. Do you have configs lieing around somewhere?18:38:49
@sepiabrown:matrix.orgSuwon Park
In reply to @flxai:matrix.org
sepiabrown: Thanks, this sounds like a good mix. Do you have configs lieing around somewhere?

https://github.com/sepiabrown/jupyterWith_poetry2nix

If you are new to NixOS, the above solution may be hard!

If other advanced user could have a look at my code and have any comment for improvement, it would be appreciated!

19:22:32
@flxai:matrix.orgFelixThanks. I'll have a look the following days and try my best. Not that comfortable with Nix and its components yet19:28:06
18 Sep 2022
@FRidh:matrix.orgFRidh set a profile picture.17:20:55
24 Sep 2022
@peddie:matrix.orgpeddie joined the room.10:45:47
30 Sep 2022
@hinklejd:matrix.orghacobjinkleOn the topic of poetry, do you guys have any nice methods for getting an editable install using pure nix? I use a flake similar to above with poetry2nix, which works great for creating a derivation for a python package, but I then need to run poetry shell from inside a devshell (through direnv) to get editable install. Poetry shell creates a virtualenv in ~/.cache/pypoetry/virtualenvs, and the module versions installed there can sometimes differ from those in the devshell.00:43:25
@hinklejd:matrix.orghacobjinklepoetry lock works well of course, but for packaging in nix i'd like to do most testing with the versions specified in flake.lock rather than poetry.lock, if possible. For now i do active development in poetry shell, then run tests there and again in nix00:45:57
@codenode:matrix.orgcode node joined the room.01:55:14
@codenode:matrix.orgcode node set a profile picture.02:40:36
@genomematt:matrix.orgMatthew Wakefield set a profile picture.11:22:50
9 Oct 2022
@bigshaq9999:matrix.orgunbby joined the room.17:52:33
15 Oct 2022
@tinybronca:sibnsk.nettinybronca changed their display name from underpantsgnome to underpantsgnome!.00:33:53
16 Oct 2022
@jake_gillberg:matrix.orgjake_gillberg joined the room.22:30:10
22 Oct 2022
@happyalu:matrix.orghappyalu joined the room.17:10:29
23 Oct 2022
@waa:mozilla.org@waa:mozilla.org joined the room.21:31:34
24 Oct 2022
@waa:mozilla.org@waa:mozilla.org left the room.06:38:32
28 Oct 2022
@carlthome:matrix.orgcarlthome

I'm trying to get TensorFlow to work with a NVIDIA GPU on Ubuntu 22.04 LTS by a shell.nix but get caught up on missing library imports upon import tensorflow as tf.

I have the Ubuntu provided NVIDIA Display Driver installed and libnvidia-container works with GPU but I'm trying to nix:ify my life more and more without plunging into NixOS.

Does anyone have a working shell.nix for GPU-accelerated PyTorch/TensorFlow/JAX on a Debian-based distro?

13:33:57

Show newer messages


Back to Room ListRoom Version: 6