!fXpAvneDgyJuYMZSwO:nixos.org

Nix Data Science

303 Members
62 Servers

You have reached the beginning of time (for this room).


SenderMessageTime
30 Jun 2022
@schnecfk:ruhr-uni-bochum.deCRTified (old handle)There is a nix kernel in https://github.com/tweag/jupyterWith07:41:57
@jb:vk3.wtfjbedohttps://github.com/tweag/jupyterWith is similar07:41:58
@jb:vk3.wtfjbedoxd07:42:18
@necrophcodr:matrix.orgnecrophcodrWell, it spins up an instance with those kernels available, but what the guix-kernel does is allow you to use Guix directly in a notebook, allowing you not only a kernel per cell, but a kernel environment per cell.08:14:43
@necrophcodr:matrix.orgnecrophcodrI'd prefer to use Nix for that though, if something like it exists. jupyterWith is not close to that behaviour, and wouldn't work on a self-hosted jupyter platform as far as I can tell, especially for the users of the platform (which is my core focus as a data scientist)08:15:59
@necrophcodr:matrix.orgnecrophcodrjupyterWith is great if what you want to do is setup a reproducible simple environment on your own system or for yourself, or for a general reproducible platform, but not for individually reproduced (even foreign) notebooks on a hosted platform.08:17:22
@necrophcodr:matrix.orgnecrophcodr
In reply to @schnecfk:ruhr-uni-bochum.de
There is a nix kernel in https://github.com/tweag/jupyterWith
The nix kernel might be very useful though, if it's possible to spin up other per-cell kernels in that
08:19:04
5 Jul 2022
@rgrunbla:matrix.orgRémy Grünblatt changed their display name from Reventlov to Rémy Grünblatt.12:36:43
@carlthome:matrix.orgCarl ThoméWonder if anyone is thinking about seeing ML model training as a nix-build and adding the resulting model binaries to the nix store, similarly to how DVC does it: https://dvc.org/doc/user-guide/project-structure/internal-files#structure-of-the-cache-directory Crazy? Reproducible experiment tracking as a build process rather than application state?21:35:28
@jb:vk3.wtfjbedoYeah I do that a lot21:38:54
@jb:vk3.wtfjbedoAlso run bioinformatics pipelines similarly: https://github.com/papenfusslab/bionix21:40:03
6 Jul 2022
@jez:petrichor.meJez (he/him) 🌦️Makes sense that the outputs (including intermediate ones) should go in the nix store and be immutable06:39:46
@jez:petrichor.meJez (he/him) 🌦️Although how do you deal with nondeterminism? Would it work to consider the RNG seed to be as part of the build input to recovery reproducibility? 06:41:46
@jez:petrichor.meJez (he/him) 🌦️* Although how do you deal with nondeterminism? Would it work to consider the RNG seed to be as part of the build input to recover reproducibility? 06:48:39
@jb:vk3.wtfjbedoi set my seeds so it's deterministic 06:48:58
@jb:vk3.wtfjbedothere's that new non-determinism feature of nix that might be useful if you can't do that06:50:38

Show newer messages


Back to Room ListRoom Version: 6