| 30 Aug 2022 |
|  aru left the room. | 14:56:16 |
|  hacobjinkle joined the room. | 16:51:54 |
| 5 Sep 2022 |
|  kotatsuyaki joined the room. | 05:39:36 |
|  michelvasconcelos joined the room. | 18:21:51 |
| 6 Sep 2022 |
| hacobjinkle | Nix is attractive for reproducibility and provenance tracking. However, for ML workflows one major limitation is that all data produced as part of a derivation resides in /nix/store. It would be great to be able to define flakes for large datasets and use them as inputs to other programs/flakes. For example define a flake for ImageNet and then get train and test splits as outputs of those downstream flakes. Currently such a train/test split would require duplication of the original dataset twice into /nix/store if I'm not mistaken. | 15:34:39 |
| hacobjinkle | apologies if there is an existing solution to this kind of data handling with nix that I'm unaware of | 15:35:12 |
| hacobjinkle | i guess the splitting could of course be done with symlinks. main question is then is there any hope of handling large datasets at rest on some storage outside /nix | 15:39:06 |
 FRidh | Nix master supports impure derivations. Impure derivations have network access, so you could write your result somewhere else. I have not tried this yet, but I imagine this going to be very useful also in CI/CD. | 17:04:49 |
| FRidh | https://github.com/NixOS/nix/pull/6227 | 17:05:19 |
| hacobjinkle | thanks. I currently use --impure on non-NixOS with nixGL to get cuda working anyway, so that may be the ticket | 17:07:24 |
| FRidh | that's not the same though, that's impure evaluation | 17:08:40 |
| hacobjinkle | i see that now. should've read before replying.. | 17:09:23 |
| 7 Sep 2022 |
 Someone S | Has anyone got a working example of micromamba environment?
I've tried using it in a bulidFHSUserEnv(Bubblewrap) with this in /etc/profile:
eval "$(micromamba shell hook --shell=bash)"
micromamba activate
...but it keeps segfaulting later when I prompt micromamba activate $envName
What helps is running the eval "$(...)" in the shell manually
| 12:43:40 |
| 15 Sep 2022 |
|  m_algery joined the room. | 12:10:46 |
| m_algery left the room. | 12:10:49 |
| 16 Sep 2022 |
|  TyberiusPrime (fiber at home when) changed their display name from TyberiusPrime to TyberiusPrime (fiber at home when). | 07:37:08 |
|  Suwon Park joined the room. | 18:17:04 |
| Suwon Park | In reply to @flxai:matrix.org
I am new to NixOS and wondering what's a good way to set up Jupyter. Are there opinions on JupyterWith or maybe some general recommendations? Try using jupyterWith + poetry2nix with flake.nix! It's hard but fun! | 18:33:55 |
 Felix | sepiabrown: Thanks, this sounds like a good mix. Do you have configs lieing around somewhere? | 18:38:49 |
| Suwon Park | In reply to @flxai:matrix.org
sepiabrown: Thanks, this sounds like a good mix. Do you have configs lieing around somewhere? https://github.com/sepiabrown/jupyterWith_poetry2nix
If you are new to NixOS, the above solution may be hard!
If other advanced user could have a look at my code and have any comment for improvement, it would be appreciated!
| 19:22:32 |
| Felix | Thanks. I'll have a look the following days and try my best. Not that comfortable with Nix and its components yet | 19:28:06 |
| 18 Sep 2022 |
| FRidh set a profile picture. | 17:20:55 |
| 24 Sep 2022 |
|  peddie joined the room. | 10:45:47 |
| 30 Sep 2022 |
| hacobjinkle | On the topic of poetry, do you guys have any nice methods for getting an editable install using pure nix? I use a flake similar to above with poetry2nix, which works great for creating a derivation for a python package, but I then need to run poetry shell from inside a devshell (through direnv) to get editable install. Poetry shell creates a virtualenv in ~/.cache/pypoetry/virtualenvs, and the module versions installed there can sometimes differ from those in the devshell. | 00:43:25 |
| hacobjinkle | poetry lock works well of course, but for packaging in nix i'd like to do most testing with the versions specified in flake.lock rather than poetry.lock, if possible. For now i do active development in poetry shell, then run tests there and again in nix | 00:45:57 |
|  code node joined the room. | 01:55:14 |
| code node set a profile picture. | 02:40:36 |
|  Matthew Wakefield set a profile picture. | 11:22:50 |
| 9 Oct 2022 |
|  kunny joined the room. | 17:52:33 |
| 15 Oct 2022 |
|  underpantsgnome changed their display name from underpantsgnome to underpantsgnome!. | 00:33:53 |
