!fXpAvneDgyJuYMZSwO:nixos.org

Nix Data Science

273 Members
57 Servers

Load older messages


SenderMessageTime
26 Jan 2024
@raitobezarius:matrix.orgraitobezariusIt needs to be stored somewhere?15:34:16
@benoitdr:matrix.orgbenoitdr
In reply to @raitobezarius:matrix.org
Well whether you upload it to the Nix store or to some random platform, what does that change?
the one who is paying for the storage ;-) There is no free lunch ...
15:34:54
@raitobezarius:matrix.orgraitobezariusAgain, we are not talking about cache.nixos.org, are we?15:35:28
@raitobezarius:matrix.orgraitobezariusLike even if you have pointers inside your remote storage, that does not change a lot that you are going to store a large buffer at some point somewhere, either in memory or on disk15:35:53
@benoitdr:matrix.orgbenoitdr
In reply to @raitobezarius:matrix.org
Again, we are not talking about cache.nixos.org, are we?
that's what I understood what maybe I got it wrong
15:36:08
@raitobezarius:matrix.orgraitobezarius"The Nix store" is not cache.nixos.org, right?15:36:32
@benoitdr:matrix.orgbenoitdr
In reply to @raitobezarius:matrix.org
Again, we are not talking about cache.nixos.org, are we?
* that's what I understood but maybe I got it wrong
15:36:44
@raitobezarius:matrix.orgraitobezariusEveryone who is using Nix has "the Nix store", in their local filesystem, it is in /nix/store15:36:46
@raitobezarius:matrix.orgraitobezariusBut yes, storing datasets in cache.nixos.org is mostly out of the question, at the moment, for the cost reasons you mentioned15:37:12
@raitobezarius:matrix.orgraitobezariusStoring datasets in your own Nix store seems an interesting question to me though15:37:20
@raitobezarius:matrix.orgraitobezariusCompared to… store it locally on-disk, mount it from a remote location and buffer it, etc.15:37:44
@benoitdr:matrix.orgbenoitdr fully agree on that ... trexd , Can you clarify your request ? 15:38:27
@trexd:matrix.orgtrexd
In reply to @benoitdr:matrix.org
fully agree on that ... trexd , Can you clarify your request ?
I just meant /nix/store locally.
15:48:04
@benoitdr:matrix.orgbenoitdrOK sorry for confusion, personally I'll stick to a local minio server to store and share datasets locally. I tend to prefer a clear separation between code and data ;-)15:51:11
@benoitdr:matrix.orgbenoitdr

I have built a docker image of an application that requires nvidia/cuda using dockerTools.buildImage. The image runs fine with nvidia-docker -run .... however, when I start a container from the same image via docker-compose, I have the following error :

Error response from daemon: failed to create task for container: failed to create shim task: OCI runtime create failed: runc create failed: unable to start container process: error during container init: error running hook #0: error running hook: exit status 1, stdout: , stderr: nvidia-container-cli: ldcache error: process /nix/store/cx01qk0qyylvkgisbwc7d3pk8sliccgh-glibc-2.38-27-bin/bin/ldconfig failed with error code: 1: unknown

I have added the few lines that are usually required to run nvidia/cuda images with docker-compose :

    deploy:
        resources:
          reservations:
            devices:
              - driver: nvidia
                device_ids: ['0']
                capabilities: [gpu]

Note that other images (from docker hub) that require nvidia/cuda are working fine with these few lines.
Any idea what could go wrong ?

20:49:40
@ss:someonex.netSomeoneSerge (UTC+U[-12,12])didn't read but do check out the nvidia-container-toolkit cdi PR maybe21:50:43
29 Jan 2024
@bgrayburn:matrix.orgbgrayburn joined the room.16:36:08
31 Jan 2024
@federicodschonborn:matrix.orgFederico Damián Schonborn changed their profile picture.03:36:07
@alexou:femtodata.comAlex Ou joined the room.04:57:44
@federicodschonborn:matrix.orgFederico Damián Schonborn changed their profile picture.06:21:45
3 Feb 2024
@tanja-6584:matrix.orgTanja (Old; I'm now @tanja:catgirl.cloud) joined the room.02:50:47
5 Feb 2024
@bbenno:matrix.orgbbenno joined the room.13:07:46
9 Feb 2024
@daniel-fahey:matrix.orgDaniel Fahey joined the room.10:32:08
12 Feb 2024
@luncht1me:matrix.orglunchtime joined the room.02:13:16
@lunchtime:envs.netlunchtime joined the room.10:45:57
14 Feb 2024
@user_5739:matrix.orguser_5739 joined the room.12:51:42
@user_5739:matrix.orguser_5739Hello All 👋 New to NixOS here but I need to be able to run a virtual env manager like miniconda. Anybody has any successes in this regard?12:56:13
@benoitdr:matrix.orgbenoitdrI think nix-shell is what you are looking for. Personally I completely gave up conda, venv and pip since I discovered nix ;-)13:26:59
17 Feb 2024
@user_5739:matrix.orguser_5739
In reply to@benoitdr:matrix.org
I think nix-shell is what you are looking for. Personally I completely gave up conda, venv and pip since I discovered nix ;-)
Interesting... I've been avoiding going out of the config file in terms of configuration. I'll try to use the nix-shell. Any guides you can recommend?
07:40:16
@ss:someonex.netSomeoneSerge (UTC+U[-12,12])
In reply to @user_5739:matrix.org
Hello All 👋
New to NixOS here but I need to be able to run a virtual env manager like miniconda. Anybody has any successes in this regard?
I also use nixpkgs python3Packages as my main python distribution, but if you need conda then nix-ld + micromamba work fine
11:42:01

Show newer messages


Back to Room ListRoom Version: 6