!fXpAvneDgyJuYMZSwO:nixos.org

Nix Data Science

293 Members
63 Servers

Load older messages


SenderMessageTime
15 Jan 2023
@discoshrimp:matrix.orgdiscoshrimp joined the room.15:25:25
18 Jan 2023
@yuu:matrix.orgYuu Yin changed their display name from yuu to Yuu Yin.13:41:16
28 Jan 2023
@mcwitt:matrix.orgmcwitt

I recently opened PRs to add awswrangler (AWS SDK for pandas) and 2 dependencies to nixpkgs. Would appreciate reviews from anyone interested in these!

  • https://github.com/NixOS/nixpkgs/pull/213055
  • https://github.com/NixOS/nixpkgs/pull/213053
  • https://github.com/NixOS/nixpkgs/pull/213054
16:49:32
6 Feb 2023
@kadenwolff:matrix.orgkadenwolff joined the room.21:08:32
9 Feb 2023
@ri-char:hashi.sbsri-char joined the room.08:17:00
16 Feb 2023
@jboy:utwente.ioJohn ✒️ removed their profile picture.15:12:58
@jboy:utwente.ioJohn ✒️ set a profile picture.15:13:24
18 Feb 2023
@kadenwolff:matrix.orgkadenwolff set a profile picture.07:58:30
21 Feb 2023
@jboy:utwente.ioJohn ✒️I wrote up a little blog post on how I finally managed to get Nix working on my university's HPC facility: https://www.jboy.space/blog/nix-on-hpc.html10:43:21
@carlthome:matrix.orgCarl ThoméNice! I particularly enjoyed the framing of reproducible builds vs reproducible environments as: "However, containers only “ensure reproducibility for computers … not for humans.” Code isn’t only or even primarily meant to communicate with computers, but with humans as well."21:26:29
22 Feb 2023
@jboy:utwente.ioJohn ✒️ If you don't know it already, I highly recommend everything Konrad Hinsen writes about this kind of stuff. 08:04:36
@josw:matrix.orgjosw John ✒️: Great! Would you be willing to post this also on Discourse.nixos.org? 08:21:54
@jboy:utwente.ioJohn ✒️good idea, I just (finally) signed up. I don't think I'm allowed to post links yet, but hopefully soon.15:45:27
@jboy:utwente.ioJohn ✒️https://discourse.nixos.org/t/using-the-nix-package-manager-on-an-hpc-cluster/25699?u=jboy20:13:13
23 Feb 2023
@a-kenji:matrix.orga-kenji joined the room.16:36:06
25 Feb 2023
@amardeeps:matrix.orgamardeeps joined the room.05:48:56
28 Feb 2023
@apache8080:matrix.orgapache8080 joined the room.22:21:13
@apache8080:matrix.orgapache8080 is there a good nix shell example to get libtorch with cuda working? I have config.cudaSupport = true set in my nixpkgs and it seems like the libtorch being pulled in is the one with cuda support but when I run an example .cpp file it doesn't seem to find GPU support 23:09:26
@apache8080:matrix.orgapache8080Not sure if I'm missing some LD_LIBRARY_PATH stuff23:09:40
@apache8080:matrix.orgapache8080https://pastebin.com/iBiJZBQR23:10:54
@apache8080:matrix.orgapache8080here is the flake.nix I am using 23:11:01
@apache8080:matrix.orgapache8080https://github.com/metobom/tchrs-opencv-webcam-inference this is really the thing I'm trying to get running, was using a simple cpp example as a sanity check for now23:14:03
@ss:someonex.netSomeoneSerge (hash-versioned python modules when)

Note: libtorch-bin just wraps a prebuilt libtorch, and patches it to fix dynamic linkage errors. Personally, I just use python3Packages.torch.dev (together with cuda-maintainers.cachix.org), but maybe libtorch-bin will work for you

That aside, the issue is likely in locating libcuda.so. Are you running NixOS?

23:17:52
@apache8080:matrix.orgapache8080 yeah I am running NixOS so libcuda.so should be in /run/opengl-drivers/lib 23:18:56
@apache8080:matrix.orgapache8080let me try using the python package23:19:03
@ss:someonex.netSomeoneSerge (hash-versioned python modules when)
In reply to @apache8080:matrix.org
yeah I am running NixOS so libcuda.so should be in /run/opengl-drivers/lib
Does adding that to LD_LIBRARY_PATH help?
23:20:04
@apache8080:matrix.orgapache8080no difference23:21:46
@apache8080:matrix.orgapache8080
Could not run 'aten::empty_strided' with arguments from the 'CUDA' backend.

the rust program keeps failing with this which seems to indicate that it is not using the cuda version of libtorch

23:22:20
@apache8080:matrix.orgapache8080going to use the python package next23:22:32
@apache8080:matrix.orgapache8080hmm no luck with using the python package23:28:08

Show newer messages


Back to Room ListRoom Version: 6