!eWOErHSaiddIbsUNsJ:nixos.org

NixOS CUDA

324 Members
CUDA packages maintenance and support in nixpkgs | https://github.com/orgs/NixOS/projects/27/ | https://nixos.org/manual/nixpkgs/unstable/#cuda64 Servers

Load older messages


SenderMessageTime
22 Dec 2022
@shiroki:matrix.orgShiroki Satsuki joined the room.17:59:25
@shiroki:matrix.orgShiroki Satsuki Hello, I'm using shell.nix with Arch Linux, and I'm trying to use python310Packages.pycuda in my Python project, but when I import pycuda.driver, Python complained about missing of libcuda.so.1 18:04:05
@shiroki:matrix.orgShiroki Satsuki Is this package only available in NixOS? Or do I need some setup to link my host libcuda.so.1 into shell.nix? 18:05:57
@shiroki:matrix.orgShiroki Satsuki
18:06:21
@shiroki:matrix.orgShiroki Satsuki *
> ldd /nix/store/x8gqndanr39r0zf2465xad9z0pkg0y39-python3-3.10.9-env/lib/python3.10/site-packages/pycuda/_driver.cpython-310-x86_64-linux-gnu.so
        linux-vdso.so.1 (0x00007ffff3797000)
        libboost_python310.so.1.79.0 => /nix/store/r7gb9lm3bisvj7njwb73acawvmkqr3sw-boost-1.79.0/lib/libboost_python310.so.1.79.0 (0x00007fe813a75000)
        libboost_thread.so.1.79.0 => /nix/store/r7gb9lm3bisvj7njwb73acawvmkqr3sw-boost-1.79.0/lib/libboost_thread.so.1.79.0 (0x00007fe813a58000)
        libcuda.so.1 => not found
        libcurand.so.10 => /nix/store/rp33ncna7sm3inj3fjlrracg27sl78x3-cudatoolkit-11.7.0/lib/libcurand.so.10 (0x00007fe80de00000)
        libstdc++.so.6 => /nix/store/wprxx5zkkk13hpj6k1v6qadjylh3vq9m-gcc-11.3.0-lib/lib/libstdc++.so.6 (0x00007fe80da00000)
        libm.so.6 => /nix/store/ayfr5l52xkqqjn3n4h9jfacgnchz1z7s-glibc-2.35-224/lib/libm.so.6 (0x00007fe80dd20000)
        libgcc_s.so.1 => /nix/store/ayfr5l52xkqqjn3n4h9jfacgnchz1z7s-glibc-2.35-224/lib/libgcc_s.so.1 (0x00007fe813a3c000)
        libc.so.6 => /nix/store/ayfr5l52xkqqjn3n4h9jfacgnchz1z7s-glibc-2.35-224/lib/libc.so.6 (0x00007fe80d600000)
        librt.so.1 => /nix/store/ayfr5l52xkqqjn3n4h9jfacgnchz1z7s-glibc-2.35-224/lib/librt.so.1 (0x00007fe813a37000)
        libdl.so.2 => /nix/store/ayfr5l52xkqqjn3n4h9jfacgnchz1z7s-glibc-2.35-224/lib/libdl.so.2 (0x00007fe813a30000)
        libpthread.so.0 => /nix/store/ayfr5l52xkqqjn3n4h9jfacgnchz1z7s-glibc-2.35-224/lib/libpthread.so.0 (0x00007fe813a2b000)
        libutil.so.1 => /nix/store/ayfr5l52xkqqjn3n4h9jfacgnchz1z7s-glibc-2.35-224/lib/libutil.so.1 (0x00007fe813a26000)
        /nix/store/ayfr5l52xkqqjn3n4h9jfacgnchz1z7s-glibc-2.35-224/lib64/ld-linux-x86-64.so.2 (0x00007fe813cad000)
18:06:29
@tpw_rules:matrix.orgtpw_rulesif you are not using nixos you need nixGL: https://github.com/guibou/nixGL for cuda to work18:11:11
@tpw_rules:matrix.orgtpw_rules(and other graphics stuff)18:11:24
@shiroki:matrix.orgShiroki Satsuki Thanks, I only know that nixGL is needed for OpenGL and Vulkan 18:13:42
@ss:someonex.netSomeoneSerge (matrix works sometimes) libcuda.so.1 comes with your nvidia driver, and applications built with nix expect driver-related libraries to be available in /run/opengl-driver/lib; you could use nixGL as suggested, or you could try symlinking your system's nvidia libraries into that directory (although it's not always guaranteed to work) 18:16:10
@ss:someonex.netSomeoneSerge (matrix works sometimes)

As mentioned in the thread, you'd need to add a "8.2.4" attribute in cudnn/extension.nix like in this diff and ensure that "11.6" is listed among supportedCudaVersions

This should introduce in nixpkgs an attribute cudaPackages_11_6.cudnn_8_2_4

18:22:27
@ss:someonex.netSomeoneSerge (matrix works sometimes)And onnxruntime-gpu support in nixpkgs sounds exciting, I really hope you make something out of it18:24:40
25 Dec 2022
@ahsmha:matrix.orgahmed left the room.10:36:33
28 Dec 2022
@phaer:matrix.orgphaer joined the room.21:09:19
@phaer:matrix.orgphaer left the room.21:09:30
30 Dec 2022
@iopq:matrix.orgiopq joined the room.09:38:53
@iopq:matrix.orgiopqi get a warning from cachix09:39:27
@iopq:matrix.orgiopq trace: warning: The option nix.binaryCaches' defined in /etc/nixos/cachix/cuda-maintainers.nix' and /etc/nixos/cachix.nix' has been renamed to nix.settings.substituters'.
trace: warning: The option nix.binaryCachePublicKeys' defined in /etc/nixos/cachix/cuda-maintainers.nix' has been renamed to `nix.settings.trusted-public-keys'.
09:39:28
@iopq:matrix.orgiopqI just found it from this page09:40:09
@iopq:matrix.orgiopqhttps://nixos.wiki/wiki/CUDA09:40:10
@schnecfk:ruhr-uni-bochum.deCRTified (old handle) left the room.10:43:28
@iopq:matrix.orgiopqhow do I install a different cuda toolkit version12:55:26
@tpw_rules:matrix.orgtpw_rulesfor what?22:47:45
@tpw_rules:matrix.orgtpw_rulesyou can use like cudatoolkit_11_5 instead of just cudatoolkit22:48:00
31 Dec 2022
@iopq:matrix.orgiopqah, I see, because different programs have different version requirements, CUDA is often like that04:19:53
@iopq:matrix.orgiopqBut maybe I should approach the problem from another end, what's the recommended way to run stable diffusion on NixOS?04:24:16
@hexa:lossy.networkhexafyi https://github.com/NixOS/nixpkgs/pull/20823212:45:51
1 Jan 2023
@tpw_rules:matrix.orgtpw_ruleshttps://fxtwitter.com/pytorch/status/1609334425384517633 oops. we are not affected04:59:29
@ss:someonex.netSomeoneSerge (matrix works sometimes)Hey folks, Feliz Navidad and happy ending of that ridiculous year. You're all awesome15:22:01
@ss:someonex.netSomeoneSerge (matrix works sometimes) * Hey folks, (late) Feliz Navidad and happy ending of that ridiculous year. You're all awesome15:37:34
@hexa:lossy.networkhexapython-updates updates numpy past 1.24.0 and numba is lagging behind as usual17:06:58

Show newer messages


Back to Room ListRoom Version: 9