!eWOErHSaiddIbsUNsJ:nixos.org

NixOS CUDA

288 Members
CUDA packages maintenance and support in nixpkgs | https://github.com/orgs/NixOS/projects/27/ | https://nixos.org/manual/nixpkgs/unstable/#cuda58 Servers

Load older messages


SenderMessageTime
15 Sep 2022
@m_algery:leohoo.xyzm_algery left the room.12:33:43
@hexa:lossy.networkhexahttps://github.com/NixOS/nixpkgs/pull/19133316:22:20
@ss:someonex.netSomeoneSerge (back on matrix)
In reply to @hexa:lossy.network
https://github.com/NixOS/nixpkgs/pull/191333
https://hercules-ci.com/github/SomeoneSerge/nixpkgs-unfree/jobs/1925
16:36:11
@hexa:lossy.networkhexafwiw: possibly a bit too early, given that we have a failing numpy build16:45:30
@hexa:lossy.networkhexanumba pins setuptools<6021:19:53
@hexa:lossy.networkhexai can't even.21:20:00
@hexa:lossy.networkhexawe have been >60 for a while now21:20:08
16 Sep 2022
@sepiabrown:matrix.orgSuwon Park joined the room.17:28:32
@sepiabrown:matrix.orgSuwon Park left the room.17:30:03
@sepiabrown:matrix.orgSuwon Park joined the room.17:30:26
@sepiabrown:matrix.orgSuwon ParkHello everyone!17:33:48
@sepiabrown:matrix.orgSuwon Park Is there anyone who has tried building pytorch with cuda enabled? 17:34:56
@sepiabrown:matrix.orgSuwon Park

When I tried to build pytorch, this error occurs.

17:36:51
@sepiabrown:matrix.orgSuwon ParkRedacted or Malformed Event17:36:59
@sepiabrown:matrix.orgSuwon Park *

When I tried to build pytorch, this error occurs in the cmake phase.

-- Could NOT find CUDA (missing: CUDA_CUDART_LIBRARY) (found version "11.6")
17:37:25
@sepiabrown:matrix.orgSuwon Park So I looked up the source of pytorch in nixpkgs and there was no cudaPackages.cuda_cudart in buildInputs. 17:38:18
@sepiabrown:matrix.orgSuwon Park cudaPackages.cuda_cudart seems to fix the error, but is there any reason why it is not there? 17:39:17
@ss:someonex.netSomeoneSerge (back on matrix) python3Packages.pytorch currently still uses the older cudaPackages.cudatoolkit expression, which ships a lot of stuff, including cuda_cudart 17:39:58
@ss:someonex.netSomeoneSerge (back on matrix) cuda_* expressions are preferred 17:40:20
@ss:someonex.netSomeoneSerge (back on matrix) I didn't catch this though. Are you getting this when manually building pytorch, or when running nix build? 17:41:52
@sepiabrown:matrix.orgSuwon Park I'm running nix develop genericBuild! 17:49:08
@sepiabrown:matrix.orgSuwon Park * I'm running nix develop and genericBuild with poetry inside flake.nix! 17:49:37
@sepiabrown:matrix.orgSuwon Park * I'm running nix develop and genericBuild with flake.nix! 17:49:47
@sepiabrown:matrix.orgSuwon Park
In reply to @ss:someonex.net
python3Packages.pytorch currently still uses the older cudaPackages.cudatoolkit expression, which ships a lot of stuff, including cuda_cudart

But, if you check pytorch in 22.05 version of nixpkgs, the following code already exists

    # Move some libraries to the lib output so that programs that
    # depend on them don't pull in this entire monstrosity.
    mkdir -p $lib/lib
    mv -v $out/lib64/libcudart* $lib/lib/

which means that cudaPackages.cudatoolkit expression does not ship with cudart!

17:55:09
@sepiabrown:matrix.orgSuwon Park
In reply to @ss:someonex.net
python3Packages.pytorch currently still uses the older cudaPackages.cudatoolkit expression, which ships a lot of stuff, including cuda_cudart
*

But, if you check cudaPackages in 22.05 version of nixpkgs, the following code already exists

    # Move some libraries to the lib output so that programs that
    # depend on them don't pull in this entire monstrosity.
    mkdir -p $lib/lib
    mv -v $out/lib64/libcudart* $lib/lib/

which means that cudaPackages.cudatoolkit expression does not ship with cudart!

17:56:11
@sepiabrown:matrix.orgSuwon Park *

But, if you check cudaPackages.cudatoolkit in 22.05 version of nixpkgs, the following code already exists

    # Move some libraries to the lib output so that programs that
    # depend on them don't pull in this entire monstrosity.
    mkdir -p $lib/lib
    mv -v $out/lib64/libcudart* $lib/lib/

which means that cudaPackages.cudatoolkit expression does not ship with cudart!

17:56:20
@sepiabrown:matrix.orgSuwon Park

If you unpack python39Packages.pytorch (current version : 1.11.0), and go to source/cmake/Modules_CUDA_fix/upstream/FindCUDA.cmake line 1128, there is the following code block which creates -- Could NOT find CUDA (missing: CUDA_CUDART_LIBRARY) (found version "11.6") error.

find_package_handle_standard_args(CUDA
  REQUIRED_VARS
    CUDA_TOOLKIT_ROOT_DIR
    CUDA_NVCC_EXECUTABLE
    CUDA_INCLUDE_DIRS
    ${CUDA_CUDART_LIBRARY_VAR}
  VERSION_VAR
    CUDA_VERSION
  )

And in the end if I understood the code correctly, that ${CUDA_CUDART_LIBRARY_VAR} looks for libcudart.so inside cudaPackages.cudatoolkit which now doesnt have libcuda.*` because of the above code I mentioned. Am I right..?🤔

18:07:46
@sepiabrown:matrix.orgSuwon Park *

If you unpack python39Packages.pytorch (current version : 1.11.0), and go to source/cmake/Modules_CUDA_fix/upstream/FindCUDA.cmake line 1128, there is the following code block which creates -- Could NOT find CUDA (missing: CUDA_CUDART_LIBRARY) (found version "11.6") error.

find_package_handle_standard_args(CUDA
  REQUIRED_VARS
    CUDA_TOOLKIT_ROOT_DIR
    CUDA_NVCC_EXECUTABLE
    CUDA_INCLUDE_DIRS
    ${CUDA_CUDART_LIBRARY_VAR}
  VERSION_VAR
    CUDA_VERSION
  )

That's because in the end, if I understood the code correctly, ${CUDA_CUDART_LIBRARY_VAR} looks for libcudart.so inside cudaPackages.cudatoolkit which now doesnt have libcuda.*` because of the above code I mentioned. Am I right..?🤔

18:08:28
@sepiabrown:matrix.orgSuwon Park *

If you unpack python39Packages.pytorch (current version : 1.11.0), and go to source/cmake/Modules_CUDA_fix/upstream/FindCUDA.cmake line 1128, there is the following code block which creates -- Could NOT find CUDA (missing: CUDA_CUDART_LIBRARY) (found version "11.6") error.

find_package_handle_standard_args(CUDA
  REQUIRED_VARS
    CUDA_TOOLKIT_ROOT_DIR
    CUDA_NVCC_EXECUTABLE
    CUDA_INCLUDE_DIRS
    ${CUDA_CUDART_LIBRARY_VAR}
  VERSION_VAR
    CUDA_VERSION
  )

That's because in the end, if I understood the code correctly, ${CUDA_CUDART_LIBRARY_VAR} looks for libcudart.so inside cudaPackages.cudatoolkit which now doesn``t have libcuda.* because of the above code I mentioned. Am I right..?🤔

18:08:53
@sepiabrown:matrix.orgSuwon Park *

If you unpack python39Packages.pytorch (current version : 1.11.0), and go to source/cmake/Modules_CUDA_fix/upstream/FindCUDA.cmake line 1128, there is the following code block which creates -- Could NOT find CUDA (missing: CUDA_CUDART_LIBRARY) (found version "11.6") error.

find_package_handle_standard_args(CUDA
  REQUIRED_VARS
    CUDA_TOOLKIT_ROOT_DIR
    CUDA_NVCC_EXECUTABLE
    CUDA_INCLUDE_DIRS
    ${CUDA_CUDART_LIBRARY_VAR}
  VERSION_VAR
    CUDA_VERSION
  )

That's because in the end, if I understood the code correctly, ${CUDA_CUDART_LIBRARY_VAR} looks for libcudart.so inside cudaPackages.cudatoolkit which now doesn`t have libcuda.* because of the above code I mentioned. Am I right..?🤔

18:09:06

Show newer messages


Back to Room ListRoom Version: 9