!eWOErHSaiddIbsUNsJ:nixos.org

NixOS CUDA

324 Members
CUDA packages maintenance and support in nixpkgs | https://github.com/orgs/NixOS/projects/27/ | https://nixos.org/manual/nixpkgs/unstable/#cuda64 Servers

Load older messages


SenderMessageTime
6 Mar 2023
@ss:someonex.netSomeoneSerge (matrix works sometimes)Oh! I like the name! Wait, last run was two years ago https://github.com/pytorch/builder/actions/workflows/build-pytorch-wheels.yml22:33:36
@hexa:lossy.networkhexayep, they prepare the build env through that22:33:58
@hexa:lossy.networkhexaget centos, llvm 9.0.1, enable some centos repo, yum update, 22:35:12
@hexa:lossy.networkhexa

yum install -y wget curl perl util-linux xz bzip2 git patch which zlib-devel

22:35:13
@hexa:lossy.networkhexathen22:35:25
@hexa:lossy.networkhexa

yum install -y autoconf automake make cmake gdb gcc gcc-c++

22:35:26
@hexa:lossy.networkhexa

yum install -y openssl-devel zlib-devel bzip2-devel ncurses-devel sqlite-devel readline-devel tk-devel gdbm-devel libpcap-devel xz-devel libffi-devel

22:35:34
@ss:someonex.netSomeoneSerge (matrix works sometimes)And that is how we get AI22:35:48
@hexa:lossy.networkhexa

then they use scripts to install

  • openssl
  • libpng
  • jni
  • patchelf (yay)
  • mkl
  • conda (nay)
22:36:17
@hexa:lossy.networkhexanice22:36:50
@hexa:lossy.networkhexayeah, I'm tired.22:37:23
@hexa:lossy.networkhexahttps://github.com/pytorch/builder/blob/3eb479e831d3d8bd80d6c71203a51a4d22f93c7f/libtorch/Dockerfile#L3422:39:22
@hexa:lossy.networkhexathat is that docker file22:39:26
@ss:someonex.netSomeoneSerge (matrix works sometimes)Half way there, we just need to know what to run inside the container22:40:01
@hexa:lossy.networkhexamaybe https://github.com/pytorch/builder/blob/3eb479e831d3d8bd80d6c71203a51a4d22f93c7f/wheel/build_wheel.sh22:40:21
@ss:someonex.netSomeoneSerge (matrix works sometimes)I'm beginning to wonder if we should go back to the pytorch repo22:40:30
@ss:someonex.netSomeoneSerge (matrix works sometimes)
In reply to @hexa:lossy.network
maybe https://github.com/pytorch/builder/blob/3eb479e831d3d8bd80d6c71203a51a4d22f93c7f/wheel/build_wheel.sh
This one is, if we trust pytorch discourse, for Darwin
22:40:54
@ss:someonex.netSomeoneSerge (matrix works sometimes)And there's manywheel for Linux22:41:02
@ss:someonex.netSomeoneSerge (matrix works sometimes)But all of these scripts are full of conditional flags22:41:10
@ss:someonex.netSomeoneSerge (matrix works sometimes)So, somewhere out there something must call them with certain flags set on 🤔22:41:31
@hexa:lossy.networkhexahttps://github.com/pytorch/builder/blob/3eb479e831d3d8bd80d6c71203a51a4d22f93c7f/wheel/build_all.sh#L1222:42:10
@hexa:lossy.networkhexayep, darwin22:42:13
@ss:someonex.netSomeoneSerge (matrix works sometimes)
.github/workflows/_binary-build-linux.yml
203:          docker exec -t "${container_name}" bash -c "source ${BINARY_ENV_FILE} && bash /builder/${{ inputs.PACKAGE_TYPE }}/build.sh"
22:44:35
@ss:someonex.netSomeoneSerge (matrix works sometimes)
.github/workflows/_linux-build.yml
161:          docker exec -t "${container_name}" sh -c '.jenkins/pytorch/build.sh'
22:45:01
@ss:someonex.netSomeoneSerge (matrix works sometimes)Yes, I think this is the right one: https://github.com/pytorch/pytorch/blob/39e8311a29b5713c8858cab73a8f713a7f3d531c/.github/workflows/_binary-build-linux.yml#L205 ...but they still take the flags from elsewhere and just propagate them22:51:02
@ss:someonex.netSomeoneSerge (matrix works sometimes)aaaaaand 0 workflows run https://github.com/pytorch/pytorch/actions/workflows/_binary-build-linux.yml22:51:55
@hexa:lossy.networkhexayeah, why would they run that 😄22:52:07
@ss:someonex.netSomeoneSerge (matrix works sometimes)https://github.com/pytorch/pytorch/actions/runs/433782356222:54:01
@ss:someonex.netSomeoneSerge (matrix works sometimes)Here https://github.com/pytorch/pytorch/actions/runs/4337823562/jobs/7574087583#step:14:30522:55:00
@ss:someonex.netSomeoneSerge (matrix works sometimes)

-DBUILD_LIBTORCH_CPU_WITH_DEBUG=0

Ok, how do we check we don't have any debug symbols in our libs?

22:55:59

Show newer messages


Back to Room ListRoom Version: 9