!eWOErHSaiddIbsUNsJ:nixos.org

NixOS CUDA

326 Members
CUDA packages maintenance and support in nixpkgs | https://github.com/orgs/NixOS/projects/27/ | https://nixos.org/manual/nixpkgs/unstable/#cuda64 Servers

Load older messages


SenderMessageTime
3 Mar 2023
@ss:someonex.netSomeoneSerge (matrix works sometimes)I ended up just pushing it into that fat pr... https://github.com/NixOS/nixpkgs/pull/218265/commits/0d6eb2a8e03e7a9d2e625ac6d568c73040429c2701:00:19
@ss:someonex.netSomeoneSerge (matrix works sometimes) nix build nixpkgs#magma fails 01:08:39
@ss:someonex.netSomeoneSerge (matrix works sometimes) It defaults to cudaSupport = true and dies evaluating unfree cuda_nvcc 01:09:28
@connorbaker:matrix.orgconnor (he/him)
In reply to @ss:someonex.net
❯ cuobjdump /nix/store/mkrv74b38zx1afkkpj55xmnm68rgmywq-magma-2.7.1/lib/libmagma.so | rg 'arch =' | sort | uniq
arch = sm_86
oh I had just added the equivalent of "-DCUDA_ARCHITECTURES=89" instead of "-DCMAKE_CUDA_ARCHITECTURES", derp. I'll try rebuilding and see if I also see it complied with the specified arch that way instead of just the default
01:16:03
@connorbaker:matrix.orgconnor (he/him)

Oh hell yeah

$ cuobjdump ./result/lib/libmagma.so | rg "arch =" | sort -u
arch = sm_89
01:17:02
@connorbaker:matrix.orgconnor (he/him)I'm going to see if I can repro your nix build failure01:19:47
@connorbaker:matrix.orgconnor (he/him)

fwiw I'm able to build it, but I used nix build --impure -L .#magma and my ~/.config/nixpkgs/config.nix looks like

{
  allowUnfree = true;
  cudaSupport = true;
  cudaCapabilities = [ "8.6" ];
  cudaForwardCompat = false;
}
01:24:56
@ss:someonex.netSomeoneSerge (matrix works sometimes)That's the difference, yeah01:25:18
@connorbaker:matrix.orgconnor (he/him)What's it supposed to fail with (if at all)? I think it does that on master as well?01:26:44
@ss:someonex.netSomeoneSerge (matrix works sometimes)Yes, I meant master01:27:42
@ss:someonex.netSomeoneSerge (matrix works sometimes)
❯ nix build github:NixOS/nixpkgs/master#magma
error: Package ‘cuda_nvcc-11.7.64’ in /nix/store/hjlp6rhp33n9npc69g2ikhq138fkrh9w-source/pkgs/development/compilers/cudatoolkit/redist/build-cuda-redist-package.nix:47 has an unfree license (‘unfree’), refusing to evaluate.

       a) To temporarily allow unfree packages, you can use an environment variable

because it takes cudaSupport ? true

01:28:51
@ss:someonex.netSomeoneSerge (matrix works sometimes) And then we just import it in all-packages.nix as is 01:29:04
@ss:someonex.netSomeoneSerge (matrix works sometimes) I'm not sure what we're exposing magma, magma_2_7_1 and magma_2_6_2 for, I think we only use magma-cuda and magma-hip? 01:30:06
@ss:someonex.netSomeoneSerge (matrix works sometimes) Oh, I get it now! I was wondering why doesn't ofborg complain about it, but it defaults tocudaSupport = true, so it sets license = unfree, so ofborg doesn't try to evaluate it 01:31:53
@connorbaker:matrix.orgconnor (he/him) torch takes magma as an argument supplied by callPackage -- torchWithCuda and torchWithRocm specifically pass magma = magma-cuda etc., but the default torch just expects magma 01:33:12
@connorbaker:matrix.orgconnor (he/him) lmao is torch the only package that actually takes magma as an argument 01:34:22
@ss:someonex.netSomeoneSerge (matrix works sometimes)And is it true that magma can't be built cpu-only, and can't mix cuda and hip?01:34:56
@connorbaker:matrix.orgconnor (he/him)Actually not sure about mixing cuda and HIP, but it is a GPU-accelerated library so not sure what the point of building CPU-only (if at all possible) would be01:35:47
@connorbaker:matrix.orgconnor (he/him) Ah from the CMakeLists.txt it does look like it's CUDA XOR HIP: https://bitbucket.org/icl/magma/src/f4ec79e2c13a2347eff8a77a3be6f83bc2daec20/CMakeLists.txt#lines-469 01:37:11
@ss:someonex.netSomeoneSerge (matrix works sometimes)That's convincing01:37:35
@hexa:lossy.networkhexa Samuel Ainsworth: jax tests broke on python-updates due to scipy update 03:18:19
@hexa:lossy.networkhexahttps://hydra.nixos.org/log/rgrylknin2b3yflgiy7jbjrb5r7j18m3-python3.10-jax-0.4.1.drv03:18:22
@hexa:lossy.networkhexa * Samuel Ainsworth: jax tests broke on python-updates due to numpy/scipy update 03:19:16
@ss:someonex.netSomeoneSerge (matrix works sometimes) * Mostly outPaths react to cudaSupport through gst-plugins-bad, which depend on opencv #FalsePositive15:51:59
@ss:someonex.netSomeoneSerge (matrix works sometimes) Another potential #FalsePositive: we rebuild scikitimage because it depends on numba, which changes with cudaSupport 15:54:07
4 Mar 2023
@ss:someonex.netSomeoneSerge (matrix works sometimes) Turned off the hercules builds. I finally skimmed through the part of the manual, where it says it supports onSchedule jobs, I'm hoping I can ditch github actions and bash scripts, and make a smarter schedule where I'd build e.g. 8.6 more frequently than the big default set of capabilities 🤔 00:50:21
5 Mar 2023
@ss:someonex.netSomeoneSerge (matrix works sometimes)Yay, I'm beginning to understand how to use hercules "properly"14:18:12
@ss:someonex.netSomeoneSerge (matrix works sometimes)image.png
Download image.png
14:18:13
@ss:someonex.netSomeoneSerge (matrix works sometimes) Kevin Mittman: can't seem to find nvJPEG2k in the redist packages 22:46:11
@justbrowsing:matrix.orgKevin Mittman (UTC-7) IIRC the payload exists but the directory is not browse-able (yet). I'll check on it tomorrow 22:48:57

Show newer messages


Back to Room ListRoom Version: 9