!eWOErHSaiddIbsUNsJ:nixos.org

NixOS CUDA

328 Members
CUDA packages maintenance and support in nixpkgs | https://github.com/orgs/NixOS/projects/27/ | https://nixos.org/manual/nixpkgs/unstable/#cuda64 Servers

Load older messages


SenderMessageTime
2 Mar 2023
@ss:someonex.netSomeoneSerge (matrix works sometimes)Yes23:00:55
@connorbaker:matrix.orgconnor (he/him) What's the package name that provides that utility? I'd like to nix shell into it and not install CUDA system-wide :l 23:01:31
@ss:someonex.netSomeoneSerge (matrix works sometimes) cudaPackages.cuda_cuobjdump 23:01:59
@ss:someonex.netSomeoneSerge (matrix works sometimes)or something like it23:02:03
@connorbaker:matrix.orgconnor (he/him)

Awwww my heart ;(

$ cuobjdump ./result/lib/libmagma.so | rg "arch =" | sort -u
arch = sm_52
23:03:10
@ss:someonex.netSomeoneSerge (matrix works sometimes)Redacted or Malformed Event23:10:05
@ss:someonex.netSomeoneSerge (matrix works sometimes)Redacted or Malformed Event23:10:08
@ss:someonex.netSomeoneSerge (matrix works sometimes)Redacted or Malformed Event23:10:13
@ss:someonex.netSomeoneSerge (matrix works sometimes)Redacted or Malformed Event23:10:27
@ss:someonex.netSomeoneSerge (matrix works sometimes)
In reply to @connorbaker:matrix.org

Awwww my heart ;(

$ cuobjdump ./result/lib/libmagma.so | rg "arch =" | sort -u
arch = sm_52
Strange
23:13:25
@ss:someonex.netSomeoneSerge (matrix works sometimes) I think they end up reseting CUDA_ARCHITECTURES to an empty list 23:14:38
@ss:someonex.netSomeoneSerge (matrix works sometimes)
CMakeCache.txt:CMAKE_CUDA_ARCHITECTURES:STRING=52
CMakeCache.txt:CUDA_ARCHITECTURES:UNINITIALIZED=86
23:19:46
@ss:someonex.netSomeoneSerge (matrix works sometimes)Ok, I've got a good feeling about this one23:20:59
@ss:someonex.netSomeoneSerge (matrix works sometimes)
In reply to @hexa:lossy.network
we probably need https://github.com/numba/numba/pull/8691
https://github.com/numba/numba/pull/8691#issuecomment-1452616968
23:23:24
@hexa:lossy.networkhexawhat's the tl;dr?23:24:27
@hexa:lossy.networkhexaI did apply that series in python-updates23:24:37
@ss:someonex.netSomeoneSerge (matrix works sometimes)I saw that23:24:42
@ss:someonex.netSomeoneSerge (matrix works sometimes)The reason they weren't merging the PR was that they were using Anaconda's channels for their CI, and Anaconda never shipped the new numpy. AFAIU, they switched to conda-forge and are about to merge23:25:30
@ss:someonex.netSomeoneSerge (matrix works sometimes)
In reply to @ss:someonex.net
CMakeCache.txt:CMAKE_CUDA_ARCHITECTURES:STRING=52
CMakeCache.txt:CUDA_ARCHITECTURES:UNINITIALIZED=86
❯ cuobjdump /nix/store/mkrv74b38zx1afkkpj55xmnm68rgmywq-magma-2.7.1/lib/libmagma.so | rg 'arch =' | sort | uniq
arch = sm_86
23:31:22
@ss:someonex.netSomeoneSerge (matrix works sometimes) connor (he/him): how bad would it be if magma accepted both gpuTargets and cudaPackages.cudaFlags, but only used the latter for cuda capabilities? 23:49:13
3 Mar 2023
@connorbaker:matrix.orgconnor (he/him) Hmm...
So from what I could tell when I originally started on the Magma derivation, gpuTargets was used solely for AMD GPUs. In the hip attribute set (their equivalent of cudaPackages?), they have gpuTargets which is the equivalent of our cudaCapabilities (I think). In the original derivation, the gpuTargets attribute Magma takes had precedence over whatever hip.gpuTargets was.
00:56:31
@connorbaker:matrix.orgconnor (he/him) I like the idea of specifying per-package GPU target overrides, so when I refactored the derivation I made gpuTargets also take precedence over cudaPackages's capabilities 00:57:17
@ss:someonex.netSomeoneSerge (matrix works sometimes)I ended up just pushing it into that fat pr... https://github.com/NixOS/nixpkgs/pull/218265/commits/0d6eb2a8e03e7a9d2e625ac6d568c73040429c2701:00:19
@ss:someonex.netSomeoneSerge (matrix works sometimes) nix build nixpkgs#magma fails 01:08:39
@ss:someonex.netSomeoneSerge (matrix works sometimes) It defaults to cudaSupport = true and dies evaluating unfree cuda_nvcc 01:09:28
@connorbaker:matrix.orgconnor (he/him)
In reply to @ss:someonex.net
❯ cuobjdump /nix/store/mkrv74b38zx1afkkpj55xmnm68rgmywq-magma-2.7.1/lib/libmagma.so | rg 'arch =' | sort | uniq
arch = sm_86
oh I had just added the equivalent of "-DCUDA_ARCHITECTURES=89" instead of "-DCMAKE_CUDA_ARCHITECTURES", derp. I'll try rebuilding and see if I also see it complied with the specified arch that way instead of just the default
01:16:03
@connorbaker:matrix.orgconnor (he/him)

Oh hell yeah

$ cuobjdump ./result/lib/libmagma.so | rg "arch =" | sort -u
arch = sm_89
01:17:02
@connorbaker:matrix.orgconnor (he/him)I'm going to see if I can repro your nix build failure01:19:47
@connorbaker:matrix.orgconnor (he/him)

fwiw I'm able to build it, but I used nix build --impure -L .#magma and my ~/.config/nixpkgs/config.nix looks like

{
  allowUnfree = true;
  cudaSupport = true;
  cudaCapabilities = [ "8.6" ];
  cudaForwardCompat = false;
}
01:24:56
@ss:someonex.netSomeoneSerge (matrix works sometimes)That's the difference, yeah01:25:18

Show newer messages


Back to Room ListRoom Version: 9