!eWOErHSaiddIbsUNsJ:nixos.org

NixOS CUDA

293 Members
CUDA packages maintenance and support in nixpkgs | https://github.com/orgs/NixOS/projects/27/ | https://nixos.org/manual/nixpkgs/unstable/#cuda57 Servers

Load older messages


SenderMessageTime
14 Oct 2024
@glepage:matrix.orgGaétan Lepage It looks like python312Packages.onnx does not build when cudaSupport = true. 08:11:25
@ss:someonex.netSomeoneSerge (back on matrix) Gaétan Lepage: could you give https://github.com/NixOS/nixpkgs/pull/328247 another look? I just picked up where the author left off, I didn't try questioning whether e.g. adding a separate triton-llvm is the right way or whatever, and my brain is not in the place to think high-level rn 18:43:40
@ss:someonex.netSomeoneSerge (back on matrix)
In reply to @zopieux:matrix.zopi.eu
Pinning nixpkgs to 9357f4f23713673f310988025d9dc261c20e70c6 per this commit, I successfully manage to retrieve cudaPackages.(things) from cuda-maintainers cachix, however onnxruntime doesn't seem to be in there, is it broken?

Seems like dependencies failed to build: https://hercules-ci.com/accounts/github/SomeoneSerge/derivations/%2Fnix%2Fstore%2Fn3lww4jsfan66wyryh3ip3ryarn874q5-onnxruntime-1.18.1.drv?via-job=e51bf1d4-6191-4763-8780-dd317be0b70b

Rather than debugging this, I'd advise you look into https://hydra.nix-community.org/job/nixpkgs/cuda/onnxruntime.x86_64-linux

18:50:31
@ss:someonex.netSomeoneSerge (back on matrix)
In reply to @zopieux:matrix.zopi.eu
Pinning nixpkgs to 9357f4f23713673f310988025d9dc261c20e70c6 per this commit, I successfully manage to retrieve cudaPackages.(things) from cuda-maintainers cachix, however onnxruntime doesn't seem to be in there, is it broken?
*

Seems like dependencies failed to build: https://hercules-ci.com/accounts/github/SomeoneSerge/derivations/%2Fnix%2Fstore%2Fn3lww4jsfan66wyryh3ip3ryarn874q5-onnxruntime-1.18.1.drv?via-job=e51bf1d4-6191-4763-8780-dd317be0b70b

Rather than debugging this, I'd advise you look into https://hydra.nix-community.org/job/nixpkgs/cuda/onnxruntime.x86_64-linux. There hasn't been any official announcements from nix-community's infra team to the best of my knowledge -> no "promises", but the hope is that this will become the supported and long-term maintained solution

18:51:50
@ss:someonex.netSomeoneSerge (back on matrix)https://nix-community.org/cache/18:52:36
@glepage:matrix.orgGaétan Lepage
In reply to @ss:someonex.net

Seems like dependencies failed to build: https://hercules-ci.com/accounts/github/SomeoneSerge/derivations/%2Fnix%2Fstore%2Fn3lww4jsfan66wyryh3ip3ryarn874q5-onnxruntime-1.18.1.drv?via-job=e51bf1d4-6191-4763-8780-dd317be0b70b

Rather than debugging this, I'd advise you look into https://hydra.nix-community.org/job/nixpkgs/cuda/onnxruntime.x86_64-linux. There hasn't been any official announcements from nix-community's infra team to the best of my knowledge -> no "promises", but the hope is that this will become the supported and long-term maintained solution

Indeed, it seems to fail currently
19:02:58
@glepage:matrix.orgGaétan Lepage
In reply to @ss:someonex.net

Seems like dependencies failed to build: https://hercules-ci.com/accounts/github/SomeoneSerge/derivations/%2Fnix%2Fstore%2Fn3lww4jsfan66wyryh3ip3ryarn874q5-onnxruntime-1.18.1.drv?via-job=e51bf1d4-6191-4763-8780-dd317be0b70b

Rather than debugging this, I'd advise you look into https://hydra.nix-community.org/job/nixpkgs/cuda/onnxruntime.x86_64-linux. There hasn't been any official announcements from nix-community's infra team to the best of my knowledge -> no "promises", but the hope is that this will become the supported and long-term maintained solution

This is building the cuda version of onnx ?
19:03:19
@ss:someonex.netSomeoneSerge (back on matrix)Yes but also the hydra history is all green 🤷19:08:54
@glepage:matrix.orgGaétan LepageYes, weird...19:13:19
@ss:someonex.netSomeoneSerge (back on matrix)Noticed https://github.com/SomeoneSerge/nixpkgs-cuda-ci/issues/31#issuecomment-2412043822 only now, published a response19:22:08
@glepage:matrix.orgGaétan Lepage I can't get onnx to build...
Here are the logs in case someone know what is happening: https://paste.glepage.com/upload/eel-falcon-sloth
20:08:13
@ss:someonex.netSomeoneSerge (back on matrix)
      error: downloading 'https://github.com/abseil/abseil-cpp/archive/refs/tags/20230125.3.tar.gz' failed

lol

20:19:08
@ss:someonex.netSomeoneSerge (back on matrix)
In reply to @ss:someonex.net
Yes but also the hydra history is all green 🤷
Maybe that just came in from staging
20:19:30
15 Oct 2024
@connorbaker:matrix.orgconnor (he/him)
In reply to @glepage:matrix.org
I can't get onnx to build...
Here are the logs in case someone know what is happening: https://paste.glepage.com/upload/eel-falcon-sloth
Onnx's CMake isn't detecting at least one dependency, so it tries to download them all in order, starting with abseil. Since there's no networking in the sandbox, it fails.
00:06:48
@connorbaker:matrix.orgconnor (he/him)I'm currently working on Onnx packaging for a thing, and you can see what I've got going on here: https://github.com/ConnorBaker/cuda-packages/blob/main/cudaPackages-common/onnx.nix (It's a combination C++/Python install so it's gnarly. But better than having two separate derivations with libraries built with different flags, I guess.)00:09:04
@glepage:matrix.orgGaétan LepageOk interesting, thanks for sharing05:46:57
@glepage:matrix.orgGaétan LepageIs your plan to upstream this to nixpkgs ?05:47:13
@glepage:matrix.orgGaétan Lepage [triton update]
triton-llvm fails during the test phase.
Logs: https://paste.glepage.com/upload/fish-jaguar-pig
08:48:05
@atagen:imagisphe.reatagen joined the room.11:38:21
@ss:someonex.netSomeoneSerge (back on matrix)
In reply to @glepage:matrix.org
[triton update]
triton-llvm fails during the test phase.
Logs: https://paste.glepage.com/upload/fish-jaguar-pig
Can't reproduce, builds for me
12:35:31
@ss:someonex.netSomeoneSerge (back on matrix)
In reply to @glepage:matrix.org
[triton update]
triton-llvm fails during the test phase.
Logs: https://paste.glepage.com/upload/fish-jaguar-pig
* Can't reproduce, builds for me. Maybe we tried different HEADs?
12:36:26
@atagen:imagisphe.reatagen hi, what am I missing to get a cache hit? going by this hydra output torch should be in the cache (for nixpkgs 5633bcf). I have nix-community cachix set up, allowUnfree, cudaSupport,, and the package in question is providing its overlay properly with final.callPackage so it ought to be using my system packages 12:46:24
@atagen:imagisphe.reatagenhttps://gist.github.com/atagen/615e187e323f3ca3f5f9d40e55ce2b7c12:55:50
@atagen:imagisphe.reatagen oof, could it be because I'm specifying python311Packages instead of python3Packages? 12:57:30
@atagen:imagisphe.reatagen... yup, that was it12:58:23
@ss:someonex.netSomeoneSerge (back on matrix)https://github.com/NixOS/nixpkgs/blob/70f9c111b27db0d459a227e477acce62016cbf10/pkgs/top-level/release-cuda.nix#L11813:04:59
@ss:someonex.netSomeoneSerge (back on matrix)
In reply to @glepage:matrix.org
[triton update]
triton-llvm fails during the test phase.
Logs: https://paste.glepage.com/upload/fish-jaguar-pig
With the current HEAD and ccache off I just reached the pytest branch
14:17:17
@glepage:matrix.orgGaétan Lepage
In reply to @ss:someonex.net
With the current HEAD and ccache off I just reached the pytest branch
You mean that you were able to build it fine ?
14:47:18
@ss:someonex.netSomeoneSerge (back on matrix)Yes14:47:27
@ss:someonex.netSomeoneSerge (back on matrix)Well the pytest bit fails with these 20 tests ofc but that'll come later14:47:41

Show newer messages


Back to Room ListRoom Version: 9