| 23 Dec 2024 |
 hexa | is anyone looking into the triton-llvm test issues on stagin-next? | 13:40:22 |
| hexa | * is anyone looking into the triton-llvm test issues on staging-next? | 13:40:25 |
| hexa | https://hydra.nixos.org/build/281892957 | 13:40:30 |
| 24 Dec 2024 |
 matthewcroughan | Hah, this old good one | 11:39:47 |
| matthewcroughan | SomeoneSerge (utc+3): you might be interested in https://github.com/huggingface/optimum-quanto/issues/361 | 11:40:09 |
| matthewcroughan | Because optimum-quanto depends on a string that only exists in torch-bin
And when using torch-bin in an overlay, this happens
error: attribute 'cudaPackages' missing
at /nix/store/6zgbbqlr7nnfxpzkyj7fsl4fpg89jbw0-source/pkgs/development/python-modules/bitsandbytes/default.nix:16:19:
15|
16| inherit (torch) cudaPackages cudaSupport;
| ^
17| inherit (cudaPackages) cudaVersion;
| 11:40:27 |
| matthewcroughan | And when I tell this specific package to use torch-bin, it turns out torch-bin doesn't seem to compile because of python3.12-triton> chmod: cannot access '/nix/store/kwahd53lf8hqylcpiyv15l157iayn1gc-python3.12-triton-3.1.0/lib/python3.12/site-packages/triton/third_party/cuda/bin/ptxas': No such file or directory | 11:41:32 |
 SomeoneSerge (back on matrix) | Hmmm there used to be a postPatch in triton-bin symlinking our ptxas | 13:54:40 |
| SomeoneSerge (back on matrix) | * Hmmm there used to be a postPatch in triton-bin (and in triton) symlinking our ptxas | 13:54:52 |
| SomeoneSerge (back on matrix) | I just keep subscribing to issues but idk when I'll have the energy to reply like... to any of the github pings | 13:56:05 |
 Gaétan Lepage | In reply to @hexa:lossy.network
is anyone looking into the triton-llvm test issues on staging-next? Can we at least mark it as broken, because every attempt at building it is currently useless and wasting CPU time ? | 14:01:16 |
| Gaétan Lepage | * Can we at least mark it as broken ? Because every attempt at building it is currently useless and wasting CPU time | 14:01:24 |
| hexa | is this the royal we? | 14:02:08 |
| Gaétan Lepage | I meant, would you be OK with that ? | 14:02:33 |
| Gaétan Lepage | I can make the PR, but I prefer to ask before | 14:02:45 |
| hexa | I don't maintain that package 😄 | 14:04:34 |
| hexa | ideally someone can disable that test instead? | 14:04:50 |
| hexa | * and ideally someone can disable that test instead? | 14:04:52 |
| matthewcroughan | Amen, you are not being well enough supported financially to solve tough issues, most people in this community are not. | 14:38:25 |
| matthewcroughan | The polish is a matter of resources | 14:38:58 |
| matthewcroughan | I did some postfixups, etc and worked around it | 14:39:15 |
| matthewcroughan | But yes I also landed on the same PRs as you, and I'm not sure why it is still an issue despite those PR's having been merged | 14:39:32 |
|  Collin Arnett joined the room. | 21:10:15 |
| Collin Arnett | Hello, are there any packages in the hackellPackage set that setup cudaSupport that I can use as an example to add cuda support for hasktorch? The author submitted a PR to bump the version here and has marked it as broken so I figured it would be good to get first class cuda support implemented here as well.
https://github.com/NixOS/nixpkgs/pull/367998/ | 21:16:42 |
| 25 Dec 2024 |
| SomeoneSerge (back on matrix) | Oooooh that's a really great question, not least because, afaik, the haskell package set is its own thing with slightly different override patterns than elsewhere? | 00:04:12 |
| SomeoneSerge (back on matrix) | I imagine haskell packages are auto-generated? If so, there must be some customization examples for other native/ffi libraries that might use dlopen at runtime or pkg-config at build time, e.g. wrappers for opengl or vulkan | 00:07:08 |
 connor (he/him) | If accelerate is working or supported, check that out. Not sure it’s still supported given it relies on LLVM 12 (or earlier) for LLVM-HS.
Outside of that, not sure what people use for GPU stuff with Haskell | 00:14:03 |
| Collin Arnett | * Hello, are there any packages in the hackellPackage set that setup cudaSupport that I can use as an example to add cuda support for hasktorch? The author submitted a PR to bump the version here and has marked it as unbroken so I figured it would be good to get first class cuda support implemented here as well.
https://github.com/NixOS/nixpkgs/pull/367998/ | 03:28:32 |
| Collin Arnett | He ended up doing this in the hackage-packages.nix file:
"libtorch-ffi" = callPackage
({ mkDerivation, async, base, bytestring, c10, containers, hspec
, inline-c, inline-c-cpp, lib, libtorch-ffi-helper
, optparse-applicative, safe-exceptions, sysinfo, template-haskell
, text, torch, torch_cpu, torch_cuda ? null } :
mkDerivation {
pname = "libtorch-ffi";
version = "2.0.1.1";
sha256 = "0m6gg0z6dc67rxijqycyza197365xf1p71s74a8p4pkc2m2yl6p3";
libraryHaskellDepends = [
async base bytestring containers inline-c inline-c-cpp
libtorch-ffi-helper optparse-applicative safe-exceptions sysinfo
template-haskell text
];
librarySystemDepends = [ c10 torch torch_cpu ];
testHaskellDepends = [ base hspec safe-exceptions ];
homepage = "https://github.com/hasktorch/hasktorch#readme";
description = "Haskell bindings for PyTorch";
license = lib.licenses.bsd3;
configureFlags = [
"--extra-include-dirs=${lib.getDev pkgs.libtorch-bin}/include/torch/csrc/api/include"
] ++ lib.optionals pkgs.config.cudaSupport [ "-f cuda" ];
}) ({
c10 = pkgs.libtorch-bin;
torch_cpu = pkgs.libtorch-bin;
torch = pkgs.libtorch-bin;
} // lib.optionalAttrs (pkgs.config.cudaSupport) {
torch_cuda = pkgs.libtorch-bin;
});
| 11:39:48 |
| SomeoneSerge (back on matrix) | I'll follow up on github | 17:19:13 |
