| 24 Dec 2024 |
matthewcroughan @fosdem | SomeoneSerge (utc+3): you might be interested in https://github.com/huggingface/optimum-quanto/issues/361 | 11:40:09 |
matthewcroughan @fosdem | Because optimum-quanto depends on a string that only exists in torch-bin
And when using torch-bin in an overlay, this happens
error: attribute 'cudaPackages' missing
at /nix/store/6zgbbqlr7nnfxpzkyj7fsl4fpg89jbw0-source/pkgs/development/python-modules/bitsandbytes/default.nix:16:19:
15|
16| inherit (torch) cudaPackages cudaSupport;
| ^
17| inherit (cudaPackages) cudaVersion;
| 11:40:27 |
matthewcroughan @fosdem | And when I tell this specific package to use torch-bin, it turns out torch-bin doesn't seem to compile because of python3.12-triton> chmod: cannot access '/nix/store/kwahd53lf8hqylcpiyv15l157iayn1gc-python3.12-triton-3.1.0/lib/python3.12/site-packages/triton/third_party/cuda/bin/ptxas': No such file or directory | 11:41:32 |
SomeoneSerge (back on matrix) | Hmmm there used to be a postPatch in triton-bin symlinking our ptxas | 13:54:40 |
SomeoneSerge (back on matrix) | * Hmmm there used to be a postPatch in triton-bin (and in triton) symlinking our ptxas | 13:54:52 |
SomeoneSerge (back on matrix) | I just keep subscribing to issues but idk when I'll have the energy to reply like... to any of the github pings | 13:56:05 |
Gaétan Lepage | In reply to @hexa:lossy.network is anyone looking into the triton-llvm test issues on staging-next? Can we at least mark it as broken, because every attempt at building it is currently useless and wasting CPU time ? | 14:01:16 |
Gaétan Lepage | * Can we at least mark it as broken ? Because every attempt at building it is currently useless and wasting CPU time | 14:01:24 |
hexa | is this the royal we? | 14:02:08 |
Gaétan Lepage | I meant, would you be OK with that ? | 14:02:33 |
Gaétan Lepage | I can make the PR, but I prefer to ask before | 14:02:45 |
hexa | I don't maintain that package 😄 | 14:04:34 |
hexa | ideally someone can disable that test instead? | 14:04:50 |
hexa | * and ideally someone can disable that test instead? | 14:04:52 |
matthewcroughan @fosdem | Amen, you are not being well enough supported financially to solve tough issues, most people in this community are not. | 14:38:25 |
matthewcroughan @fosdem | The polish is a matter of resources | 14:38:58 |
matthewcroughan @fosdem | I did some postfixups, etc and worked around it | 14:39:15 |