!eWOErHSaiddIbsUNsJ:nixos.org

NixOS CUDA

290 Members
CUDA packages maintenance and support in nixpkgs | https://github.com/orgs/NixOS/projects/27/ | https://nixos.org/manual/nixpkgs/unstable/#cuda57 Servers

Load older messages


SenderMessageTime
22 Dec 2024
@matthewcroughan:defenestrate.itmatthewcroughan What I mean is that I could sit here and build stuff, and with some hard drives given to me host a cache for almost free on a gigabit connection 13:30:52
@matthewcroughan:defenestrate.itmatthewcroughanBut there's no incentive for me to do so, because I would starve trying13:31:01
@ss:someonex.netSomeoneSerge (back on matrix) Nooooo you have to build a profitable business that justifies building stuff, embrace the grind 14:15:23
@matthewcroughan:defenestrate.itmatthewcroughan I think what I'm saying is that there seems to be exactly no way to justify building for AMD, and that this goes beyond NixOS and upstream 14:20:45
@allrealmsoflife:matrix.orgallrealmsoflife joined the room.15:55:31
23 Dec 2024
@hexa:lossy.networkhexais anyone looking into the triton-llvm test issues on stagin-next?13:40:22
@hexa:lossy.networkhexa * is anyone looking into the triton-llvm test issues on staging-next?13:40:25
@hexa:lossy.networkhexahttps://hydra.nixos.org/build/28189295713:40:30
24 Dec 2024
@matthewcroughan:defenestrate.itmatthewcroughanHah, this old good one11:39:47
@matthewcroughan:defenestrate.itmatthewcroughan SomeoneSerge (utc+3): you might be interested in https://github.com/huggingface/optimum-quanto/issues/361 11:40:09
@matthewcroughan:defenestrate.itmatthewcroughan

Because optimum-quanto depends on a string that only exists in torch-bin

And when using torch-bin in an overlay, this happens

       error: attribute 'cudaPackages' missing
       at /nix/store/6zgbbqlr7nnfxpzkyj7fsl4fpg89jbw0-source/pkgs/development/python-modules/bitsandbytes/default.nix:16:19:
           15|
           16|   inherit (torch) cudaPackages cudaSupport;
             |                   ^
           17|   inherit (cudaPackages) cudaVersion;
11:40:27
@matthewcroughan:defenestrate.itmatthewcroughan And when I tell this specific package to use torch-bin, it turns out torch-bin doesn't seem to compile because of python3.12-triton> chmod: cannot access '/nix/store/kwahd53lf8hqylcpiyv15l157iayn1gc-python3.12-triton-3.1.0/lib/python3.12/site-packages/triton/third_party/cuda/bin/ptxas': No such file or directory 11:41:32
@ss:someonex.netSomeoneSerge (back on matrix) Hmmm there used to be a postPatch in triton-bin symlinking our ptxas 13:54:40
@ss:someonex.netSomeoneSerge (back on matrix) * Hmmm there used to be a postPatch in triton-bin (and in triton) symlinking our ptxas 13:54:52
@ss:someonex.netSomeoneSerge (back on matrix) I just keep subscribing to issues but idk when I'll have the energy to reply like... to any of the github pings 13:56:05
@glepage:matrix.orgGaétan Lepage
In reply to @hexa:lossy.network
is anyone looking into the triton-llvm test issues on staging-next?
Can we at least mark it as broken, because every attempt at building it is currently useless and wasting CPU time ?
14:01:16
@glepage:matrix.orgGaétan Lepage* Can we at least mark it as broken ? Because every attempt at building it is currently useless and wasting CPU time14:01:24
@hexa:lossy.networkhexais this the royal we?14:02:08
@glepage:matrix.orgGaétan LepageI meant, would you be OK with that ?14:02:33
@glepage:matrix.orgGaétan LepageI can make the PR, but I prefer to ask before14:02:45
@hexa:lossy.networkhexaI don't maintain that package 😄 14:04:34
@hexa:lossy.networkhexaideally someone can disable that test instead?14:04:50
@hexa:lossy.networkhexa * and ideally someone can disable that test instead?14:04:52
@matthewcroughan:defenestrate.itmatthewcroughan Amen, you are not being well enough supported financially to solve tough issues, most people in this community are not. 14:38:25
@matthewcroughan:defenestrate.itmatthewcroughanThe polish is a matter of resources14:38:58
@matthewcroughan:defenestrate.itmatthewcroughanI did some postfixups, etc and worked around it14:39:15
@matthewcroughan:defenestrate.itmatthewcroughanBut yes I also landed on the same PRs as you, and I'm not sure why it is still an issue despite those PR's having been merged14:39:32
@collinarnett:matrix.orgCollin Arnett joined the room.21:10:15
@collinarnett:matrix.orgCollin ArnettHello, are there any packages in the hackellPackage set that setup cudaSupport that I can use as an example to add cuda support for hasktorch? The author submitted a PR to bump the version here and has marked it as broken so I figured it would be good to get first class cuda support implemented here as well. https://github.com/NixOS/nixpkgs/pull/367998/21:16:42
25 Dec 2024
@ss:someonex.netSomeoneSerge (back on matrix)Oooooh that's a really great question, not least because, afaik, the haskell package set is its own thing with slightly different override patterns than elsewhere?00:04:12

Show newer messages


Back to Room ListRoom Version: 9