!eWOErHSaiddIbsUNsJ:nixos.org

NixOS CUDA

308 Members
CUDA packages maintenance and support in nixpkgs | https://github.com/orgs/NixOS/projects/27/ | https://nixos.org/manual/nixpkgs/unstable/#cuda60 Servers

You have reached the beginning of time (for this room).


SenderMessageTime
16 Dec 2024
@matthewcroughan:defenestrate.itmatthewcroughanI'm happy as long as I don't have to do weird things to achieve it14:48:58
@matthewcroughan:defenestrate.itmatthewcroughanand for me, this is not weird14:49:02
@matthewcroughan:defenestrate.itmatthewcroughanpreviously what my flake was doing was far weirder14:49:07
@matthewcroughan:defenestrate.itmatthewcroughanhttps://github.com/nixified-ai/flake/blob/master/projects/invokeai/default.nix#L66-L9614:49:32
@matthewcroughan:defenestrate.itmatthewcroughan previously it was defining functions that were able to create variants of packages without setting rocmSupport or cudaSupport 14:49:51
@matthewcroughan:defenestrate.itmatthewcroughanJust terrible14:50:00
@matthewcroughan:defenestrate.itmatthewcroughan Besides, the modules the flake will export, won't interact with the comfyui-nvidia or comfyui-amd attrs, this is just for people who want to try it with nix run 14:50:42
@matthewcroughan:defenestrate.itmatthewcroughan In a system using the nixosModules, the overlay will be applied, which strictly ignores the packages attr of the flake 14:51:05
@matthewcroughan:defenestrate.itmatthewcroughanthe packages attr of the flake is just there for people wanting to use things in a non-nixos context really14:53:53
@ss:someonex.netSomeoneSerge (matrix works sometimes) They're just completely separate.
I guess there are mappings between subsets of the frameworks, as evidenced by ZLUDA, hipify, and https://docs.scale-lang.com.
I suppose one could say that ZLUDA is a sort of a runtime proxy, although the multi-versioning bit is still missing.
14:55:59
@matthewcroughan:defenestrate.itmatthewcroughan Interestingly in the case of comfyui, I didn't need to add any rocm specific stuff 15:33:35
@matthewcroughan:defenestrate.itmatthewcroughan * Interestingly in the case of comfyui, I didn't need to add any rocm or cuda specific stuff 15:33:37

Show newer messages


Back to Room ListRoom Version: 9