!eWOErHSaiddIbsUNsJ:nixos.org

NixOS CUDA

306 Members
CUDA packages maintenance and support in nixpkgs | https://github.com/orgs/NixOS/projects/27/ | https://nixos.org/manual/nixpkgs/unstable/#cuda60 Servers

You have reached the beginning of time (for this room).


SenderMessageTime
19 Jan 2025
@connorbaker:matrix.orgconnor (he/him)Interesting byproduct of getting rid of the CUDA stdenv is having libraries produced by multiple versions of a compiler, which breaks LTO: https://github.com/ConnorBaker/cuda-packages/commit/87cb387ecfba3f46b76e604b896d64417fdf9e8b16:15:00
@glepage:matrix.orgGaétan Lepage
In reply to @hexa:lossy.network
https://hydra.nix-community.org/project/nixpkgs
So on the nix-community CI builders ?
17:01:35
@hexa:lossy.networkhexayes17:03:53
@glepage:matrix.orgGaétan LepageOk thanks17:05:39
@ss:someonex.netSomeoneSerge (matrix works sometimes)

https://github.com/NixOS/nixpkgs/pull/369956#issuecomment-2601068826

Maybe .override { cudaSupport = true; } should have been .override { stdenv = cudaStdenv; } in the first place. All lib.optionals cudaSupport should have been lib.optionals stdenv.isCuda or stdenv.isNVCC. We could remove (move to stdenv) all cuda- or hip-related flags, but the easiest way to do that is to make config.cudaSupport replace the actual default stdenv for all packages, triggering even more rebuilds than we do now.
Accidentally, this would also make it easier to move config.cudaSupport into crossSystem and introduce a pkgsCross.cuda.

23:36:30
21 Jan 2025
@kaya:catnip.eekaya 𖤐 changed their profile picture.00:27:42
@joelmatrixaccount:matrix.orgJoel joined the room.12:12:46
@caniko:matrix.orgcanikoDoes ollama still require compiling CUDA?20:16:41
@caniko:matrix.orgcanikoI failed to compile last time, and actually have no interest in doing so...20:17:44
@ss:someonex.netSomeoneSerge (matrix works sometimes) It's optional 21:13:16
@oak:universumi.fioak 🏳️‍🌈♥️ changed their profile picture.22:35:37
@ss:someonex.netSomeoneSerge (matrix works sometimes) * CUDA support is optional. If you enable it you have to rebuild ollama. It should be cached in nix-community cachix 21:14:50
@oak:universumi.fioak 🏳️‍🌈♥️ changed their profile picture.22:37:17
@ss:someonex.netSomeoneSerge (matrix works sometimes) * CUDA support is optional. If you enable it you have to rebuild ollama. It should be cached in nix-community cachix (more specifically, (import <nixpkgs> { config.cudaSupport = true; }).ollama should be) 21:15:17
23 Jan 2025
@ss:someonex.netSomeoneSerge (matrix works sometimes) connor (he/him) (UTC-7): we never published that community update, you think you'd be able to find the time to push that over the line? 14:37:45
24 Jan 2025
@connorbaker:matrix.orgconnor (he/him)Ah yeah; do you remember if I had a draft or if you did?06:31:29
@ss:someonex.netSomeoneSerge (matrix works sometimes)
In reply to @ss:someonex.net
https://pad.lassul.us/DwBgo1SZSzSVL29wsnK0fg#
^
08:52:02
@leighleighleigh:matrix.org@leighleighleigh:matrix.org left the room.20:40:08
25 Jan 2025
@caniko:matrix.orgcaniko
In reply to @ss:someonex.net
CUDA support is optional. If you enable it you have to rebuild ollama. It should be cached in nix-community cachix (more specifically, (import <nixpkgs> { config.cudaSupport = true; }).ollama should be)
Really? It used compile stuff in C back when I did this the last time
14:31:28
@caniko:matrix.orgcanikoperhaps something changed?14:31:42
@caniko:matrix.orgcanikoI just checked, it has parts that are written in C 😄14:33:59

Show newer messages


Back to Room ListRoom Version: 9