!eWOErHSaiddIbsUNsJ:nixos.org

NixOS CUDA

289 Members
CUDA packages maintenance and support in nixpkgs | https://github.com/orgs/NixOS/projects/27/ | https://nixos.org/manual/nixpkgs/unstable/#cuda57 Servers

Load older messages


SenderMessageTime
18 Jan 2025
@hexa:lossy.networkhexa (UTC+1)I think it is only blocked on those, and I'd like to build upon the PR14:49:22
@connorbaker:matrix.orgconnor (burnt/out) (UTC-8)How are there so many rebuilds for that PR? Is it taking the number of rebuilds against master?18:38:30
@hexa:lossy.networkhexa (UTC+1)eigen18:49:16
@hexa:lossy.networkhexa (UTC+1)* that is due to the eigen bump18:49:22
@hexa:lossy.networkhexa (UTC+1)* that is due to the eigen bump, I believe18:52:05
@glepage:matrix.orgGaétan LepageOn which infra are the cuda derivations (which since a few months, are cached on the nix-community cachix) built ?22:57:27
19 Jan 2025
@swordofthemorning:matrix.orgSword joined the room.04:21:18
@hexa:lossy.networkhexa (UTC+1)https://hydra.nix-community.org/project/nixpkgs16:10:02
@connorbaker:matrix.orgconnor (burnt/out) (UTC-8)Interesting byproduct of getting rid of the CUDA stdenv is having libraries produced by multiple versions of a compiler, which breaks LTO: https://github.com/ConnorBaker/cuda-packages/commit/87cb387ecfba3f46b76e604b896d64417fdf9e8b16:15:00
@glepage:matrix.orgGaétan Lepage
In reply to @hexa:lossy.network
https://hydra.nix-community.org/project/nixpkgs
So on the nix-community CI builders ?
17:01:35
@hexa:lossy.networkhexa (UTC+1)yes17:03:53
@glepage:matrix.orgGaétan LepageOk thanks17:05:39
@ss:someonex.netSomeoneSerge (back on matrix)

https://github.com/NixOS/nixpkgs/pull/369956#issuecomment-2601068826

Maybe .override { cudaSupport = true; } should have been .override { stdenv = cudaStdenv; } in the first place. All lib.optionals cudaSupport should have been lib.optionals stdenv.isCuda or stdenv.isNVCC. We could remove (move to stdenv) all cuda- or hip-related flags, but the easiest way to do that is to make config.cudaSupport replace the actual default stdenv for all packages, triggering even more rebuilds than we do now.
Accidentally, this would also make it easier to move config.cudaSupport into crossSystem and introduce a pkgsCross.cuda.

23:36:30
21 Jan 2025
@kaya:catnip.eekaya 𖤐 changed their profile picture.00:27:42
@joelmatrixaccount:matrix.orgJoel joined the room.12:12:46
@caniko:matrix.orgcanikoDoes ollama still require compiling CUDA?20:16:41
@caniko:matrix.orgcanikoI failed to compile last time, and actually have no interest in doing so...20:17:44
@ss:someonex.netSomeoneSerge (back on matrix) It's optional 21:13:16
@oak:universumi.fioak 🏳️‍🌈♥️ changed their profile picture.22:35:37
@ss:someonex.netSomeoneSerge (back on matrix) * CUDA support is optional. If you enable it you have to rebuild ollama. It should be cached in nix-community cachix 21:14:50
@oak:universumi.fioak 🏳️‍🌈♥️ changed their profile picture.22:37:17
@ss:someonex.netSomeoneSerge (back on matrix) * CUDA support is optional. If you enable it you have to rebuild ollama. It should be cached in nix-community cachix (more specifically, (import <nixpkgs> { config.cudaSupport = true; }).ollama should be) 21:15:17
23 Jan 2025
@ss:someonex.netSomeoneSerge (back on matrix) connor (he/him) (UTC-7): we never published that community update, you think you'd be able to find the time to push that over the line? 14:37:45
24 Jan 2025
@connorbaker:matrix.orgconnor (burnt/out) (UTC-8)Ah yeah; do you remember if I had a draft or if you did?06:31:29
@ss:someonex.netSomeoneSerge (back on matrix)
In reply to @ss:someonex.net
https://pad.lassul.us/DwBgo1SZSzSVL29wsnK0fg#
^
08:52:02
@leighleighleigh:matrix.org@leighleighleigh:matrix.org left the room.20:40:08
25 Jan 2025
@caniko:matrix.orgcaniko
In reply to @ss:someonex.net
CUDA support is optional. If you enable it you have to rebuild ollama. It should be cached in nix-community cachix (more specifically, (import <nixpkgs> { config.cudaSupport = true; }).ollama should be)
Really? It used compile stuff in C back when I did this the last time
14:31:28
@caniko:matrix.orgcanikoperhaps something changed?14:31:42
@caniko:matrix.orgcanikoI just checked, it has parts that are written in C 😄14:33:59
@caniko:matrix.orgcanikodoes nix get the build requirements by itself?14:34:35

Show newer messages


Back to Room ListRoom Version: 9