!eWOErHSaiddIbsUNsJ:nixos.org

NixOS CUDA

290 Members
CUDA packages maintenance and support in nixpkgs | https://github.com/orgs/NixOS/projects/27/ | https://nixos.org/manual/nixpkgs/unstable/#cuda57 Servers

Load older messages


SenderMessageTime
15 Jan 2025
@ss:someonex.netSomeoneSerge (back on matrix) changed their display name from SomeoneSerge (utc+3) to SomeoneSerge.19:02:40
16 Jan 2025
@connorbaker:matrix.orgconnor (he/him)if anyone enjoys the process of bumping opencv looks like 4.11 is out now (master is still using 4.9)07:51:29
@glepage:matrix.orgGaétan LepageHas to happen on staging right ?07:52:29
@connorbaker:matrix.orgconnor (he/him)I think so due to the number of rebuilds07:54:12
@connorbaker:matrix.orgconnor (he/him)Good news is that 4.10 fixes compilation with CUDA 12.3+07:54:34
18 Jan 2025
@connorbaker:matrix.orgconnor (he/him) just updated https://github.com/connorbaker/nix-cuda-test to use the latest changes in https://github.com/ConnorBaker/cuda-packages, which include getting rid of the need for a custom CUDA stdenv 08:51:19
@connorbaker:matrix.orgconnor (he/him)At least, I’m fairly certain I’ve implemented it that way. I’ve also got a setup hook which checks for RPATHs in produced libraries that match library directories from NVCC’s host compiler09:35:02
@glepage:matrix.orgGaétan Lepage
In reply to @connorbaker:matrix.org
if anyone enjoys the process of bumping opencv looks like 4.11 is out now (master is still using 4.9)
I'm looking for some reviewers ;)
https://github.com/NixOS/nixpkgs/pull/374246
09:45:39
@connorbaker:matrix.orgconnor (he/him)I’ll try to take a look this weekend to see if I can help with the tests/fill the missing hashes09:53:14
@hexa:lossy.networkhexa connor (he/him) (UTC-7): can you respond to the commonts on the onnxruntime PR? https://github.com/NixOS/nixpkgs/pull/364362 14:49:05
@hexa:lossy.networkhexaI think it is only blocked on those, and I'd like to build upon the PR14:49:22
@connorbaker:matrix.orgconnor (he/him)How are there so many rebuilds for that PR? Is it taking the number of rebuilds against master?18:38:30
@hexa:lossy.networkhexaeigen18:49:16
@hexa:lossy.networkhexa* that is due to the eigen bump18:49:22
@hexa:lossy.networkhexa* that is due to the eigen bump, I believe18:52:05
@glepage:matrix.orgGaétan LepageOn which infra are the cuda derivations (which since a few months, are cached on the nix-community cachix) built ?22:57:27
19 Jan 2025
@swordofthemorning:matrix.orgSword joined the room.04:21:18
@hexa:lossy.networkhexahttps://hydra.nix-community.org/project/nixpkgs16:10:02
@connorbaker:matrix.orgconnor (he/him)Interesting byproduct of getting rid of the CUDA stdenv is having libraries produced by multiple versions of a compiler, which breaks LTO: https://github.com/ConnorBaker/cuda-packages/commit/87cb387ecfba3f46b76e604b896d64417fdf9e8b16:15:00
@glepage:matrix.orgGaétan Lepage
In reply to @hexa:lossy.network
https://hydra.nix-community.org/project/nixpkgs
So on the nix-community CI builders ?
17:01:35
@hexa:lossy.networkhexayes17:03:53
@glepage:matrix.orgGaétan LepageOk thanks17:05:39
@ss:someonex.netSomeoneSerge (back on matrix)

https://github.com/NixOS/nixpkgs/pull/369956#issuecomment-2601068826

Maybe .override { cudaSupport = true; } should have been .override { stdenv = cudaStdenv; } in the first place. All lib.optionals cudaSupport should have been lib.optionals stdenv.isCuda or stdenv.isNVCC. We could remove (move to stdenv) all cuda- or hip-related flags, but the easiest way to do that is to make config.cudaSupport replace the actual default stdenv for all packages, triggering even more rebuilds than we do now.
Accidentally, this would also make it easier to move config.cudaSupport into crossSystem and introduce a pkgsCross.cuda.

23:36:30
21 Jan 2025
@kaya:catnip.eekaya 𖤐 changed their profile picture.00:27:42
@joelmatrixaccount:matrix.orgJoel joined the room.12:12:46
@caniko:matrix.orgcanikoDoes ollama still require compiling CUDA?20:16:41
@caniko:matrix.orgcanikoI failed to compile last time, and actually have no interest in doing so...20:17:44
@ss:someonex.netSomeoneSerge (back on matrix) It's optional 21:13:16
@oak:universumi.fioak 🏳️‍🌈♥️ changed their profile picture.22:35:37
@ss:someonex.netSomeoneSerge (back on matrix) * CUDA support is optional. If you enable it you have to rebuild ollama. It should be cached in nix-community cachix 21:14:50

Show newer messages


Back to Room ListRoom Version: 9