!eWOErHSaiddIbsUNsJ:nixos.org

NixOS CUDA

239 Members
CUDA packages maintenance and support in nixpkgs | https://github.com/orgs/NixOS/projects/27/ | https://nixos.org/manual/nixpkgs/unstable/#cuda45 Servers

Load older messages


SenderMessageTime
18 Mar 2025
@stick:matrix.orgsticklooking at versions of tensorrt and pypi - only these two are affected: 8.6.1.6 vs 8.6.1 10.3.0.26 vs 10.3.020:03:39
@stick:matrix.orgstickbecause 8.5.3.1 uses the same version in pypy (including the .1) and older versions are not present on pypi at all20:04:37
@koutensky:matrix.nesad.fit.vutbr.czMichal Koutenskýguess i can submit a PR that conditionally changes the filename for those two20:06:15
@koutensky:matrix.nesad.fit.vutbr.czMichal Koutenskýthanks for your help!20:06:40
@stick:matrix.orgstickthat would work, ping me in the PR, thanks20:07:02
@stick:matrix.orgstickyou would just override the version here: https://github.com/NixOS/nixpkgs/blob/59b1aef59071cae6e87859dc65de973d2cc595c0/pkgs/development/python-modules/tensorrt/default.nix#L1620:07:24
@koutensky:matrix.nesad.fit.vutbr.czMichal Koutenskýnot in the unpack phase?20:07:53
@stick:matrix.orgsticki guess the question is what version is being reported by the wheel20:09:08
@stick:matrix.orgstick

try calling

import tensorrt
print(tensorrt.version)

20:10:01
@stick:matrix.orgstick *

try calling

import tensorrt
print(tensorrt.__version__)
20:10:10
@stick:matrix.orgstick

or

import tensorrt
from importlib.metadata import version
version('tensorrt')
20:11:00
@stick:matrix.orgstick if you are feeling adventurous, you might as well update pkgs/development/cuda-modules/tensorrt/releases.nix to contain the latest 10.9.x.y release 20:12:02
@stick:matrix.orgstick * if you are feeling adventurous, you might as well update pkgs/development/cuda-modules/tensorrt/releases.nix to contain the latest 10.9.x.y release (both for cuda 11.x and 12.x) 20:12:16
@koutensky:matrix.nesad.fit.vutbr.czMichal Koutenskýboth report '10.3.0' for me20:13:44
@koutensky:matrix.nesad.fit.vutbr.czMichal Koutenskýsure, i can do that tomorrow20:14:26
@stick:matrix.orgstickin that case it makes sense to update version on line 16, not the unpack phase20:15:01
@stick:matrix.orgstickso the nix package has the same version as reported by wheel20:15:18
@koutensky:matrix.nesad.fit.vutbr.czMichal Koutenskýyeah that makes sense20:15:26
@stick:matrix.orgstick

SomeoneSerge (UTC+U[-12,12]): I finally managed to build onnxruntime with CUDA 12.8 - see https://github.com/NixOS/nixpkgs/pull/390885

can you run the CUDA version bump test suite and let me know if we can merge the PR?

22:20:53
@stick:matrix.orgstick *

SomeoneSerge (UTC+U[-12,12]): I finally managed to build onnxruntime (afaik the only blocker) with CUDA 12.8 - see https://github.com/NixOS/nixpkgs/pull/390885

can you run the CUDA version bump test suite and let me know if we can merge the PR?

22:21:20
@stick:matrix.orgstickI am building magma/torch/vllm as we speak - but IIRC this already went OK when i tried it few weeks ago22:21:59
@stick:matrix.orgstickthe onnxruntime fix was to turn off LTO - it went bonkers (into infinite loop) when trying to do the final link - I looked into gentoo ebuilds and they also turn off LTO when linking onnxruntime with cuda22:24:01
@ss:someonex.netSomeoneSerge (UTC+U[-12,12]) stick: just a heads up: I've been using the university workstation for nixpkgs-review so far, but I'm no longer employed by the uni and am migrating between infrastructures; going to take time 🤷 22:24:51
@stick:matrix.orgstickso the version bump test is only running nixpkgs-review on the PR?22:25:57
@ss:someonex.netSomeoneSerge (UTC+U[-12,12])There's, nixpgks-review with cudaSupport=true, there's passthru gpuChecks, there's samuela's and Connor's out-of-tree test-suites22:27:50
@ss:someonex.netSomeoneSerge (UTC+U[-12,12])Nixpkgs-review is a bit of cargo culting but it gives an idea of the size of the fallout22:29:14
@stick:matrix.orgstickyeah, i use it often locally - but there are many failing packages also on master unfortunately22:30:00
@stick:matrix.orgstick* yeah, i use it often locally - but there are many not-so-important failing packages also on master unfortunately22:30:20
@ss:someonex.netSomeoneSerge (UTC+U[-12,12])Yes, it's definitely too much compute hours spent on just getting a statistic (# failures)22:38:34
21 Mar 2025
@domenkozar:matrix.orgDomen Kožar changed their profile picture.11:40:19

There are no newer messages yet.


Back to Room ListRoom Version: 9