!eWOErHSaiddIbsUNsJ:nixos.org

NixOS CUDA

251 Members
CUDA packages maintenance and support in nixpkgs | https://github.com/orgs/NixOS/projects/27/ | https://nixos.org/manual/nixpkgs/unstable/#cuda46 Servers

You have reached the beginning of time (for this room).


SenderMessageTime
25 Apr 2025
@luke-skywalker:matrix.orgluke-skywalker *

I see.

If Ill have to I would probably opt for editing /var/run/cdi/nvidia-container-toolkit.json, but at this point I dont see a reason not to stick with 16.2 and update once the upstream issue is resolved.

13:08:17
@ereslibre:ereslibre.socialereslibreyeah, updating /var/run/cdi/nvidia-container-toolkit.json is flaky as I exposed it, it expects ldconfig to be present within the container at the specified path13:10:27
@luke-skywalker:matrix.orgluke-skywalkergood to know. well until I see a good reason not to and everything works as needed, I will stick with 16.2 for the time being then.13:13:16
@luke-skywalker:matrix.orgluke-skywalkercurrently just testing out different cluster setups in my homelab (4x machines, 2x with nvidia GPU) so will be a bit until any real deployment... 13:14:35
@connorbaker:matrix.orgconnor (he/him) (UTC-7) Kevin Mittman: I noticed the TensorRT binary archive for x86_64-linux (and only x86_64-linux) includes libnvinfer_builder_resource.so.10.9.0 and libnvinfer_builder_resource_win.so.10.9.0. Both are ~1.9 GB, and I'm wondering if libnvinfer_builder_resource_win.so.10.9.0 is relevant for x86_64-linux systems, and if so, what it does compared to libnvinfer_builder_resource.so.10.9.0. 23:33:24
@justbrowsing:matrix.orgKevin Mittman
In reply to @connorbaker:matrix.org
Kevin Mittman: I noticed the TensorRT binary archive for x86_64-linux (and only x86_64-linux) includes libnvinfer_builder_resource.so.10.9.0 and libnvinfer_builder_resource_win.so.10.9.0. Both are ~1.9 GB, and I'm wondering if libnvinfer_builder_resource_win.so.10.9.0 is relevant for x86_64-linux systems, and if so, what it does compared to libnvinfer_builder_resource.so.10.9.0.
Checking. Also that tarball doesn't conform to the "binary archive" format ... and 6.4GB
23:48:23
@justbrowsing:matrix.orgKevin Mittman As the name implies, seems to be for cross compilation, Linux -> Windows 23:55:01
26 Apr 2025
@connorbaker:matrix.orgconnor (he/him) (UTC-7) Shouldn't it be in a different targets directory if it's for cross to another system? 00:01:28
@hexa:lossy.networkhexa (UTC+1)heads up19:52:11
@hexa:lossy.networkhexa (UTC+1)current onnxruntime on unstable requires w+x, while the version on release-24.11 does not19:52:34

Show newer messages


Back to Room ListRoom Version: 9