| 1 Mar 2025 |
 @hexa:lossy.network |
RuntimeError: /build/source/onnxruntime/core/session/provider_bridge_ort.cc:1539 onnxruntime::Provider& onnxruntime::ProviderLibrary::Get() [ONNXRuntimeError] : 1 : FAIL : Failed to load library /nix/store/0d0l820v8vnw7kf959xr6bvpvyg21r2b-onnxruntime-1.20.2/lib/libonnxruntime_providers_openvino.so with error: /nix/store/0d0l820v8vnw7kf959xr6bvpvyg21r2b-onnxruntime-1.20.2/lib/libonnxruntime_providers_openvino.so: undefined symbol: _ZN9OrtDevice3NPUE
| 06:32:49 |
| @hexa:lossy.network | anyone with magic cpp skills? | 06:32:59 |
| @hexa:lossy.network | https://github.com/NixOS/nixpkgs/pull/380543 | 06:33:05 |
 K900 | https://github.com/microsoft/onnxruntime/blob/1ffe793a834cf347b13845c15aa9cd008ec23b23/include/onnxruntime/core/framework/ortdevice.h#L19 | 06:35:48 |
| K900 | Looks like it's a static | 06:35:50 |
| K900 | That's defined in onnxruntime somewhere | 06:36:09 |
| @hexa:lossy.network | yup | 06:36:25 |
| @hexa:lossy.network | where do we go from here? | 06:39:22 |
| K900 | I feel like this is some C++ ABI bullshit because why is it even trying to access that as a symbol | 06:41:18 |
 mattleon | I work on C++ all day, but that doesn't make me someone with magic cpp skills.
That said, my best guess is that onnxruntime is being built with a define or flag that does not include that file or symbol.
It looks like we're specifying `USE_OPENVINO_NPU` etc., but do we need to be using MULTI mode to enable that? https://github.com/microsoft/onnxruntime/blob/1ffe793a834cf347b13845c15aa9cd008ec23b23/tools/ci_build/build.py#L103 | 11:55:10 |
|  @achnazoor:matrix.org left the room. | 12:44:14 |
| @hexa:lossy.network | yeah, aiui the unit needs to be compiled and linked into the shared library | 17:22:49 |
| @hexa:lossy.network | + (lib.cmakeFeature "onnxruntime_USE_OPENVINO_AUTO" (if effectiveStdenv.hostPlatform.system == "x86_64-linux" then "NPU,GPU,CPU" else "GPU"))
| 17:23:18 |
| @hexa:lossy.network | this did not resolve the situation | 17:23:25 |
| @hexa:lossy.network | ok, I dug into the code | 18:49:58 |
| @hexa:lossy.network | and I think onnxruntime_framework does not get linked into the openvino provider | 18:50:11 |
| @hexa:lossy.network | I tried to add that to the resulting library, but meh | 19:17:22 |
| @hexa:lossy.network | diff --git a/cmake/onnxruntime_providers_openvino.cmake b/cmake/onnxruntime_providers_openvino.cmake
index 143d002c61..c7ad02b94d 100644
--- a/cmake/onnxruntime_providers_openvino.cmake
+++ b/cmake/onnxruntime_providers_openvino.cmake
@@ -37,7 +37,7 @@
source_group(TREE ${ONNXRUNTIME_ROOT}/core FILES ${onnxruntime_providers_openvino_cc_srcs})
onnxruntime_add_shared_library_module(onnxruntime_providers_openvino ${onnxruntime_providers_openvino_cc_srcs} "${ONNXRUNTIME_ROOT}/core/dll/onnxruntime.rc")
- onnxruntime_add_include_to_target(onnxruntime_providers_openvino onnxruntime_common onnx nlohmann_json::nlohmann_json)
+ onnxruntime_add_include_to_target(onnxruntime_providers_openvino onnxruntime_common onnxruntime_framework onnx nlohmann_json::nlohmann_json)
install(FILES ${PROJECT_SOURCE_DIR}/../include/onnxruntime/core/providers/openvino/openvino_provider_factory.h
DESTINATION ${CMAKE_INSTALL_INCLUDEDIR}/onnxruntime/)
set_target_properties(onnxruntime_providers_openvino PROPERTIES CXX_STANDARD 20)
| 19:17:25 |
| @hexa:lossy.network | * diff --git a/cmake/onnxruntime_providers_openvino.cmake b/cmake/onnxruntime_providers_openvino.cmake
index 143d002c61..c7ad02b94d 100644
--- a/cmake/onnxruntime_providers_openvino.cmake
+++ b/cmake/onnxruntime_providers_openvino.cmake
@@ -37,7 +37,7 @@
source_group(TREE ${ONNXRUNTIME_ROOT}/core FILES ${onnxruntime_providers_openvino_cc_srcs})
onnxruntime_add_shared_library_module(onnxruntime_providers_openvino ${onnxruntime_providers_openvino_cc_srcs} "${ONNXRUNTIME_ROOT}/core/dll/onnxruntime.rc")
- onnxruntime_add_include_to_target(onnxruntime_providers_openvino onnxruntime_common onnx nlohmann_json::nlohmann_json)
+ onnxruntime_add_include_to_target(onnxruntime_providers_openvino onnxruntime_common onnxruntime_framework onnx nlohmann_json::nlohmann_json)
install(FILES ${PROJECT_SOURCE_DIR}/../include/onnxruntime/core/providers/openvino/openvino_provider_factory.h
DESTINATION ${CMAKE_INSTALL_INCLUDEDIR}/onnxruntime/)
set_target_properties(onnxruntime_providers_openvino PROPERTIES CXX_STANDARD 20)
| 19:17:28 |
| @hexa:lossy.network | no change | 19:17:38 |
| @hexa:lossy.network | https://github.com/microsoft/onnxruntime/issues/9756 | 19:19:46 |
| @hexa:lossy.network | this is also /great/ | 19:19:48 |
| 2 Mar 2025 |
| @hexa:lossy.network | frigate 0.15.0 PR is up, needs more testing https://github.com/NixOS/nixpkgs/pull/386266 | 01:22:27 |
| @hexa:lossy.network | still investigating crashes of the test suite on aarch64-linux | 01:24:27 |
| @hexa:lossy.network | 
Download image.png | 01:36:09 |
| @hexa:lossy.network | 
Download image.png | 01:36:25 |
| @hexa:lossy.network | config now gets copied to /run/frigate/frigate.yml and you can make changes in frigate and see them in there | 01:36:50 |
| @hexa:lossy.network | still need to sync them back, or they'll get reset on restart | 01:36:58 |
|  @dont.wanna.tell:matrix.org joined the room. | 19:52:46 |
| 3 Mar 2025 |
| @hexa:lossy.network | * For Frigate users: SSDlite mobilenet v2 model converted into the OpenVINO IR Format required for the detector: https://shells.darmstadt.ccc.de/~hexa/omz/ | 03:09:38 |
