Onnxruntime wrong GLIBCXX version

zadkiel · January 8, 2025, 6:24pm

Given Jetson Zoo - eLinux.org documentation, onnxruntime_gpu-1.18.0-cp38-cp38-linux_aarch64.whl should be used with Jetpack 5.1.2.
I found that this onnxruntime wheel includes a shared library (/usr/local/lib/python3.8/dist-packages/onnxruntime/capi/onnxruntime_pybind11_state.so) that depends on GLIBCXX_3.4.29.
However, it seams that nvcr.io/nvidia/l4t-jetpack:r35.4.1 only has GLIBCXX_3.4.28.

Here’s a dump of my versions:

Host L4T 35.4.1
Host Jetpack 5.1.2
Container nvcr.io/nvidia/l4t-jetpack:r35.4.1
onnx 1.17.0
onnxslim 0.1.46
onnxruntime-gpu https://nvidia.box.com/shared/static/3fechcaiwbtblznlchl6dh8uuat3dp5r.whl
torch https://developer.download.nvidia.com/compute/redist/jp/v512/pytorch/torch-2.1.0a0+41361538.nv23.06-cp38-cp38-linux_aarch64.whl
torchvision https://github.com/ultralytics/assets/releases/download/v0.0.0/torchvision-0.16.2+c6f3977-cp38-cp38-linux_aarch64.whl

I get the following error message:

ONNX: slimming with onnxslim 0.1.46...
ONNX: simplifier failure: /lib/aarch64-linux-gnu/libstdc++.so.6: version `GLIBCXX_3.4.29' not found (required by /usr/local/lib/python3.8/dist-packages/onnxruntime/capi/onnxruntime_pybind11_state.so)

$ strings /lib/aarch64-linux-gnu/libstdc++.so.6 | grep GLIBCXX
GLIBCXX_3.4
GLIBCXX_3.4.1
GLIBCXX_3.4.2
GLIBCXX_3.4.3
GLIBCXX_3.4.4
GLIBCXX_3.4.5
GLIBCXX_3.4.6
GLIBCXX_3.4.7
GLIBCXX_3.4.8
GLIBCXX_3.4.9
GLIBCXX_3.4.10
GLIBCXX_3.4.11
GLIBCXX_3.4.12
GLIBCXX_3.4.13
GLIBCXX_3.4.14
GLIBCXX_3.4.15
GLIBCXX_3.4.16
GLIBCXX_3.4.17
GLIBCXX_3.4.18
GLIBCXX_3.4.19
GLIBCXX_3.4.20
GLIBCXX_3.4.21
GLIBCXX_3.4.22
GLIBCXX_3.4.23
GLIBCXX_3.4.24
GLIBCXX_3.4.25
GLIBCXX_3.4.26
GLIBCXX_3.4.27
GLIBCXX_3.4.28

Can you please publish a up to date image or recommend an other version of onnxruntime-gpu compatible with GLIBCXX_3.4.28?

Thank you

zadkiel · January 8, 2025, 6:37pm

I found that docker.io/dustynv/l4t-pytorch:r35.4.1 has the required GLIBXX versions:

...
GLIBCXX_3.4.29
GLIBCXX_3.4.30

Shouldn’t the official image be updated?

AastaLLL · January 9, 2025, 3:28am

Hi,

This is a known issue and the packages are prepared by the ONNXRuntime team.
The recommendation of the ONNXRuntime team is to upgrade the environment to JetPack 6.x.

github.com/microsoft/onnxruntime

[Build] Trying to build on a embedded device that doesn't support BFLOAT16

opened 07:07PM - 14 Mar 24 UTC

closed 11:54PM - 19 Jun 24 UTC

ChthonicOne

build platform:mobile ep:ArmNN

### Describe the issue I'm trying to build onnxruntime on a Radxa-Zero, but I'v…e come to find out that it does not support BFLOAT16 instructions. As a result your builds fail because they require those instructions and I cannot find any way to disable support for those instructions. I do not need support for these instructions on this device. I can make do with fp16 datatype instead if need be despite the rounding error. I already do with NCNN. The problem I have with NCNN is that the device does not properly support Vulcan at this time, and I wished to attempt to try GPU acceleration using ArmNN with ONNX. Is there a way I can disable these instructions and build onnxruntime without them on this device? I have already built ArmNN on the device. ### Urgency I am currently blocked from attempting to use onnxruntime on the Radxa ### Target platform Radxa-zero aarch64 ### Build script ./build.sh --config RelWithDebInfo --build_shared_lib --parallel --compile_no_warning_as_error --skip_submodule_sync --disable_types=float8 --use_armnn --armnn_relu --armnn_bn ### Error / output debug log is as follows: ``` ./build.sh --config RelWithDebInfo --build_shared_lib --parallel --compile_no_warning_as_error --skip_submodule_sync --disable_types=float8 --use_armnn --armnn_relu --armnn_bn 2024-03-14 14:49:53,302 build [DEBUG] - Command line arguments: --build_dir /home/rock/temp/onnxruntime/build/Linux --config RelWithDebInfo --build_shared_lib --parallel --compile_no_warning_as_error --skip_submodule_sync --disable_types=float8 --use_armnn --armnn_relu --armnn_bn Namespace(acl_home=None, acl_libs=None, allow_running_as_root=False, android=False, android_abi='arm64-v8a', android_api=27, android_cpp_shared=False, android_ndk_path='', android_run_emulator=False, android_sdk_path='', apple_deploy_target=None, apple_sysroot='', arm=False, arm64=False, arm64ec=False, armnn_bn=True, armnn_home=None, armnn_libs=None, armnn_relu=True, build=False, build_apple_framework=False, build_csharp=False, build_dir='/home/rock/temp/onnxruntime/build/Linux', build_java=False, build_micro_benchmarks=False, build_nodejs=False, build_nuget=False, build_objc=False, build_shared_lib=True, build_wasm=False, build_wasm_static_lib=False, build_wheel=False, buildasx=False, cann_home=None, clean=False, cmake_extra_defines=None, cmake_generator=None, cmake_path='cmake', code_coverage=False, compile_no_warning_as_error=True, config=['RelWithDebInfo'], ctest_path='ctest', cuda_home=None, cuda_version=None, cudnn_home=None, disable_contrib_ops=False, disable_exceptions=False, disable_memleak_checker=False, disable_ml_ops=False, disable_rtti=False, disable_types=['float8'], disable_wasm_exception_catching=False, dml_external_project=False, dml_path='', dnnl_aarch64_runtime='', dnnl_acl_root='', dnnl_gpu_runtime='', dnnl_opencl_root='', eigen_path=None, emscripten_settings=None, emsdk_version='3.1.51', enable_address_sanitizer=False, enable_cuda_line_info=False, enable_cuda_nhwc_ops=False, enable_cuda_profiling=False, enable_external_custom_op_schemas=False, enable_language_interop_ops=False, enable_lazy_tensor=False, enable_lto=False, enable_memory_profile=False, enable_msinternal=False, enable_msvc_static_runtime=False, enable_nccl=False, enable_nvtx_profile=False, enable_onnx_tests=False, enable_pybind=False, enable_reduced_operator_type_support=False, enable_rocm_profiling=False, enable_symbolic_shape_infer_tests=False, enable_training=False, enable_training_apis=False, enable_training_ops=False, enable_transformers_tool_test=False, enable_wasm_api_exception_catching=False, enable_wasm_debug_info=False, enable_wasm_exception_throwing_override=True, enable_wasm_profiling=False, enable_wasm_simd=False, enable_wasm_threads=False, enable_wcos=False, extensions_overridden_path=None, external_graph_transformer_path=None, fuzz_testing=False, gdk_edition='.', gdk_platform='Scarlett', gen_api_doc=False, gen_doc=None, include_ops_by_config=None, ios=False, ios_toolchain_file='', llvm_config='', llvm_path=None, migraphx_home=None, minimal_build=None, mpi_home=None, ms_experimental=False, msbuild_extra_options=None, msvc_toolset=None, nccl_home=None, nnapi_min_api=None, numpy_version=None, nvcc_threads=-1, osx_arch='x86_64', parallel=0, path_to_protoc_exe=None, qnn_home=None, riscv_qemu_path='', riscv_toolchain_root='', rocm_home=None, rocm_version=None, rv64=False, skip_keras_test=False, skip_nodejs_tests=False, skip_onnx_tests=False, skip_submodule_sync=True, skip_tests=False, skip_winml_tests=False, snpe_root=None, target=None, tensorrt_home=None, test=False, test_all_timeout='10800', tvm_cuda_runtime=False, update=False, use_acl=None, use_armnn=True, use_azure=False, use_binskim_compliant_compile_flags=False, use_cache=False, use_cann=False, use_coreml=False, use_cuda=False, use_dml=False, use_dnnl=False, use_extensions=False, use_full_protobuf=False, use_gdk=False, use_jsep=False, use_lock_free_queue=False, use_migraphx=False, use_mimalloc=False, use_mpi=False, use_nnapi=False, use_openvino=None, use_preinstalled_eigen=False, use_qnn=False, use_rknpu=False, use_rocm=False, use_snpe=False, use_telemetry=False, use_tensorrt=False, use_tensorrt_builtin_parser=True, use_tensorrt_oss_parser=False, use_triton_kernel=False, use_tvm=False, use_tvm_hash=False, use_vitisai=False, use_webnn=False, use_winml=False, use_xnnpack=False, wasm_malloc=None, wasm_run_tests_in_browser=False, wheel_name_suffix=None, windows_sdk_version=None, winml_root_namespace_override=None, x86=False, xcode_code_signing_identity='', xcode_code_signing_team_id='') 2024-03-14 14:49:53,332 build [DEBUG] - Defaulting to running update, build [and test for native builds]. 2024-03-14 14:49:53,333 build [INFO] - Build started 2024-03-14 14:49:53,334 build [INFO] - Generating CMake build tree 2024-03-14 14:49:53,335 build [INFO] - /home/rock/.local/bin/cmake /home/rock/temp/onnxruntime/cmake --compile-no-warning-as-error -Donnxruntime_RUN_ONNX_TESTS=OFF -Donnxruntime_GENERATE_TEST_REPORTS=ON -DPython_EXECUTABLE=/usr/bin/python3 -DPYTHON_EXECUTABLE=/usr/bin/python3 -Donnxruntime_USE_MIMALLOC=OFF -Donnxruntime_ENABLE_PYTHON=OFF -Donnxruntime_BUILD_CSHARP=OFF -Donnxruntime_BUILD_JAVA=OFF -Donnxruntime_BUILD_NODEJS=OFF -Donnxruntime_BUILD_OBJC=OFF -Donnxruntime_BUILD_SHARED_LIB=ON -Donnxruntime_BUILD_APPLE_FRAMEWORK=OFF -Donnxruntime_USE_DNNL=OFF -Donnxruntime_USE_NNAPI_BUILTIN=OFF -Donnxruntime_USE_RKNPU=OFF -Donnxruntime_USE_LLVM=OFF -Donnxruntime_ENABLE_MICROSOFT_INTERNAL=OFF -Donnxruntime_USE_VITISAI=OFF -Donnxruntime_USE_TENSORRT=OFF -Donnxruntime_USE_TENSORRT_BUILTIN_PARSER=ON -Donnxruntime_USE_TVM=OFF -Donnxruntime_TVM_CUDA_RUNTIME=OFF -Donnxruntime_TVM_USE_HASH=OFF -Donnxruntime_USE_MIGRAPHX=OFF -Donnxruntime_DISABLE_CONTRIB_OPS=OFF -Donnxruntime_DISABLE_ML_OPS=OFF -Donnxruntime_DISABLE_RTTI=OFF -Donnxruntime_DISABLE_EXCEPTIONS=OFF -Donnxruntime_MINIMAL_BUILD=OFF -Donnxruntime_EXTENDED_MINIMAL_BUILD=OFF -Donnxruntime_MINIMAL_BUILD_CUSTOM_OPS=OFF -Donnxruntime_REDUCED_OPS_BUILD=OFF -Donnxruntime_ENABLE_LANGUAGE_INTEROP_OPS=OFF -Donnxruntime_USE_DML=OFF -Donnxruntime_USE_WINML=OFF -Donnxruntime_BUILD_MS_EXPERIMENTAL_OPS=OFF -Donnxruntime_USE_TELEMETRY=OFF -Donnxruntime_ENABLE_LTO=OFF -Donnxruntime_USE_ACL=OFF -Donnxruntime_USE_ACL_1902=OFF -Donnxruntime_USE_ACL_1905=OFF -Donnxruntime_USE_ACL_1908=OFF -Donnxruntime_USE_ACL_2002=OFF -Donnxruntime_USE_ACL_2308=OFF -Donnxruntime_USE_ARMNN=ON -Donnxruntime_ARMNN_RELU_USE_CPU=OFF -Donnxruntime_ARMNN_BN_USE_CPU=OFF -Donnxruntime_USE_JSEP=OFF -Donnxruntime_ENABLE_NVTX_PROFILE=OFF -Donnxruntime_ENABLE_TRAINING=OFF -Donnxruntime_ENABLE_TRAINING_OPS=OFF -Donnxruntime_ENABLE_TRAINING_APIS=OFF -Donnxruntime_ENABLE_CPU_FP16_OPS=OFF -Donnxruntime_USE_NCCL=OFF -Donnxruntime_BUILD_BENCHMARKS=OFF -Donnxruntime_USE_ROCM=OFF -DOnnxruntime_GCOV_COVERAGE=OFF -Donnxruntime_USE_MPI=OFF -Donnxruntime_ENABLE_MEMORY_PROFILE=OFF -Donnxruntime_ENABLE_CUDA_LINE_NUMBER_INFO=OFF -Donnxruntime_USE_CUDA_NHWC_OPS=OFF -Donnxruntime_BUILD_WEBASSEMBLY_STATIC_LIB=OFF -Donnxruntime_ENABLE_WEBASSEMBLY_EXCEPTION_CATCHING=ON -Donnxruntime_ENABLE_WEBASSEMBLY_API_EXCEPTION_CATCHING=OFF -Donnxruntime_ENABLE_WEBASSEMBLY_EXCEPTION_THROWING=ON -Donnxruntime_WEBASSEMBLY_RUN_TESTS_IN_BROWSER=OFF -Donnxruntime_ENABLE_WEBASSEMBLY_THREADS=OFF -Donnxruntime_ENABLE_WEBASSEMBLY_DEBUG_INFO=OFF -Donnxruntime_ENABLE_WEBASSEMBLY_PROFILING=OFF -Donnxruntime_ENABLE_LAZY_TENSOR=OFF -Donnxruntime_ENABLE_EXTERNAL_CUSTOM_OP_SCHEMAS=OFF -Donnxruntime_ENABLE_CUDA_PROFILING=OFF -Donnxruntime_ENABLE_ROCM_PROFILING=OFF -Donnxruntime_USE_XNNPACK=OFF -Donnxruntime_USE_WEBNN=OFF -Donnxruntime_USE_CANN=OFF -Donnxruntime_USE_TRITON_KERNEL=OFF -Donnxruntime_DISABLE_FLOAT8_TYPES=ON -Donnxruntime_DISABLE_SPARSE_TENSORS=OFF -Donnxruntime_DISABLE_OPTIONAL_TYPE=OFF -DCMAKE_TLS_VERIFY=ON -DFETCHCONTENT_QUIET=OFF -DCMAKE_BUILD_TYPE=RelWithDebInfo -DCMAKE_PREFIX_PATH=/home/rock/temp/onnxruntime/build/Linux/RelWithDebInfo/installed Ignoring COMPILE_WARNING_AS_ERROR target property and CMAKE_COMPILE_WARNING_AS_ERROR variable. CMake Deprecation Warning at CMakeLists.txt:14 (cmake_policy): The OLD behavior for policy CMP0104 will be removed from a future version of CMake. The cmake-policies(7) manual explains that the OLD behaviors of all policies are deprecated and that a policy should be set to OLD only under specific short-term circumstances. Projects should be ported to the NEW behavior and not rely on setting a policy to OLD. CMake Warning (dev) at CMakeLists.txt:55 (include): Policy CMP0145 is not set: The Dart and FindDart modules are removed. Run "cmake --help-policy CMP0145" for policy details. Use the cmake_policy command to set the policy and suppress this warning. This warning is for project developers. Use -Wno-dev to suppress it. CMake Warning (dev) at /home/rock/.local/lib/python3.8/site-packages/cmake/data/share/cmake-3.28/Modules/Dart.cmake:47 (message): Policy CMP0145 is not set: The Dart and FindDart modules are removed. Run "cmake --help-policy CMP0145" for policy details. Use the cmake_policy command to set the policy and suppress this warning. Call Stack (most recent call first): CMakeLists.txt:55 (include) This warning is for project developers. Use -Wno-dev to suppress it. CMake Warning (dev) at /home/rock/.local/lib/python3.8/site-packages/cmake/data/share/cmake-3.28/Modules/Dart.cmake:57 (find_package): Policy CMP0144 is not set: find_package uses upper-case <PACKAGENAME>_ROOT variables. Run "cmake --help-policy CMP0144" for policy details. Use the cmake_policy command to set the policy and suppress this warning. CMake variable DART_ROOT is set to: DART_ROOT-NOTFOUND For compatibility, find_package is ignoring the variable, but code in a .cmake module might still use it. Call Stack (most recent call first): CMakeLists.txt:55 (include) This warning is for project developers. Use -Wno-dev to suppress it. F16C instruction set is not supported. FMA instruction set is not supported. AVX instruction set is not supported. One or more AVX/F16C instruction flags are not supported. Building ONNX Runtime for aarch64 CPU ARCH Patch found: /usr/bin/patch Loading Dependencies URLs ... Loading Dependencies ... -- Populating abseil_cpp -- Configuring done (0.1s) -- Generating done (0.0s) -- Build files have been written to: /home/rock/temp/onnxruntime/build/Linux/RelWithDebInfo/_deps/abseil_cpp-subbuild [100%] Built target abseil_cpp-populate -- Abseil source dir:/home/rock/temp/onnxruntime/build/Linux/RelWithDebInfo/_deps/abseil_cpp-src -- Populating date -- Configuring done (0.1s) -- Generating done (0.0s) -- Build files have been written to: /home/rock/temp/onnxruntime/build/Linux/RelWithDebInfo/_deps/date-subbuild [100%] Built target date-populate -- Populating google_nsync -- Configuring done (0.1s) -- Generating done (0.0s) -- Build files have been written to: /home/rock/temp/onnxruntime/build/Linux/RelWithDebInfo/_deps/google_nsync-subbuild [100%] Built target google_nsync-populate CMake Deprecation Warning at /home/rock/temp/onnxruntime/build/Linux/RelWithDebInfo/_deps/google_nsync-src/CMakeLists.txt:1 (cmake_minimum_required): Compatibility with CMake < 3.5 will be removed from a future version of CMake. Update the VERSION argument <min> value or use a ...<max> suffix to tell CMake that the project does not need compatibility with older versions. -- Populating safeint -- Configuring done (0.1s) -- Generating done (0.0s) -- Build files have been written to: /home/rock/temp/onnxruntime/build/Linux/RelWithDebInfo/_deps/safeint-subbuild [100%] Built target safeint-populate -- Populating utf8_range -- Configuring done (0.1s) -- Generating done (0.0s) -- Build files have been written to: /home/rock/temp/onnxruntime/build/Linux/RelWithDebInfo/_deps/utf8_range-subbuild [100%] Built target utf8_range-populate -- Populating protobuf -- Configuring done (0.1s) -- Generating done (0.0s) -- Build files have been written to: /home/rock/temp/onnxruntime/build/Linux/RelWithDebInfo/_deps/protobuf-subbuild [100%] Built target protobuf-populate -- -- 3.21.12.0 -- Populating nlohmann_json -- Configuring done (0.1s) -- Generating done (0.0s) -- Build files have been written to: /home/rock/temp/onnxruntime/build/Linux/RelWithDebInfo/_deps/nlohmann_json-subbuild [100%] Built target nlohmann_json-populate CMake Deprecation Warning at /home/rock/temp/onnxruntime/build/Linux/RelWithDebInfo/_deps/nlohmann_json-src/CMakeLists.txt:1 (cmake_minimum_required): Compatibility with CMake < 3.5 will be removed from a future version of CMake. Update the VERSION argument <min> value or use a ...<max> suffix to tell CMake that the project does not need compatibility with older versions. -- Using the single-header code from /home/rock/temp/onnxruntime/build/Linux/RelWithDebInfo/_deps/nlohmann_json-src/single_include/ -- Populating mp11 -- Configuring done (0.1s) -- Generating done (0.0s) -- Build files have been written to: /home/rock/temp/onnxruntime/build/Linux/RelWithDebInfo/_deps/mp11-subbuild [100%] Built target mp11-populate -- Populating re2 -- Configuring done (0.1s) -- Generating done (0.0s) -- Build files have been written to: /home/rock/temp/onnxruntime/build/Linux/RelWithDebInfo/_deps/re2-subbuild [100%] Built target re2-populate -- Populating gsl -- Configuring done (0.1s) -- Generating done (0.0s) -- Build files have been written to: /home/rock/temp/onnxruntime/build/Linux/RelWithDebInfo/_deps/gsl-subbuild [100%] Built target gsl-populate -- Populating flatbuffers -- Configuring done (0.1s) -- Generating done (0.0s) -- Build files have been written to: /home/rock/temp/onnxruntime/build/Linux/RelWithDebInfo/_deps/flatbuffers-subbuild [100%] Built target flatbuffers-populate CMake Deprecation Warning at /home/rock/temp/onnxruntime/build/Linux/RelWithDebInfo/_deps/flatbuffers-src/CMakeLists.txt:1 (cmake_minimum_required): Compatibility with CMake < 3.5 will be removed from a future version of CMake. Update the VERSION argument <min> value or use a ...<max> suffix to tell CMake that the project does not need compatibility with older versions. -- Populating pytorch_cpuinfo -- Configuring done (0.1s) -- Generating done (0.0s) -- Build files have been written to: /home/rock/temp/onnxruntime/build/Linux/RelWithDebInfo/_deps/pytorch_cpuinfo-subbuild [100%] Built target pytorch_cpuinfo-populate -- Populating pytorch_clog -- Configuring done (0.1s) -- Generating done (0.0s) -- Build files have been written to: /home/rock/temp/onnxruntime/build/Linux/RelWithDebInfo/_deps/pytorch_clog-subbuild [100%] Built target pytorch_clog-populate CMake Deprecation Warning at /home/rock/temp/onnxruntime/build/Linux/RelWithDebInfo/_deps/pytorch_clog-src/deps/clog/CMakeLists.txt:1 (CMAKE_MINIMUM_REQUIRED): Compatibility with CMake < 3.5 will be removed from a future version of CMake. Update the VERSION argument <min> value or use a ...<max> suffix to tell CMake that the project does not need compatibility with older versions. -- Populating googletest -- Configuring done (0.1s) -- Generating done (0.0s) -- Build files have been written to: /home/rock/temp/onnxruntime/build/Linux/RelWithDebInfo/_deps/googletest-subbuild [100%] Built target googletest-populate -- Populating eigen -- Configuring done (0.1s) -- Generating done (0.0s) -- Build files have been written to: /home/rock/temp/onnxruntime/build/Linux/RelWithDebInfo/_deps/eigen-subbuild [100%] Built target eigen-populate -- Populating onnx -- Configuring done (0.1s) -- Generating done (0.0s) -- Build files have been written to: /home/rock/temp/onnxruntime/build/Linux/RelWithDebInfo/_deps/onnx-subbuild [100%] Built target onnx-populate CMake Deprecation Warning at /home/rock/temp/onnxruntime/build/Linux/RelWithDebInfo/_deps/onnx-src/CMakeLists.txt:2 (cmake_minimum_required): Compatibility with CMake < 3.5 will be removed from a future version of CMake. Update the VERSION argument <min> value or use a ...<max> suffix to tell CMake that the project does not need compatibility with older versions. CMake Warning (dev) at /home/rock/temp/onnxruntime/build/Linux/RelWithDebInfo/_deps/onnx-src/CMakeLists.txt:112 (find_package): Policy CMP0148 is not set: The FindPythonInterp and FindPythonLibs modules are removed. Run "cmake --help-policy CMP0148" for policy details. Use the cmake_policy command to set the policy and suppress this warning. This warning is for project developers. Use -Wno-dev to suppress it. Generated: /home/rock/temp/onnxruntime/build/Linux/RelWithDebInfo/_deps/onnx-build/onnx/onnx-ml.proto Generated: /home/rock/temp/onnxruntime/build/Linux/RelWithDebInfo/_deps/onnx-build/onnx/onnx-operators-ml.proto Generated: /home/rock/temp/onnxruntime/build/Linux/RelWithDebInfo/_deps/onnx-build/onnx/onnx-data.proto -- -- ******** Summary ******** -- CMake version : 3.28.3 -- CMake command : /home/rock/.local/lib/python3.8/site-packages/cmake/data/bin/cmake -- System : Linux -- C++ compiler : /usr/bin/c++ -- C++ compiler version : 9.4.0 -- CXX flags : -ffunction-sections -fdata-sections -Wno-restrict -DCPUINFO_SUPPORTED -Wnon-virtual-dtor -- Build type : RelWithDebInfo -- Compile definitions : ORT_ENABLE_STREAM;EIGEN_MPL2_ONLY;_GNU_SOURCE;__STDC_FORMAT_MACROS -- CMAKE_PREFIX_PATH : /home/rock/temp/onnxruntime/build/Linux/RelWithDebInfo/installed -- CMAKE_INSTALL_PREFIX : /usr/local -- CMAKE_MODULE_PATH : /home/rock/temp/onnxruntime/cmake/external -- -- ONNX version : 1.15.0 -- ONNX NAMESPACE : onnx -- ONNX_USE_LITE_PROTO : ON -- USE_PROTOBUF_SHARED_LIBS : OFF -- Protobuf_USE_STATIC_LIBS : ON -- ONNX_DISABLE_EXCEPTIONS : OFF -- ONNX_DISABLE_STATIC_REGISTRATION : OFF -- ONNX_WERROR : OFF -- ONNX_BUILD_TESTS : OFF -- ONNX_BUILD_BENCHMARKS : OFF -- ONNX_BUILD_SHARED_LIBS : -- BUILD_SHARED_LIBS : OFF -- -- Protobuf compiler : -- Protobuf includes : -- Protobuf libraries : -- BUILD_ONNX_PYTHON : OFF Finished fetching external dependencies NVCC_ERROR = NVCC_OUT = No such file or directory CMake Error at CMakeLists.txt:659 (message): The compiler doesn't support BFLOAT16!!! -- Configuring incomplete, errors occurred! Traceback (most recent call last): File "/home/rock/temp/onnxruntime/tools/ci_build/build.py", line 2914, in <module> sys.exit(main()) File "/home/rock/temp/onnxruntime/tools/ci_build/build.py", line 2771, in main generate_build_tree( File "/home/rock/temp/onnxruntime/tools/ci_build/build.py", line 1635, in generate_build_tree run_subprocess( File "/home/rock/temp/onnxruntime/tools/ci_build/build.py", line 850, in run_subprocess return run(*args, cwd=cwd, capture_stdout=capture_stdout, shell=shell, env=my_env) File "/home/rock/temp/onnxruntime/tools/python/util/run.py", line 49, in run completed_process = subprocess.run( File "/usr/lib/python3.8/subprocess.py", line 516, in run raise CalledProcessError(retcode, process.args, subprocess.CalledProcessError: Command '['/home/rock/.local/bin/cmake', '/home/rock/temp/onnxruntime/cmake', '--compile-no-warning-as-error', '-Donnxruntime_RUN_ONNX_TESTS=OFF', '-Donnxruntime_GENERATE_TEST_REPORTS=ON', '-DPython_EXECUTABLE=/usr/bin/python3', '-DPYTHON_EXECUTABLE=/usr/bin/python3', '-Donnxruntime_USE_MIMALLOC=OFF', '-Donnxruntime_ENABLE_PYTHON=OFF', '-Donnxruntime_BUILD_CSHARP=OFF', '-Donnxruntime_BUILD_JAVA=OFF', '-Donnxruntime_BUILD_NODEJS=OFF', '-Donnxruntime_BUILD_OBJC=OFF', '-Donnxruntime_BUILD_SHARED_LIB=ON', '-Donnxruntime_BUILD_APPLE_FRAMEWORK=OFF', '-Donnxruntime_USE_DNNL=OFF', '-Donnxruntime_USE_NNAPI_BUILTIN=OFF', '-Donnxruntime_USE_RKNPU=OFF', '-Donnxruntime_USE_LLVM=OFF', '-Donnxruntime_ENABLE_MICROSOFT_INTERNAL=OFF', '-Donnxruntime_USE_VITISAI=OFF', '-Donnxruntime_USE_TENSORRT=OFF', '-Donnxruntime_USE_TENSORRT_BUILTIN_PARSER=ON', '-Donnxruntime_USE_TVM=OFF', '-Donnxruntime_TVM_CUDA_RUNTIME=OFF', '-Donnxruntime_TVM_USE_HASH=OFF', '-Donnxruntime_USE_MIGRAPHX=OFF', '-Donnxruntime_DISABLE_CONTRIB_OPS=OFF', '-Donnxruntime_DISABLE_ML_OPS=OFF', '-Donnxruntime_DISABLE_RTTI=OFF', '-Donnxruntime_DISABLE_EXCEPTIONS=OFF', '-Donnxruntime_MINIMAL_BUILD=OFF', '-Donnxruntime_EXTENDED_MINIMAL_BUILD=OFF', '-Donnxruntime_MINIMAL_BUILD_CUSTOM_OPS=OFF', '-Donnxruntime_REDUCED_OPS_BUILD=OFF', '-Donnxruntime_ENABLE_LANGUAGE_INTEROP_OPS=OFF', '-Donnxruntime_USE_DML=OFF', '-Donnxruntime_USE_WINML=OFF', '-Donnxruntime_BUILD_MS_EXPERIMENTAL_OPS=OFF', '-Donnxruntime_USE_TELEMETRY=OFF', '-Donnxruntime_ENABLE_LTO=OFF', '-Donnxruntime_USE_ACL=OFF', '-Donnxruntime_USE_ACL_1902=OFF', '-Donnxruntime_USE_ACL_1905=OFF', '-Donnxruntime_USE_ACL_1908=OFF', '-Donnxruntime_USE_ACL_2002=OFF', '-Donnxruntime_USE_ACL_2308=OFF', '-Donnxruntime_USE_ARMNN=ON', '-Donnxruntime_ARMNN_RELU_USE_CPU=OFF', '-Donnxruntime_ARMNN_BN_USE_CPU=OFF', '-Donnxruntime_USE_JSEP=OFF', '-Donnxruntime_ENABLE_NVTX_PROFILE=OFF', '-Donnxruntime_ENABLE_TRAINING=OFF', '-Donnxruntime_ENABLE_TRAINING_OPS=OFF', '-Donnxruntime_ENABLE_TRAINING_APIS=OFF', '-Donnxruntime_ENABLE_CPU_FP16_OPS=OFF', '-Donnxruntime_USE_NCCL=OFF', '-Donnxruntime_BUILD_BENCHMARKS=OFF', '-Donnxruntime_USE_ROCM=OFF', '-DOnnxruntime_GCOV_COVERAGE=OFF', '-Donnxruntime_USE_MPI=OFF', '-Donnxruntime_ENABLE_MEMORY_PROFILE=OFF', '-Donnxruntime_ENABLE_CUDA_LINE_NUMBER_INFO=OFF', '-Donnxruntime_USE_CUDA_NHWC_OPS=OFF', '-Donnxruntime_BUILD_WEBASSEMBLY_STATIC_LIB=OFF', '-Donnxruntime_ENABLE_WEBASSEMBLY_EXCEPTION_CATCHING=ON', '-Donnxruntime_ENABLE_WEBASSEMBLY_API_EXCEPTION_CATCHING=OFF', '-Donnxruntime_ENABLE_WEBASSEMBLY_EXCEPTION_THROWING=ON', '-Donnxruntime_WEBASSEMBLY_RUN_TESTS_IN_BROWSER=OFF', '-Donnxruntime_ENABLE_WEBASSEMBLY_THREADS=OFF', '-Donnxruntime_ENABLE_WEBASSEMBLY_DEBUG_INFO=OFF', '-Donnxruntime_ENABLE_WEBASSEMBLY_PROFILING=OFF', '-Donnxruntime_ENABLE_LAZY_TENSOR=OFF', '-Donnxruntime_ENABLE_EXTERNAL_CUSTOM_OP_SCHEMAS=OFF', '-Donnxruntime_ENABLE_CUDA_PROFILING=OFF', '-Donnxruntime_ENABLE_ROCM_PROFILING=OFF', '-Donnxruntime_USE_XNNPACK=OFF', '-Donnxruntime_USE_WEBNN=OFF', '-Donnxruntime_USE_CANN=OFF', '-Donnxruntime_USE_TRITON_KERNEL=OFF', '-Donnxruntime_DISABLE_FLOAT8_TYPES=ON', '-Donnxruntime_DISABLE_SPARSE_TENSORS=OFF', '-Donnxruntime_DISABLE_OPTIONAL_TYPE=OFF', '-DCMAKE_TLS_VERIFY=ON', '-DFETCHCONTENT_QUIET=OFF', '-DCMAKE_BUILD_TYPE=RelWithDebInfo', '-DCMAKE_PREFIX_PATH=/home/rock/temp/onnxruntime/build/Linux/RelWithDebInfo/installed']' returned non-zero exit status 1. ``` gcc type compatibility is as follows: ``` g++ example.cpp -march=armv8.2-a+bf16 cc1plus: error: invalid feature modifier ‘bf16’ in ‘-march=armv8.2-a+bf16’ cc1plus: note: valid arguments are: fp simd crypto crc lse fp16 rcpc rdma dotprod aes sha2 sha3 sm4 fp16fml sve profile rng memtag sb ssbs predres; ``` ### Visual Studio Version n/a ### GCC / Compiler Version Ubuntu 9.4.0-1ubuntu1~20.04.2

Thanks.

system · January 29, 2025, 6:16am

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.

Topic		Replies	Views
Build onnxruntime v1.19.2 for Jetpack 5.1.4 L4T 35.6 Faild Jetson Orin Nano onnx	11	387	January 30, 2025
The compiler doesn't support BFLOAT16! on Jetson Nano Jetson Nano tensorrt , cudnn , onnx	2	103	April 7, 2025
How to install onnx on jetson nano jetpack 4.6.1 Jetson Nano onnx	7	1496	July 30, 2024
Issues while installing onnx==1.6.0 Jetson Nano onnx	4	3309	October 18, 2021
problem with installing ONNX on jetson nano Jetson Nano	13	16693	October 14, 2021
Install onnxruntime on Jetson Xavier NX Jetson AGX Xavier onnx	2	4722	October 3, 2021
Install Onnxruntime with JetPack 4.4 on AGX Jetson AGX Xavier onnx	3	1899	October 18, 2021
Getting error as ERROR: Failed building wheel for onnx Jetson Orin Nano python	10	13960	November 10, 2023
Can not Install ONNX==1.4.1 on Jetson Xavier Jetson AGX Xavier onnx	9	3691	March 23, 2022
Installing ONNX library on my Jetson Xavier Jetson AGX Xavier	13	6389	October 18, 2021

Onnxruntime wrong GLIBCXX version

Related topics