Unable to run tensorRT on DRIVE OS 6.0

aastudil · April 2, 2025, 11:27am

Please provide the following info (tick the boxes after creating this topic):
Software Version
DRIVE OS 6.0.10.0
DRIVE OS 6.0.8.1
DRIVE OS 6.0.6
DRIVE OS 6.0.5
DRIVE OS 6.0.4 (rev. 1)
DRIVE OS 6.0.4 SDK
other

Target Operating System
Linux
QNX
other

Hardware Platform
DRIVE AGX Orin Developer Kit (940-63710-0010-300)
DRIVE AGX Orin Developer Kit (940-63710-0010-200)
DRIVE AGX Orin Developer Kit (940-63710-0010-100)
DRIVE AGX Orin Developer Kit (940-63710-0010-D00)
DRIVE AGX Orin Developer Kit (940-63710-0010-C00)
DRIVE AGX Orin Developer Kit (not sure its number)
other

SDK Manager Version
2.1.0
other

Host Machine Version
native Ubuntu Linux 20.04 Host installed with SDK Manager
native Ubuntu Linux 20.04 Host installed with DRIVE OS Docker Containers
native Ubuntu Linux 18.04 Host installed with DRIVE OS Docker Containers
other

Issue Description
Hello Nvidia Team,
I am trying to compile some cpp packages that uses tensorRT libraries.

Engine Generation Success:

Successfully created .engine file using trtexec (see image below)

trtexec_onnx_ok1190×344 73.1 KB
Verification: Engine runs correctly with trtexec --loadEngine=model.engine (see image below)

trtexec_engine_ok1184×316 69.1 KB

Compilation Failure - Missing Components:
Expected structure in /usr/src/tensorrt:

bin/ # For utilities
lib/ # For shared libraries
samples/ # Example code
include/ # Headers (NvInfer.h, etc.)

On my custom cpp package: NvInfer.h not found (see image below) even though the LD_LIBRARY_PATH is correct.

Attempted Workarounds:

Copied samples/ directory from another machine
Tried compiling with:
sudo make TARGET=aarch64
Result: Same NvInfer.h not found error (see image below)

trt_samples_error1190×490 89.1 KB

Key Questions:

Is there a different package needed to get the full TensorRT development environment on DRIVE OS?
What’s the recommended way to:
– Locate the correct headers/libraries for compilation?
– Set up the build system properly for compiling on target machine (DRIVE)?

ldconfig -p | grep nvinfer

ldconfig -p | grep nvinfer
	libnvinfer_vc_plugin.so.8 (libc6,AArch64) => /lib/aarch64-linux-gnu/libnvinfer_vc_plugin.so.8
	libnvinfer_plugin.so.8 (libc6,AArch64) => /lib/aarch64-linux-gnu/libnvinfer_plugin.so.8
	libnvinfer_lean.so.8 (libc6,AArch64) => /lib/aarch64-linux-gnu/libnvinfer_lean.so.8
	libnvinfer_dispatch.so.8 (libc6,AArch64) => /lib/aarch64-linux-gnu/libnvinfer_dispatch.so.8
	libnvinfer.so.8 (libc6,AArch64) => /lib/aarch64-linux-gnu/libnvinfer.so.8
	do_not_link_against_nvinfer_builder_resource (libc6,AArch64) => /lib/aarch64-linux-gnu/do_not_link_against_nvinfer_builder_resource

echo $LD_LIBRARY_PATH

echo $LD_LIBRARY_PATH
/lib/aarch64-linux-gnu/:/usr/src/tensorrt/:

SivaRamaKrishnaNV · April 3, 2025, 5:37am

Did you run this on target or docker? You need to run this on docker container. it worked out of the box from me on docker

root@6.0.10.0-0009-build-linux-sdk:/usr/src/tensorrt/samples# make TARGET=aarch64
make[1]: Entering directory '/usr/src/tensorrt/samples/sampleAlgorithmSelector'
../Makefile.config:15: CUDA_INSTALL_DIR variable is not specified, using /usr/local/cuda by default, use CUDA_INSTALL_DIR=<cuda_directory> to change. fsync-groups {
../Makefile.config:20: CUDNN_INSTALL_DIR variable is not specified, using /usr/local/cuda by default, use CUDNN_INSTALL_DIR=<cudnn_directory> to change.      fsync-group@0 {
../Makefile.config:40: TRT_LIB_DIR is not specified, searching ../../lib, ../../lib, ../lib by default, use TRT_LIB_DIR=<trt_lib_directory> to change.                status = "okay";
../Makefile.config:45: PROTOBUF_INSTALL_DIR variable is not specified, use PROTOBUF_INSTALL_DIR=<protobuf_directory> to change. Using default value: /usr/lib/x86_64-linux-gnu
if [ ! -d ../../bin/dchobj/sampleAlgorithmSelector/sampleAlgorithmSelector ]; then mkdir -p ../../bin/dchobj/sampleAlgorithmSelector/sampleAlgorithmSelector; fi      id = <1>;
if [ ! -d ../../bin/chobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common ]; then mkdir -p ../../bin/dchobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common; fi && :1>;
aarch64-linux-gnu-g++ -MM -MF ../../bin/dchobj/sampleAlgorithmSelector/sampleAlgorithmSelector/sampleAlgorithmSelector.d -MP -MT ../../bin/dchobj/sampleAlgorithmSelector/sampleAlgorithmSelector/sampleAlgorithmSelector.o -Wall -Wno-deprecated-declarations -std=c++14  -I"/usr/include/aarch64-linux-gnu" -I"/usr/include/aarch64-linux-gnu" -I"/usr/local/cuda/targets/aarch64-linux/include" -I"../common" -I"/usr/local/cuda/include" -I"/usr/local/cuda/include" -I"../include" -I"../../include" -I"../../parsers/onnxOpenSource" -D_REENTRANT -DTRT_STATIC=0 sampleAlgorithmSelector.cpp
Compiling: sampleAlgorithmSelector.cppvsciipc";
aarch64-linux-gnu-g++ -Wall -Wno-deprecated-declarations -std=c++14  -I"/usr/include/aarch64-linux-gnu" -I"/usr/include/aarch64-linux-gnu" -I"/usr/local/cuda/targets/aarch64-linux/include" -I"../common" -I"/usr/local/cuda/include" -I"/usr/local/cuda/include" -I"../include" -I"../../include" -I"../../parsers/onnxOpenSource" -D_REENTRANT -DTRT_STATIC=0 -g -c -o ../../bin/dchobj/sampleAlgorithmSelector/sampleAlgorithmSelector/sampleAlgorithmSelector.o sampleAlgorithmSelector.cpp
if [ ! -d ../../bin/dchobj/sampleAlgorithmSelector/sampleAlgorithmSelector ]; then mkdir -p ../../bin/dchobj/sampleAlgorithmSelector/sampleAlgorithmSelector; fi
if [ ! -d ../../bin/chobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common ]; then mkdir -p ../../bin/dchobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common; fi && :
aarch64-linux-gnu-g++ -MM -MF ../../bin/dchobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common/sampleInference.d -MP -MT ../../bin/dchobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common/sampleInference.o -Wall -Wno-deprecated-declarations -std=c++14  -I"/usr/include/aarch64-linux-gnu" -I"/usr/include/aarch64-linux-gnu" -I"/usr/local/cuda/targets/aarch64-linux/include" -I"../common" -I"/usr/local/cuda/include" -I"/usr/local/cuda/include" -I"../include" -I"../../include" -I"../../parsers/onnxOpenSource" -D_REENTRANT -DTRT_STATIC=0 ../common/sampleInference.cpp
Compiling: ../common/sampleInference.cpp
aarch64-linux-gnu-g++ -Wall -Wno-deprecated-declarations -std=c++14  -I"/usr/include/aarch64-linux-gnu" -I"/usr/include/aarch64-linux-gnu" -I"/usr/local/cuda/targets/aarch64-linux/include" -I"../common" -I"/usr/local/cuda/include" -I"/usr/local/cuda/include" -I"../include" -I"../../include" -I"../../parsers/onnxOpenSource" -D_REENTRANT -DTRT_STATIC=0 -g -c -o ../../bin/dchobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common/sampleInference.o ../common/sampleInference.cpp
if [ ! -d ../../bin/dchobj/sampleAlgorithmSelector/sampleAlgorithmSelector ]; then mkdir -p ../../bin/dchobj/sampleAlgorithmSelector/sampleAlgorithmSelector; fi
if [ ! -d ../../bin/chobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common ]; then mkdir -p ../../bin/dchobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common; fi && :
aarch64-linux-gnu-g++ -MM -MF ../../bin/dchobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common/sampleUtils.d -MP -MT ../../bin/dchobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common/sampleUtils.o -Wall -Wno-deprecated-declarations -std=c++14  -I"/usr/include/aarch64-linux-gnu" -I"/usr/include/aarch64-linux-gnu" -I"/usr/local/cuda/targets/aarch64-linux/include" -I"../common" -I"/usr/local/cuda/include" -I"/usr/local/cuda/include" -I"../include" -I"../../include" -I"../../parsers/onnxOpenSource" -D_REENTRANT -DTRT_STATIC=0 ../common/sampleUtils.cpp
Compiling: ../common/sampleUtils.cpp
aarch64-linux-gnu-g++ -Wall -Wno-deprecated-declarations -std=c++14  -I"/usr/include/aarch64-linux-gnu" -I"/usr/include/aarch64-linux-gnu" -I"/usr/local/cuda/targets/aarch64-linux/include" -I"../common" -I"/usr/local/cuda/include" -I"/usr/local/cuda/include" -I"../include" -I"../../include" -I"../../parsers/onnxOpenSource" -D_REENTRANT -DTRT_STATIC=0 -g -c -o ../../bin/dchobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common/sampleUtils.o ../common/sampleUtils.cpp
if [ ! -d ../../bin/dchobj/sampleAlgorithmSelector/sampleAlgorithmSelector ]; then mkdir -p ../../bin/dchobj/sampleAlgorithmSelector/sampleAlgorithmSelector; fi
if [ ! -d ../../bin/chobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common ]; then mkdir -p ../../bin/dchobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common; fi && :
aarch64-linux-gnu-g++ -MM -MF ../../bin/dchobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common/sampleOptions.d -MP -MT ../../bin/dchobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common/sampleOptions.o -Wall -Wno-deprecated-declarations -std=c++14  -I"/usr/include/aarch64-linux-gnu" -I"/usr/include/aarch64-linux-gnu" -I"/usr/local/cuda/targets/aarch64-linux/include" -I"../common" -I"/usr/local/cuda/include" -I"/usr/local/cuda/include" -I"../include" -I"../../include" -I"../../parsers/onnxOpenSource" -D_REENTRANT -DTRT_STATIC=0 ../common/sampleOptions.cpp
Compiling: ../common/sampleOptions.cpp
aarch64-linux-gnu-g++ -Wall -Wno-deprecated-declarations -std=c++14  -I"/usr/include/aarch64-linux-gnu" -I"/usr/include/aarch64-linux-gnu" -I"/usr/local/cuda/targets/aarch64-linux/include" -I"../common" -I"/usr/local/cuda/include" -I"/usr/local/cuda/include" -I"../include" -I"../../include" -I"../../parsers/onnxOpenSource" -D_REENTRANT -DTRT_STATIC=0 -g -c -o ../../bin/dchobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common/sampleOptions.o ../common/sampleOptions.cpp
if [ ! -d ../../bin/dchobj/sampleAlgorithmSelector/sampleAlgorithmSelector ]; then mkdir -p ../../bin/dchobj/sampleAlgorithmSelector/sampleAlgorithmSelector; fi
if [ ! -d ../../bin/chobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common ]; then mkdir -p ../../bin/dchobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common; fi && :
aarch64-linux-gnu-g++ -MM -MF ../../bin/dchobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common/logger.d -MP -MT ../../bin/dchobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common/logger.o -Wall -Wno-deprecated-declarations -std=c++14  -I"/usr/include/aarch64-linux-gnu" -I"/usr/include/aarch64-linux-gnu" -I"/usr/local/cuda/targets/aarch64-linux/include" -I"../common" -I"/usr/local/cuda/include" -I"/usr/local/cuda/include" -I"../include" -I"../../include" -I"../../parsers/onnxOpenSource" -D_REENTRANT -DTRT_STATIC=0 ../common/logger.cpp
Compiling: ../common/logger.cpp
aarch64-linux-gnu-g++ -Wall -Wno-deprecated-declarations -std=c++14  -I"/usr/include/aarch64-linux-gnu" -I"/usr/include/aarch64-linux-gnu" -I"/usr/local/cuda/targets/aarch64-linux/include" -I"../common" -I"/usr/local/cuda/include" -I"/usr/local/cuda/include" -I"../include" -I"../../include" -I"../../parsers/onnxOpenSource" -D_REENTRANT -DTRT_STATIC=0 -g -c -o ../../bin/dchobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common/logger.o ../common/logger.cpp
if [ ! -d ../../bin/dchobj/sampleAlgorithmSelector/sampleAlgorithmSelector ]; then mkdir -p ../../bin/dchobj/sampleAlgorithmSelector/sampleAlgorithmSelector; fi
if [ ! -d ../../bin/chobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common ]; then mkdir -p ../../bin/dchobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common; fi && :
aarch64-linux-gnu-g++ -MM -MF ../../bin/dchobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common/getOptions.d -MP -MT ../../bin/dchobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common/getOptions.o -Wall -Wno-deprecated-declarations -std=c++14  -I"/usr/include/aarch64-linux-gnu" -I"/usr/include/aarch64-linux-gnu" -I"/usr/local/cuda/targets/aarch64-linux/include" -I"../common" -I"/usr/local/cuda/include" -I"/usr/local/cuda/include" -I"../include" -I"../../include" -I"../../parsers/onnxOpenSource" -D_REENTRANT -DTRT_STATIC=0 ../common/getOptions.cpp
Compiling: ../common/getOptions.cpp
aarch64-linux-gnu-g++ -Wall -Wno-deprecated-declarations -std=c++14  -I"/usr/include/aarch64-linux-gnu" -I"/usr/include/aarch64-linux-gnu" -I"/usr/local/cuda/targets/aarch64-linux/include" -I"../common" -I"/usr/local/cuda/include" -I"/usr/local/cuda/include" -I"../include" -I"../../include" -I"../../parsers/onnxOpenSource" -D_REENTRANT -DTRT_STATIC=0 -g -c -o ../../bin/dchobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common/getOptions.o ../common/getOptions.cpp
if [ ! -d ../../bin/dchobj/sampleAlgorithmSelector/sampleAlgorithmSelector ]; then mkdir -p ../../bin/dchobj/sampleAlgorithmSelector/sampleAlgorithmSelector; fi
if [ ! -d ../../bin/chobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common ]; then mkdir -p ../../bin/dchobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common; fi && :
aarch64-linux-gnu-g++ -MM -MF ../../bin/dchobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common/sampleReporting.d -MP -MT ../../bin/dchobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common/sampleReporting.o -Wall -Wno-deprecated-declarations -std=c++14  -I"/usr/include/aarch64-linux-gnu" -I"/usr/include/aarch64-linux-gnu" -I"/usr/local/cuda/targets/aarch64-linux/include" -I"../common" -I"/usr/local/cuda/include" -I"/usr/local/cuda/include" -I"../include" -I"../../include" -I"../../parsers/onnxOpenSource" -D_REENTRANT -DTRT_STATIC=0 ../common/sampleReporting.cpp
Compiling: ../common/sampleReporting.cpp
aarch64-linux-gnu-g++ -Wall -Wno-deprecated-declarations -std=c++14  -I"/usr/include/aarch64-linux-gnu" -I"/usr/include/aarch64-linux-gnu" -I"/usr/local/cuda/targets/aarch64-linux/include" -I"../common" -I"/usr/local/cuda/include" -I"/usr/local/cuda/include" -I"../include" -I"../../include" -I"../../parsers/onnxOpenSource" -D_REENTRANT -DTRT_STATIC=0 -g -c -o ../../bin/dchobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common/sampleReporting.o ../common/sampleReporting.cpp
if [ ! -d ../../bin/dchobj/sampleAlgorithmSelector/sampleAlgorithmSelector ]; then mkdir -p ../../bin/dchobj/sampleAlgorithmSelector/sampleAlgorithmSelector; fi
if [ ! -d ../../bin/chobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common ]; then mkdir -p ../../bin/dchobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common; fi && :
aarch64-linux-gnu-g++ -MM -MF ../../bin/dchobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common/sampleEngines.d -MP -MT ../../bin/dchobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common/sampleEngines.o -Wall -Wno-deprecated-declarations -std=c++14  -I"/usr/include/aarch64-linux-gnu" -I"/usr/include/aarch64-linux-gnu" -I"/usr/local/cuda/targets/aarch64-linux/include" -I"../common" -I"/usr/local/cuda/include" -I"/usr/local/cuda/include" -I"../include" -I"../../include" -I"../../parsers/onnxOpenSource" -D_REENTRANT -DTRT_STATIC=0 ../common/sampleEngines.cpp
Compiling: ../common/sampleEngines.cpp
aarch64-linux-gnu-g++ -Wall -Wno-deprecated-declarations -std=c++14  -I"/usr/include/aarch64-linux-gnu" -I"/usr/include/aarch64-linux-gnu" -I"/usr/local/cuda/targets/aarch64-linux/include" -I"../common" -I"/usr/local/cuda/include" -I"/usr/local/cuda/include" -I"../include" -I"../../include" -I"../../parsers/onnxOpenSource" -D_REENTRANT -DTRT_STATIC=0 -g -c -o ../../bin/dchobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common/sampleEngines.o ../common/sampleEngines.cpp
Linking: ../../bin/sample_algorithm_selector_debug
aarch64-linux-gnu-g++ -o ../../bin/sample_algorithm_selector_debug  -L"../lib/stubs" -L"../../lib/stubs" -L"/usr/lib/aarch64-linux-gnu/stubs" -L"/usr/lib/aarch64-linux-gnu" -L"/usr/lib/aarch64-linux-gnu/stubs" -L"/usr/lib/aarch64-linux-gnu" -L"/usr/local/cuda/targets/aarch64-linux/lib/stubs" -L"/usr/local/cuda/targets/aarch64-linux/lib" -L"/usr/local/cuda/lib" -Wl,-rpath-link="/usr/local/cuda/lib" -L"/usr/local/cuda/lib64" -Wl,-rpath-link="/usr/local/cuda/lib64" -L"../lib" -L"../../lib" -L"../../lib" -Wl,-rpath-link="../../lib"  -L"/usr/lib/x86_64-linux-gnu/lib" -Wl,-rpath-link="/usr/lib/x86_64-linux-gnu/lib" -L"" -Wl,-rpath-link="" -L../../bin  -Wl,--start-group -lnvinfer -lnvparsers -lnvinfer_plugin -lnvonnxparser -lcudart -lcublas -lcudnn -lrt -ldl -lpthread  ../../bin/dchobj/sampleAlgorithmSelector/sampleAlgorithmSelector/sampleAlgorithmSelector.o ../../bin/dchobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common/sampleInference.o ../../bin/dchobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common/sampleUtils.o ../../bin/dchobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common/sampleOptions.o ../../bin/dchobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common/logger.o ../../bin/dchobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common/getOptions.o ../../bin/dchobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common/sampleReporting.o ../../bin/dchobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common/sampleEngines.o -Wl,--end-group
if [ ! -d ../../bin/chobj/sampleAlgorithmSelector/sampleAlgorithmSelector ]; then mkdir -p ../../bin/chobj/sampleAlgorithmSelector/sampleAlgorithmSelector; fi
if [ ! -d ../../bin/chobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common ]; then mkdir -p ../../bin/chobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common; fi && :
aarch64-linux-gnu-g++ -MM -MF ../../bin/chobj/sampleAlgorithmSelector/sampleAlgorithmSelector/sampleAlgorithmSelector.d -MP -MT ../../bin/chobj/sampleAlgorithmSelector/sampleAlgorithmSelector/sampleAlgorithmSelector.o -Wall -Wno-deprecated-declarations -std=c++14  -I"/usr/include/aarch64-linux-gnu" -I"/usr/include/aarch64-linux-gnu" -I"/usr/local/cuda/targets/aarch64-linux/include" -I"../common" -I"/usr/local/cuda/include" -I"/usr/local/cuda/include" -I"../include" -I"../../include" -I"../../parsers/onnxOpenSource" -D_REENTRANT -DTRT_STATIC=0 sampleAlgorithmSelector.cpp
Compiling: sampleAlgorithmSelector.cpp
aarch64-linux-gnu-g++ -Wall -Wno-deprecated-declarations -std=c++14  -I"/usr/include/aarch64-linux-gnu" -I"/usr/include/aarch64-linux-gnu" -I"/usr/local/cuda/targets/aarch64-linux/include" -I"../common" -I"/usr/local/cuda/include" -I"/usr/local/cuda/include" -I"../include" -I"../../include" -I"../../parsers/onnxOpenSource" -D_REENTRANT -DTRT_STATIC=0 -c -o ../../bin/chobj/sampleAlgorithmSelector/sampleAlgorithmSelector/sampleAlgorithmSelector.o sampleAlgorithmSelector.cpp
if [ ! -d ../../bin/chobj/sampleAlgorithmSelector/sampleAlgorithmSelector ]; then mkdir -p ../../bin/chobj/sampleAlgorithmSelector/sampleAlgorithmSelector; fi
if [ ! -d ../../bin/chobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common ]; then mkdir -p ../../bin/chobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common; fi && :
aarch64-linux-gnu-g++ -MM -MF ../../bin/chobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common/sampleInference.d -MP -MT ../../bin/chobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common/sampleInference.o -Wall -Wno-deprecated-declarations -std=c++14  -I"/usr/include/aarch64-linux-gnu" -I"/usr/include/aarch64-linux-gnu" -I"/usr/local/cuda/targets/aarch64-linux/include" -I"../common" -I"/usr/local/cuda/include" -I"/usr/local/cuda/include" -I"../include" -I"../../include" -I"../../parsers/onnxOpenSource" -D_REENTRANT -DTRT_STATIC=0 ../common/sampleInference.cpp
Compiling: ../common/sampleInference.cpp
aarch64-linux-gnu-g++ -Wall -Wno-deprecated-declarations -std=c++14  -I"/usr/include/aarch64-linux-gnu" -I"/usr/include/aarch64-linux-gnu" -I"/usr/local/cuda/targets/aarch64-linux/include" -I"../common" -I"/usr/local/cuda/include" -I"/usr/local/cuda/include" -I"../include" -I"../../include" -I"../../parsers/onnxOpenSource" -D_REENTRANT -DTRT_STATIC=0 -c -o ../../bin/chobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common/sampleInference.o ../common/sampleInference.cpp
if [ ! -d ../../bin/chobj/sampleAlgorithmSelector/sampleAlgorithmSelector ]; then mkdir -p ../../bin/chobj/sampleAlgorithmSelector/sampleAlgorithmSelector; fi
if [ ! -d ../../bin/chobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common ]; then mkdir -p ../../bin/chobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common; fi && :
aarch64-linux-gnu-g++ -MM -MF ../../bin/chobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common/sampleUtils.d -MP -MT ../../bin/chobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common/sampleUtils.o -Wall -Wno-deprecated-declarations -std=c++14  -I"/usr/include/aarch64-linux-gnu" -I"/usr/include/aarch64-linux-gnu" -I"/usr/local/cuda/targets/aarch64-linux/include" -I"../common" -I"/usr/local/cuda/include" -I"/usr/local/cuda/include" -I"../include" -I"../../include" -I"../../parsers/onnxOpenSource" -D_REENTRANT -DTRT_STATIC=0 ../common/sampleUtils.cpp
Compiling: ../common/sampleUtils.cpp
aarch64-linux-gnu-g++ -Wall -Wno-deprecated-declarations -std=c++14  -I"/usr/include/aarch64-linux-gnu" -I"/usr/include/aarch64-linux-gnu" -I"/usr/local/cuda/targets/aarch64-linux/include" -I"../common" -I"/usr/local/cuda/include" -I"/usr/local/cuda/include" -I"../include" -I"../../include" -I"../../parsers/onnxOpenSource" -D_REENTRANT -DTRT_STATIC=0 -c -o ../../bin/chobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common/sampleUtils.o ../common/sampleUtils.cpp
if [ ! -d ../../bin/chobj/sampleAlgorithmSelector/sampleAlgorithmSelector ]; then mkdir -p ../../bin/chobj/sampleAlgorithmSelector/sampleAlgorithmSelector; fi
if [ ! -d ../../bin/chobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common ]; then mkdir -p ../../bin/chobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common; fi && :
aarch64-linux-gnu-g++ -MM -MF ../../bin/chobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common/sampleOptions.d -MP -MT ../../bin/chobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common/sampleOptions.o -Wall -Wno-deprecated-declarations -std=c++14  -I"/usr/include/aarch64-linux-gnu" -I"/usr/include/aarch64-linux-gnu" -I"/usr/local/cuda/targets/aarch64-linux/include" -I"../common" -I"/usr/local/cuda/include" -I"/usr/local/cuda/include" -I"../include" -I"../../include" -I"../../parsers/onnxOpenSource" -D_REENTRANT -DTRT_STATIC=0 ../common/sampleOptions.cpp
Compiling: ../common/sampleOptions.cpp
aarch64-linux-gnu-g++ -Wall -Wno-deprecated-declarations -std=c++14  -I"/usr/include/aarch64-linux-gnu" -I"/usr/include/aarch64-linux-gnu" -I"/usr/local/cuda/targets/aarch64-linux/include" -I"../common" -I"/usr/local/cuda/include" -I"/usr/local/cuda/include" -I"../include" -I"../../include" -I"../../parsers/onnxOpenSource" -D_REENTRANT -DTRT_STATIC=0 -c -o ../../bin/chobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common/sampleOptions.o ../common/sampleOptions.cpp
if [ ! -d ../../bin/chobj/sampleAlgorithmSelector/sampleAlgorithmSelector ]; then mkdir -p ../../bin/chobj/sampleAlgorithmSelector/sampleAlgorithmSelector; fi
if [ ! -d ../../bin/chobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common ]; then mkdir -p ../../bin/chobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common; fi && :
aarch64-linux-gnu-g++ -MM -MF ../../bin/chobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common/logger.d -MP -MT ../../bin/chobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common/logger.o -Wall -Wno-deprecated-declarations -std=c++14  -I"/usr/include/aarch64-linux-gnu" -I"/usr/include/aarch64-linux-gnu" -I"/usr/local/cuda/targets/aarch64-linux/include" -I"../common" -I"/usr/local/cuda/include" -I"/usr/local/cuda/include" -I"../include" -I"../../include" -I"../../parsers/onnxOpenSource" -D_REENTRANT -DTRT_STATIC=0 ../common/logger.cpp
Compiling: ../common/logger.cpp
aarch64-linux-gnu-g++ -Wall -Wno-deprecated-declarations -std=c++14  -I"/usr/include/aarch64-linux-gnu" -I"/usr/include/aarch64-linux-gnu" -I"/usr/local/cuda/targets/aarch64-linux/include" -I"../common" -I"/usr/local/cuda/include" -I"/usr/local/cuda/include" -I"../include" -I"../../include" -I"../../parsers/onnxOpenSource" -D_REENTRANT -DTRT_STATIC=0 -c -o ../../bin/chobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common/logger.o ../common/logger.cpp
if [ ! -d ../../bin/chobj/sampleAlgorithmSelector/sampleAlgorithmSelector ]; then mkdir -p ../../bin/chobj/sampleAlgorithmSelector/sampleAlgorithmSelector; fi
if [ ! -d ../../bin/chobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common ]; then mkdir -p ../../bin/chobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common; fi && :
aarch64-linux-gnu-g++ -MM -MF ../../bin/chobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common/getOptions.d -MP -MT ../../bin/chobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common/getOptions.o -Wall -Wno-deprecated-declarations -std=c++14  -I"/usr/include/aarch64-linux-gnu" -I"/usr/include/aarch64-linux-gnu" -I"/usr/local/cuda/targets/aarch64-linux/include" -I"../common" -I"/usr/local/cuda/include" -I"/usr/local/cuda/include" -I"../include" -I"../../include" -I"../../parsers/onnxOpenSource" -D_REENTRANT -DTRT_STATIC=0 ../common/getOptions.cpp
Compiling: ../common/getOptions.cpp
aarch64-linux-gnu-g++ -Wall -Wno-deprecated-declarations -std=c++14  -I"/usr/include/aarch64-linux-gnu" -I"/usr/include/aarch64-linux-gnu" -I"/usr/local/cuda/targets/aarch64-linux/include" -I"../common" -I"/usr/local/cuda/include" -I"/usr/local/cuda/include" -I"../include" -I"../../include" -I"../../parsers/onnxOpenSource" -D_REENTRANT -DTRT_STATIC=0 -c -o ../../bin/chobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common/getOptions.o ../common/getOptions.cpp
if [ ! -d ../../bin/chobj/sampleAlgorithmSelector/sampleAlgorithmSelector ]; then mkdir -p ../../bin/chobj/sampleAlgorithmSelector/sampleAlgorithmSelector; fi
if [ ! -d ../../bin/chobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common ]; then mkdir -p ../../bin/chobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common; fi && :
aarch64-linux-gnu-g++ -MM -MF ../../bin/chobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common/sampleReporting.d -MP -MT ../../bin/chobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common/sampleReporting.o -Wall -Wno-deprecated-declarations -std=c++14  -I"/usr/include/aarch64-linux-gnu" -I"/usr/include/aarch64-linux-gnu" -I"/usr/local/cuda/targets/aarch64-linux/include" -I"../common" -I"/usr/local/cuda/include" -I"/usr/local/cuda/include" -I"../include" -I"../../include" -I"../../parsers/onnxOpenSource" -D_REENTRANT -DTRT_STATIC=0 ../common/sampleReporting.cpp
Compiling: ../common/sampleReporting.cpp
aarch64-linux-gnu-g++ -Wall -Wno-deprecated-declarations -std=c++14  -I"/usr/include/aarch64-linux-gnu" -I"/usr/include/aarch64-linux-gnu" -I"/usr/local/cuda/targets/aarch64-linux/include" -I"../common" -I"/usr/local/cuda/include" -I"/usr/local/cuda/include" -I"../include" -I"../../include" -I"../../parsers/onnxOpenSource" -D_REENTRANT -DTRT_STATIC=0 -c -o ../../bin/chobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common/sampleReporting.o ../common/sampleReporting.cpp
if [ ! -d ../../bin/chobj/sampleAlgorithmSelector/sampleAlgorithmSelector ]; then mkdir -p ../../bin/chobj/sampleAlgorithmSelector/sampleAlgorithmSelector; fi
if [ ! -d ../../bin/chobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common ]; then mkdir -p ../../bin/chobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common; fi && :
aarch64-linux-gnu-g++ -MM -MF ../../bin/chobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common/sampleEngines.d -MP -MT ../../bin/chobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common/sampleEngines.o -Wall -Wno-deprecated-declarations -std=c++14  -I"/usr/include/aarch64-linux-gnu" -I"/usr/include/aarch64-linux-gnu" -I"/usr/local/cuda/targets/aarch64-linux/include" -I"../common" -I"/usr/local/cuda/include" -I"/usr/local/cuda/include" -I"../include" -I"../../include" -I"../../parsers/onnxOpenSource" -D_REENTRANT -DTRT_STATIC=0 ../common/sampleEngines.cpp
Compiling: ../common/sampleEngines.cpp
aarch64-linux-gnu-g++ -Wall -Wno-deprecated-declarations -std=c++14  -I"/usr/include/aarch64-linux-gnu" -I"/usr/include/aarch64-linux-gnu" -I"/usr/local/cuda/targets/aarch64-linux/include" -I"../common" -I"/usr/local/cuda/include" -I"/usr/local/cuda/include" -I"../include" -I"../../include" -I"../../parsers/onnxOpenSource" -D_REENTRANT -DTRT_STATIC=0 -c -o ../../bin/chobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common/sampleEngines.o ../common/sampleEngines.cpp
Linking: ../../bin/sample_algorithm_selector
aarch64-linux-gnu-g++ -o ../../bin/sample_algorithm_selector  -L"../lib/stubs" -L"../../lib/stubs" -L"/usr/lib/aarch64-linux-gnu/stubs" -L"/usr/lib/aarch64-linux-gnu" -L"/usr/lib/aarch64-linux-gnu/stubs" -L"/usr/lib/aarch64-linux-gnu" -L"/usr/local/cuda/targets/aarch64-linux/lib/stubs" -L"/usr/local/cuda/targets/aarch64-linux/lib" -L"/usr/local/cuda/lib" -Wl,-rpath-link="/usr/local/cuda/lib" -L"/usr/local/cuda/lib64" -Wl,-rpath-link="/usr/local/cuda/lib64" -L"../lib" -L"../../lib" -L"../../lib" -Wl,-rpath-link="../../lib"  -L"/usr/lib/x86_64-linux-gnu/lib" -Wl,-rpath-link="/usr/lib/x86_64-linux-gnu/lib" -L"" -Wl,-rpath-link="" -L../../bin  -Wl,--start-group -lnvinfer -lnvparsers -lnvinfer_plugin -lnvonnxparser -lcudart -lcublas -lcudnn -lrt -ldl -lpthread  ../../bin/chobj/sampleAlgorithmSelector/sampleAlgorithmSelector/sampleAlgorithmSelector.o ../../bin/chobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common/sampleInference.o ../../bin/chobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common/sampleUtils.o ../../bin/chobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common/sampleOptions.o ../../bin/chobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common/logger.o ../../bin/chobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common/getOptions.o ../../bin/chobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common/sampleReporting.o ../../bin/chobj/sampleAlgorithmSelector/sampleAlgorithmSelector/../common/sampleEngines.o -Wl,--end-group
make[1]: Leaving directory '/usr/src/tensorrt/samples/sampleAlgorithmSelector'
make[1]: Entering directory '/usr/src/tensorrt/samples/sampleCharRNN'
../Makefile.config:15: CUDA_INSTALL_DIR variable is not specified, using /usr/local/cuda by default, use CUDA_INSTALL_DIR=<cuda_directory> to change.
../Makefile.config:20: CUDNN_INSTALL_DIR variable is not specified, using /usr/local/cuda by default, use CUDNN_INSTALL_DIR=<cudnn_directory> to change.
../Makefile.config:40: TRT_LIB_DIR is not specified, searching ../../lib, ../../lib, ../lib by default, use TRT_LIB_DIR=<trt_lib_directory> to change.
../Makefile.config:45: PROTOBUF_INSTALL_DIR variable is not specified, use PROTOBUF_INSTALL_DIR=<protobuf_directory> to change. Using default value: /usr/lib/x86_64-linux-gnu
if [ ! -d ../../bin/dchobj/sampleCharRNN/sampleCharRNN ]; then mkdir -p ../../bin/dchobj/sampleCharRNN/sampleCharRNN; fi
if [ ! -d ../../bin/chobj/sampleCharRNN/sampleCharRNN/../common ]; then mkdir -p ../../bin/dchobj/sampleCharRNN/sampleCharRNN/../common; fi && :
aarch64-linux-gnu-g++ -MM -MF ../../bin/dchobj/sampleCharRNN/sampleCharRNN/sampleCharRNN.d -MP -MT ../../bin/dchobj/sampleCharRNN/sampleCharRNN/sampleCharRNN.o -Wall -Wno-deprecated-declarations -std=c++14  -I"/usr/include/aarch64-linux-gnu" -I"/usr/include/aarch64-linux-gnu" -I"/usr/local/cuda/targets/aarch64-linux/include" -I"../common" -I"/usr/local/cuda/include" -I"/usr/local/cuda/include" -I"../include" -I"../../include" -I"../../parsers/onnxOpenSource" -D_REENTRANT -DTRT_STATIC=0 sampleCharRNN.cpp
Compiling: sampleCharRNN.cpp
aarch64-linux-gnu-g++ -Wall -Wno-deprecated-declarations -std=c++14  -I"/usr/include/aarch64-linux-gnu" -I"/usr/include/aarch64-linux-gnu" -I"/usr/local/cuda/targets/aarch64-linux/include" -I"../common" -I"/usr/local/cuda/include" -I"/usr/local/cuda/include" -I"../include" -I"../../include" -I"../../parsers/onnxOpenSource" -D_REENTRANT -DTRT_STATIC=0 -g -c -o ../../bin/dchobj/sampleCharRNN/sampleCharRNN/sampleCharRNN.o sampleCharRNN.cpp
if [ ! -d ../../bin/dchobj/sampleCharRNN/sampleCharRNN ]; then mkdir -p ../../bin/dchobj/sampleCharRNN/sampleCharRNN; fi
if [ ! -d ../../bin/chobj/sampleCharRNN/sampleCharRNN/../common ]; then mkdir -p ../../bin/dchobj/sampleCharRNN/sampleCharRNN/../common; fi && :
aarch64-linux-gnu-g++ -MM -MF ../../bin/dchobj/sampleCharRNN/sampleCharRNN/../common/sampleInference.d -MP -MT ../../bin/dchobj/sampleCharRNN/sampleCharRNN/../common/sampleInference.o -Wall -Wno-deprecated-declarations -std=c++14  -I"/usr/include/aarch64-linux-gnu" -I"/usr/include/aarch64-linux-gnu" -I"/usr/local/cuda/targets/aarch64-linux/include" -I"../common" -I"/usr/local/cuda/include" -I"/usr/local/cuda/include" -I"../include" -I"../../include" -I"../../parsers/onnxOpenSource" -D_REENTRANT -DTRT_STATIC=0 ../common/sampleInference.cpp
Compiling: ../common/sampleInference.cpp
aarch64-linux-gnu-g++ -Wall -Wno-deprecated-declarations -std=c++14  -I"/usr/include/aarch64-linux-gnu" -I"/usr/include/aarch64-linux-gnu" -I"/usr/local/cuda/targets/aarch64-linux/include" -I"../common" -I"/usr/local/cuda/include" -I"/usr/local/cuda/include" -I"../include" -I"../../include" -I"../../parsers/onnxOpenSource" -D_REENTRANT -DTRT_STATIC=0 -g -c -o ../../bin/dchobj/sampleCharRNN/sampleCharRNN/../common/sampleInference.o ../common/sampleInference.cpp
if [ ! -d ../../bin/dchobj/sampleCharRNN/sampleCharRNN ]; then mkdir -p ../../bin/dchobj/sampleCharRNN/sampleCharRNN; fi
if [ ! -d ../../bin/chobj/sampleCharRNN/sampleCharRNN/../common ]; then mkdir -p ../../bin/dchobj/sampleCharRNN/sampleCharRNN/../common; fi && :
aarch64-linux-gnu-g++ -MM -MF ../../bin/dchobj/sampleCharRNN/sampleCharRNN/../common/sampleUtils.d -MP -MT ../../bin/dchobj/sampleCharRNN/sampleCharRNN/../common/sampleUtils.o -Wall -Wno-deprecated-declarations -std=c++14  -I"/usr/include/aarch64-linux-gnu" -I"/usr/include/aarch64-linux-gnu" -I"/usr/local/cuda/targets/aarch64-linux/include" -I"../common" -I"/usr/local/cuda/include" -I"/usr/local/cuda/include" -I"../include" -I"../../include" -I"../../parsers/onnxOpenSource" -D_REENTRANT -DTRT_STATIC=0 ../common/sampleUtils.cpp
Compiling: ../common/sampleUtils.cpp
aarch64-linux-gnu-g++ -Wall -Wno-deprecated-declarations -std=c++14  -I"/usr/include/aarch64-linux-gnu" -I"/usr/include/aarch64-linux-gnu" -I"/usr/local/cuda/targets/aarch64-linux/include" -I"../common" -I"/usr/local/cuda/include" -I"/usr/local/cuda/include" -I"../include" -I"../../include" -I"../../parsers/onnxOpenSource" -D_REENTRANT -DTRT_STATIC=0 -g -c -o ../../bin/dchobj/sampleCharRNN/sampleCharRNN/../common/sampleUtils.o ../common/sampleUtils.cpp
if [ ! -d ../../bin/dchobj/sampleCharRNN/sampleCharRNN ]; then mkdir -p ../../bin/dchobj/sampleCharRNN/sampleCharRNN; fi
if [ ! -d ../../bin/chobj/sampleCharRNN/sampleCharRNN/../common ]; then mkdir -p ../../bin/dchobj/sampleCharRNN/sampleCharRNN/../common; fi && :
aarch64-linux-gnu-g++ -MM -MF ../../bin/dchobj/sampleCharRNN/sampleCharRNN/../common/sampleOptions.d -MP -MT ../../bin/dchobj/sampleCharRNN/sampleCharRNN/../common/sampleOptions.o -Wall -Wno-deprecated-declarations -std=c++14  -I"/usr/include/aarch64-linux-gnu" -I"/usr/include/aarch64-linux-gnu" -I"/usr/local/cuda/targets/aarch64-linux/include" -I"../common" -I"/usr/local/cuda/include" -I"/usr/local/cuda/include" -I"../include" -I"../../include" -I"../../parsers/onnxOpenSource" -D_REENTRANT -DTRT_STATIC=0 ../common/sampleOptions.cpp
Compiling: ../common/sampleOptions.cpp
aarch64-linux-gnu-g++ -Wall -Wno-deprecated-declarations -std=c++14  -I"/usr/include/aarch64-linux-gnu" -I"/usr/include/aarch64-linux-gnu" -I"/usr/local/cuda/targets/aarch64-linux/include" -I"../common" -I"/usr/local/cuda/include" -I"/usr/local/cuda/include" -I"../include" -I"../../include" -I"../../parsers/onnxOpenSource" -D_REENTRANT -DTRT_STATIC=0 -g -c -o ../../bin/dchobj/sampleCharRNN/sampleCharRNN/../common/sampleOptions.o ../common/sampleOptions.cpp
if [ ! -d ../../bin/dchobj/sampleCharRNN/sampleCharRNN ]; then mkdir -p ../../bin/dchobj/sampleCharRNN/sampleCharRNN; fi
if [ ! -d ../../bin/chobj/sampleCharRNN/sampleCharRNN/../common ]; then mkdir -p ../../bin/dchobj/sampleCharRNN/sampleCharRNN/../common; fi && :
aarch64-linux-gnu-g++ -MM -MF ../../bin/dchobj/sampleCharRNN/sampleCharRNN/../common/logger.d -MP -MT ../../bin/dchobj/sampleCharRNN/sampleCharRNN/../common/logger.o -Wall -Wno-deprecated-declarations -std=c++14  -I"/usr/include/aarch64-linux-gnu" -I"/usr/include/aarch64-linux-gnu" -I"/usr/local/cuda/targets/aarch64-linux/include" -I"../common" -I"/usr/local/cuda/include" -I"/usr/local/cuda/include" -I"../include" -I"../../include" -I"../../parsers/onnxOpenSource" -D_REENTRANT -DTRT_STATIC=0 ../common/logger.cpp
Compiling: ../common/logger.cpp
aarch64-linux-gnu-g++ -Wall -Wno-deprecated-declarations -std=c++14  -I"/usr/include/aarch64-linux-gnu" -I"/usr/include/aarch64-linux-gnu" -I"/usr/local/cuda/targets/aarch64-linux/include" -I"../common" -I"/usr/local/cuda/include" -I"/usr/local/cuda/include" -I"../include" -I"../../include" -I"../../parsers/onnxOpenSource" -D_REENTRANT -DTRT_STATIC=0 -g -c -o ../../bin/dchobj/sampleCharRNN/sampleCharRNN/../common/logger.o ../common/logger.cpp
if [ ! -d ../../bin/dchobj/sampleCharRNN/sampleCharRNN ]; then mkdir -p ../../bin/dchobj/sampleCharRNN/sampleCharRNN; fi
if [ ! -d ../../bin/chobj/sampleCharRNN/sampleCharRNN/../common ]; then mkdir -p ../../bin/dchobj/sampleCharRNN/sampleCharRNN/../common; fi && :
aarch64-linux-gnu-g++ -MM -MF ../../bin/dchobj/sampleCharRNN/sampleCharRNN/../common/getOptions.d -MP -MT ../../bin/dchobj/sampleCharRNN/sampleCharRNN/../common/getOptions.o -Wall -Wno-deprecated-declarations -std=c++14  -I"/usr/include/aarch64-linux-gnu" -I"/usr/include/aarch64-linux-gnu" -I"/usr/local/cuda/targets/aarch64-linux/include" -I"../common" -I"/usr/local/cuda/include" -I"/usr/local/cuda/include" -I"../include" -I"../../include" -I"../../parsers/onnxOpenSource" -D_REENTRANT -DTRT_STATIC=0 ../common/getOptions.cpp
Compiling: ../common/getOptions.cpp
aarch64-linux-gnu-g++ -Wall -Wno-deprecated-declarations -std=c++14  -I"/usr/include/aarch64-linux-gnu" -I"/usr/include/aarch64-linux-gnu" -I"/usr/local/cuda/targets/aarch64-linux/include" -I"../common" -I"/usr/local/cuda/include" -I"/usr/local/cuda/include" -I"../include" -I"../../include" -I"../../parsers/onnxOpenSource" -D_REENTRANT -DTRT_STATIC=0 -g -c -o ../../bin/dchobj/sampleCharRNN/sampleCharRNN/../common/getOptions.o ../common/getOptions.cpp
if [ ! -d ../../bin/dchobj/sampleCharRNN/sampleCharRNN ]; then mkdir -p ../../bin/dchobj/sampleCharRNN/sampleCharRNN; fi
if [ ! -d ../../bin/chobj/sampleCharRNN/sampleCharRNN/../common ]; then mkdir -p ../../bin/dchobj/sampleCharRNN/sampleCharRNN/../common; fi && :
aarch64-linux-gnu-g++ -MM -MF ../../bin/dchobj/sampleCharRNN/sampleCharRNN/../common/sampleReporting.d -MP -MT ../../bin/dchobj/sampleCharRNN/sampleCharRNN/../common/sampleReporting.o -Wall -Wno-deprecated-declarations -std=c++14  -I"/usr/include/aarch64-linux-gnu" -I"/usr/include/aarch64-linux-gnu" -I"/usr/local/cuda/targets/aarch64-linux/include" -I"../common" -I"/usr/local/cuda/include" -I"/usr/local/cuda/include" -I"../include" -I"../../include" -I"../../parsers/onnxOpenSource" -D_REENTRANT -DTRT_STATIC=0 ../common/sampleReporting.cpp
Compiling: ../common/sampleReporting.cpp
aarch64-linux-gnu-g++ -Wall -Wno-deprecated-declarations -std=c++14  -I"/usr/include/aarch64-linux-gnu" -I"/usr/include/aarch64-linux-gnu" -I"/usr/local/cuda/targets/aarch64-linux/include" -I"../common" -I"/usr/local/cuda/include" -I"/usr/local/cuda/include" -I"../include" -I"../../include" -I"../../parsers/onnxOpenSource" -D_REENTRANT -DTRT_STATIC=0 -g -c -o ../../bin/dchobj/sampleCharRNN/sampleCharRNN/../common/sampleReporting.o ../common/sampleReporting.cpp
if [ ! -d ../../bin/dchobj/sampleCharRNN/sampleCharRNN ]; then mkdir -p ../../bin/dchobj/sampleCharRNN/sampleCharRNN; fi
if [ ! -d ../../bin/chobj/sampleCharRNN/sampleCharRNN/../common ]; then mkdir -p ../../bin/dchobj/sampleCharRNN/sampleCharRNN/../common; fi && :
aarch64-linux-gnu-g++ -MM -MF ../../bin/dchobj/sampleCharRNN/sampleCharRNN/../common/sampleEngines.d -MP -MT ../../bin/dchobj/sampleCharRNN/sampleCharRNN/../common/sampleEngines.o -Wall -Wno-deprecated-declarations -std=c++14  -I"/usr/include/aarch64-linux-gnu" -I"/usr/include/aarch64-linux-gnu" -I"/usr/local/cuda/targets/aarch64-linux/include" -I"../common" -I"/usr/local/cuda/include" -I"/usr/local/cuda/include" -I"../include" -I"../../include" -I"../../parsers/onnxOpenSource" -D_REENTRANT -DTRT_STATIC=0 ../common/sampleEngines.cpp
Compiling: ../common/sampleEngines.cpp
aarch64-linux-gnu-g++ -Wall -Wno-deprecated-declarations -std=c++14  -I"/usr/include/aarch64-linux-gnu" -I"/usr/include/aarch64-linux-gnu" -I"/usr/local/cuda/targets/aarch64-linux/include" -I"../common" -I"/usr/local/cuda/include" -I"/usr/local/cuda/include" -I"../include" -I"../../include" -I"../../parsers/onnxOpenSource" -D_REENTRANT -DTRT_STATIC=0 -g -c -o ../../bin/dchobj/sampleCharRNN/sampleCharRNN/../common/sampleEngines.o ../common/sampleEngines.cpp
Linking: ../../bin/sample_char_rnn_debug
aarch64-linux-gnu-g++ -o ../../bin/sample_char_rnn_debug  -L"../lib/stubs" -L"../../lib/stubs" -L"/usr/lib/aarch64-linux-gnu/stubs" -L"/usr/lib/aarch64-linux-gnu" -L"/usr/lib/aarch64-linux-gnu/stubs" -
.
.

if [ ! -d ../../bin/dchobj/sampleOnnxMnistCoordConvAC/sampleOnnxMnistCoordConvAC ]; then mkdir -p ../../bin/dchobj/sampleOnnxMnistCoordConvAC/sampleOnnxMnistCoordConvAC; fi
if [ ! -d ../../bin/chobj/sampleOnnxMnistCoordConvAC/sampleOnnxMnistCoordConvAC/../common ]; then mkdir -p ../../bin/dchobj/sampleOnnxMnistCoordConvAC/sampleOnnxMnistCoordConvAC/../common; fi && :
aarch64-linux-gnu-g++ -MM -MF ../../bin/dchobj/sampleOnnxMnistCoordConvAC/sampleOnnxMnistCoordConvAC/../common/sampleOptions.d -MP -MT ../../bin/dchobj/sampleOnnxMnistCoordConvAC/sampleOnnxMnistCoordConvAC/../common/sampleOptions.o -Wall -Wno-deprecated-declarations -std=c++14  -I"/usr/include/aarch64-linux-gnu" -I"/usr/include/aarch64-linux-gnu" -I"/usr/local/cuda/targets/aarch64-linux/include" -I"../common" -I"/usr/local/cuda/include" -I"/usr/local/cuda/include" -I"../include" -I"../../include" -I"../../parsers/onnxOpenSource" -D_REENTRANT -DTRT_STATIC=0 ../common/sampleOptions.cpp
Compiling: ../common/sampleOptions.cpp
aarch64-linux-gnu-g++ -Wall -Wno-deprecated-declarations -std=c++14  -I"/usr/include/aarch64-linux-gnu" -I"/usr/include/aarch64-linux-gnu" -I"/usr/local/cuda/targets/aarch64-linux/include" -I"../common" -I"/usr/local/cuda/include" -I"/usr/local/cuda/include" -I"../include" -I"../../include" -I"../../parsers/onnxOpenSource" -D_REENTRANT -DTRT_STATIC=0 -g -c -o ../../bin/dchobj/sampleOnnxMnistCoordConvAC/sampleOnnxMnistCoordConvAC/../common/sampleOptions.o ../common/sampleOptions.cpp
if [ ! -d ../../bin/dchobj/sampleOnnxMnistCoordConvAC/sampleOnnxMnistCoordConvAC ]; then mkdir -p ../../bin/dchobj/sampleOnnxMnistCoordConvAC/sampleOnnxMnistCoordConvAC; fi
.
.
../../bin/chobj/trtexec/trtexec/../common/sampleReporting.d -MP -MT ../../bin/chobj/trtexec/trtexec/../common/sampleReporting.o -Wall -Wno-deprecated-declarations -std=c++14  -I"/usr/include/aarch64-linux-gnu" -I"/usr/include/aarch64-linux-gnu" -I"/usr/local/cuda/targets/aarch64-linux/include" -I"../common" -I"/usr/local/cuda/include" -I"/usr/local/cuda/include" -I"../include" -I"../../include" -I"../../parsers/onnxOpenSource" -D_REENTRANT -DTRT_STATIC=0 ../common/sampleReporting.cpp
Compiling: ../common/sampleReporting.cpp
aarch64-linux-gnu-g++ -Wall -Wno-deprecated-declarations -std=c++14  -I"/usr/include/aarch64-linux-gnu" -I"/usr/include/aarch64-linux-gnu" -I"/usr/local/cuda/targets/aarch64-linux/include" -I"../common" -I"/usr/local/cuda/include" -I"/usr/local/cuda/include" -I"../include" -I"../../include" -I"../../parsers/onnxOpenSource" -D_REENTRANT -DTRT_STATIC=0 -c -o ../../bin/chobj/trtexec/trtexec/../common/sampleReporting.o ../common/sampleReporting.cpp
if [ ! -d ../../bin/chobj/trtexec/trtexec ]; then mkdir -p ../../bin/chobj/trtexec/trtexec; fi
if [ ! -d ../../bin/chobj/trtexec/trtexec/../common ]; then mkdir -p ../../bin/chobj/trtexec/trtexec/../common; fi && :
aarch64-linux-gnu-g++ -MM -MF ../../bin/chobj/trtexec/trtexec/../common/sampleEngines.d -MP -MT ../../bin/chobj/trtexec/trtexec/../common/sampleEngines.o -Wall -Wno-deprecated-declarations -std=c++14  -I"/usr/include/aarch64-linux-gnu" -I"/usr/include/aarch64-linux-gnu" -I"/usr/local/cuda/targets/aarch64-linux/include" -I"../common" -I"/usr/local/cuda/include" -I"/usr/local/cuda/include" -I"../include" -I"../../include" -I"../../parsers/onnxOpenSource" -D_REENTRANT -DTRT_STATIC=0 ../common/sampleEngines.cpp
Compiling: ../common/sampleEngines.cpp
aarch64-linux-gnu-g++ -Wall -Wno-deprecated-declarations -std=c++14  -I"/usr/include/aarch64-linux-gnu" -I"/usr/include/aarch64-linux-gnu" -I"/usr/local/cuda/targets/aarch64-linux/include" -I"../common" -I"/usr/local/cuda/include" -I"/usr/local/cuda/include" -I"../include" -I"../../include" -I"../../parsers/onnxOpenSource" -D_REENTRANT -DTRT_STATIC=0 -c -o ../../bin/chobj/trtexec/trtexec/../common/sampleEngines.o ../common/sampleEngines.cpp
Linking: ../../bin/trtexec
aarch64-linux-gnu-g++ -o ../../bin/trtexec  -L"../lib/stubs" -L"../../lib/stubs" -L"/usr/lib/aarch64-linux-gnu/stubs" -L"/usr/lib/aarch64-linux-gnu" -L"/usr/lib/aarch64-linux-gnu/stubs" -L"/usr/lib/aarch64-linux-gnu" -L"/usr/local/cuda/targets/aarch64-linux/lib/stubs" -L"/usr/local/cuda/targets/aarch64-linux/lib" -L"/usr/local/cuda/lib" -Wl,-rpath-link="/usr/local/cuda/lib" -L"/usr/local/cuda/lib64" -Wl,-rpath-link="/usr/local/cuda/lib64" -L"../lib" -L"../../lib" -L"../../lib" -Wl,-rpath-link="../../lib"  -L"/usr/lib/x86_64-linux-gnu/lib" -Wl,-rpath-link="/usr/lib/x86_64-linux-gnu/lib" -L"" -Wl,-rpath-link="" -L../../bin  -Wl,--start-group -lcudart -lcublas -lcudnn -lrt -ldl -lpthread  ../../bin/chobj/trtexec/trtexec/trtexec.o ../../bin/chobj/trtexec/trtexec/../common/sampleInference.o ../../bin/chobj/trtexec/trtexec/../common/sampleUtils.o ../../bin/chobj/trtexec/trtexec/../common/sampleOptions.o ../../bin/chobj/trtexec/trtexec/../common/logger.o ../../bin/chobj/trtexec/trtexec/../common/getOptions.o ../../bin/chobj/trtexec/trtexec/../common/sampleReporting.o ../../bin/chobj/trtexec/trtexec/../common/sampleEngines.o -Wl,--end-group
make[1]: Leaving directory '/usr/src/tensorrt/samples/trtexec'

Also, please see Tensorrt and cudnn on drive os 6.0.8 - #10 by SivaRamaKrishnaNV helps?
you need to copy the missing headers and libs to target from docker and try native compilation on target directly.

aastudil · April 4, 2025, 7:00am

Hi @SivaRamaKrishnaNV

I run it on native target. Could you provide me the docker so I can run it on my target machine?
Yes, I saw the issue you linked and I could not managed to make it work, I think it was due to missing libs on the selected path, I will collect some more logs for this approach. In the meantime, can we continue with option-1?

Best.

SivaRamaKrishnaNV · April 4, 2025, 7:31am

Dear @aastudil ,
It is the same DRIVE OS 6.0.10 docker container you used for flashing. It has all the samples and headers for cross compilation.
Please see Set Up DRIVE OS Linux with NVIDIA GPU Cloud (NGC) | NVIDIA Docs

aastudil · April 21, 2025, 3:33pm

Hi Siva,

Thank you for your help.

TensorRT Samples
1.1. I was able to compile the samples on the docker image (host x86 machine), with the TARGET=aarch64 parameter.
1.2. I copy the sample, bin and data folders from the docker image to the target machine (IGX Orin).
1.3. I run the samples successfully! on the target machine
Custom cpp file
2.1. I have a custom CPP file that reads and image and performs a 2d-Object Detection inference.
2.2. I tried to compile it and I realize that a cmake -DCMAKE_TOOLCHAIN_FILE=/path/to/aarch64-toolchain.cmake .. command was needed, not only the make TARGET=aarch64.
2.3. Then, tons of libraries errors arise. I was solving them one-by-one but I got stucked.
2.4. I had to build the following tree:

/opt/tensorrt-aarch64/
|-- include
|   |-- NvCaffeParser.h
|   |-- NvInfer.h
|   |-- NvInferConsistency.h
|   |-- NvInferConsistencyImpl.h
|   |-- NvInferImpl.h
|   |-- NvInferLegacyDims.h
|   |-- NvInferPlugin.h
|   |-- NvInferPluginUtils.h
|   |-- NvInferRuntime.h
|   |-- NvInferRuntimeBase.h
|   |-- NvInferRuntimeCommon.h
|   |-- NvInferRuntimePlugin.h
|   |-- NvInferSafeRuntime.h
|   |-- NvInferVersion.h
|   |-- NvOnnxConfig.h
|   |-- NvOnnxParser.h
|   |-- NvUffParser.h
|   |-- NvUtils.h
|   `-- common
|       |-- BatchStream.h
|       |-- EntropyCalibrator.h
|       |-- ErrorRecorder.h
|       |-- argsParser.h
|       |-- buffers.h
|       |-- common.h
|       |-- getOptions.h
|       |-- getoptWin.h
|       |-- half.h
|       |-- logger.h
|       |-- logging.h
|       |-- parserOnnxConfig.h
|       |-- safeCommon.h
|       |-- sampleConfig.h
|       |-- sampleDevice.h
|       |-- sampleEngines.h
|       |-- sampleEntrypoints.h
|       |-- sampleInference.h
|       |-- sampleOptions.h
|       |-- sampleReporting.h
|       `-- sampleUtils.h
`-- lib
    |-- libnvinfer.so
    |-- libnvinfer.so.8
    `-- libnvinfer.so.8.6.13

2.5. Using the following CMakeLists

# Define the Minimum Required Version of CMake
cmake_minimum_required(VERSION 3.10)

# Project Name
project(2d_od_image_trt_cpp)

# Set the C++ Version and Compilation Options
set(CMAKE_CXX_STANDARD 11)
set(CMAKE_CXX_STANDARD_REQUIRED ON)
set(CMAKE_BUILD_TYPE Debug)

# Configure Compilation Flags
set(CMAKE_CXX_FLAGS "${CMAKE_CXX_FLAGS} -std=c++11 -Wall -Ofast -D_MWAITXINTRIN_H_INCLUDED")

# Include Directories
include_directories(
    ${CMAKE_SOURCE_DIR}/include                          
    # /usr/src/tensorrt/include # TensorRT directory
    # /usr/src/tensorrt/samples/common # TensorRT common directory
    /opt/tensorrt-aarch64/include
    /opt/tensorrt-aarch64/include/common
    /usr/local/cuda/include                              
    /usr/include/opencv4                               
)

# Library Directories
link_directories(
    # /usr/src/tensorrt/lib   # TensorRT library directory
    /opt/tensorrt-aarch64/lib
    /usr/local/cuda/lib64                                # CUDA library directory
    /usr/lib/aarch64-linux-gnu
    /usr/local/cuda-11.4/targets/aarch64-linux/lib
    # /usr/lib/x86_64-linux-gnu                          # Standard Linux library directory
)

# Informative Messages
message(STATUS "Configuring project with the following dependencies:")
message(STATUS "    TensorRT include: /usr/src/tensorrt/include")
message(STATUS "    TensorRT common include: /usr/src/tensorrt/samples/common")
message(STATUS "    TensorRT lib: /usr/src/tensorrt/lib")
message(STATUS "    CUDA include: /usr/local/cuda/include")
message(STATUS "    OpenCV include: /usr/include/opencv4")

# Find Required Libraries
# find_package(CUDA REQUIRED)
find_package(Threads REQUIRED)

message(STATUS "CUDA library status:")
message(STATUS "    libraries: ${CUDA_LIBRARIES}")
message(STATUS "    include path: ${CUDA_INCLUDE_DIRS}")

# Project Sources
set(SOURCES
    src/main.cpp
    lib/engine.cpp
    lib/rtdetr.cpp
    lib/config.cpp
)

# Generate the Executable
add_executable(${PROJECT_NAME} ${SOURCES})

# Link Necessary Libraries
target_link_libraries(${PROJECT_NAME}
    nvinfer                 # Main TensorRT library
    nvinfer_plugin          # TensorRT plugins
    cudart                  # CUDA Runtime library
    ${CMAKE_THREAD_LIBS_INIT} # Libraries for thread management
    opencv_core             # Main OpenCV library
    opencv_imgproc          # Image processing library
    opencv_highgui          # OpenCV GUI library
    opencv_imgcodecs        # Image encoding and decoding library
)

# Set Environment Variables for Execution
set(ENV{LD_LIBRARY_PATH} "/usr/src/tensorrt/lib:$ENV{LD_LIBRARY_PATH}")

# Final Configuration Message
message(STATUS "Project configured with TensorRT and OpenCV")

Notice that I have commented the lines that works for x86 arch.

2.6. cmake

root@6.0.10.0-0009-build-linux-sdk:/drive_flashing/tmp/general-2d_od_image-trt_cpp/build# cmake ..   -DCMAKE_TOOLCHAIN_FILE=/drive/toolchains/aarch64--glibc--stable-2022.03-1/share/buildroot/toolchainfile.cmake
-- The C compiler identification is GNU 9.3.0
-- The CXX compiler identification is GNU 9.3.0
-- Check for working C compiler: /drive/toolchains/aarch64--glibc--stable-2022.03-1/bin/aarch64-buildroot-linux-gnu-gcc
-- Check for working C compiler: /drive/toolchains/aarch64--glibc--stable-2022.03-1/bin/aarch64-buildroot-linux-gnu-gcc -- works
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Detecting C compile features
-- Detecting C compile features - done
-- Check for working CXX compiler: /drive/toolchains/aarch64--glibc--stable-2022.03-1/bin/aarch64-buildroot-linux-gnu-g++
-- Check for working CXX compiler: /drive/toolchains/aarch64--glibc--stable-2022.03-1/bin/aarch64-buildroot-linux-gnu-g++ -- works
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- Configuring project with the following dependencies:
--     TensorRT include: /usr/src/tensorrt/include
--     TensorRT common include: /usr/src/tensorrt/samples/common
--     TensorRT lib: /usr/src/tensorrt/lib
--     CUDA include: /usr/local/cuda/include
--     OpenCV include: /usr/include/opencv4
-- Looking for pthread.h
-- Looking for pthread.h - found
-- Performing Test CMAKE_HAVE_LIBC_PTHREAD
-- Performing Test CMAKE_HAVE_LIBC_PTHREAD - Failed
-- Looking for pthread_create in pthreads
-- Looking for pthread_create in pthreads - not found
-- Looking for pthread_create in pthread
-- Looking for pthread_create in pthread - found
-- Found Threads: TRUE  
-- CUDA library status:
--     libraries: 
--     include path: 
-- Project configured with TensorRT and OpenCV
-- Configuring done
-- Generating done
-- Build files have been written to: /drive_flashing/tmp/general-2d_od_image-trt_cpp/build

2.7 Error on make

root@6.0.10.0-0009-build-linux-sdk:/drive_flashing/tmp/general-2d_od_image-trt_cpp/build# make TARGET=aarch64
[ 20%] Linking CXX executable 2d_od_image_trt_cpp
aarch64-buildroot-linux-gnu-g++: WARNING: unsafe header/library path used in cross-compilation: '-L/usr/lib/aarch64-linux-gnu'
/drive/toolchains/aarch64--glibc--stable-2022.03-1/bin/../lib/gcc/aarch64-buildroot-linux-gnu/9.3.0/../../../../aarch64-buildroot-linux-gnu/bin/ld: warning: library search path "/usr/lib/aarch64-linux-gnu" is unsafe for cross-compilation
/drive/toolchains/aarch64--glibc--stable-2022.03-1/bin/../lib/gcc/aarch64-buildroot-linux-gnu/9.3.0/../../../../aarch64-buildroot-linux-gnu/bin/ld: skipping incompatible /usr/local/cuda/lib64/libcudart.so when searching for -lcudart
/drive/toolchains/aarch64--glibc--stable-2022.03-1/bin/../lib/gcc/aarch64-buildroot-linux-gnu/9.3.0/../../../../aarch64-buildroot-linux-gnu/bin/ld: cannot find -lopencv_core
/drive/toolchains/aarch64--glibc--stable-2022.03-1/bin/../lib/gcc/aarch64-buildroot-linux-gnu/9.3.0/../../../../aarch64-buildroot-linux-gnu/bin/ld: cannot find -lopencv_imgproc
/drive/toolchains/aarch64--glibc--stable-2022.03-1/bin/../lib/gcc/aarch64-buildroot-linux-gnu/9.3.0/../../../../aarch64-buildroot-linux-gnu/bin/ld: cannot find -lopencv_highgui
/drive/toolchains/aarch64--glibc--stable-2022.03-1/bin/../lib/gcc/aarch64-buildroot-linux-gnu/9.3.0/../../../../aarch64-buildroot-linux-gnu/bin/ld: cannot find -lopencv_imgcodecs
collect2: error: ld returned 1 exit status
make[2]: *** [CMakeFiles/2d_od_image_trt_cpp.dir/build.make:129: 2d_od_image_trt_cpp] Error 1
make[1]: *** [CMakeFiles/Makefile2:76: CMakeFiles/2d_od_image_trt_cpp.dir/all] Error 2
make: *** [Makefile:84: all] Error 2

Any insights on this issue?

SivaRamaKrishnaNV · May 14, 2025, 2:45pm

Looks like issue with linking of openCV libs. Note that we don’t officially support OpenCV on DRIVE. You may check the compilation/linking issue in opencv forums.

system · May 28, 2025, 2:47pm

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.

Topic		Replies	Views
Error in executing TensorRT samples through docker container environment DRIVE AGX Orin General docker , driveos-dl	14	108	October 24, 2024
How to compile and install TensorrtOSS on DRIVE AGX ORIN? DRIVE AGX Orin General driveos-dl	2	1124	March 17, 2023
TensorRT 8.6.1 on Drive OS Docker - CudaMemcpyAsync Invalid Argument DRIVE AGX Orin General driveos-dl	3	472	February 8, 2024
Running TensorRT inference in docker container on Drive Orin AGX DRIVE AGX Orin General driveos-dl	18	1788	September 12, 2023
How to infer the .trt/.engine model on Drive AGX Orin through cross-compile? DRIVE AGX Orin General driveos-dl	4	453	March 7, 2024
Convert onnx model using trtexec in DRIVE OS DRIVE AGX Orin General driveos-dl	8	52	September 4, 2024
Errors while running Drive samples DRIVE AGX Orin General driveos-cuda	9	828	July 8, 2023
Upgrading CUDA for Autoware Compatibility and tensorrt libs not Accessible Inside the l4t-jetpack DRIVE AGX Orin General driveos-cuda	10	909	January 22, 2024
Convert onnx model using trtexec in DRIVE OS DRIVE AGX Orin General driveos-dl	2	33	August 6, 2024
Drive AGX Orin TensorRT inference failed DRIVE AGX Orin General driveos-dl	25	998	September 14, 2023

Unable to run tensorRT on DRIVE OS 6.0

Related topics