API's missing

AI & Data Science Deep Learning (Training & Inference) TensorRT
1

I am in the process of installing onnx-trt
It is telling me

/usr/bin/ld: warning: libcudart.so.10.2, needed by /usr/lib/x86_64-linux-gnu/libnvinfer.so, not found (try using -rpath or -rpath-link)
/usr/bin/ld: warning: libnvrtc.so.10.2, needed by /usr/lib/x86_64-linux-gnu/libnvinfer.so, not found (try using -rpath or -rpath-link)
/usr/lib/x86_64-linux-gnu/libnvinfer_plugin.so: undefined reference to `cudaMemcpyAsync'
/usr/lib/x86_64-linux-gnu/libnvinfer_plugin.so: undefined reference to `nvrtcGetProgramLogSize@libnvrtc.so.10.2'
/usr/lib/x86_64-linux-gnu/libnvinfer_plugin.so: undefined reference to `nvrtcGetPTXSize@libnvrtc.so.10.2'
/usr/lib/x86_64-linux-gnu/libnvinfer.so: undefined reference to `cudaStreamWaitEvent@libcudart.so.10.2'
/usr/lib/x86_64-linux-gnu/libnvinfer_plugin.so: undefined reference to `cudaStreamDestroy'
/usr/lib/x86_64-linux-gnu/libnvinfer_plugin.so: undefined reference to `cudaStreamWaitEvent'
/usr/lib/x86_64-linux-gnu/libnvinfer_plugin.so: undefined reference to `cudaMemsetAsync'
/usr/lib/x86_64-linux-gnu/libnvinfer_plugin.so: undefined reference to `cudaLaunchKernel'
/usr/lib/x86_64-linux-gnu/libnvinfer_plugin.so: undefined reference to `cudaFree'
/usr/lib/x86_64-linux-gnu/libnvinfer_plugin.so: undefined reference to `cudaMallocHost'
/usr/lib/x86_64-linux-gnu/libnvinfer_plugin.so: undefined reference to `cudaGetDeviceProperties'
/usr/lib/x86_64-linux-gnu/libnvinfer_plugin.so: undefined reference to `cudaPeekAtLastError'
/usr/lib/x86_64-linux-gnu/libnvinfer.so: undefined reference to `cudaEventDestroy@libcudart.so.10.2'
/usr/lib/x86_64-linux-gnu/libnvinfer.so: undefined reference to `cudaMalloc@libcudart.so.10.2'
/usr/lib/x86_64-linux-gnu/libnvinfer.so: undefined reference to `cudaGetDevice@libcudart.so.10.2'
/usr/lib/x86_64-linux-gnu/libnvinfer_plugin.so: undefined reference to `cudaGetDevice'
/usr/lib/x86_64-linux-gnu/libnvinfer_plugin.so: undefined reference to `__cudaRegisterFunction'
/usr/lib/x86_64-linux-gnu/libnvinfer_plugin.so: undefined reference to `nvrtcDestroyProgram@libnvrtc.so.10.2'
/usr/lib/x86_64-linux-gnu/libnvinfer_plugin.so: undefined reference to `nvrtcGetPTX@libnvrtc.so.10.2'
/usr/lib/x86_64-linux-gnu/libnvinfer.so: undefined reference to `cudaMemcpyToSymbol@libcudart.so.10.2'
/usr/lib/x86_64-linux-gnu/libnvinfer.so: undefined reference to `cudaRuntimeGetVersion@libcudart.so.10.2'
/usr/lib/x86_64-linux-gnu/libnvinfer_plugin.so: undefined reference to `nvrtcCreateProgram@libnvrtc.so.10.2'
/usr/lib/x86_64-linux-gnu/libnvinfer.so: undefined reference to `cudaLaunchKernel@libcudart.so.10.2'
/usr/lib/x86_64-linux-gnu/libnvinfer.so: undefined reference to `cudaGetDeviceProperties@libcudart.so.10.2'
/usr/lib/x86_64-linux-gnu/libnvinfer.so: undefined reference to `cudaStreamAddCallback@libcudart.so.10.2'
/usr/lib/x86_64-linux-gnu/libnvinfer.so: undefined reference to `cudaFuncSetAttribute@libcudart.so.10.2'
/usr/lib/x86_64-linux-gnu/libnvinfer_plugin.so: undefined reference to `cudaEventRecord'
/usr/lib/x86_64-linux-gnu/libnvinfer_plugin.so: undefined reference to `cudaDeviceGetAttribute'
/usr/lib/x86_64-linux-gnu/libnvinfer.so: undefined reference to `cudaMemcpy@libcudart.so.10.2'
/usr/lib/x86_64-linux-gnu/libnvinfer_plugin.so: undefined reference to `cudaFuncGetAttributes'
/usr/lib/x86_64-linux-gnu/libnvinfer_plugin.so: undefined reference to `nvrtcCompileProgram@libnvrtc.so.10.2'
/usr/lib/x86_64-linux-gnu/libnvinfer.so: undefined reference to `cudaCreateChannelDesc@libcudart.so.10.2'
/usr/lib/x86_64-linux-gnu/libnvinfer_plugin.so: undefined reference to `nvrtcGetProgramLog@libnvrtc.so.10.2'
/usr/lib/x86_64-linux-gnu/libnvinfer_plugin.so: undefined reference to `cudaStreamCreate'
/usr/lib/x86_64-linux-gnu/libnvinfer.so: undefined reference to `cudaGetLastError@libcudart.so.10.2'
/usr/lib/x86_64-linux-gnu/libnvinfer.so: undefined reference to `cudaCreateTextureObject@libcudart.so.10.2'
/usr/lib/x86_64-linux-gnu/libnvinfer.so: undefined reference to `cudaGetErrorString@libcudart.so.10.2'
/usr/lib/x86_64-linux-gnu/libnvinfer.so: undefined reference to `cudaGetDeviceCount@libcudart.so.10.2'
/usr/lib/x86_64-linux-gnu/libnvinfer.so: undefined reference to `__cudaRegisterFatBinary@libcudart.so.10.2'
/usr/lib/x86_64-linux-gnu/libnvinfer_plugin.so: undefined reference to `cudaOccupancyMaxActiveBlocksPerMultiprocessorWithFlags'
/usr/lib/x86_64-linux-gnu/libnvinfer.so: undefined reference to `nvrtcVersion@libnvrtc.so.10.2'
/usr/lib/x86_64-linux-gnu/libnvinfer.so: undefined reference to `cudaEventElapsedTime@libcudart.so.10.2'
/usr/lib/x86_64-linux-gnu/libnvinfer_plugin.so: undefined reference to `cudaFreeHost'
/usr/lib/x86_64-linux-gnu/libnvinfer_plugin.so: undefined reference to `__cudaRegisterFatBinaryEnd'
/usr/lib/x86_64-linux-gnu/libnvinfer.so: undefined reference to `cudaFree@libcudart.so.10.2'
/usr/lib/x86_64-linux-gnu/libnvinfer_plugin.so: undefined reference to `cudaEventDestroy'
/usr/lib/x86_64-linux-gnu/libnvinfer_plugin.so: undefined reference to `cudaGetErrorName'
/usr/lib/x86_64-linux-gnu/libnvinfer.so: undefined reference to `cudaEventCreateWithFlags@libcudart.so.10.2'
/usr/lib/x86_64-linux-gnu/libnvinfer.so: undefined reference to `__cudaRegisterFunction@libcudart.so.10.2'
/usr/lib/x86_64-linux-gnu/libnvinfer_plugin.so: undefined reference to `cudaEventCreateWithFlags'
/usr/lib/x86_64-linux-gnu/libnvinfer.so: undefined reference to `cudaEventRecord@libcudart.so.10.2'
/usr/lib/x86_64-linux-gnu/libnvinfer.so: undefined reference to `cudaStreamQuery@libcudart.so.10.2'
/usr/lib/x86_64-linux-gnu/libnvinfer.so: undefined reference to `cudaStreamCreate@libcudart.so.10.2'
/usr/lib/x86_64-linux-gnu/libmyelin.so: undefined reference to `nvrtcGetErrorString@libnvrtc.so.10.2'
/usr/lib/x86_64-linux-gnu/libnvinfer_plugin.so: undefined reference to `cudaDeviceSynchronize'
/usr/lib/x86_64-linux-gnu/libnvinfer_plugin.so: undefined reference to `__cudaUnregisterFatBinary'
/usr/lib/x86_64-linux-gnu/libnvinfer_plugin.so: undefined reference to `cudaStreamSynchronize'
/usr/lib/x86_64-linux-gnu/libnvinfer.so: undefined reference to `cudaDestroyTextureObject@libcudart.so.10.2'
/usr/lib/x86_64-linux-gnu/libnvinfer_plugin.so: undefined reference to `cudaHostAlloc'
/usr/lib/x86_64-linux-gnu/libnvinfer.so: undefined reference to `cudaStreamDestroy@libcudart.so.10.2'
/usr/lib/x86_64-linux-gnu/libnvinfer.so: undefined reference to `cudaDeviceSynchronize@libcudart.so.10.2'
/usr/lib/x86_64-linux-gnu/libnvinfer.so: undefined reference to `cudaMemcpyAsync@libcudart.so.10.2'
/usr/lib/x86_64-linux-gnu/libnvinfer.so: undefined reference to `cudaDeviceGetAttribute@libcudart.so.10.2'
/usr/lib/x86_64-linux-gnu/libnvinfer.so: undefined reference to `__cudaPushCallConfiguration@libcudart.so.10.2'
/usr/lib/x86_64-linux-gnu/libnvinfer_plugin.so: undefined reference to `__cudaRegisterFatBinary'
/usr/lib/x86_64-linux-gnu/libnvinfer_plugin.so: undefined reference to `cudaStreamCreateWithPriority'
/usr/lib/x86_64-linux-gnu/libnvinfer.so: undefined reference to `__cudaRegisterFatBinaryEnd@libcudart.so.10.2'
/usr/lib/x86_64-linux-gnu/libnvinfer_plugin.so: undefined reference to `__cudaPopCallConfiguration'
/usr/lib/x86_64-linux-gnu/libnvinfer.so: undefined reference to `__cudaUnregisterFatBinary@libcudart.so.10.2'
/usr/lib/x86_64-linux-gnu/libnvinfer.so: undefined reference to `cudaEventSynchronize@libcudart.so.10.2'
/usr/lib/x86_64-linux-gnu/libnvinfer_plugin.so: undefined reference to `nvrtcAddNameExpression@libnvrtc.so.10.2'
/usr/lib/x86_64-linux-gnu/libnvinfer.so: undefined reference to `cudaPeekAtLastError@libcudart.so.10.2'
/usr/lib/x86_64-linux-gnu/libnvinfer.so: undefined reference to `cudaMemsetAsync@libcudart.so.10.2'
/usr/lib/x86_64-linux-gnu/libnvinfer_plugin.so: undefined reference to `cudaMalloc'
/usr/lib/x86_64-linux-gnu/libnvinfer_plugin.so: undefined reference to `cudaMemcpy'
/usr/lib/x86_64-linux-gnu/libnvinfer.so: undefined reference to `__cudaPopCallConfiguration@libcudart.so.10.2'
/usr/lib/x86_64-linux-gnu/libnvinfer.so: undefined reference to `cudaMemGetInfo@libcudart.so.10.2'
/usr/lib/x86_64-linux-gnu/libnvinfer_plugin.so: undefined reference to `nvrtcGetLoweredName@libnvrtc.so.10.2'
/usr/lib/x86_64-linux-gnu/libnvinfer.so: undefined reference to `cudaStreamSynchronize@libcudart.so.10.2'
/usr/lib/x86_64-linux-gnu/libnvinfer.so: undefined reference to `__cudaRegisterVar@libcudart.so.10.2'
/usr/lib/x86_64-linux-gnu/libnvinfer.so: undefined reference to `cudaMemcpy2DAsync@libcudart.so.10.2'
/usr/lib/x86_64-linux-gnu/libnvinfer_plugin.so: undefined reference to `__cudaRegisterVar'
/usr/lib/x86_64-linux-gnu/libnvinfer_plugin.so: undefined reference to `__cudaPushCallConfiguration'
/usr/lib/x86_64-linux-gnu/libnvinfer_plugin.so: undefined reference to `cudaGetLastError'
/usr/lib/x86_64-linux-gnu/libnvinfer_plugin.so: undefined reference to `cudaGetErrorString'
/usr/lib/x86_64-linux-gnu/libnvinfer_plugin.so: undefined reference to `cudaDeviceReset'
collect2: error: ld returned 1 exit status
make[2]: *** [onnx2trt] Error 1

even though

$ nvcc --version
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2019 NVIDIA Corporation
Built on Wed_Oct_23_19:24:38_PDT_2019
Cuda compilation tools, release 10.2, V10.2.89
2

Hi,

Per the onnx-tensorrt docs here: GitHub - onnx/onnx-tensorrt: ONNX-TensorRT: TensorRT backend for ONNX

Can you try building following the instructions from the TensorRT repo instead: GitHub - NVIDIA/TensorRT: TensorRT is a C++ library for high performance inference on NVIDIA GPUs and deep learning accelerators.?

In case it helps, there’s an example script for installing TensorRT OSS components on a typical x86 Linux system here: tensorrt-utils/build_OSS.sh at master · rmccorm4/tensorrt-utils · GitHub

There’s also a script that comes inside the nvcr/nvidia/tensorrt:19.12-py3 container:
“To install open source parsers, plugins, and samples, run /opt/tensorrt/install_opensource.sh. See GitHub - NVIDIA/TensorRT at 19.12 for more information.”