Tensorrt not working in RTX 3080

logesh.krishnan · October 11, 2021, 2:57am

Description

Trying to bring up tensorrt using docker for 3080, working fine for older gpus with 7.x.x trt version and 11.0 cuda but when tried the same for 3080 getting library not found. Trying to figure out the correct Cuda and trt version for this gpu.

Environment

TensorRT Version: 8.2.0.6
GPU Type: RTX 3080
Nvidia Driver Version: 470.63.01
CUDA Version: 11.4
CUDNN Version: 8.0.2
Operating System + Version: Ubuntu 18.04
Python Version (if applicable): 3.6.9
TensorFlow Version (if applicable): 2.5.0
PyTorch Version (if applicable):
Baremetal or Container (if container which image + tag): Container

Steps To Reproduce

github.com

NVIDIA/TensorRT/blob/master/docker/ubuntu-18.04.Dockerfile

# Copyright (c) 2021, NVIDIA CORPORATION. All rights reserved.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
#     http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.

ARG CUDA_VERSION=11.4.2
ARG OS_VERSION=18.04

FROM nvidia/cuda:${CUDA_VERSION}-cudnn8-devel-ubuntu${OS_VERSION}
LABEL maintainer="NVIDIA CORPORATION"

This file has been truncated. show original

Built on the dockerfile provided in the tensorrt repo

Docker error logs:

workers_gpu | 2021-10-11 02:49:00.148285: W tensorflow/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library ‘libnvinfer.so.7’; dlerror: libnvinfer.so.7: cannot open shared object file: No such file or directory; LD_LIBRARY_PATH: /usr/local/nvidia/lib:/usr/local/nvidia/lib64:/src/TensorRT/build/out:/usr/lib/x86_64-linux-gnu
workers_gpu | 2021-10-11 02:49:00.148321: F tensorflow/compiler/tf2tensorrt/stub/nvinfer_stub.cc:49] getInferLibVersion symbol not found.

spolisetty · October 11, 2021, 10:24am

Hi @logesh.krishnan,

Looks like dependencies are not configured properly. Please follow steps from installation guide. Also please check support matrix doc and make sure you’ve dependencies installed correctly.

Thank you.

logesh.krishnan · October 11, 2021, 10:27am

okay thank you

Topic		Replies	Views
Tensorrt 8.0.0.3 with cuda 11.1 TensorRT tensorrt	2	1652	August 28, 2021
TensorRT 8.2.5 could not load library libcublasLt.so.10 TensorRT tensorrt , cuda , ubuntu , docker	3	3218	December 13, 2022
TensorRT installation version issue in docker container TensorRT docker	4	1691	March 30, 2023
Can't find libnvinfer.so.7 TensorRT	1	2878	February 28, 2023
Could not load dynamic library 'libnvinfer.so.7' TensorRT tensorrt , cuda , python	3	2902	June 9, 2023
Where an I download TensorRT 6 tar file TensorRT tensorrt	6	1250	October 12, 2021
Could not load dynamic library 'libcudart.so.10.1'; TensorRT	1	8689	November 30, 2020
Getting errors while trying to install TensorRT 8.5.3 in CUDA 11.8 environment TensorRT	3	2411	December 31, 2023
TensorRT 8.0.0 network installation issue TensorRT	5	1560	May 11, 2021
TensorRT installation problem TensorRT	4	1755	October 16, 2024

Tensorrt not working in RTX 3080

Description

Environment

Steps To Reproduce

Related topics