Migration from TRT5 to TRT7

bnascimento · December 8, 2020, 10:30am

Description

Lack of understanding how to migrate SSD code written for TensorRT5 to the latest TensorRT7.

A clear and concise description of the bug or issue.
While migrating from TensorRT5 to TensorRT7 I stumbled into a lack of understanding how to correctly use the new V2 plugin system on c++. For example, calls like createSSDDetectionOutputPlugin or createSSDAnchorGeneratorPlugin are now deprecated. Is there an example how to use use SSD on TensorRT7?

Environment

Ngc tensorflow 20.8 docker container

TensorRT Version: 7
GPU Type: Titan V
Nvidia Driver Version: 450.66
CUDA Version: 11
CUDNN Version: 8
Operating System + Version: Ubuntu 18.04.4 LTS
Python Version (if applicable): 3.6.9
TensorFlow Version (if applicable): 20.8
PyTorch Version (if applicable):
Baremetal or Container (if container which image + tag): Ngc tensorflow 20.8 docke

SunilJB · December 9, 2020, 8:58am

Hi @bnascimento,
We highly encourage you to move to IPluginV2IOExt or IPluginV2DynamicExt to be able to use all the new plugin functionalities.
Please refer to below sample for your reference:

github.com

NVIDIA/TensorRT/blob/492878b2df3c9bf19a26c2b66cba129f450475bc/plugin/geluPlugin/geluPlugin.cpp

/*
 * Copyright (c) 2020, NVIDIA CORPORATION. All rights reserved.
 *
 * Licensed under the Apache License, Version 2.0 (the "License");
 * you may not use this file except in compliance with the License.
 * You may obtain a copy of the License at
 *
 *     http://www.apache.org/licenses/LICENSE-2.0
 *
 * Unless required by applicable law or agreed to in writing, software
 * distributed under the License is distributed on an "AS IS" BASIS,
 * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
 * See the License for the specific language governing permissions and
 * limitations under the License.
 */

#include <cuda.h>
#if CUDA_VERSION >= 10010

#include <cassert>

This file has been truncated. show original

Topic		Replies	Views
Seeking Guidance on Proper Installation of TensorRT TensorRT	1	1300	August 14, 2023
Module 'tensorrt' has no attribute 'Logger' TensorRT	4	1420	January 3, 2023
Could not find any supported formats consistent with input/output data types TensorRT	1	866	April 11, 2023
Custom Layer Implementation - TensorRT - Tensorflow model DriveWorks	9	2701	September 10, 2018
TensorRT8, Tensorflow1.15.5 and Cuda 10.2 TensorRT	3	1127	June 3, 2021
TensorRT on Windows 10 with CUDA 11.5 and cuDNN 8.3 TensorRT	1	1587	November 26, 2021
Unable to use TensorRT 7.2.3 for Ubuntu 18.04 and CUDA 11.2 TensorRT	6	4572	May 6, 2021
getPluginCreator could not find plugin BatchedNMS_TRT version 1 TensorRT	5	4031	December 23, 2020
Where an I download TensorRT 6 tar file TensorRT tensorrt	6	1272	October 12, 2021
New TensorRT Model occupying more GPU Memory as compared to older version TensorRT tensorrt , tensorflow , gpu	8	1990	August 20, 2021

Migration from TRT5 to TRT7

Description

Environment

Related topics