How to infer 1 input and 5 output model?

AI & Data Science Deep Learning (Training & Inference) TensorRT
1

Description

Hi!!
I converted the segmentation model to TensorRT file.(pth → onnx → trt)
This model consists of 1 input and 5 outputs.
In this case, how do I enqueue it for use in C++?
Is there any example or reference?

Environment

TensorRT Version: 7.2.3.4
GPU Type: gtx1060
Nvidia Driver Version: 440.33.01
CUDA Version: 10.2
CUDNN Version: 8.1.1
Operating System + Version: Ubuntu 18.04
Python Version (if applicable): 3.6.9
TensorFlow Version (if applicable):
PyTorch Version (if applicable): 1.7.0
Baremetal or Container (if container which image + tag):

Relevant Files

Here is my onnx, trt files and text file.
https://drive.google.com/file/d/1N97CFgr9fO5NhYc93eG_DAVn_A34ormD/view?usp=sharing

Steps To Reproduce

Please include:

  • Exact steps/commands to build your repro
  • Exact steps/commands to run your repro
  • Full traceback of errors encountered
5

Hi @yuk09122000,

Hope this will help you.
https://github.com/NVIDIA/TensorRT/blob/master/samples/opensource/trtexec/trtexec.cpp

Thank you.