Multiple inputs/outputs in TensorRT

xxxpsyduck · February 1, 2021, 10:37am

I have a trained model in onnx format. It has 9 outputs. In developer guide I only see example for 1 input and I output:

int inputIndex = engine->getBindingIndex(INPUT_BLOB_NAME); int outputIndex = engine->getBindingIndex(OUTPUT_BLOB_NAME);

void* buffers[2]; buffers[inputIndex] = inputBuffer; buffers[outputIndex] = outputBuffer;

I would like to have some examples about dealing with multiple inputs/outputs in tensorrt. Thanks so much!

spolisetty · February 2, 2021, 10:10am

Hi @xxxpsyduck,

You may find the answer to your query here

Updated link for above mentioned post.

github.com

dusty-nv/jetson-inference/blob/master/c/tensorNet.cpp

/*
 * Copyright (c) 2017, NVIDIA CORPORATION. All rights reserved.
 *
 * Permission is hereby granted, free of charge, to any person obtaining a
 * copy of this software and associated documentation files (the "Software"),
 * to deal in the Software without restriction, including without limitation
 * the rights to use, copy, modify, merge, publish, distribute, sublicense,
 * and/or sell copies of the Software, and to permit persons to whom the
 * Software is furnished to do so, subject to the following conditions:
 *
 * The above copyright notice and this permission notice shall be included in
 * all copies or substantial portions of the Software.
 *
 * THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
 * IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
 * FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT.  IN NO EVENT SHALL
 * THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
 * LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING
 * FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER
 * DEALINGS IN THE SOFTWARE.

This file has been truncated. show original

Thank you.

system · October 12, 2021, 6:59am

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.

Topic		Replies	Views
multiple inputs and outputs in DL models Jetson Nano	9	2416	October 18, 2021
Mulitple Output classification on Nano Jetson Nano tensorrt	3	348	October 18, 2021
Tensorrt conversion for onnx model with tow output arrays TensorRT	4	859	June 24, 2021
Different engines give different inference results when using the same onnx model and giving the same input TensorRT	4	893	December 31, 2023
Tensorrt inference on multiple batches TensorRT tensorrt , jetson-inference	5	2867	October 27, 2022
Tensorrt8.5 inference different with origin onnx model TensorRT	6	1063	December 13, 2022
How to infer 1 input and 5 output model? TensorRT	1	326	May 12, 2021
How to set multiple outputs using python API? TensorRT tensorrt	2	814	July 22, 2022
Finding TensorRT blob tensor output of model layer TensorRT tensorrt	3	469	April 28, 2020
Segfault error when exporting model from ONNX to TensorRT Jetson Nano tensorrt , onnx	4	711	October 10, 2021

Multiple inputs/outputs in TensorRT

Related topics