Description Hello everyone, I’m new in using TensorRT Python API. Could you help me to migrate simple angle prediction model from Keras framework to TensorRT via ONNX? Now the main trouble is batch processing. My model has one dynamic input (batch of images). I created TRT engine with trtexec: .…

Work with batch in TensorRT

spolisetty July 20, 2021, 6:15pm 23

Looks like issues are more w.r.t inference script. We recommend you to please go through https://docs.nvidia.com/deeplearning/tensorrt/developer-guide/index.html#python_topics for better undemanding of inference using TensorRT python api, And correct the bindings related, other errors in the script.

Topic		Replies	Views
Tensorrt inference with batch > 1 TensorRT	4	1509	October 13, 2022
Batch Inference Wrong in Python API TensorRT	14	3765	February 20, 2020
Question about Python tutorial TensorRT	2	622	September 13, 2021
Unable to batch TensorRT TensorRT	0	579	March 23, 2021
TensorRT Batch Inferences : empty outputs TensorRT tensorrt , jetson-inference	8	2144	July 18, 2024
TensorRT С++ optimization profile TensorRT tensorrt , opencv , cuda	29	3533	September 9, 2021
Tensorrt inference on multiple batches TensorRT tensorrt , jetson-inference	4	3464	October 13, 2022
Tensorrt Batch Inference TensorRT tensorrt	8	1739	December 1, 2020
Setting the batch in TensorRT using CPP API TensorRT tensorrt	9	1454	January 24, 2025
How to work with explicit batches in python TensorRT	4	2654	February 9, 2022