NVIDIA Developer Forums

Setting the batch in TensorRT using CPP API

AI & Data Science Deep Learning (Training & Inference) TensorRT

romilaggarwal611 September 26, 2021, 12:10pm 4

I was able to solve the issue by passing the context to the buffer manager. Had forgotten to add that.
Thanks anyways!

1 Like

Topic		Replies	Views	Activity
TensorRT runtime batch processing in C++ TensorRT tensorrt	5	1590	September 8, 2021
Tensorrt with implicit batchsize TensorRT tensorrt , cudnn	3	581	January 14, 2024
How to support dynamic batch size for TensorRT engine? TensorRT	1	1114	March 3, 2023
Batch Inference Wrong in Python API TensorRT	15	3562	October 12, 2021
Work with batch in TensorRT TensorRT tensorrt , opencv , cuda , tensorflow	20	3850	July 20, 2021
[TensorRT] C++ batch inference gives weird results TensorRT	3	1040	October 12, 2021
Dynamic batch size TensorRT	3	4510	January 24, 2023
Creating a TensorRT Engine with different batch sizes TensorRT python , onnx	12	2828	August 18, 2020
Tensorrt inference on multiple batches TensorRT tensorrt , jetson-inference	5	3180	October 27, 2022
Dynamic batch size for tensorrt Engine TensorRT tensorrt	1	1492	May 30, 2024