Batch Processing using TensorRT Engine

AI & Data Science Deep Learning (Training & Inference) TensorRT
1

Can anyone help out c++ code to do inference through batch processing.
Thanks in advance.

2

Hi,

Please refer to below samples for your reference:
https://github.com/NVIDIA/TensorRT/blob/07ed9b57b1ff7c24664388e5564b17f7ce2873e5/samples/opensource/sampleSSD/sampleSSD.cpp
https://github.com/NVIDIA/TensorRT/blob/07ed9b57b1ff7c24664388e5564b17f7ce2873e5/samples/opensource/sampleINT8/sampleINT8.cpp

Thanks

3

Thank you Mr. SunilJB.