Work with batch in TensorRT

v.stadnichuk July 15, 2021, 8:41am 22

We have Nvidia Drive AGX, not Jetson AGX. And Drive AGX does not support Polygraphy. We checked it here:
Environment.txt (461 Bytes)

That’s why we use TensorRT and can you help with TensorRT script?

Also now batch processing is not important, so could you help with this issue (Deploy this script on the C++ TensorRT API)?

Topic		Replies	Views
Batch Inference Wrong in Python API TensorRT	15	3636	October 12, 2021
Tensorrt inference with batch > 1 TensorRT	4	1439	October 13, 2022
Unable to batch TensorRT TensorRT	0	559	March 23, 2021
Question about Python tutorial TensorRT	3	574	October 12, 2021
Tensorrt Batch Inference TensorRT tensorrt	8	1648	December 1, 2020
[TensorRT] C++ batch inference gives weird results TensorRT	3	1077	October 12, 2021
TensorRT С++ optimization profile TensorRT tensorrt , opencv , cuda	29	3279	September 9, 2021
"Engine buffer is full" TensorRT	15	3806	October 12, 2021
TensorRT runtime batch processing in C++ TensorRT tensorrt	5	1639	September 8, 2021
Tensorrt inference on multiple batches TensorRT tensorrt , jetson-inference	5	3294	October 27, 2022