Hi,
How can I batch in TensorRT 6?
In TensorRT 5, it works but now output value is all zero.
I allocated B x C x H x W and copy all of them.
But in output, batch 0’s result is good but batch 1’s result is all zero.
I convert trt engine from onnx using onnx-trt and I add arg -b 2, batch size is checked in trt engine.
Is there anything i should do?
Thanks.