Q-1 As you know, in the TensorRT 5/6, batch size >1 has a problem, It’s perform image by image instead of all images of batch at same time. I want to know this problem is occurred in UFF parser? Is this problem solved by ONNX parser even in the TensrRT 5/6? I know this problem solved in the TensrRT 7 with profiler.
Q-2, On what basis, we define the value of max workspace in the converting to TensorRT? If the value that we define be smaller than min size, The process of convert will be stop? I want to know, How do we set optimal value for workspace?