@bwallach Please refer to some topics , for example, Inferring Yolo_v3.trt model in python - #33 by Morganh , YOLO v4 inference with TensorRT after training with TLT 3.0 - #3 by johan_b