You can try to get the image from each of your steps to see if that is normal.
Since you have verified it by using your model alone as PGIE and our nvinfer is open source. You can also get the image from each steps in the nvinfer. We have a detailed source code diagram that you can refer to.