Sorry for late reply. Since I cannot reproduce the error locally, I decide to test with an AWS instance as yours. I select an A100 AWS machine.
And I still cannot reproduce your issue. The int8 trt engine will not get mAP 0.
So, please double check on your side.
Especially in your notebook as below, can you chmod the int8 trt engine and retry?
Exported engine 1:
-rwxrwxrwx 1 root root 48M Apr 21 06:41 /workspace/tlt-experiments/yolo_v4/export32/trt.engine
Exported engine 2:
-rwxrwxrwx 1 root root 13M Apr 21 06:46 /workspace/tlt-experiments/yolo_v4/export16/trt.engine
Exported engine 3:
-rw-r–r-- 1 root root 11M Apr 21 06:53 /workspace/tlt-experiments/yolo_v4/export8/trt.engine