I am converting my caffe model to tensorrt int8 version.
However, I stuck in calibration phase and the program cannot create a calibration table for the error below.
Here is the error msg:
ERROR: Tensor (Unnamed ITensor* 352) is uniformly zero; network calibration failed.
I have several questions:
How could I find out which layer output is the “Unnamed ITensor* 352”? I could not even check if it is really uniformly zero without knowing which layer output that has been referring to.
The calibrator reads images in the same format as the engine input. Is image the only thing needed for calibration? or I need to provide labels to the calibrator? If labels are needed for calibration, how can I do this? is there any code example?
I actually do not believe that there would be a tensor output uniformly zero in the network, for fp32 and fp16 version of my model can perform correctly as I expected and my model is for segmentation. If that after I checked, the tensor specified turned out not outputting uniformly zero, any ideas what could be the cause of this error and how to fix it?
I tried to use 1000 calibration images for that there is an advice in the forum says lack of calibration images could be the problem. But still, increasing the number of calibration data does not solve the error. Any other advice on calibration dataset manipulation?
I encountered this error with the following environment:
GPU : nvidia GeForce RTX 2080 Ti
TRT : version 18.104.22.168
Cuda : version 10
cudnn : version 7.3