After calibration a custom deep net work. I got an error.
net:
layer {
name: “attenstion1/relu1”
type: “ReLU”
bottom: “attention1_max_fc1”
top: “attention1_max_relu1”
}
if i use “attention1_max_fc1” as output, i can get right calibration result.
but when using “attention1_max_relu1” as output, got the following error.
Tensor attention1_max_relu1 is uniformly zero; network calibration failed.
INT8_CALIB: cudnnBuilder2.cpp:996: nvinfer1::cudnn::Engine* nvinfer1::builder::buildEngine(nvinfer1::CudaEngineBuildConfig&, const nvinfer1::cudnn::HardwareContext&, const nvinfer1::Network&): Assertion `it != tensorScales.end()’ failed.
br.