I’m looking to do int8 calibration for a particular model. The scales generated by calibration are not performing adequately. Is there a way to hand-tune the scales?
I’ve noticed that the cached calibration file contains a hex value for each layer. Can you explain what these values represent? That way it becomes possible to try to tune these values for improved model accuracy.