I have found that sample_INT8 does exist which shows the example for mnist.
Can you let me know if my understanding with sample int8 is correct
1)what is the use of BatchStream calibrationStream(CAL_BATCH_SIZE, NB_CAL_BATCHES);
2) I assume the Int8EntropyCalibrator calibrator(calibrationStream, FIRST_CAL_BATCH); does the actual calibration . But how the data need to be feed for calibrator. I assume that batches folder need to be created and then batch0,batch1… need to be created and data need to be copied in it. But it is a tedious task.
3)scoreModel(batchSize, firstScoreBatch, nbScoreBatches, &calibrator);
I assume this is the one which does the actual scoring and lets us know whether INT8 weights are useful for our usage or not for inference . Where the INT8 converted weights will be placed ?
Questions may appear too basic? If there is any documentation regarding the same it would much more helpful for the newbies…
Thanks in advance…