I’m trying to use TAO to train a QAT model, then export it to INT8, then finally convert it to TRT engine. And from this document, RetinaNet - NVIDIA Docs in the export section it mentioned
The export tool can generate INT8 calibration cache by ingesting training data using either of these options:
- Option 1: Using the training data loader to load the training images for INT8 calibration. This option is now the recommended approach to support multiple image directories by leveraging the training dataset loader. This also ensures two important aspects of data during calibration:
- Data pre-processing in the INT8 calibration step is the same as in the training process.
- The data batches are sampled randomly across the entire training dataset, thereby improving the accuracy of the INT8 model.
- Option 2: Pointing the tool to a directory of images that you want to use to calibrate the model. For this option, make sure to create a sub-sampled directory of random images that best represent your training dataset.
My question is how do I do Option 1: using the dataloader, since it is the recommended option ?
I couldn’t find any settings in the export command…