Int8 quantization

AI & Data Science Deep Learning (Training & Inference) TensorRT
1

Description

I want to quantify with int8. How to use Python to generate the calibration set required by int8.

Environment

TensorRT Version: 7.2.0.14
GPU Type:
Nvidia Driver Version: NVIDIA Xavier NX
CUDA Version: 10.2
CUDNN Version: 8.0.0
Operating System + Version: ubuntu18.04
Python Version (if applicable): 3.6
TensorFlow Version (if applicable):
PyTorch Version (if applicable): 1.6.0
Baremetal or Container (if container which image + tag):

2

Hi, Please refer to the below links to perform inference in INT8

Thanks!