Minimum compute capability for INT8 optimization?

AI & Data Science Deep Learning (Training & Inference) TensorRT
1

Description

Is there any device requirements for INT8 optimization? I have read the compute capability should be larger than 6.1 for INT8 optimization. According to this, INT8 optimization is not available in P100 or Jetson nano, which is a big surprise to me. Thank you.

Environment

TensorRT Version:
GPU Type:
Nvidia Driver Version:
CUDA Version:
CUDNN Version:
Operating System + Version:
Python Version (if applicable):
TensorFlow Version (if applicable):
PyTorch Version (if applicable):
Baremetal or Container (if container which image + tag):

Relevant Files

Please attach or include links to any models, data, files, or scripts necessary to reproduce your issue. (Github repo, Google Drive, Dropbox, etc.)

Steps To Reproduce

Please include:

  • Exact steps/commands to build your repro
  • Exact steps/commands to run your repro
  • Full traceback of errors encountered
3

Hi @Wukung,

Please refer the following doc.

Thank you.

4

Thank you! That’s exactly what I want.

1 Like