Difference in data type specified during tlt export and tlt convert

Accelerated Computing Intelligent Video Analytics TAO Toolkit
5

More info:

  1. For tlt-export, no matter FP32/FP16/INT8, the etlt model is exactly the same. The datatype is always fp32.
  2. For tlt-export, if set to INT8, it can do calibration and generate the INT8 calibration table for deployment.
  3. FP16 tlt-export + FP32 tlt-convert will behave exactly like FP32 all the way. It will generate FP32 engine
  4. FP32 tlt-export + FP16 tlt-convert will generate FP16 engine.
2 Likes