Does tensorrt support QAT using Tensorrt

530869411 · June 10, 2021, 9:14am

Description

I want to know Tensorrt support QAT? or just support Q after traning.

spolisetty · June 14, 2021, 10:39am

Yes TensorRT supports QAT (quantization aware training).
Please refer following developer guide doc for more details,

Sample for your reference,

Thank you.

Topic		Replies	Views
TensorRT help for beginners TensorRT	1	1027	August 30, 2018
Tlt int8 qat Deep Learning (Training & Inference)	1	497	September 8, 2020
Where Can I get supported tensor rt for cuda version 11.4.1 TensorRT tensorrt	2	960	June 21, 2022
Practical aspects about neural networks quantization with TensorRT TensorRT tensorrt	1	763	March 31, 2023
TensorRT conversion issues of ONNX model trained with Quantization Aware Training + custom quantization scale TensorRT tensorrt	5	1371	April 14, 2021
TF TRT Quantization Aware training TensorRT	1	1014	December 13, 2019
Can TensorRT run on Windows server 2016？ TensorRT	1	400	December 18, 2020
QAT on Image classification -- faulty documantation? TAO Toolkit	3	392	July 6, 2022
CONV2DLSTM is compatible with TENSORT? TensorRT	1	284	March 1, 2021
Tensorflow with TensorRT on Jetson TX2 Jetson TX2	2	579	October 18, 2021