Does TensorRT 8.6.1 support INT8 quantization for HardSwish?

AakankshaS · October 20, 2023, 8:23am

Hi,
Can you try running your model with trtexec command, and share the “”–verbose"" log in case if the issue persist

You can refer below link for all the supported operators list, in case any operator is not supported you need to create a custom plugin to support that operation

github.com

onnx/onnx-tensorrt/blob/main/docs/operators.md

<!--- SPDX-License-Identifier: Apache-2.0 -->

# Supported ONNX Operators

TensorRT 8.6 supports operators up to Opset 17. Latest information of ONNX operators can be found [here](https://github.com/onnx/onnx/blob/master/docs/Operators.md)

TensorRT supports the following ONNX data types: DOUBLE, FLOAT32, FLOAT16, INT8, and BOOL

> Note: There is limited support for INT32, INT64, and DOUBLE types. TensorRT will attempt to cast down INT64 to INT32 and DOUBLE down to FLOAT, clamping values to `+-INT_MAX` or `+-FLT_MAX` if necessary.

See below for the support matrix of ONNX operators in ONNX-TensorRT.

## Operator Support Matrix

| Operator                  | Supported  | Supported Types | Restrictions                                                                                                           |
|---------------------------|------------|-----------------|------------------------------------------------------------------------------------------------------------------------|
| Abs                       | Y          | FP32, FP16, INT32 |
| Acos                      | Y          | FP32, FP16 |
| Acosh                     | Y          | FP32, FP16 |
| Add                       | Y          | FP32, FP16, INT32 |

This file has been truncated. show original

Also, request you to share your model and script if not shared already so that we can help you better.

Meanwhile, for some common errors and queries please refer to below link:

Thanks!

Topic		Replies	Views
Practical aspects about neural networks quantization with TensorRT TensorRT tensorrt	1	803	March 31, 2023
Tensorrt inferencing getting failed with custom quantized int 8 TensorFlow model TensorRT tensorrt , ubuntu , python , cudnn	1	17	March 28, 2025
Convert int8-onnx model to trt engine? TensorRT onnx	6	1086	April 29, 2023
Problem converting TensorFlow 2-> ONNX model to TensorRT Engine (efficientdet_d0) TensorRT	8	1398	November 17, 2022
How to pass uint8 input to a tensorrt engine? TensorRT	6	2834	October 12, 2021
Why while ONNX-TensorRT conversion with INT8 quantizations some layers are not quantized? TensorRT tensorrt , pytorch , onnx	12	2719	December 4, 2022
Quantization of D-FINE in tensorrt 10.8 fails TensorRT tensorrt , cudnn , onnx	3	61	April 30, 2025
How can we know we have convert the onnx to int8trt rather than Float32? TensorRT tensorrt	23	1882	June 14, 2021
Detectron2: faster inferencing TensorRT	2	1412	April 29, 2022
Keras CRNN model conversion to tensorrt engine error TensorRT tensorrt , tensorflow , onnx	3	958	April 8, 2022

Does TensorRT 8.6.1 support INT8 quantization for HardSwish?

Related topics