How to get : per activation tensor dynamic range?

AI & Data Science Deep Learning (Training & Inference) TensorRT

cr_men_CN0411 June 4, 2019, 9:46am 1

I run the sampleINT8API on win10,cuda10,cudnn7.5,tensorRT5.1.5.It works well.
This sample, sampleINT8API, performs INT8 inference without using the INT8 calibrator; using the user provided per activation tensor dynamic range.
But i want to know how to get per activation tensor dynamic range named:resnet50_per_tensor_dynamic_range.txt?

1 Like

Topic		Replies	Views
example script to calculate dynamic range TensorRT	1	809	December 11, 2018
about the onnx tensort int8 TensorRT	0	619	June 23, 2019
Location of data/int8/ or resnet50_per_tensor_dynamic_range.txt TensorRT	4	1241	October 12, 2021
about onnx tensorRT int8 dynamic range(without calibration) method TensorRT	0	808	June 25, 2019
How to run uff_resnet50.py sample in INT8 mode TensorRT	2	1119	January 2, 2019
TensorRT 6.0.1 - trtexec: Users must provide dynamic range for all tensors that are not Int32 TensorRT	4	4059	June 3, 2022
Converting ONNX model to INT8 TensorRT	3	3319	April 9, 2021
Resnet results on AGX TensorRT tensorrt	1	381	February 17, 2022
TRT5: sample code to measure the TensorRT inference performance TensorRT	4	1160	October 15, 2018
Why we need to use setDynamicRange() for all layer data in TensorRT TensorRT tensorrt	1	578	May 17, 2021

How to get : per activation tensor dynamic range?

Related topics