Is there a way to get higher performance of running back-to-back-detectors with Deepstream5.0 on NX?
We tested back-to-back-detectors with DS5 on NX and got not smooth inference result. The speed might be lower than 15 FPS.
Also the GPU usage was around 99%. (see attached.)
Already set nvpmodel to 2 and enabled jetson-clock.
Moreover, modifying interval did not see any change.
May I check again?
On NX , should we set nvpmodel to 0 or 2 for max performance?
As network-mode was set to 1 and we got “INT calibration file not specified, TRYING FP16” ( see attached.)
However, using FP 16 seems better than FP32.
Just like to know, is it possible to use INT 8?
2.
INT8 requires GPU architecture > 7.x, and Xavier NX does meet the requirement.
The error indicates you need a calibration table to map a floating number into an integer.
Based on the configure below, it should find a calibration table named cal_trt.bin.
Could you check if the file exists in your environment first?