Hello All, I converted two classifiers (resnet50 and mobilenetV2 ) from tenserflow .pb to onnx using this GitHub repo GitHub - onnx/tensorflow-onnx: Convert TensorFlow, Keras, Tensorflow.js and Tflite models to ONNX I compare between .onnx and .pb reults after the conversion and I got the same res…

Hi, Please check the suggestion shared on 24 Jun first. Use GPU for scaling can improve the accuracy issue. If you are using images as the pipeline, there is a bug fix in the jpeg decoder. The fix will be available in our upcoming release. Thanks.

Hi, Thank you both for the clarification. It seems the root cause is from TensorRT rather than Deepstream. Could you share the sample that can output expected (onnxruntime?) and incorrect (TensorRT) results with us? We want to check this with the TensorRT team. Thanks.

Hi, I have managed to add some code to dump out our result data of running efficientdet-d0.onnx by OnnxRuntime to the json file onnxruntime_result.json with the same format as that of trtexec-result.json, which was output by running trtexec with efficientdet-d0.onnx. And so, the raw data, which …

Sorry, for the onnx, please use this efficientdet-d0-s.zip: efficientdet-d0-s.zip (2.0 MB)

Hello, any update ? thanks. Please ignore the result seen in o4_clip-1-TensorRT_result.jpg attached last time, I forgot to scale bbox back to their actual size with the scale ratio used in image preprocessing for network, so the size and position of the two bboxes in o4_clip-1-TensorRT_result.jp…

Hi, Thanks for sharing the information. There is a similar issue in Inference of model using tensorflow/onnxruntime and TensorRT gives different result and we are checking it right now. Will update here for any further progress. Thanks.

Hi, We have confirmed that the above topic is a user bug in pre-processing. Could you check if you are meeting the similar first? [image] Inference of model using tensorflow/onnxruntime and TensorRT gives different result Jetson TX2 Hi, We have confirmed this is an appl…

No, I think the cause of the precision degradation I saw is totally different, as I got the raw input data for OnnxRuntime’s run() by np.tofile(), the same raw data runs with OnnxRuntime’s run() could get much better result than that runs with trtexec. You can have a test with the raw data wh…

I have a similar issue with efficentnet and efficientdet when converting from onnx to tensorrt. In onnxruntime the predictions are fine but when doing inference with tensorrt I only get a zero tensor

Hi, both Thanks for your reporting. We are trying to reproducing this issue with the date shared by akachen in Nov 5. Will let you know for any progress. Thanks.

Hi, akachen Sorry for the late. We try to reproduce this issue with following file: efficientdet-d0-s.zip effcientdet-onnx_ort-vs-trtexec.part01.zip (4 MB) effcientdet-onnx_ort-vs-trtexec.part02.zip (4 MB) effcientdet-onnx_ort-vs-trtexec.part03.zip (4 MB) effcientdet-onnx_ort-vs-trtexec.part0…

Classifier result on onnx doesn't match Deepstream result

Accelerated Computing Intelligent Video Analytics DeepStream SDK

AastaLLL November 25, 2020, 6:14am 16

Hi,

We have confirmed that the above topic is a user bug in pre-processing.
Could you check if you are meeting the similar first?

Thanks.

Topic		Replies	Views
TensorFlow EfficientDet-D0 -> ONNX -> TensorRT converted model fails to run in Deepstream DeepStream SDK deepstream61	7	1184	August 11, 2022
Loss of precision to onnx converter for engine by deepstream 6.3 DeepStream SDK tensorrt , gstreamer , inference-server-triton	30	963	August 2, 2024
Custom detection ONNX model gives wrong outputs using nvinfer with DeepStream 5.1 DeepStream SDK	16	3162	September 27, 2021
Detections change in Deepstream 6.2 DeepStream SDK tensorrt , camera , cuda , kernel , gstreamer , yolo , python , deepstream , deepstream61	21	2156	July 31, 2023
Output of deepstream doesn't match with output of onnx model DeepStream SDK tensorrt , onnx	3	722	September 15, 2020
Tensorflow RetinaNet Object Detector on Deepstream DeepStream SDK	18	3090	February 3, 2020
Difference between predictions of exported TensorRT engine and PyTorch pth models DeepStream SDK	22	2770	March 14, 2023
Problems with Onnx model zoo -> trtexec -> DeepStream 6.0 pipeline DeepStream SDK	16	1107	November 29, 2023
Output tensor values are different from Deepstream and keras, python TensorRt implementation DeepStream SDK nvbugs	42	3167	March 7, 2022
Issue with Converting ONNX Model with different dimensions to TensorRT Engine for DeepStream DeepStream SDK deepstream	21	882	May 23, 2025

Classifier result on onnx doesn't match Deepstream result

Related topics