DeepStream 6.4 test3 works on x86 Desktop but does not work on Orin

Please provide complete information as applicable to your setup.

• Hardware Platform (Jetson / GPU):

Desktop: i7-8700, GTX1080 8G, 32GB RAM, 500GB SSD, Ubuntu 22.0.4

Orin: Model P3737
• DeepStream Version
Both 6.4
• JetPack Version (valid for Jetson only)

JetPack 6.0 (rev2)
• TensorRT Version

Desktop: Not Found

Orin: 8.6.2
• NVIDIA GPU Driver Version (valid for GPU only)

Desktop: 580.126.09, CUDA Version 13.0

Orin: NVIDIA-SMI 540.3.0 Driver Version: N/A CUDA Version: 12.2

Orin:
• Issue Type( questions, new requirements, bugs)

test3 works well on my desktop(no matter 1, 2, 3, 4, 6, 8 recorded videos simultaneously), but not working on Orin.

test1 and 2 works well on both desktop and jetson
• How to reproduce the issue ? (This is for bugs. Including which sample app is using, the configuration files content, the command line used and other details for reproducing)

cd /opt/nvidia/deepstream/deepstream-6.4/sources/apps/sample_apps/deepstream-test3

Edit dstest3_pgie_config.txt, use model-engine-file=../../../../samples/models/Primary_Detector/resnet18_trafficcamnet.etlt_b1_gpu0_fp32.engine (line 66) and (line 74) network-mode=0 to repleace original lines.

sudo make CUDA_VER=12.2

./deepstream-test3-app file:///opt/nvidia/deepstream/deepstream-6.4/samples/streams/sample_720p.h264

Then a new dark window appear, and disappear immediately, program crashed.

nvidia@ubuntu:/opt/nvidia/deepstream/deepstream-6.4/sources/apps/sample_apps/deepstream-test3$ ./deepstream-test3-app file:///opt/nvidia/deepstream/deepstream-6.4/samples/streams/sample_720p.h264
Now playing: file:///opt/nvidia/deepstream/deepstream-6.4/samples/streams/sample_720p.h264,
WARNING: [TRT]: Using an engine plan file across different models of devices is not recommended and is likely to affect performance or even cause errors.
0:00:05.331940074 5584 0xaaab0cd59a10 INFO nvinfer gstnvinfer.cpp:682:gst_nvinfer_logger: NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::deserializeEngineAndBackend() <nvdsinfer_context_impl.cpp:2092> [UID = 1]: deserialized trt engine from :/opt/nvidia/deepstream/deepstream-6.4/samples/models/Primary_Detector/resnet18_trafficcamnet.etlt_b1_gpu0_fp32.engine
INFO: [Implicit Engine Info]: layers num: 3
0 INPUT kFLOAT input_1 3x544x960
1 OUTPUT kFLOAT output_bbox/BiasAdd 16x34x60
2 OUTPUT kFLOAT output_cov/Sigmoid 4x34x60

0:00:05.677782254 5584 0xaaab0cd59a10 INFO nvinfer gstnvinfer.cpp:682:gst_nvinfer_logger: NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::generateBackendContext() <nvdsinfer_context_impl.cpp:2195> [UID = 1]: Use deserialized engine model: /opt/nvidia/deepstream/deepstream-6.4/samples/models/Primary_Detector/resnet18_trafficcamnet.etlt_b1_gpu0_fp32.engine
0:00:05.688669119 5584 0xaaab0cd59a10 INFO nvinfer gstnvinfer_impl.cpp:328:notifyLoadModelStatus: [UID 1]: Load new model:dstest3_pgie_config.txt sucessfully
Decodebin child added: source

(deepstream-test3-app:5584): GLib-GObject-WARNING **: 10:24:25.413: g_object_set_is_valid_property: object class ‘GstFileSrc’ has no property named ‘drop-on-latency’
Decodebin child added: decodebin0
Running…

Decodebin child added: h264parse0
Decodebin child added: capsfilter0
Decodebin child added: nvv4l2decoder0
Opening in BLOCKING MODE
NvMMLiteOpen : Block : BlockType = 261
NvMMLiteBlockCreate : Block : BlockType = 261
Frame Number = 0 Number of objects = 16 Vehicle Count = 10 Person Count = 6

• Requirement details( This is for new requirement. Including the module name-for which plugin or for which sample application, the function description)

How could test3 compatible with Orin?

deepstream-test3 does not support raw ES stream. Please use file:///opt/nvidia/deepstream/deepstream/samples/streams/sample_1080p_h264.mp4 instead.

Thanks for your answer. If deepstream-test3 does not support raw ES stream, how did it work on the desktop with dgpu?

I solved by changing version I am afraid that I will not be able to try file:///opt/nvidia/deepstream/deepstream/samples/streams/sample_1080p_h264.mp4.

For Orin, I flashed again with JetPack 6.2.1 (rev.1), selected DeepStream 7.1 as additional SDKS. Then I change settings (still these two lines) by

cd /opt/nvidia/deepstream/deepstream-7.1/sources/apps/sample_apps/deepstream-test3
sudo nano dstest3_pgie_config.txt

compile using

sudo make CUDA_VER=12.6

finally,

deepstream-test3-app file:///opt/nvidia/deepstream/deepstream-7.1/samples/streams/sample_720p.h264

works.

Multiple channels works, but saving the model takes long time, I still have to change config manually to fit number of channels.

For example, change

model-engine-file=../../../../samples/models/Primary_Detector/resnet18_trafficcamnet.etlt_b1_gpu0_fp32.engine

to

model-engine-file=../../../../samples/models/Primary_Detector/resnet18_trafficcamnet.etlt_b2_gpu0_fp32.engine

Then I can use

deepstream-test3-app file:///opt/nvidia/deepstream/deepstream-7.1/samples/streams/sample_720p.h264 file:///opt/nvidia/deepstream/deepstream-7.1/samples/streams/sample_720p.h264

First time it take 100s, then it takes the .engine file, and video appears almost immediately.

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.