Speed question of Deepstream on Jetson Orin Nano

Accelerated Computing Intelligent Video Analytics DeepStream SDK
,
1

• Hardware Platform (Jetson Orin Nano with Jetpack 6.1)
• DeepStream Version: 7.1
• JetPack Version (Jetpack 6.1)
• TensorRT Version 10.3
• Issue Type( question)
Hello nvs,
I use the Jetson Orin Nano to deploy bodypose3d with github deepstream_reference_apps/deepstream-bodypose-3d at master · NVIDIA-AI-IOT/deepstream_reference_apps · GitHub

Below is the log

seer@seer:/opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-bodypose-3d/sources$ ./deepstream-pose-estimation-app --input file://$BODYPOSE3D_HOME/streams/bodypose.mp4 --output $BODYPOSE3D_HOME/streams/bodypose_3dbp.mp4 --focal 800.0 --width 1280 --height 720 --fps --save-pose $BODYPOSE3D_HOME/streams/bodypose_3dbp.json
Now playing: file:///opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-bodypose-3d/streams/bodypose.mp4
Setting min object dimensions as 16x16 instead of 1x1 to support VIC compute mode.
0:00:00.366455297 69963 0xaaaadcfd14f0 INFO                 nvinfer gstnvinfer.cpp:684:gst_nvinfer_logger:<secondary-nvinference-engine> NvDsInferContext[UID 2]: Info from NvDsInferContextImpl::deserializeEngineAndBackend() <nvdsinfer_context_impl.cpp:2092> [UID = 2]: deserialized trt engine from :/opt/nvidia/deepstream/deepstream-7.1/sources/apps/sample_apps/deepstream-bodypose-3d/models/bodypose3dnet/bodypose3dnet_accuracy.onnx_b8_gpu0_fp16.engine
INFO: [FullDims Engine Info]: layers num: 9
0   INPUT  kFLOAT input0          3x256x192       min: 1x3x256x192     opt: 8x3x256x192     Max: 8x3x256x192     
1   INPUT  kFLOAT k_inv           3x3             min: 1x3x3           opt: 8x3x3           Max: 8x3x3           
2   INPUT  kFLOAT t_form_inv      3x3             min: 1x3x3           opt: 8x3x3           Max: 8x3x3           
3   INPUT  kFLOAT scale_normalized_mean_limb_lengths 36              min: 1x36            opt: 8x36            Max: 8x36            
4   INPUT  kFLOAT mean_limb_lengths 36              min: 1x36            opt: 8x36            Max: 8x36            
5   OUTPUT kFLOAT pose2d          34x3            min: 0               opt: 0               Max: 0               
6   OUTPUT kFLOAT pose2d_org_img  34x3            min: 0               opt: 0               Max: 0               
7   OUTPUT kFLOAT pose25d         34x4            min: 0               opt: 0               Max: 0               
8   OUTPUT kFLOAT pose3d          34x3            min: 0               opt: 0               Max: 0               

0:00:00.366646141 69963 0xaaaadcfd14f0 INFO                 nvinfer gstnvinfer.cpp:684:gst_nvinfer_logger:<secondary-nvinference-engine> NvDsInferContext[UID 2]: Info from NvDsInferContextImpl::generateBackendContext() <nvdsinfer_context_impl.cpp:2195> [UID = 2]: Use deserialized engine model: /opt/nvidia/deepstream/deepstream-7.1/sources/apps/sample_apps/deepstream-bodypose-3d/models/bodypose3dnet/bodypose3dnet_accuracy.onnx_b8_gpu0_fp16.engine
0:00:00.376978376 69963 0xaaaadcfd14f0 INFO                 nvinfer gstnvinfer_impl.cpp:343:notifyLoadModelStatus:<secondary-nvinference-engine> [UID 2]: Load new model:../configs/config_infer_secondary_bodypose3dnet.txt sucessfully
gstnvtracker: Loading low-level lib at /opt/nvidia/deepstream/deepstream/lib/libnvds_nvmultiobjecttracker.so
[NvMultiObjectTracker] Initialized
Setting min object dimensions as 16x16 instead of 1x1 to support VIC compute mode.
0:00:00.465781011 69963 0xaaaadcfd14f0 INFO                 nvinfer gstnvinfer.cpp:684:gst_nvinfer_logger:<primary-nvinference-engine> NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::deserializeEngineAndBackend() <nvdsinfer_context_impl.cpp:2092> [UID = 1]: deserialized trt engine from :/opt/nvidia/deepstream/deepstream-7.1/sources/apps/sample_apps/deepstream-bodypose-3d/models/peoplenet/resnet34_peoplenet_int8.onnx_b1_gpu0_int8.engine
Implicit layer support has been deprecated
INFO: [Implicit Engine Info]: layers num: 0

0:00:00.465879441 69963 0xaaaadcfd14f0 INFO                 nvinfer gstnvinfer.cpp:684:gst_nvinfer_logger:<primary-nvinference-engine> NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::generateBackendContext() <nvdsinfer_context_impl.cpp:2195> [UID = 1]: Use deserialized engine model: /opt/nvidia/deepstream/deepstream-7.1/sources/apps/sample_apps/deepstream-bodypose-3d/models/peoplenet/resnet34_peoplenet_int8.onnx_b1_gpu0_int8.engine
0:00:00.468080797 69963 0xaaaadcfd14f0 INFO                 nvinfer gstnvinfer_impl.cpp:343:notifyLoadModelStatus:<primary-nvinference-engine> [UID 1]: Load new model:../configs/config_infer_primary_peoplenet.txt sucessfully
Decodebin child added: source
Decodebin child added: decodebin0
Running...
Opening in BLOCKING MODE 
NvMMLiteOpen : Block : BlockType = 279 
NvMMLiteBlockCreate : Block : BlockType = 279 
In cb_newpad

gstnvtracker: Unable to acquire a user meta buffer. Try increasing user-meta-pool-size
gstnvtracker: Unable to acquire a user meta buffer. Try increasing user-meta-pool-size
gstnvtracker: Unable to acquire a user meta buffer. Try increasing user-meta-pool-size
**PERF : FPS_0 (26.99)
gstnvtracker: Unable to acquire a user meta buffer. Try increasing user-meta-pool-size
gstnvtracker: Unable to acquire a user meta buffer. Try increasing user-meta-pool-size
gstnvtracker: Unable to acquire a user meta buffer. Try increasing user-meta-pool-size
**PERF : FPS_0 (15.49)
**PERF : FPS_0 (12.99)
**PERF : FPS_0 (11.24)
**PERF : FPS_0 (9.99)
**PERF : FPS_0 (9.33)
gstnvtracker: Unable to acquire a user meta buffer. Try increasing user-meta-pool-size
**PERF : FPS_0 (8.71)
gstnvtracker: Unable to acquire a user meta buffer. Try increasing user-meta-pool-size
gstnvtracker: Unable to acquire a user meta buffer. Try increasing user-meta-pool-size
gstnvtracker: Unable to acquire a user meta buffer. Try increasing user-meta-pool-size
**PERF : FPS_0 (8.37)
gstnvtracker: Unable to acquire a user meta buffer. Try increasing user-meta-pool-size
gstnvtracker: Unable to acquire a user meta buffer. Try increasing user-meta-pool-size
**PERF : FPS_0 (8.11)
**PERF : FPS_0 (7.89)
**PERF : FPS_0 (7.72)
**PERF : FPS_0 (7.57)
gstnvtracker: Unable to acquire a user meta buffer. Try increasing user-meta-pool-size
**PERF : FPS_0 (7.45)
gstnvtracker: Unable to acquire a user meta buffer. Try increasing user-meta-pool-size
**PERF : FPS_0 (7.35)
gstnvtracker: Unable to acquire a user meta buffer. Try increasing user-meta-pool-size
gstnvtracker: Unable to acquire a user meta buffer. Try increasing user-meta-pool-size
gstnvtracker: Unable to acquire a user meta buffer. Try increasing user-meta-pool-size
gstnvtracker: Unable to acquire a user meta buffer. Try increasing user-meta-pool-size
**PERF : FPS_0 (7.33)
**PERF : FPS_0 (7.18)
**PERF : FPS_0 (7.17)
**PERF : FPS_0 (7.10)
**PERF : FPS_0 (7.04)
gstnvtracker: Unable to acquire a user meta buffer. Try increasing user-meta-pool-size
gstnvtracker: Unable to acquire a user meta buffer. Try increasing user-meta-pool-size
**PERF : FPS_0 (6.99)
gstnvtracker: Unable to acquire a user meta buffer. Try increasing user-meta-pool-size
gstnvtracker: Unable to acquire a user meta buffer. Try increasing user-meta-pool-size
gstnvtracker: Unable to acquire a user meta buffer. Try increasing user-meta-pool-size
**PERF : FPS_0 (6.99)
gstnvtracker: Unable to acquire a user meta buffer. Try increasing user-meta-pool-size
**PERF : FPS_0 (6.95)
**PERF : FPS_0 (6.91)
**PERF : FPS_0 (6.95)
gstnvtracker: Unable to acquire a user meta buffer. Try increasing user-meta-pool-size
**PERF : FPS_0 (6.99)
gstnvtracker: Unable to acquire a user meta buffer. Try increasing user-meta-pool-size
gstnvtracker: Unable to acquire a user meta buffer. Try increasing user-meta-pool-size
gstnvtracker: Unable to acquire a user meta buffer. Try increasing user-meta-pool-size
**PERF : FPS_0 (6.99)
gstnvtracker: Unable to acquire a user meta buffer. Try increasing user-meta-pool-size
gstnvtracker: Unable to acquire a user meta buffer. Try increasing user-meta-pool-size
**PERF : FPS_0 (6.99)
**PERF : FPS_0 (7.03)
**PERF : FPS_0 (7.03)
gstnvtracker: Unable to acquire a user meta buffer. Try increasing user-meta-pool-size
**PERF : FPS_0 (7.03)
gstnvtracker: Unable to acquire a user meta buffer. Try increasing user-meta-pool-size
**PERF : FPS_0 (6.99)
gstnvtracker: Unable to acquire a user meta buffer. Try increasing user-meta-pool-size
gstnvtracker: Unable to acquire a user meta buffer. Try increasing user-meta-pool-size
**PERF : FPS_0 (6.96)
gstnvtracker: Unable to acquire a user meta buffer. Try increasing user-meta-pool-size
gstnvtracker: Unable to acquire a user meta buffer. Try increasing user-meta-pool-size
**PERF : FPS_0 (6.96)
**PERF : FPS_0 (7.02)
**PERF : FPS_0 (7.02)
gstnvtracker: Unable to acquire a user meta buffer. Try increasing user-meta-pool-size
**PERF : FPS_0 (7.02)
gstnvtracker: Unable to acquire a user meta buffer. Try increasing user-meta-pool-size
gstnvtracker: Unable to acquire a user meta buffer. Try increasing user-meta-pool-size
gstnvtracker: Unable to acquire a user meta buffer. Try increasing user-meta-pool-size
gstnvtracker: Unable to acquire a user meta buffer. Try increasing user-meta-pool-size
**PERF : FPS_0 (7.05)
**PERF : FPS_0 (7.02)
gstnvtracker: Unable to acquire a user meta buffer. Try increasing user-meta-pool-size
**PERF : FPS_0 (6.97)
**PERF : FPS_0 (6.94)
**PERF : FPS_0 (6.90)
gstnvtracker: Unable to acquire a user meta buffer. Try increasing user-meta-pool-size
**PERF : FPS_0 (6.90)
gstnvtracker: Unable to acquire a user meta buffer. Try increasing user-meta-pool-size
gstnvtracker: Unable to acquire a user meta buffer. Try increasing user-meta-pool-size
gstnvtracker: Unable to acquire a user meta buffer. Try increasing user-meta-pool-size
gstnvtracker: Unable to acquire a user meta buffer. Try increasing user-meta-pool-size
**PERF : FPS_0 (6.90)
gstnvtracker: Unable to acquire a user meta buffer. Try increasing user-meta-pool-size
**PERF : FPS_0 (6.93)
**PERF : FPS_0 (6.93)
**PERF : FPS_0 (6.95)
gstnvtracker: Unable to acquire a user meta buffer. Try increasing user-meta-pool-size
**PERF : FPS_0 (6.93)
gstnvtracker: Unable to acquire a user meta buffer. Try increasing user-meta-pool-size
gstnvtracker: Unable to acquire a user meta buffer. Try increasing user-meta-pool-size
gstnvtracker: Unable to acquire a user meta buffer. Try increasing user-meta-pool-size
**PERF : FPS_0 (6.95)
gstnvtracker: Unable to acquire a user meta buffer. Try increasing user-meta-pool-size
**PERF : FPS_0 (6.97)
gstnvtracker: Unable to acquire a user meta buffer. Try increasing user-meta-pool-size
**PERF : FPS_0 (6.95)
**PERF : FPS_0 (6.97)
gstnvtracker: Unable to acquire a user meta buffer. Try increasing user-meta-pool-size
**PERF : FPS_0 (6.99)
gstnvtracker: Unable to acquire a user meta buffer. Try increasing user-meta-pool-size
gstnvtracker: Unable to acquire a user meta buffer. Try increasing user-meta-pool-size
**PERF : FPS_0 (6.97)
gstnvtracker: Unable to acquire a user meta buffer. Try increasing user-meta-pool-size
gstnvtracker: Unable to acquire a user meta buffer. Try increasing user-meta-pool-size
**PERF : FPS_0 (7.01)
gstnvtracker: Unable to acquire a user meta buffer. Try increasing user-meta-pool-size
**PERF : FPS_0 (6.99)
**PERF : FPS_0 (6.99)
**PERF : FPS_0 (6.98)
gstnvtracker: Unable to acquire a user meta buffer. Try increasing user-meta-pool-size
gstnvtracker: Unable to acquire a user meta buffer. Try increasing user-meta-pool-size
**PERF : FPS_0 (6.98)
gstnvtracker: Unable to acquire a user meta buffer. Try increasing user-meta-pool-size
gstnvtracker: Unable to acquire a user meta buffer. Try increasing user-meta-pool-size
**PERF : FPS_0 (6.99)
gstnvtracker: Unable to acquire a user meta buffer. Try increasing user-meta-pool-size
**PERF : FPS_0 (6.99)
gstnvtracker: Unable to acquire a user meta buffer. Try increasing user-meta-pool-size
**PERF : FPS_0 (6.99)
**PERF : FPS_0 (6.99)
**PERF : FPS_0 (6.98)
gstnvtracker: Unable to acquire a user meta buffer. Try increasing user-meta-pool-size
gstnvtracker: Unable to acquire a user meta buffer. Try increasing user-meta-pool-size
gstnvtracker: Unable to acquire a user meta buffer. Try increasing user-meta-pool-size
gstnvtracker: Unable to acquire a user meta buffer. Try increasing user-meta-pool-size
**PERF : FPS_0 (6.99)
gstnvtracker: Unable to acquire a user meta buffer. Try increasing user-meta-pool-size
**PERF : FPS_0 (7.01)
gstnvtracker: Unable to acquire a user meta buffer. Try increasing user-meta-pool-size
**PERF : FPS_0 (7.01)
nvstreammux: Successfully handled EOS for source_id=0
**PERF : FPS_0 (7.04)
**PERF : FPS_0 (0.00)
**PERF : FPS_0 (0.00)
**PERF : FPS_0 (0.00)
**PERF : FPS_0 (0.00)
**PERF : FPS_0 (0.00)
End of Stream
Returned, stopping playback
Deleting pipeline
[NvMultiObjectTracker] De-initialized

Can I know if the fps normal? Below is jtop

image
image629×210 6.94 KB

THanks,

3

please refer to this link for performance improvement. especially setting “clocks high”, solution 5 and Solution 12.

4

when I test on DGPU, there is no logging

gstnvtracker: Unable to acquire a user meta buffer. Try increasing user-meta-pool-size

will this influence performance?

5

Please refer to this link for “increasing user-meta-pool-size”. When the latency for downstream plugins to release the buffers is too long, the buffer pool may be empty so tracker will skip reporting the miscellaneous data for next batch.
The processing speed of downstream plugins may be slow due to some performance problems.

6

are you many objects in the test video? could you share the source? Thanks! You can use forum private email. please click forum avatar-> personal messages->new message.