Deepstream4.0.2 -> deepstream5.0.1 deepstream-app FPS degradation on Jetson Nano

Accelerated Computing Intelligent Video Analytics DeepStream SDK
1

I observed FPS degradation when migrating from DS4 to DS5.
I really want to amend this issue to upgrade deepstream version without the degradation.

• Hardware Platform (Jetson / GPU)
Jetson Nano
• DeepStream Version
4.0.2 and 5.0.1
• JetPack Version (valid for Jetson only)
Jetpack 4.3 for deepstream 4.0.2
Jetpack 4.4 for deepstream 5.0.1
• TensorRT Version
• NVIDIA GPU Driver Version (valid for GPU only)
• Issue Type( questions, new requirements, bugs)
question, bug
• How to reproduce the issue ? (This is for bugs. Including which sample app is using, the configuration files content, the command line used and other details for reproducing)

  1. for each env, find source4_1080p_dec_infer-resnet_tracker_sgie_tiled_display_int8.txt (under /opt/nvidia/deepstream/…)
    and modified like below for benchmarking.
  • num-sources: 4 → 1
  • sink0 type: 2 → 1 (type=1 for fakesink)
  • sink0 sync: 1 → 0 (sync=0 for higher FPS)

  1. set freq to max and run app
    sudo jetson_clocks
    deepstream-app -c source4_1080p_dec_infer-resnet_tracker_sgie_tiled_display_int8.txt

  2. check PERF output(check average FPS at the final row)
    DS4: 35.44
    DS5: 31.28 (run2: 31.89)

I tried another experiments:

  • no FPS gap when running the app with detection only (delete [track] and [secondary-gie1,2,3] in config)
    DS4: 48.72
    DS5: 48.68
  • no FPS gap when running the app with detection+tracking only (delete [secondary-gie1,2,3] in config)
    DS4: 39.82 (run2: 39.40)
    DS5: 39.20 (run2: 39.29)

• Requirement details( This is for new requirement. Including the module name-for which plugin or for which sample application, the function description)

modified config file for deepstream4 and deepstream5 :
config_ds5.txt (5.8 KB) config_ds4.txt (4.3 KB)

3

It will take some time to look into this issue. Will be back to you when there is any progress.

6

If available, can you do one more experiment, on Jetpack 4.5.1, to see how FPS does same conditions as before versions used?

7

another experiment:

  • low FPS for Deepstream 5.1 ( jetpack4.5.1)
    detection+tracking+secondary1,2,3
    => 31.99 FPS
8

Hi,
I just run on NANO with Jetpack 4.5.1, got FPS around below, higher than your result. i share the configuration i used, can you try with this configuration? make sure we are in the same page.

source4_1080p_dec_infer-resnet_tracker_sgie_tiled_display_int8.txt (5.6 KB)

**PERF: 37.53 (37.28)
**PERF: 31.94 (34.35)
**PERF: 33.49 (34.08)
**PERF: 33.16 (33.80)
**PERF: 36.94 (34.42)
**PERF: 35.14 (34.59)
**PERF: 34.34 (34.56)
**PERF: 37.39 (34.92)
**PERF: 39.04 (35.39)
**PERF: 32.73 (35.10)
**PERF: 32.42 (34.83)
**PERF: 34.63 (34.83)