Deepstream4.0.2 -> deepstream5.0.1 deepstream-app FPS degradation on Jetson Nano

I observed FPS degradation when migrating from DS4 to DS5.
I really want to amend this issue to upgrade deepstream version without the degradation.

• Hardware Platform (Jetson / GPU)
Jetson Nano
• DeepStream Version
4.0.2 and 5.0.1
• JetPack Version (valid for Jetson only)
Jetpack 4.3 for deepstream 4.0.2
Jetpack 4.4 for deepstream 5.0.1
• TensorRT Version
• NVIDIA GPU Driver Version (valid for GPU only)
• Issue Type( questions, new requirements, bugs)
question, bug
• How to reproduce the issue ? (This is for bugs. Including which sample app is using, the configuration files content, the command line used and other details for reproducing)

  1. for each env, find source4_1080p_dec_infer-resnet_tracker_sgie_tiled_display_int8.txt (under /opt/nvidia/deepstream/…)
    and modified like below for benchmarking.
  • num-sources: 4 → 1
  • sink0 type: 2 → 1 (type=1 for fakesink)
  • sink0 sync: 1 → 0 (sync=0 for higher FPS)
  1. set freq to max and run app
    sudo jetson_clocks
    deepstream-app -c source4_1080p_dec_infer-resnet_tracker_sgie_tiled_display_int8.txt

  2. check PERF output(check average FPS at the final row)
    DS4: 35.44
    DS5: 31.28 (run2: 31.89)

I tried another experiments:

  • no FPS gap when running the app with detection only (delete [track] and [secondary-gie1,2,3] in config)
    DS4: 48.72
    DS5: 48.68
  • no FPS gap when running the app with detection+tracking only (delete [secondary-gie1,2,3] in config)
    DS4: 39.82 (run2: 39.40)
    DS5: 39.20 (run2: 39.29)

• Requirement details( This is for new requirement. Including the module name-for which plugin or for which sample application, the function description)

modified config file for deepstream4 and deepstream5 :
config_ds5.txt (5.8 KB) config_ds4.txt (4.3 KB)

It will take some time to look into this issue. Will be back to you when there is any progress.

If available, can you do one more experiment, on Jetpack 4.5.1, to see how FPS does same conditions as before versions used?

another experiment:

  • low FPS for Deepstream 5.1 ( jetpack4.5.1)
    => 31.99 FPS

I just run on NANO with Jetpack 4.5.1, got FPS around below, higher than your result. i share the configuration i used, can you try with this configuration? make sure we are in the same page.

source4_1080p_dec_infer-resnet_tracker_sgie_tiled_display_int8.txt (5.6 KB)

**PERF: 37.53 (37.28)
**PERF: 31.94 (34.35)
**PERF: 33.49 (34.08)
**PERF: 33.16 (33.80)
**PERF: 36.94 (34.42)
**PERF: 35.14 (34.59)
**PERF: 34.34 (34.56)
**PERF: 37.39 (34.92)
**PERF: 39.04 (35.39)
**PERF: 32.73 (35.10)
**PERF: 32.42 (34.83)
**PERF: 34.63 (34.83)