50 CCTV cameras video analysis

sivaishere96 · March 10, 2020, 2:57pm

I want to run SSD-Mobilenetv2 on AGX Xavier for 50 cctv live camera streams each running at a minimum 15fps. Is it possible?

Looking at the mlperf 0.5 multistream results, it states that the AGX Xavier can run 102 streams.

https://blogs.nvidia.com/blog/2019/11/06/ai-inference-mlperf-benchmarks/.

Running source source30_1080p_dec_infer-resnet_tiled_display_int8.txt, I was able to get only 30 sources. Increasing the number of sources beyond 30 results in decrease in fps.

kayccc · March 10, 2020, 2:57pm

Hi sivaishere96,

I will suggest to use DeepStream SDK, please refer to https://developer.nvidia.com/deepstream-sdk

sivaishere96 · March 10, 2020, 2:57pm

As i have mentioned above, I am using the source30_1080p_dec_infer-resnet_tiled_display_int8.txt config file which is a part of deepstream. I am facing this problem while using deepstream. Without deepstream I am getting much worse results.

DaneLLL · March 10, 2020, 2:58pm

Hi,
You may try in running Xavier in max performance. Please refer to
https://devtalk.nvidia.com/default/topic/1049168/

source30_1080p_dec_infer-resnet_tiled_display_int8.txt is what we have verified. Your usecase is more aggressive. Please give it a try.

sivaishere96 · May 6, 2020, 6:02pm

I am running the device in maximum performance mode.

In the mlperf results, it stated that the age Xavier can process almost 2500 images in offline mode and 102 batches in multi-stream mode for ssd mobilenet v2. Shouldn’t the multi stream results mean that the Xavier can process 102 streams running ssd mobilenet v2 at 20 FPS.

Hence I thought running 40 streams shouldn’t be an issue.

DaneLLL · March 10, 2020, 2:58pm

Hi,
By default source30_1080p_dec_infer-resnet_tiled_display_int8.txt runs ResNet. Do you also hit performance bottleneck in running ResNet? Would like to know if it is specific to mobilenetv2.

sivaishere96 · March 10, 2020, 2:58pm

Yes. The issue was with both Resnet and mobilenetv2.

DaneLLL · March 10, 2020, 2:58pm

Hi,
Please share your config file for reference. You may put it in

or zip and attach it/

Also please run tegrastats to check if GPU runs at max clocks and reaches 100% loading.
https://docs.nvidia.com/jetson/l4t/index.html#page/Tegra%2520Linux%2520Driver%2520Package%2520Development%2520Guide%2FAppendixTegraStats.html%23

sivaishere96 · March 10, 2020, 2:59pm

source30_1080p_dec_infer-resnet_tiled_display_int8.txt is the config file that we have used. Everything is the same except that the number of sources have been changed to 50.

Will update you with the log in a while as I am travelling right now.

sivaishere96 · March 10, 2020, 3:01pm

Hi DaneLLL,

I have an update. I am trying to run only 30 sources. However the performace does not seem to be consistent. During one run all the sources seem to run at 30 fps without any problem.

god@jetson-xavier:~/deepstream_sdk_v4.0.1_jetson$ deepstream-app -c samples/configs/deepstream-app/source30_1080p_dec_infer-resnet_tiled_display_int8.txt 
** WARN: <create_pipeline:930>: Num of Tiles less than number of sources, readjusting to 6 rows, 6 columns
0:00:00.568724475 10867     0x3e122000 INFO                 nvinfer gstnvinfer.cpp:519:gst_nvinfer_logger:<primary_gie_classifier> NvDsInferContext[UID 1]:initialize(): Trying to create engine from model files
0:00:49.209637762 10867     0x3e122000 INFO                 nvinfer gstnvinfer.cpp:519:gst_nvinfer_logger:<primary_gie_classifier> NvDsInferContext[UID 1]:generateTRTModel(): Storing the serialized cuda engine to file at /home/god/deepstream_sdk_v4.0.1_jetson/samples/models/Primary_Detector/resnet18_detector.etlt_b30_int8.engine

Runtime commands:
	h: Print this help
	q: Quit

	p: Pause
	r: Resume

NOTE: To expand a source in the 2D tiled display and view object details, left-click on the source.
      To go back to the tiled display, right-click anywhere on the window.


**PERF: FPS 0 (Avg)	FPS 1 (Avg)	FPS 2 (Avg)	FPS 3 (Avg)	FPS 4 (Avg)	FPS 5 (Avg)	FPS 6 (Avg)	FPS 7 (Avg)	FPS 8 (Avg)	FPS 9 (Avg)	FPS 10 (Avg)	FPS 11 (Avg)	FPS 12 (Avg)	FPS 13 (Avg)	FPS 14 (Avg)	FPS 15 (Avg)	FPS 16 (Avg)	FPS 17 (Avg)	FPS 18 (Avg)	FPS 19 (Avg)	FPS 20 (Avg)	FPS 21 (Avg)	FPS 22 (Avg)	FPS 23 (Avg)	FPS 24 (Avg)	FPS 25 (Avg)	FPS 26 (Avg)	FPS 27 (Avg)	FPS 28 (Avg)	FPS 29 (Avg)	FPS 30 (Avg)	
**PERF: 0.00 (0.00)	0.00 (0.00)	0.00 (0.00)	0.00 (0.00)	0.00 (0.00)	0.00 (0.00)	0.00 (0.00)	0.00 (0.00)	0.00 (0.00)	0.00 (0.00)	0.00 (0.00)	0.00 (0.00)	0.00 (0.00)	0.00 (0.00)	0.00 (0.00)	0.00 (0.00)	0.00 (0.00)	0.00 (0.00)	0.00 (0.00)	0.00 (0.00)	0.00 (0.00)	0.00 (0.00)	0.00 (0.00)	0.00 (0.00)	0.00 (0.00)	0.00 (0.00)	0.00 (0.00)	0.00 (0.00)	0.00 (0.00)	0.00 (0.00)	0.00 (0.00)	
** INFO: <bus_callback:189>: Pipeline ready

Opening in BLOCKING MODE 
Opening in BLOCKING MODE 
Opening in BLOCKING MODE 
Opening in BLOCKING MODE 
Opening in BLOCKING MODE 
Opening in BLOCKING MODE 
Opening in BLOCKING MODE 
Opening in BLOCKING MODE 
Opening in BLOCKING MODE 
Opening in BLOCKING MODE 
Opening in BLOCKING MODE 
NvMMLiteOpen : Block : BlockType = 261 
NvMMLiteOpen : Block : BlockType = 261 
NvMMLiteOpen : Block : BlockType = 261 
NvMMLiteOpen : Block : BlockType = 261 
NvMMLiteOpen : Block : BlockType = 261 
NvMMLiteOpen : Block : BlockType = 261 
NvMMLiteOpen : Block : BlockType = 261 
NvMMLiteOpen : Block : BlockType = 261 
NvMMLiteOpen : Block : BlockType = 261 
NvMMLiteOpen : Block : BlockType = 261 
Opening in BLOCKING MODE 
NvMMLiteOpen : Block : BlockType = 261 
NVMEDIA: Reading vendor.tegra.display-size : status: 6 
NVMEDIA: Reading vendor.tegra.display-size : status: 6 
NvMMLiteOpen : Block : BlockType = 261 
Opening in BLOCKING MODE 
NVMEDIA: Reading vendor.tegra.display-size : status: 6 
NVMEDIA: Reading vendor.tegra.display-size : status: 6 
Opening in BLOCKING MODE 
NVMEDIA: Reading vendor.tegra.display-size : status: 6 
NVMEDIA: Reading vendor.tegra.display-size : status: 6 
NVMEDIA: Reading vendor.tegra.display-size : status: 6 
NVMEDIA: Reading vendor.tegra.display-size : status: 6 
NVMEDIA: Reading vendor.tegra.display-size : status: 6 
NvMMLiteBlockCreate : Block : BlockType = 261 
NvMMLiteBlockCreate : Block : BlockType = 261 
NVMEDIA: Reading vendor.tegra.display-size : status: 6 
NvMMLiteBlockCreate : Block : BlockType = 261 
Opening in BLOCKING MODE 
NvMMLiteOpen : Block : BlockType = 261 
NvMMLiteBlockCreate : Block : BlockType = 261 
Opening in BLOCKING MODE 
NvMMLiteBlockCreate : Block : BlockType = 261 
NvMMLiteBlockCreate : Block : BlockType = 261 
NvMMLiteBlockCreate : Block : BlockType = 261 
NvMMLiteOpen : Block : BlockType = 261 
NvMMLiteBlockCreate : Block : BlockType = 261 
NVMEDIA: Reading vendor.tegra.display-size : status: 6 
NvMMLiteBlockCreate : Block : BlockType = 261 
NvMMLiteBlockCreate : Block : BlockType = 261 
NvMMLiteOpen : Block : BlockType = 261 
NvMMLiteOpen : Block : BlockType = 261 
Opening in BLOCKING MODE 
NVMEDIA: Reading vendor.tegra.display-size : status: 6 
NvMMLiteOpen : Block : BlockType = 261 
NvMMLiteBlockCreate : Block : BlockType = 261 
NVMEDIA: Reading vendor.tegra.display-size : status: 6 
NvMMLiteBlockCreate : Block : BlockType = 261 
NVMEDIA: Reading vendor.tegra.display-size : status: 6 
NvMMLiteBlockCreate : Block : BlockType = 261 
Opening in BLOCKING MODE 
Opening in BLOCKING MODE 
NvMMLiteBlockCreate : Block : BlockType = 261 
NVMEDIA: Reading vendor.tegra.display-size : status: 6 
Opening in BLOCKING MODE 
Opening in BLOCKING MODE 
NVMEDIA: Reading vendor.tegra.display-size : status: 6 
NVMEDIA: Reading vendor.tegra.display-size : status: 6 
NvMMLiteBlockCreate : Block : BlockType = 261 
NvMMLiteBlockCreate : Block : BlockType = 261 
NvMMLiteOpen : Block : BlockType = 261 
Opening in BLOCKING MODE 
Opening in BLOCKING MODE 
Opening in BLOCKING MODE 
Opening in BLOCKING MODE 
NvMMLiteOpen : Block : BlockType = 261 
Opening in BLOCKING MODE 
NvMMLiteOpen : Block : BlockType = 261 
NvMMLiteBlockCreate : Block : BlockType = 261 
NvMMLiteOpen : Block : BlockType = 261 
Opening in BLOCKING MODE 
NvMMLiteOpen : Block : BlockType = 261 
NVMEDIA: Reading vendor.tegra.display-size : status: 6 
NvMMLiteOpen : Block : BlockType = 261 
NVMEDIA: Reading vendor.tegra.display-size : status: 6 
Opening in BLOCKING MODE 
NvMMLiteOpen : Block : BlockType = 261 
NvMMLiteBlockCreate : Block : BlockType = 261 
NvMMLiteBlockCreate : Block : BlockType = 261 
NvMMLiteOpen : Block : BlockType = 261 
Opening in BLOCKING MODE 
NVMEDIA: Reading vendor.tegra.display-size : status: 6 
NVMEDIA: Reading vendor.tegra.display-size : status: 6 
NvMMLiteOpen : Block : BlockType = 261 
Opening in BLOCKING MODE 
NvMMLiteOpen : Block : BlockType = 261 
NvMMLiteOpen : Block : BlockType = 261 
NvMMLiteBlockCreate : Block : BlockType = 261 
NVMEDIA: Reading vendor.tegra.display-size : status: 6 
NvMMLiteBlockCreate : Block : BlockType = 261 
NvMMLiteOpen : Block : BlockType = 261 
NvMMLiteOpen : Block : BlockType = 261 
NVMEDIA: Reading vendor.tegra.display-size : status: 6 
Opening in BLOCKING MODE 
NVMEDIA: Reading vendor.tegra.display-size : status: 6 
NvMMLiteOpen : Block : BlockType = 261 
NvMMLiteBlockCreate : Block : BlockType = 261 
NVMEDIA: Reading vendor.tegra.display-size : status: 6 
NVMEDIA: Reading vendor.tegra.display-size : status: 6 
NVMEDIA: Reading vendor.tegra.display-size : status: 6 
NvMMLiteBlockCreate : Block : BlockType = 261 
NvMMLiteBlockCreate : Block : BlockType = 261 
NvMMLiteBlockCreate : Block : BlockType = 261 
NvMMLiteBlockCreate : Block : BlockType = 261 
NVMEDIA: Reading vendor.tegra.display-size : status: 6 
NvMMLiteBlockCreate : Block : BlockType = 261 
NVMEDIA: Reading vendor.tegra.display-size : status: 6 
NVMEDIA: Reading vendor.tegra.display-size : status: 6 
NvMMLiteBlockCreate : Block : BlockType = 261 
NVMEDIA: Reading vendor.tegra.display-size : status: 6 
NvMMLiteBlockCreate : Block : BlockType = 261 
NvMMLiteBlockCreate : Block : BlockType = 261 
NvMMLiteBlockCreate : Block : BlockType = 261 
** INFO: <bus_callback:175>: Pipeline running

**PERF: 29.99 (29.99)	30.02 (30.02)	30.41 (30.41)	29.53 (29.53)	28.65 (28.65)	29.79 (29.79)	29.94 (29.94)	28.67 (28.67)	29.15 (29.15)	28.18 (28.18)	29.79 (29.79)	30.72 (30.72)	29.94 (29.94)	30.41 (30.41)	28.18 (28.18)	30.18 (30.18)	29.97 (29.97)	30.48 (30.48)	29.76 (29.76)	30.22 (30.22)	29.38 (29.38)	29.39 (29.39)	30.17 (30.17)	30.72 (30.72)	29.46 (29.46)	29.48 (29.48)	30.48 (30.48)	30.13 (30.13)	30.18 (30.18)	28.91 (28.91)	29.32 (29.32)	
**PERF: 29.60 (29.78)	29.80 (29.90)	29.40 (29.87)	29.40 (29.46)	29.60 (29.15)	29.00 (29.36)	27.62 (28.68)	28.80 (28.74)	29.00 (29.07)	27.22 (27.65)	29.20 (29.47)	29.59 (30.11)	28.40 (29.10)	29.60 (29.97)	28.40 (28.30)	29.60 (29.87)	28.98 (29.43)	29.80 (30.11)	29.40 (29.57)	30.00 (30.10)	29.20 (29.28)	28.38 (28.84)	29.18 (29.63)	29.21 (29.90)	29.01 (29.22)	28.60 (29.00)	29.60 (30.01)	28.81 (29.41)	28.20 (29.11)	27.37 (28.08)	29.20 (29.26)	
**PERF: 28.60 (29.37)	28.59 (29.44)	29.80 (29.84)	30.20 (29.72)	28.60 (28.96)	29.20 (29.30)	27.80 (28.37)	29.00 (28.83)	28.80 (28.97)	28.60 (27.99)	28.20 (29.02)	29.60 (29.93)	28.81 (29.00)	29.00 (29.63)	28.21 (28.27)	28.60 (29.43)	28.40 (29.07)	29.00 (29.72)	29.60 (29.58)	29.20 (29.79)	28.81 (29.11)	28.21 (28.62)	30.01 (29.76)	29.40 (29.73)	28.60 (29.00)	30.00 (29.35)	30.20 (30.07)	29.79 (29.55)	29.79 (29.35)	29.00 (28.40)	28.59 (29.03)	
**PERF: 30.41 (29.64)	28.81 (29.28)	29.61 (29.78)	29.61 (29.69)	29.40 (29.07)	27.41 (28.81)	28.79 (28.48)	26.98 (28.35)	30.01 (29.24)	27.61 (27.89)	30.01 (29.28)	29.61 (29.85)	29.41 (29.11)	27.81 (29.16)	29.60 (28.61)	27.41 (28.90)	29.60 (29.21)	27.41 (29.12)	29.41 (29.53)	30.01 (29.84)	30.40 (29.45)	29.81 (28.93)	29.20 (29.61)	28.01 (29.28)	26.21 (28.28)	30.41 (29.62)	30.00 (30.05)	29.01 (29.41)	26.43 (28.59)	29.81 (28.77)	28.42 (28.87)	
**PERF: 28.59 (29.42)	29.99 (29.43)	28.78 (29.58)	28.99 (29.55)	29.60 (29.18)	28.99 (28.85)	28.80 (28.55)	28.01 (28.28)	29.39 (29.27)	28.59 (28.03)	29.39 (29.30)	29.19 (29.71)	28.39 (28.96)	28.99 (29.13)	28.60 (28.61)	28.79 (28.88)	29.20 (29.21)	29.39 (29.18)	29.99 (29.63)	29.59 (29.79)	30.20 (29.60)	29.17 (28.98)	28.79 (29.44)	28.79 (29.18)	29.19 (28.46)	29.39 (29.58)	29.20 (29.88)	28.59 (29.24)	28.19 (28.51)	28.59 (28.74)	28.19 (28.73)	
^C** ERROR: <_intr_handler:140>: User Interrupted.. 

Quitting
App run successful

However in an another run the fps displayed is 0.

god@jetson-xavier:~/deepstream_sdk_v4.0.1_jetson$ deepstream-app -c samples/configs/deepstream-app/source30_1080p_dec_infer-resnet_tiled_display_int8.txt 
** WARN: <create_pipeline:930>: Num of Tiles less than number of sources, readjusting to 6 rows, 6 columns
0:00:00.578794163 11299     0x12116000 INFO                 nvinfer gstnvinfer.cpp:519:gst_nvinfer_logger:<primary_gie_classifier> NvDsInferContext[UID 1]:initialize(): Trying to create engine from model files
0:00:49.228657332 11299     0x12116000 INFO                 nvinfer gstnvinfer.cpp:519:gst_nvinfer_logger:<primary_gie_classifier> NvDsInferContext[UID 1]:generateTRTModel(): Storing the serialized cuda engine to file at /home/god/deepstream_sdk_v4.0.1_jetson/samples/models/Primary_Detector/resnet18_detector.etlt_b30_int8.engine

Runtime commands:
	h: Print this help
	q: Quit

	p: Pause
	r: Resume

NOTE: To expand a source in the 2D tiled display and view object details, left-click on the source.
      To go back to the tiled display, right-click anywhere on the window.


**PERF: FPS 0 (Avg)	FPS 1 (Avg)	FPS 2 (Avg)	FPS 3 (Avg)	FPS 4 (Avg)	FPS 5 (Avg)	FPS 6 (Avg)	FPS 7 (Avg)	FPS 8 (Avg)	FPS 9 (Avg)	FPS 10 (Avg)	FPS 11 (Avg)	FPS 12 (Avg)	FPS 13 (Avg)	FPS 14 (Avg)	FPS 15 (Avg)	FPS 16 (Avg)	FPS 17 (Avg)	FPS 18 (Avg)	FPS 19 (Avg)	FPS 20 (Avg)	FPS 21 (Avg)	FPS 22 (Avg)	FPS 23 (Avg)	FPS 24 (Avg)	FPS 25 (Avg)	FPS 26 (Avg)	FPS 27 (Avg)	FPS 28 (Avg)	FPS 29 (Avg)	FPS 30 (Avg)	
**PERF: 0.00 (0.00)	0.00 (0.00)	0.00 (0.00)	0.00 (0.00)	0.00 (0.00)	0.00 (0.00)	0.00 (0.00)	0.00 (0.00)	0.00 (0.00)	0.00 (0.00)	0.00 (0.00)	0.00 (0.00)	0.00 (0.00)	0.00 (0.00)	0.00 (0.00)	0.00 (0.00)	0.00 (0.00)	0.00 (0.00)	0.00 (0.00)	0.00 (0.00)	0.00 (0.00)	0.00 (0.00)	0.00 (0.00)	0.00 (0.00)	0.00 (0.00)	0.00 (0.00)	0.00 (0.00)	0.00 (0.00)	0.00 (0.00)	0.00 (0.00)	0.00 (0.00)	
** INFO: <bus_callback:189>: Pipeline ready

Opening in BLOCKING MODE 
Opening in BLOCKING MODE 
Opening in BLOCKING MODE 
Opening in BLOCKING MODE 
Opening in BLOCKING MODE 
Opening in BLOCKING MODE 
Opening in BLOCKING MODE 
Opening in BLOCKING MODE 
Opening in BLOCKING MODE 
Opening in BLOCKING MODE 
NvMMLiteOpen : Block : BlockType = 261 
Opening in BLOCKING MODE 
NvMMLiteOpen : Block : BlockType = 261 
NvMMLiteOpen : Block : BlockType = 261 
Opening in BLOCKING MODE 
NvMMLiteOpen : Block : BlockType = 261 
Opening in BLOCKING MODE 
Opening in BLOCKING MODE 
Opening in BLOCKING MODE 
Opening in BLOCKING MODE 
NvMMLiteOpen : Block : BlockType = 261 
NvMMLiteOpen : Block : BlockType = 261 
NVMEDIA: Reading vendor.tegra.display-size : status: 6 
NVMEDIA: Reading vendor.tegra.display-size : status: 6 
NVMEDIA: Reading vendor.tegra.display-size : status: 6 
NVMEDIA: Reading vendor.tegra.display-size : status: 6 
NVMEDIA: Reading vendor.tegra.display-size : status: 6 
NvMMLiteOpen : Block : BlockType = 261 
NVMEDIA: Reading vendor.tegra.display-size : status: 6 
Opening in BLOCKING MODE 
NvMMLiteOpen : Block : BlockType = 261 
NvMMLiteOpen : Block : BlockType = 261 
Opening in BLOCKING MODE 
NvMMLiteOpen : Block : BlockType = 261 
NvMMLiteBlockCreate : Block : BlockType = 261 
NvMMLiteBlockCreate : Block : BlockType = 261 
NvMMLiteBlockCreate : Block : BlockType = 261 
NvMMLiteOpen : Block : BlockType = 261 
NvMMLiteOpen : Block : BlockType = 261 
Opening in BLOCKING MODE 
NvMMLiteBlockCreate : Block : BlockType = 261 
NvMMLiteBlockCreate : Block : BlockType = 261 
NvMMLiteBlockCreate : Block : BlockType = 261 
NvMMLiteOpen : Block : BlockType = 261 
NvMMLiteOpen : Block : BlockType = 261 
Opening in BLOCKING MODE 
NVMEDIA: Reading vendor.tegra.display-size : status: 6 
NvMMLiteOpen : Block : BlockType = 261 
NvMMLiteOpen : Block : BlockType = 261 
Opening in BLOCKING MODE 
NvMMLiteOpen : Block : BlockType = 261 
Opening in BLOCKING MODE 
Opening in BLOCKING MODE 
NvMMLiteOpen : Block : BlockType = 261 
Opening in BLOCKING MODE 
NvMMLiteOpen : Block : BlockType = 261 
Opening in BLOCKING MODE 
Opening in BLOCKING MODE 
Opening in BLOCKING MODE 
Opening in BLOCKING MODE 
NVMEDIA: Reading vendor.tegra.display-size : status: 6 
NVMEDIA: Reading vendor.tegra.display-size : status: 6 
NVMEDIA: Reading vendor.tegra.display-size : status: 6 
NvMMLiteBlockCreate : Block : BlockType = 261 
NVMEDIA: Reading vendor.tegra.display-size : status: 6 
NVMEDIA: Reading vendor.tegra.display-size : status: 6 
NvMMLiteBlockCreate : Block : BlockType = 261 
NvMMLiteBlockCreate : Block : BlockType = 261 
NvMMLiteBlockCreate : Block : BlockType = 261 
NvMMLiteOpen : Block : BlockType = 261 
NvMMLiteOpen : Block : BlockType = 261 
NVMEDIA: Reading vendor.tegra.display-size : status: 6 
NvMMLiteOpen : Block : BlockType = 261 
NvMMLiteOpen : Block : BlockType = 261 
NvMMLiteOpen : Block : BlockType = 261 
NvMMLiteOpen : Block : BlockType = 261 
NvMMLiteOpen : Block : BlockType = 261 
NvMMLiteOpen : Block : BlockType = 261 
NvMMLiteOpen : Block : BlockType = 261 
NvMMLiteBlockCreate : Block : BlockType = 261 
NvMMLiteBlockCreate : Block : BlockType = 261 
NvMMLiteBlockCreate : Block : BlockType = 261 
Opening in BLOCKING MODE 
Opening in BLOCKING MODE 
NVMEDIA: Reading vendor.tegra.display-size : status: 6 
NVMEDIA: Reading vendor.tegra.display-size : status: 6 
NVMEDIA: Reading vendor.tegra.display-size : status: 6 
Opening in BLOCKING MODE 
NVMEDIA: Reading vendor.tegra.display-size : status: 6 
NVMEDIA: Reading vendor.tegra.display-size : status: 6 
NVMEDIA: Reading vendor.tegra.display-size : status: 6 
NvMMLiteOpen : Block : BlockType = 261 
NvMMLiteBlockCreate : Block : BlockType = 261 
NvMMLiteOpen : Block : BlockType = 261 
NVMEDIA: Reading vendor.tegra.display-size : status: 6 
NVMEDIA: Reading vendor.tegra.display-size : status: 6 
NvMMLiteOpen : Block : BlockType = 261 
NvMMLiteBlockCreate : Block : BlockType = 261 
NvMMLiteBlockCreate : Block : BlockType = 261 
NVMEDIA: Reading vendor.tegra.display-size : status: 6 
NVMEDIA: Reading vendor.tegra.display-size : status: 6 
NvMMLiteBlockCreate : Block : BlockType = 261 
NVMEDIA: Reading vendor.tegra.display-size : status: 6 
NVMEDIA: Reading vendor.tegra.display-size : status: 6 
NVMEDIA: Reading vendor.tegra.display-size : status: 6 
NVMEDIA: Reading vendor.tegra.display-size : status: 6 
NvMMLiteBlockCreate : Block : BlockType = 261 
NVMEDIA: Reading vendor.tegra.display-size : status: 6 
NvMMLiteBlockCreate : Block : BlockType = 261 
NvMMLiteBlockCreate : Block : BlockType = 261 
NvMMLiteBlockCreate : Block : BlockType = 261 
NvMMLiteBlockCreate : Block : BlockType = 261 
NvMMLiteBlockCreate : Block : BlockType = 261 
NvMMLiteBlockCreate : Block : BlockType = 261 
NvMMLiteBlockCreate : Block : BlockType = 261 
NvMMLiteBlockCreate : Block : BlockType = 261 
NvMMLiteBlockCreate : Block : BlockType = 261 
NvMMLiteBlockCreate : Block : BlockType = 261 
NVMEDIA: Reading vendor.tegra.display-size : status: 6 
NvMMLiteBlockCreate : Block : BlockType = 261 
NVMEDIA: Reading vendor.tegra.display-size : status: 6 
NVMEDIA: Reading vendor.tegra.display-size : status: 6 
NvMMLiteBlockCreate : Block : BlockType = 261 
NvMMLiteBlockCreate : Block : BlockType = 261 
** INFO: <bus_callback:175>: Pipeline running

**PERF: 37.06 (37.06)	1.59 (1.59)	27.37 (27.37)	0.00 (0.00)	28.08 (28.08)	0.00 (0.00)	31.07 (31.07)	32.61 (32.61)	9.23 (9.23)	31.30 (31.30)	2.98 (2.98)	11.44 (11.44)	36.40 (36.40)	0.00 (0.00)	3.11 (3.11)	7.94 (7.94)	0.00 (0.00)	6.82 (6.82)	32.06 (32.06)	0.00 (0.00)	35.22 (35.22)	3.97 (3.97)	0.00 (0.00)	44.73 (44.73)	35.84 (35.84)	44.72 (44.72)	29.00 (29.00)	29.78 (29.78)	31.20 (31.20)	11.77 (11.77)	1048576.00 (1048576.00)	
**PERF: 0.00 (37.06)	0.00 (1.59)	0.00 (27.37)	0.00 (0.00)	0.00 (28.08)	0.00 (0.00)	2.13 (18.44)	0.00 (32.61)	0.00 (9.23)	0.00 (31.30)	0.00 (2.98)	0.00 (11.44)	0.61 (24.18)	0.00 (0.00)	0.00 (3.11)	0.00 (7.94)	0.00 (0.00)	0.00 (6.82)	0.00 (32.06)	0.00 (0.00)	0.00 (35.22)	0.00 (3.97)	0.00 (0.00)	0.00 (44.73)	0.00 (35.84)	0.00 (44.72)	0.00 (29.00)	2.74 (17.96)	2.74 (18.75)	0.00 (11.77)	0.00 (1048576.00)	
^C** ERROR: <_intr_handler:140>: User Interrupted.. 

Quitting
App run successful

And this seems to happen randomly for different runs. There is no pattern.I am monitoring the temperatures and the utilization; they seem to be fine and within limits. I even tried running the code for 4 hours straight and it ran without any problems with all the sources running at a stable 30 fps.

FYI: I have set the interval parameter to be 2 here in the experiments.

And the performace is starking to me because it is claimed by nvidia that the AGX Xavier can process around 2500 images/sec for ssd-mobilenetv2 and it is not even remotely close to the number I am getting here. Although I am running detectnetv2-Resnet-10 I should expect atleast half the number of images/sec.

DaneLLL · March 10, 2020, 3:02pm

Hi,
Please run ‘sudo nvpmodel -m 0’ to be in MAXN mode:
https://docs.nvidia.com/jetson/l4t/index.html#page/Tegra%2520Linux%2520Driver%2520Package%2520Development%2520Guide%2Fpower_management_jetson_xavier.html%23wwpID0E0AO0HA
And ‘sudo jetson_clocks’ to enable max performance.

In config file, you can set ‘type=5’ to use nvoverlaysink and ‘syc=0’ in [sink0].
https://docs.nvidia.com/metropolis/deepstream/dev-guide/index.html#page/DeepStream_Development_Guide%2Fdeepstream_app_config.3.2.html%23wwpID0ENHA

Also can try to set ‘live-source=1’ in [streammux]
https://docs.nvidia.com/metropolis/deepstream/dev-guide/index.html#page/DeepStream_Development_Guide%2Fdeepstream_app_config.3.2.html%23wwpID0E0DB0HA

You can use tegrastats to check if GPU is at max clocks and 100% loading.