The FPS of USB camera based tracking app is a lot slower than the MP4 format

Accelerated Computing Intelligent Video Analytics DeepStream SDK
1

• Hardware Platform (Jetson / GPU):Jetson Nano 4GB
• DeepStream Version:6.0.0
• JetPack Version (valid for Jetson only):4.6
• TensorRT Version:8.0.1.6
• NVIDIA GPU Driver Version (valid for GPU only):NONE
• Issue Type( questions, new requirements, bugs):questions
HI,
I run the yolo3_tiny in file /deepstream-6.0/sources/obiectDetector_Yolo/ by default config for MP4 and I get the 40 fps.
but after adding the camera setup as below to yolo3_tiny.txt, the fps decreased into 14.

[source0]
enable=1
type=1
camera-id=1
camera-width=640
camera-height=480
camera-fps-n=30
camera-fps-d=1

my camera’s format is as below:

v4l2-ctl -d /dev/video0 --list-formats-ext

ioctl: VIDIOC_ENUM_FMT
	Index       : 0
	Type        : Video Capture
	Pixel Format: 'MJPG' (compressed)
	Name        : Motion-JPEG
		Size: Discrete 1280x720
			Interval: Discrete 0.033s (30.000 fps)
		Size: Discrete 640x480
			Interval: Discrete 0.033s (30.000 fps)
		Size: Discrete 352x288
			Interval: Discrete 0.033s (30.000 fps)
		Size: Discrete 320x240
			Interval: Discrete 0.033s (30.000 fps)
		Size: Discrete 176x144
			Interval: Discrete 0.033s (30.000 fps)
		Size: Discrete 160x120
			Interval: Discrete 0.033s (30.000 fps)
		Size: Discrete 800x600
			Interval: Discrete 0.033s (30.000 fps)
		Size: Discrete 960x720
			Interval: Discrete 0.033s (30.000 fps)

	Index       : 1
	Type        : Video Capture
	Pixel Format: 'YUYV'
	Name        : YUYV 4:2:2
		Size: Discrete 1280x720
			Interval: Discrete 0.100s (10.000 fps)
		Size: Discrete 640x480
			Interval: Discrete 0.033s (30.000 fps)
		Size: Discrete 352x288
			Interval: Discrete 0.033s (30.000 fps)
		Size: Discrete 320x240
			Interval: Discrete 0.033s (30.000 fps)
		Size: Discrete 176x144
			Interval: Discrete 0.033s (30.000 fps)
		Size: Discrete 160x120
			Interval: Discrete 0.033s (30.000 fps)
		Size: Discrete 800x600
			Interval: Discrete 0.050s (20.000 fps)
		Size: Discrete 960x720
			Interval: Discrete 0.067s (15.000 fps)

I keep the config and other files’ content unchanged.

Why is the FPS drop so obvious? Is it because of my camera model or the wrong config file settings?

In addition, I would like to know the time consumption of each stage of the frame map from the USB camera to the generation of the tracking results. Is this possible? How should it be implemented?

Many thanks and I’m looking forward to an early reply.

3

Hi,

Please note that we have a newer Deepstream 6.0.1 release.
It’s recommended to upgrade your environment to the latest.

For YOLO, there is a performance issue in Deepstream 6.0.
Would you mind checking if the fix helps with your use case?

Thanks.

5

Hi,

Would you mind also trying it with Deepstream 6.0.1 + JetPack 4.6.1?
We can get a similar performance between video and USB cameras in that environment.

Thanks.

6

Sorry for reply late.

I retried using the csi and usb camera on the 6.0.1 platform, and the usb camera is still 15fps but the csi camera is 50fps. So I suspect the camera is the reason for the frame rate drop. Would you mind sharing your camera information? Or do you know what kind of usb camera is causing the framerate drop?

Thanks for your reply.

7

There is no update from you for a period, assuming this is not an issue any more.
Hence we are closing this topic. If need further support, please open a new one.
Thanks

Hi,

We cannot reproduce this issue with Deepstream 6.0.1 internally.
Do you have another USB camera that can give it a try?

Thanks.

9

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.