We want to use the filesource to reproduce your problem in our enviroment. So if you can provide the video source from your camera, It will make our analysis easier. Could you attach your deepstream_app config file to us?
If you don’t want to let your source public, you can message that to me.
1.Both mp4 or ts format is OK.
2.Please attach your deepstream_app config file to us too.
3.From the log you attached before, it may be a memory issue with your device. Could you check the memory with jtop when you run the 2 120fps cameras?
It works well with the two120fps videos. So it seems like a problem of USB bandwidth limitation. Because this is a hardware limitation, you can only solve this problem by reducing the resolution or fps of your camera.
On Orin developer kit, the 4 type-A ports are from embedded USB hub so the bandwidth is shared. There are two type-C ports. Please connect one camera to the type-A port and the other to either type-C port(through type-C to A cable). See if you can reach target frame rate for both cameras in the setup
For two 120 fps cameras issue, we will try later.
I’d like to discuss the FPS issue of deepstream-app running with only One 120fps camera.
We get FPS is about 100 from perf_measurement log.
Any comment or suggestion?
I don’t have your model and 120 fps camera. So I just run the /opt/nvidia/deepstream/deepstream-6.2/samples/configs/deepstream-app/source2_1080p_dec_infer-resnet_demux_int8.txt. Change the config file source to your 120fps video and change sink to fakesink. We can get 400 fps on my Orin.
When you use 2 60fps video as source and set the nvstreammux batch-size to 2, it will batch 2 frames at once in the nvstreammux. Although you can see that each path can reach 60fps, it’s still 60 fps for the pipeline.
About the performace:
1.You need to ensure that the camera can output 120fps of video on your board.
2.You can remove the nvinfer in your plugin to check the fps
3.You can also use the trtexec --onnx=your_model.onnx to check the TensorRT perf first
Our application is to use USB Cam - 1920x1080@120fps as input data, but we tried some tests that even only one USB Cam is connected that the real frame rate can’t reach 120fps as camera capability. (real is ~100fps)
We don’t know where is the bottleneck if use case is using real USB Camera as input.
So, we made the USB port read/write testing with U3/U2 flash disks, the result looks not so good but should afford the data throughput - 1920x1080@120fps.
=> We guessed 1920x1080@120fps should be ok, but not in fact.
| AI-Box | HP U3.1-256GB | SanDisk U3.2G1-64GB | SanDisk U3.1-64GB | SanDisk U2.0- 16GB |
|Jetson Xavier NX | 880 / 328 | 800 / 360 | 1096 / 336 | 240 / 52 |
|Jetson AGX Orin | 960 / 400 | 113 / 110 | 1200 / 800 | 262 / 60 |
<Data: Read / Write (Mbps)>
Could you help point us which part is the problem? USB bandwidth? What is the max. value?Camera Combination? 1x2K USB Camera only? 2x2K is not supported?
Or FPS limitation is no 120fps?
Thanks a lot and looking forward to hearing from your reply.