How to improve the display performance on 5-channel 4k 60 fps videos on two 4k display

[david242]

Hi,

I want to know does there are any methods or suggestions to improve the display performance.

If we have 5-channel 4k 60 fps videos and want to display those on two 4k display.

1 of 5-channel video display in full-screen mode in a 4k display.

4 of 5-channel videos scale down to 1920x1080 and quad-view 4 videos in another 4k display.

For now, the video playback is not smooth. Many frames be dropped.

BR,
david

[DaneLLL]

Hi,
Not sure if you composite the sources into single video plane for rendering. If not, we would suggest do this since this is what we demonstrate in DeepStream SDK. And for optimal performance, please execute the script:
VPI - Vision Programming Interface: Performance Benchmark

[aiolia723]

Yes, we composite 4 videos into 1 frame by QT, but we don’t familiar with DeepStream.

We do some experiments about rendering performance. We think main problem is not on composite 4 videos to 1 video.
Playing a 4k video by ffmpeg on a 4k display, GPU usage is 48%

Playing two 4k videos by ffmpeg on two 4k display, GPU usage is 78%

So if there two 4k videos, GPU is busy on rendering and can’t do AI on videos.

BR,
david

[DaneLLL]

Hi,
There may be additional memory copy while using ffmpeg. This may be bottleneck of performance. For optimal performance, we suggest use gstreamer or jetson_multimedia_api. Please check the documents:
Multimedia — Jetson Linux Developer Guide documentation