I discovered this symptom while migrating from nvbuf_utils to NvUtils in [jetson_ffmpeg] (Migrating from nvbuf_utils to NvUtils. by douo · Pull Request #125 · jocover/jetson-ffmpeg · GitHub). Here are the results of the benchmark:
devices(MAXN jetson_clocks):
- AGX Jetpack 5.1 L4T 35.2.1
- Nano Jetpack 4.6.3 L4T 32.7.3
Command:
- nvv4l2dec:
ffmpeg -y -benchmark -c:v hevc_nvv4l2dec -i $input -f null - - gstreamer:
gst-launch-1.0 filesrc location=$input ! h265parse ! nvv4l2decoder enable-max-performance=1 ! fpsdisplaysink text-overlay=0 video-sink=fakesink sync=0 -v - 00_video_decode:
video_decode H265 --disable-rendering --stats $input - jetson_ffmpeg:
ffmpeg -y -benchmark -c:v hevc_nvmpi -i $input -f null -
sample_3840x2160.hevc:
Stream #0:0: Video: hevc (Main), yuv420p(tv), 3840x2160, 23.98 fps, 23.98 tbr, 1200k tbn, 23.98 tbc
| AGX(fps) | Nano(fps) | |
|---|---|---|
| 00_video_decode | 32.7 | 97.96 |
| gstreamer | 232.61 | 97.71 |
| nvv4l2dec | 24 | 63 |
| nv_mpi | 28 | 70 |
| ffmpeg cpu | 25 | 7.3 |
sample_4k.h264:
Stream #0:0: Video: h264 (High), yuv420p(tv, bt709, progressive), 3840x2160, 25 fps, 25 tbr, 1200k tbn, 50 tbc
| AGX(fps) | Nano(fps) | |
|---|---|---|
| 00_video_decode | 25.7 | 88.10 |
| gstreamer | 132.84 | 87.29 |
| nvv4l2dec | 25 | 63 |
| nv_mpi | 23 | 69 |
| ffmpeg cpu | 64 | 19 |
sample_720.h264:
Stream #0:0: Video: h264 (Main), yuv420p(progressive), 1280x544, 24.08 fps, 23.98 tbr, 1200k tbn, 47.95 tb
| AXG(fps) | Nano(fps) | |
|---|---|---|
| 00_video_decode | 71.18 | 770.58 |
| gstreamer | 733.70 | 764.39 |
| nvv4l2dec | 47 | 409 |
| nv_mpi | 46 | 490 |
| ffmpeg cpu | 676 | 270 |
For the same video, when using gstreamer nvv4l2decoder, we obtained 200+fps on AGX and 97fps on Nano, which is normal. However, when using the 00_video_decode sample, we only obtained 32.7fps on AGX but 97fps on Nano!
Version of MMAPI:
$ apt show `dpkg -S /usr/src/jetson_multimedia_api | cut -d ':' -f1`
Package: nvidia-l4t-jetson-multimedia-api
Version: 35.2.1-20230124153320
Priority: standard
Section: Utils
Maintainer: NVIDIA Corporation
Installed-Size: 96.4 MB
Pre-Depends: nvidia-l4t-core (>> 35.2-0), nvidia-l4t-core (<< 35.3-0)
Depends: cuda-cudart-11-4, cuda-cudart-dev-11-4, libc6-dev, libglvnd-dev, libx11-dev, nvidia-l4t-camera (= 35.2.1-20230124153320), nvidia-l4t-multimedi
a (= 35.2.1-20230124153320), nvidia-l4t-multimedia-utils (= 35.2.1-20230124153320)
Homepage: http://developer.nvidia.com/jetson
Download-Size: 75.3 MB
APT-Manual-Installed: no
APT-Sources: https://repo.download.nvidia.com/jetson/common r35.2/main arm64 Packages
Description: NVIDIA Jetson Multimedia API is a collection of lower-level APIs that support flexible application development.