FFMpeg with hardware acceleration

Autonomous Vehicles DRIVE AGX Orin DRIVE AGX Orin General
1

Please provide the following info (tick the boxes after creating this topic):
Software Version
DRIVE OS 6.0.8.1
DRIVE OS 6.0.6
DRIVE OS 6.0.5
DRIVE OS 6.0.4 (rev. 1)
DRIVE OS 6.0.4 SDK
other

Target Operating System
Linux
QNX
other

Hardware Platform
DRIVE AGX Orin Developer Kit (940-63710-0010-300)
DRIVE AGX Orin Developer Kit (940-63710-0010-200)
DRIVE AGX Orin Developer Kit (940-63710-0010-100)
DRIVE AGX Orin Developer Kit (940-63710-0010-D00)
DRIVE AGX Orin Developer Kit (940-63710-0010-C00)
DRIVE AGX Orin Developer Kit (not sure its number)
other

SDK Manager Version
1.9.3.10904
other

Host Machine Version
native Ubuntu Linux 20.04 Host installed with SDK Manager
native Ubuntu Linux 20.04 Host installed with DRIVE OS Docker Containers
native Ubuntu Linux 18.04 Host installed with DRIVE OS Docker Containers
other

Im creating a sample application to grab frames from all the cameras encode them to h264 and stream them over the local network.

I can grab camera frames and run them through dwSensorSerializer in user data mode and stream this over my networks fine but with more than 2 cameras the framerates are low. Since there is no option to downsample the camera frames before they are serialized this wont work.

Normally I would use FFmpeg to do the h264 encoding using h264_nvenc but when I compiled FFmpeg from source it still needs the standard nvidia driver.

Is there anyway to install ffmpeg with hardware acceleration on the Drive AGX Orin ?

3

We have not tested ffmpeg compilation on DRIVE.
Did you try and notice any issue? Are you asking for acceleration using GPU or NVENC?

Are you storing to local storage before sending over network. Did you try isp0-res parameter(DriveWorks SDK Reference: Camera) to reduce size. Can you take a look at How to use all of encoder Instances 0, 1, 2 for encoding on Nvidia Drive AGX Orin - #13 by SivaRamaKrishnaNV to see if helps?

4

isp0-res works perfectly! Got all the camera encoders working at 30hz now!

6

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.