Migrating from encoding HEVC in NvV4L2 to NvMedia

yoav10 · January 23, 2023, 3:48pm

Please provide the following info (tick the boxes after creating this topic):
Software Version
[+] DRIVE OS 6.0.5
DRIVE OS 6.0.4 (rev. 1)
DRIVE OS 6.0.4 SDK
other

Target Operating System
[+] Linux
QNX
other

Hardware Platform
DRIVE AGX Orin Developer Kit (940-63710-0010-D00)
DRIVE AGX Orin Developer Kit (940-63710-0010-C00)
[+] DRIVE AGX Orin Developer Kit (not sure its number)
other

SDK Manager Version
[+] 1.9.1.10844
other

Host Machine Version
[+] native Ubuntu Linux 20.04 Host installed with SDK Manager
native Ubuntu Linux 20.04 Host installed with DRIVE OS Docker Containers
native Ubuntu Linux 18.04 Host installed with DRIVE OS Docker Containers
other

Hi,

Currently I’m using NvVideoEncoder based on V4L2 on Orin, and I’m trying to understand how to implement a-relatively-similar encoding pipeline on Drive-AGX-Orin, but finding it hard to find any documentation explaining how to encode video using NvMedia API

Thanks.

VickNV · January 23, 2023, 5:03pm

Please take a look at Image Encode Processing (IEP) and
NvMedia IEP – Encode Processing (nvm_iep_sci).

yoav10 · January 23, 2023, 6:43pm

Thanks,

I’ve already seen these guides, but what is not clear to me is that I don’t see the “nvm_iep_sci” application nor its source code anywhere on the Orin.

Moreover, it does seem to have some of the example applications.
Under: ‘/opt/nvidia/drive-linux/NVIDIA_CUDA-11.4_Samples’
There’re:

1_Utilities
2_Graphics
3_Imaging
4_Finance
5_Simulations
6_Advanced
7_CUDALibraries
EULA.txt
Makefile
common
libnvmedia_iep_sci.so

VickNV · January 23, 2023, 6:54pm

Which DRIVE OS version are you using?

yoav10 · January 23, 2023, 7:35pm

DriveOS 6.0.5
(with DriveWorks 5.8)

VickNV · January 23, 2023, 7:43pm

Please read through Autonomous Vehicle Development Platforms | NVIDIA Docs. The source is on your host system.

yoav10 · January 24, 2023, 9:01pm

Since I’m using a different host, I downloaded DriveOS 6.0.5 (host: ubuntu 20.04) and ran the installation - still, I have the folder DRIVE_OS_6.0.5_SDK_Linux_DRIVE_AGX_ORIN_DEVKITS, but the expected video encoder and decoder are nowhere to be found.
Can you specify the exact process of getting these samples from the SDK?
There are several other samples sources, but none of them are video related.

I won’t lie - this really feels like Nvidia just doesn’t want developers to use DriveOS for video encoding…

VickNV · January 24, 2023, 10:40pm

You should be able to find them under the directory.

~/nvidia/nvidia_sdk/DRIVE_OS_6.0.5_SDK_Linux_DRIVE_AGX_ORIN_DEVKITS/DRIVEOS/drive-linux/samples/nvmedia_6x/

yoav10 · January 24, 2023, 11:00pm

This might be the problem - under “~/nvidia/nvidia_sdk/DRIVE_OS_6.0.5_SDK_Linux_DRIVE_AGX_ORIN_DEVKITS/DRIVEOS/drive-linux/samples/”, there’s only vulkan-sc-samples/

VickNV · January 24, 2023, 11:16pm

How did you install DRIVE OS 6.0.5? followed DRIVE OS 6.0.5 Installation Guide for NVIDIA Developers? with SDK Manager or Docker?

yoav10 · January 25, 2023, 9:59am

I used SDK manager installed on ubuntu 20.04.
Installed DRIVE with Host Machine marked and Target Hardware = Drive AGX Orix DevKit.
Selected Operating System = DRIVEU OS 6.0.5 SDK

SivaRamaKrishnaNV · January 25, 2023, 10:05am

Dear @yoav10,
Is it possible to reinstall DRIVE OS 6.0.5 on host and target? We expect the samples to be under the direcory Vick mentioned.

yoav10 · January 25, 2023, 11:53am

Will try and update.
Thanks!