NVM_SURF_FMT_SET_ATTR_RGBA() for ISP1/ISP0 to convert Surface Type

Autonomous Vehicles DRIVE AGX Xavier DRIVE AGX Xavier General
1

I’m having some issues when I run the NVM_SURF_FMT_SET_ATTR_RGBA() macro in the nvsipl_camera example code to modify the surface type for ISP1/ISP0. I would like to change the output to RGBA UINT8, but I am getting errors when I run the RegisterAutoControl() method when using the parameters of RGBA, UINT, 8, PL.

I found a similar post in the forums, found here, but the user wanted YUVX, but I would like to get RGB output.

Software Version
DRIVE OS Linux 5.2.6
DRIVE OS Linux 5.2.6 and DriveWorks 4.0
DRIVE OS Linux 5.2.0
DRIVE OS Linux 5.2.0 and DriveWorks 3.5
NVIDIA DRIVE™ Software 10.0 (Linux)
NVIDIA DRIVE™ Software 9.0 (Linux)
other DRIVE OS version
other

Target Operating System
Linux
QNX
other

Hardware Platform
NVIDIA DRIVE™ AGX Xavier DevKit (E3550)
NVIDIA DRIVE™ AGX Pegasus DevKit (E3550)
other

SDK Manager Version
1.9.1.10844
other

Host Machine Version
native Ubuntu 18.04
other

3

Dear @jason.wu2,
Just to confirm, you want the output surface of ISP to be RGBA?

4

Yes, RGBA is our goal.

6

Dear @jason.wu2,
We do not support RGBA UINT8 from ISP. You need to use VIC for YUV to RGBA conversion.

7

To @SivaRamaKrishnaNV,
Thanks for the update. Can I get some more information about VIC, I’ll close the topic when you get back to me. Also, we are trying to convert RGBA Float16 to RGBA UINT8.

8

Does the ISP happen to support an RGB uint8 or an RGB 16-bit float output instead of RGBA?

Thanks

9

Dear @jason.wu2 ,
RGBA FP16 → RGB UINT8 is not supported.
May be you have to use YUV buffer and convert it to RGBA. Please check configuration parameters https://docs.nvidia.com/drive/drive-os-5.2.6.0L/drive-os/index.html#page/DRIVE_OS_Linux_SDK_NGC_Development_Guide/NvMedia/nvmedia_nvmimg_2d.html#wwpID0EEHA

10

Dear @michael.honey,
Does the ISP happen to support an RGB uint8 or an RGB 16-bit float output instead of RGBA?

No.

11

Hey @SivaRamaKrishnaNV , I’ve looked into the documentation that you linked me, and I’m not sure if it is relevant to what I’m trying to do. I don’t wish to do a blit operation, just a conversion.

image
image894×57 13.3 KB

Also, I wasn’t able to find much information regarding the VIC or how to use it.

12

Dear @jason.wu2,
Image 2D can do YUV-> RGBA conversion. Please set the src/dst surf and other parameters accorndingly.