H264/H265 Codec Format Support

Robotics & Edge Computing Jetson & Embedded Systems Jetson AGX Xavier
,
1

Hi,

Currently we are developing a product based on Jetson Xavier AGX and we have some doubts about supported formats related to the codecs and LibArgus (H265/H264).

We are aware of the gstreamer encoding plugins supported formats as indicated by gst-inspect command:

gst-inspect-1.0 nvv4l2h265enc

Pad Templates:
  SINK template: 'sink'
    Availability: Always
    Capabilities:
      video/x-raw(memory:NVMM)
                  width: [ 1, 2147483647 ]
                 height: [ 1, 2147483647 ]
                 format: { (string)I420, (string)NV12, (string)P010_10LE }
              framerate: [ 0/1, 2147483647/1 ]

However, are other formats supported from LibArgus side? We are specifically interested in the whether the following formats are supported:

  • PIXEL_FMT_Y8
  • PIXEL_FMT_Y16
  • PIXEL_FMT_YCbCr_420_888
  • PIXEL_FMT_YCbCr_422_888
  • PIXEL_FMT_YCbCr_444_888
  • PIXEL_FMT_JPEG_BLOB
  • PIXEL_FMT_RAW16
  • PIXEL_FMT_P016

If not, does hardware support them? Can we extend the format support?

Regards,
Fabian
www.ridgerun.com

3

Hi,
If you mean fetching frames from Argus and then doing encoding, currently only YUV420(I420 or NV12) is supported. YUV420 10 bit is supported by h265 encoder but not supported in Argus.

4

Hi @DaneLLL,

Thanks for the quick answer. From

tegra_multimedia_api/argus/include/Argus/Types.h

we saw all of the formats listed in my previous comment.

Can you confirm if the hardware supports any of these formats for the encoding process?

Regards,
Fabian
www.ridgerun.com

5

Hi @DaneLLL,

Just a follow-up comment to verify if you have the information about this. It is important to plan our roadmap for the project we are working on.

Thanks

Regards,
Fabian
www.ridgerun.com

6

Hello,
Currently, apart from 8 bit YUV, we support 16 bit YUV format using PIXEL_FMT_P016 ARUS format.

8

Hi, given your information, is this possible:

  1. ISP to provide PIXEL_FMT_P016
  2. Cuda to convert from P016 to P010_10LE
  3. H265 encoder to accept P010_10LE
  4. Perform 1,2,3 using GStreamer on AGX JP4.4
  5. Perform 1,2,3 Argus on AGX JP4.4

Regards and thank you for your time.