gstreamer - omxh264enc / enctune.conf

XPav · September 4, 2015, 7:04pm

I’m looking at the gstomx1 source code, and there are several flags in NVX_PARAM_VIDECPROPERTY that are interesting and I’d like to set for use with omxh264enc.

However, through the gstreamer interface, there’s no access to there.

Similar values appear to be available in /etc/enctune.conf, but I can’t seem to set them there, nor does there seem to be an easy way to pick a specific configuration from there.

I don’t particularly care how I set some of these flags, but I’m really trying to avoid having to recompile gstomx1 to set a few flags.

Any thoughts or tips? Thanks!

Manoj_Gupta · September 15, 2015, 4:56am

@XPav
You can modify the /etc/enctune.conf file by pulling it out using adb and then make the necessary changes. You might also need to modify additional files as per your requirement like media_profiles.xml and media_codecs.xml. Then push the changed files back :-
$ adb push media_profiles.xml /etc/media_profiles.xml
$ adb push media_codecs.xml /etc/media_codecs.xml
$ adb push enctune.conf /etc/enctune.conf.xml
and do a system reboot so that the changes can take effect.
$ adb reboot

kulve · September 15, 2015, 11:25am

Do those really apply to Linux for Tegra?

Manoj_Gupta · September 16, 2015, 7:07am

For L4T the logic should be same in my opinion, we can directly copy-paste files

XPav · October 2, 2015, 1:13am

Running gst-launch-1.0 with omxh264enc under strace shows that it doesn’t even open the file. So, using gstreamer 1.0, the encoder has all these options that just inaccessible.

Now, the gstreamer 0.10 module has all these various option (see below), so I know they’re there!

I attempted to build the 1.0 module from source so I could manually add the options I care about, but the tbz2 module tries to pull various information from a git repo… but no git repo is specified in any of the documentation. Trying to mash the nvidia source ontop of the stock gst-omx didn’t work either.

In order of preference:

Please add all the options that are in the 0.10 module to 1.0
Please provide better directions on how to compile the 1.0 dmx gstreamer module, and I’ll twiddle the bits myself

1.0:

Factory Details:
  Rank                     primary + 10 (266)
  Long-name                OpenMAX H.264 Video Encoder
  Klass                    Codec/Encoder/Video
  Description              Encode H.264 video streams
  Author                   Sebastian Dröge <sebastian.droege@collabora.co.uk>

Plugin Details:
  Name                     omx
  Description              GStreamer OpenMAX Plug-ins
  Filename                 /usr/lib/arm-linux-gnueabihf/gstreamer-1.0/libgstomx.so
  Version                  1.2.3
  License                  LGPL
  Source module            gstreamer
  Source release date      2014-02-08
  Binary package           GStreamer source release
  Origin URL               Unknown package origin

GObject
 +----GInitiallyUnowned
       +----GstObject
             +----GstElement
                   +----GstVideoEncoder
                         +----GstOMXVideoEnc
                               +----GstOMXH264Enc
                                     +----GstOMXH264Enc-omxh264enc

Implemented Interfaces:
  GstPreset

Pad Templates:
  SRC template: 'src'
    Availability: Always
    Capabilities:
      video/x-h264
                  width: [ 16, 4096 ]
                 height: [ 16, 4096 ]
          stream-format: { byte-stream, avc }
              alignment: au

  SINK template: 'sink'
    Availability: Always
    Capabilities:
      video/x-raw(memory:NVMM)
                 format: { I420, NV12 }
                  width: [ 1, 2147483647 ]
                 height: [ 1, 2147483647 ]
              framerate: [ 0/1, 2147483647/1 ]
      video/x-raw
                 format: { I420, NV12 }
                  width: [ 1, 2147483647 ]
                 height: [ 1, 2147483647 ]
              framerate: [ 0/1, 2147483647/1 ]


Element Flags:
  no flags set

Element Implementation:
  Has change_state() function: gst_omx_video_enc_change_state

Element has no clocking capabilities.
Element has no indexing capabilities.
Element has no URI handling capabilities.

Pads:
  SINK: 'sink'
    Implementation:
      Has chainfunc(): gst_video_encoder_chain
      Has custom eventfunc(): gst_video_encoder_sink_event
      Has custom queryfunc(): gst_video_encoder_sink_query
      Has custom iterintlinkfunc(): gst_pad_iterate_internal_links_default
    Pad Template: 'sink'
  SRC: 'src'
    Implementation:
      Has custom eventfunc(): gst_video_encoder_src_event
      Has custom queryfunc(): gst_video_encoder_src_query
      Has custom iterintlinkfunc(): gst_pad_iterate_internal_links_default
    Pad Template: 'src'

Element Properties:
  name                : The name of the object
                        flags: readable, writable
                        String. Default: "omxh264enc-omxh264enc0"
  parent              : The parent of the object
                        flags: readable, writable
                        Object of type "GstObject"
  control-rate        : Bitrate control method
                        flags: readable, writable, changeable only in NULL or READY state
                        Enum "GstOMXVideoEncControlRate" Default: 1, "variable"
                           (0): disable          - Disable
                           (1): variable         - Variable
                           (2): constant         - Constant
                           (3): variable-skip-frames - Variable Skip Frames
                           (4): constant-skip-frames - Constant Skip Frames
  target-bitrate      : Target bitrate
                        flags: readable, writable, changeable in NULL, READY, PAUSED or PLAYING state
                        Unsigned Integer. Range: 0 - 4294967295 Default: 4000000 
  quant-i-frames      : Quantization parameter for I-frames (0xffffffff=component default)
                        flags: readable, writable, changeable only in NULL or READY state
                        Unsigned Integer. Range: 0 - 4294967295 Default: 4294967295 
  quant-p-frames      : Quantization parameter for P-frames (0xffffffff=component default)
                        flags: readable, writable, changeable only in NULL or READY state
                        Unsigned Integer. Range: 0 - 4294967295 Default: 4294967295 
  quant-b-frames      : Quantization parameter for B-frames (0xffffffff=component default)
                        flags: readable, writable, changeable only in NULL or READY state
                        Unsigned Integer. Range: 0 - 4294967295 Default: 4294967295

0.10

Factory Details:
  Long name:	OpenMAX IL H.264/AVC video encoder
  Class:	Codec/Encoder/Video
  Description:	Encodes video in H.264/AVC format with OpenMAX IL
  Author(s):	Felipe Contreras
  Rank:		primary + 10 (266)

Plugin Details:
  Name:			omx
  Description:		OpenMAX IL
  Filename:		/usr/lib/arm-linux-gnueabihf/gstreamer-0.10/libgstomx.so
  Version:		0.10.1
  License:		LGPL
  Source module:	gst-openmax
  Binary package:	gst-openmax source release
  Origin URL:		Unknown package origin

GObject
 +----GstObject
       +----GstElement
             +----GstOmxBaseFilter
                   +----GstOmxBaseVideoEnc
                         +----GstOmxH264Enc

Implemented Interfaces:
  GstImplementsInterface
  GstOmx

Pad Templates:
  SINK template: 'sink'
    Availability: Always
    Capabilities:
      video/x-raw-yuv
                  width: [ 16, 4096 ]
                 height: [ 16, 4096 ]
              framerate: [ 0/1, 2147483647/1 ]
                 format: { I420, NV12 }
      video/x-nv-yuv
                  width: [ 16, 4096 ]
                 height: [ 16, 4096 ]
              framerate: [ 0/1, 2147483647/1 ]
                 format: { I420, NV12 }
      video/x-nvrm-yuv
                  width: [ 16, 4096 ]
                 height: [ 16, 4096 ]
              framerate: [ 0/1, 2147483647/1 ]
                 format: { I420, NV12 }

  SRC template: 'src'
    Availability: Always
    Capabilities:
      video/x-h264
              framerate: [ 0/1, 2147483647/1 ]
                  width: [ 176, 2147483647 ]
                 height: [ 144, 2147483647 ]
          stream-format: { byte-stream, avc }
              alignment: { au }


Element Flags:
  no flags set

Element Implementation:
  Has change_state() function: 0xb68718b4
  Has custom save_thyself() function: gst_element_save_thyself
  Has custom restore_thyself() function: gst_element_restore_thyself

Element has no clocking capabilities.
Element has no indexing capabilities.
Element has no URI handling capabilities.

Pads:
  SRC: 'src'
    Implementation:
      Has custom eventfunc(): gst_pad_event_default
      Has custom queryfunc(): gst_pad_query_default
      Has custom iterintlinkfunc(): gst_pad_iterate_internal_links_default
      Has getcapsfunc(): gst_pad_get_fixed_caps_func
      Has acceptcapsfunc(): gst_pad_acceptcaps_default
    Pad Template: 'src'
  SINK: 'sink'
    Implementation:
      Has chainfunc(): 0xb6871b9c
      Has custom eventfunc(): 0xb6871104
      Has custom queryfunc(): gst_pad_query_default
      Has custom iterintlinkfunc(): gst_pad_iterate_internal_links_default
      Has setcapsfunc(): 0xb689a310
      Has acceptcapsfunc(): gst_pad_acceptcaps_default
    Pad Template: 'sink'

Element Properties:
  name                : The name of the object
                        flags: readable, writable
                        String. Default: "omxh264enc0"
  component-name      : Name of the OpenMAX IL component to use
                        flags: readable
                        String. Default: "OMX.Nvidia.h264.encoder"
  component-role      : Role of the OpenMAX IL component
                        flags: readable
                        String. Default: null
  library-name        : Name of the OpenMAX IL implementation library to use
                        flags: readable
                        String. Default: "libnvomx.so"
  use-timestamps      : Whether or not to use timestamps
                        flags: readable, writable
                        Boolean. Default: true
  input-buffers       : The number of OMX input buffers
                        flags: readable, writable
                        Unsigned Integer. Range: 1 - 10 Default: 6 
  output-buffers      : The number of OMX output buffers
                        flags: readable, writable
                        Unsigned Integer. Range: 1 - 10 Default: 6 
  full-frame          : Whether or not the data is full framed
                        flags: readable, writable
                        Boolean. Default: false
  skip-frames         : Which types of frames to skip during decoding
                        flags: readable, writable
                        Enum "GstOmxVideoDecSkipFrameType" Default: 0, "DECODE_ALL_FRAMES"
                           (0): DECODE_ALL_FRAMES - GST_OMX_DECODE_ALL_FRAMES
                           (1): SKIP_NON_REF_FRAMES - GST_OMX_DECODE_SKIP_NON_REF_FRAMES
                           (2): DECODE_KEY_FRAMES - GST_OMX_DECODE_KEY_FRAMES
  bitrate             : Encoding bit-rate
                        flags: readable, writable
                        Unsigned Integer. Range: 0 - 4294967295 Default: 4000000 
  quality-level       : Encoding quality-level
                        flags: readable, writable
                        Unsigned Integer. Range: 0 - 2 Default: 2 
  rc-mode             : Encoding rate control mode
                        flags: readable, writable
                        Enum "GstOmxVideoEncRCModeType" Default: 2, "vbr2"
                           (0): cbr              - GST_OMX_VIDENC_RCMODE_TYPE_CONSTANT
                           (1): vbr              - GST_OMX_VIDENC_RCMODE_TYPE_VARIABLE
                           (2): vbr2             - GST_OMX_VIDENC_RCMODE_TYPE_VARIABLE2
  iframeinterval      : Encoding Intra Frame occurance frequency
                        flags: readable, writable
                        Unsigned Integer. Range: 0 - 4294967295 Default: 60 
  qp-range            : Qunatization range for P and I frame
                        flags: readable, writable
                        String. Default: null
  temporal-tradeoff   : Temporal Tradeoff value for encoder
                        flags: readable, writable
                        Enum "GstOmxVideoEncTemporalTradeoffType" Default: 0, "30fps"
                           (0): 30fps            - GST_OMX_VIDENC_FORCE_FRAMERATE_AS_FAST_AS_POSSIBLE
                           (1): 24fps            - GST_OMX_VIDENC_FORCE_FRAMERATE_24
                           (2): 20fps            - GST_OMX_VIDENC_FORCE_FRAMERATE_20
                           (3): 15fps            - GST_OMX_VIDENC_FORCE_FRAMERATE_15
                           (4): 10fps            - GST_OMX_VIDENC_FORCE_FRAMERATE_10
  bit-packetization   : Whether or not Packet size is based upon Number Of bits
                        flags: readable, writable
                        Boolean. Default: false
  insert-spsppsatidr  : Whether or not insert SPS & PPS at every IDR
                        flags: readable, writable
                        Boolean. Default: true
  low-latency         : Whether or not set low latency attribute of encoder
                        flags: readable, writable
                        Boolean. Default: false
  framerate           : Frames per second
                        flags: readable, writable
                        Integer. Range: 0 - 60 Default: 30 
  slice-header-spacing: Slice Header Spacing number of macroblocks/bits in one packet
                        flags: readable, writable
                        Unsigned Long. Range: 0 - 4294967295 Default: 0 

Element Actions:
  "force-IDR" :  void user_function (GstElement* object);

Manoj_Gupta · October 5, 2015, 6:37am

@XPav
0.1 Gstreamer and 1.0 Gstreamer are 2 different things as you know developed by Gstreamer community. The 1.x series is parallel installable to GStreamer 0.10, but all the apps running on these are not inter-compatible.

Please add all the options that are in the 0.10 module to 1.0
<<< not owned by nvidia, its open source, if you need any specific info that I can try to find out.

To install gstreamer 1.0 please follow this :-

After target devices boot up, Modify /etc/apt/sources.list file to add universe and multiverse packages
deb Index of /ubuntu-ports trusty main restricted universe multiverse
deb-src Index of /ubuntu-ports trusty main restricted universe multiverse
or
sudo add-apt-repository universe && sudo add-apt-repository multiverse
Install following packages:
sudo apt-get update && sudo apt-get install gstreamer1.0-tools gstreamer1.0-alsa gstreamer1.0-plugins-base gstreamer1.0-plugins-good gstreamer1.0-plugins-bad gstreamer1.0-plugins-ugly libgstreamer1.0-dev libgstreamer-plugins-base1.0-dev libgstreamer-plugins-good1.0-dev libgstreamer-plugins-bad1.0-dev libegl1-mesa-dev libgles2-mesa-dev

If you are attempting something else, please let me know.

XPav · October 5, 2015, 5:36pm

@Manoj_Gupta

That’s not the problem. I can run either version of gstreamer all day long.

These are the problems:
As distributed by Nvidia, the 0.10 filter has options the 1.0 does not. I need the options.
I’d add them to 1.0, but the source provided seems relies on a non-specified git repo and does not build.
I’d even use 0.10, but 1.0 is far better and fixes other bugs.

Nvidia absolutely modified gst-omx for the Tegra, compare the provided source against the gstreamer git.

Jitendrak · October 6, 2015, 5:54am

@XPav

I assume you have followed the steps mentioned in README.txt to compile the gst-omx source code.
We don’t fetch anything from git because that is complete package. Please mention the steps you have been following to compile the code.

Secondly, additional features for encoders/decoders will be part of next release. If you want you can wait till that time.

XPav · October 14, 2015, 7:45pm

@Jitendrak

The gst-omx code compiled according to directions.
The gst-omx1 code does not. README says “enter dir, do ./configure”, but there is no configure in the tbz2. autogen.sh does exist, but that looks for .git.

However, if in the next month or so you update the gstreamer 1.0 binaries and add the insert-spsppsatidr and low-latency options, I will be a happy camper.

Thanks for the note.

Jitendrak · October 27, 2015, 8:39am

Yes those options will be part of next release.

electronique · January 20, 2016, 8:33pm

@Jitendrak - have the low-latency options been added yet?

ctichenor · January 21, 2016, 9:33pm

Hello electronique, sorry, there have been no released updates to L4T on the Jetson TK1. The last update was L4T 21.4 which was released in July of 2015. An L4T update is planned but we have not set a release date.