NVOF uses outdated Optical Flow SDK version

[icetana]

• Hardware Platform (Jetson / GPU) - N/A
• DeepStream Version - v5.1.0
• JetPack Version (valid for Jetson only) - N/A
• TensorRT Version - N/A
• Issue Type (questions, new requirements, bugs) - New requirement

As of version v5.1.0 of Deepstream as available on the nvcr, the nvof plugin reports that it is still using version 1.0.10 of the Optical Flow SDK library.

Factory Details:
  Rank                     primary (256)
  Long-name                nvof
  Klass                    nvof
  Description              Gstreamer NV Optical Flow Plugin
  Author                   NVIDIA Corporation. Post on Deepstream for Jetson/Tesla forum for any queries @ https://devtalk.nvidia.com/default/board/209/
Plugin Details:
  Name                     nvdsgst_of
  Description              NVIDIA opticalflow plugin for integration with DeepStream on DGPU
  Filename                 /usr/lib/x86_64-linux-gnu/gstreamer-1.0/deepstream/libnvdsgst_of.so
  Version                  4.0
  License                  Proprietary
  Source module            nvopticalflow
  Binary package           NVIDIA DeepStream 3rdparty IP integration opticalflow plugin
  Origin URL               http://nvidia.com/
GObject
 +----GInitiallyUnowned
       +----GstObject
             +----GstElement
                   +----GstBaseTransform
                         +----GstNvOpticalFlow
Pad Templates:
  SINK template: 'sink'
    Availability: Always
    Capabilities:
      video/x-raw(memory:NVMM)
                 format: { (string)NV12 }
                  width: [ 1, 2147483647 ]
                 height: [ 1, 2147483647 ]
              framerate: [ 0/1, 2147483647/1 ]
  
  SRC template: 'src'
    Availability: Always
    Capabilities:
      video/x-raw(memory:NVMM)
                 format: { (string)NV12 }
                  width: [ 1, 2147483647 ]
                 height: [ 1, 2147483647 ]
              framerate: [ 0/1, 2147483647/1 ]
Element has no clocking capabilities.
Element has no URI handling capabilities.
Pads:
  SINK: 'sink'
    Pad Template: 'sink'
  SRC: 'src'
    Pad Template: 'src'
Element Properties:
  name                : The name of the object
                        flags: readable, writable
                        String. Default: "nvopticalflow0"
  parent              : The parent of the object
                        flags: readable, writable
                        Object of type "GstObject"
  qos                 : Handle Quality-of-Service events
                        flags: readable, writable
                        Boolean. Default: false
  gpu-id              : Set GPU Device ID
                        flags: readable, writable, changeable only in NULL or READY state
                        Unsigned Integer. Range: 0 - 4294967295 Default: 0 
  dump-of-meta        : Dump Optical Flow Meta
                        flags: readable, writable
                        Boolean. Default: false
  preset-level        : Type of Preset Levels
                        flags: readable, writable, changeable only in NULL or READY state
                        Enum "GstNvOFPresetLevel" Default: 0, "NV_OF_PERF_LEVEL_FAST"
                           (0): NV_OF_PERF_LEVEL_FAST - High performance and low quality
                           (1): NV_OF_PERF_LEVEL_MEDIUM - Low performance and medium quality
                           (2): NV_OF_PERF_LEVEL_SLOW - Lowest performance and best quality
  grid-size           : Type of Grid Size
                        flags: readable, writable, changeable only in NULL or READY state
                        Enum "GstNvOFGridSize" Default: 0, "NVOF_GRID_SIZE_4x4"
                           (0): NVOF_GRID_SIZE_4x4 - Optical Flow Grid Size 4x4
  pool-size           : Size of optical flow memory pool
                        flags: readable, writable
                        Unsigned Integer. Range: 1 - 4294967295 Default: 7 
  nvof-lib-version    : Optical Flow Library Version
                        flags: readable
                        String. Default: "1.0.10"

Yet, as of current, we are already up to version 3.0 of the Optical Flow SDK.
This is proving to be a bit of an issue for us, as it means that we are not able to receive the benefits of any fixes, improvements and new features that newer versions of the Optical Flow SDK library can give us.

Do you have any roadmap on when the Optical Flow SDK version that the nvof Deepstream plugin will be updated to the latest version, so that users of Deepstream can take advantage of the benefits of the latest Optical Flow SDK version?

[mchi]

Thanks! Will check the roadmap and get back

[mchi]

Hi @icetana ,
Sorry for delay!

There are dependencies we need to look into before we can migrate. We will take it into consideration on our roadmap. However,. you could write their own plugin and use whatever version they need.

Thanks!