HW accelerated Optical Flow

Is it possible to compute Optical Flow with dedicated HW acceleration on the Nvidia Jetson NX (or AGX)?

Hi,

Please check our VPI library:

https://docs.nvidia.com/vpi/algo_optflow_lk.html

Thanks.

Thank you for your answer. I saw the VPI, tough it seems that it only relies on CPU and GPU for the computation, and not on the dedicated hardware acceleration for Optical Flow. Apparently, this HW acceleration seems to be used in the Gstreamer plugin for Deepstream (Gst-nvof — DeepStream 5.1 Release documentation), is this accelerator really used there? And why we might prefer the VPI optical flow implementation?

Hi,

Which dedicated hardware do you indicate? Do you mean VIC?
Deepstream also implement optical flow with GPU.

Both libraries are available for Jetson.
You can choose one based on your use case.

Thanks.

Hi,

I mean the NVENC, I see that by using the gset-nvof it uses the NVENC as well as the GPU. Is there a page where to understand which kind of performance does this optical flow implementation with gstreamer return? I mean in term of frame rate for instance and latency.

Thank you

Hi,
NVENC is hardware video encoding engine. On Xavier, gst-nvof is implemented to utilize VIC engine.