Need support for equirectangular projection in nvdewarper

Hi there, I am trying to use the DeepStream GST plugin to transform two fisheye camera inputs to equirectangular video. The slides here at https://developer.download.nvidia.com/embedded/webinars/webinar-deepstream-transfer-learning-toolkit-deploy-streaming-analytics-scale.pdf?za3seEtLPmZRm4fMENIkm5Nq9EL3_FV2ZX66ks6cgGIBGbzQK_gBldM0FylvG5YXeZ72-joZrb3ZWwcctpFkAHaMaZu4lW51jLmGc-MFnuR9WVDOPt23HGZzSpgUX5xeZlc7AVtdqK3aNRlCUBSfc-03C4leCJvn5AMZypalEx9pShlq4YHl8LUotWOGDg9odGzf4CWc2ReHK3X3CsDoHYwS indicates that the nvdewarper plugin should be able to support several projections including equirectangular. However, the plugin manual I found for both 4.0 and 5.0 at https://docs.nvidia.com/metropolis/deepstream/dev-guide/index.html#page/DeepStream%20Plugins%20Development%20Guide/deepstream_plugin_details.3.08.html saying that only PushBroom and VertRadCyl is supported. Is there anyway for me to enable the support for equirectangular projection in the dewaper plugin?

• Hardware Platform (Jetson / GPU): Jetson
• DeepStream Version: 4.0
• JetPack Version (valid for Jetson only): (L4T) 32.2.3
• TensorRT Version: 5.1.6
• NVIDIA GPU Driver Version (valid for GPU only): N/A

Hi,
This looks to be feature request. We will check if we can support it in future release.

Hi,
We have checked and think the current implementation should be fine for most cases. Don’t have plan on this in near future.

Hi Danel,

Thanks for the reply, I am sorry to hear that the equireactagular dewarp will not be supported in the near future. I am wondering in this case, is that possible I could develop a dewarp myself and used it as a plugin in the NV accelerated gstreamer?

What I need here is just a pixel to pixel remap API, similar to the remap filter in ffmpeg (https://trac.ffmpeg.org/wiki/RemapFilter). I tried to run the ffmpeg on jetson but seems that ffmpeg proccesses the data on CPU so the fps does not meet our requirement. I am not an expert on video processing but I guess what it does internally on GPU is some kind of matrix multiplication on the input frame. My question is that in the current DeepStream / Nvidia jeston stack, is there some API I could use to acheive this?

I already have the mapping / transformation for the dewarping. What I need is just an API for me to perform the transformation / remapping in a GPU accelerated way. Could you give me some guidance on this?