[Jetson Orin] Fisheye dewarp multi tiles

[OZD]

Hi NVIDIA Community,

I’m currently using NVDEWARPER on a Jetson Orin to create panoramic video/images from fisheye rtsp input. I am trying to set two surfaces into separate tiles, here is my example:

export GST_PLUGIN_PATH=/opt/nvidia/deepstream/deepstream-6.2/lib
gst-launch-1.0 rtspsrc location='rtsp://username:password@ipaddress:port/rtsp' ! \
        rtph265depay ! \
        h265parse ! \
        nvv4l2decoder ! \
        nvvideoconvert ! "video/x-raw(memory:NVMM),width=3000,height=3000" ! \
        nvdewarper config-file=/path/to/tile.cfg ! \
        m.sink_0 nvstreammux name=m width=1920 height=1080 batch-size=2 num-surfaces-per-frame=2 !\
        nvmultistreamtiler columns=2 rows=1 width=1920 height=1080 ! \
        nvvideoconvert ! \
        nvv4l2h265enc bitrate=8000000 ! \
        h265parse ! \
        mux.video_0 qtmux name=mux ! \
        filesink location=/dev/shm/output.mp4 -e

Here is my config file:

[property]
output-width=1920
output-height=1080
num-batch-buffers=2

[surface0]
projection-type=7
surface-index=0
width=1920
height=1080
top-angle=22.5
bottom-angle=-22.5
pitch=15.0
yaw=15.0
roll=0
src-fov=180

[surface1]
projection-type=7
surface-index=1
width=1920
height=1080
top-angle=22.5
bottom-angle=-22.5
pitch=25.0
yaw=25.0
roll=0
src-fov=180

This is the image i am getting:

As you can see, both surfaces are located in the same tile. I want to have each surface in a separate tile. How can achieve that?
Thanks

[Fiona.Chen]

@OZD

As you can see, both surfaces are located in the same tile.

Yes. The nvmultistreamtiler handles “num-surfaces-per-frame=2” in the batch in this way.

If you want to separate the surfaces, please use the pipeline in the following way:

gst-launch-1.0 uridecodebin uri=file:///opt/nvidia/deepstream/deepstream/samples/streams/sample_cam6.mp4 ! nvvideoconvert ! 'video/x-raw(memory:NVMM),format=RGBA' ! tee name=t t.src_0 ! queue ! nvdewarper config-file=config_dewarper1.txt source_id=0 ! mux.sink_0 t.src_1 ! queue ! nvdewarper config-file=config_dewarper2.txt source_id=1 ! mux.sink_1 nvstreammux name=mux batch-size=2 width=3804 height=1500 num-surfaces-per-frame=1 ! nvmultistreamtiler columns=2 rows=1 ! nvvideoconvert ! nv3dsink

config_dewarper1.txt (271 Bytes)
config_dewarper2.txt (271 Bytes)

[OZD]

Thanks it works great.