How Deepstream reads depth data(Z16) and sends it via rtsp

Hi,
Please check technical reference manual of TX1:
https://developer.nvidia.com/embedded/downloads#?search=trm
VIC is the hardware engine for conversion/scaling/cropping.

In DeepStream SDK, this solution may not work since DS SDK is gstreamer-based implementation and Z16 is not a supported format.
It can be possible in using tegra_multimedia_api. v4l2cuda sample can be referred as a start point. In the sample, it demonstrates how to allocate CUDA buffers and do capture in V4L2_PIX_FMT_UYVY format. You may try to customize it to capture in Z16 format.