Hi,
If your source supports v4l2, you can capture frame data into NvBuffer (NVMM buffer). For gstreamer, please use nvv4l2camerasrc.
For special resolution you would need to consider data alignment. Please refer to the topic:
YUV camera(5.4M) preview issue - #19 by DaneLLL
The nvv4l2camerasrc is open source, if you need to do customization, may download the source code and check.