Hi there @sivaramakrishnan.nageswar and welcome to the NVIDIA developer forums!
Did you check out on the Jetson Nano forums yet? There have been similar discussions before, if a bit older, about rtsp streams. But the principles should still hold.
In general you should look for examples that make use of libgstrtspserver and serve video content from a gstreamer pipeline.
Sorry if I can’t give you more than this, as it is not really an NVIDIA specific thing, but maybe that gets you started.
Thanks!