Hi,
As comparison you can try RTSP. Please try the samples:
Doesn't work nvv4l2decoder for decoding RTSP in gstreamer + opencv - #3 by DaneLLL
I got the RTSP video stream on the jetson nano and ran it for about 50 frames before returning false - #7 by DaneLLL
Try other kind of OpenCV samples and check if it works.