Facing RTSP stream output switching (Frames of sinkX visible in stream of sinkY)

The problem is observed in VLC as well.
We have been reporting this issue from 5.0 GA. Based on the announcement in 5.0.1 we though the problem is solved but we have faced this problem in 5.0.1. Then we read about release noted of 5.1 talking about RTSP stability. We face this issue in 5.1 also.