Need help for TX2 mipi issue

frank133788 · November 8, 2020, 11:31am

Hi, Support,

We use mipi (Toshiba TC359746) for video capture and transmission to TX2, video format YUV422, resolution 1024x768, pixel depth 16bit, 30fps. Our application (coming from the example12 of tegra_multimedia_api) uses V4L2 API to get video frames via nvbuff on TX2. We boundled 4xlanes of mipi channels into one for our video transmission, mipi driver is ov5693.c. When our application running on TX2 received the video frames and display the video via DVI, we found the video frames was tearing on screen, which seems the half of new frame data was writen into the nvbuff which was being read by application for displaying. The screen has part of previous frame and part of the current frame. Could you help to explain where the problem is, and tell us how to fix this problem?

We use the same hardware platform as described above, but changed the video format as 1920x1080, 16bit, 30fps, yuv422.

When we capture and display this video, we also had video frame tearing problem. But when we changed the resolution to 2048x1080, the tearing problem is gone. We don’t understand why. Could you explain?DeviceTree-tegra186-camera-e3326-a00.zip (1.8 KB)

ShaneCCC · November 9, 2020, 6:31am

Dump the data to file to check if have the same problem. If the raw data have the same problem it could be the device configure problem.

v4l2-ctl -d /dev/video0 --set-fmt-video=width=1024,height=768 --set-ctrl bypass_mode=0 --stream-mmap --stream-count=5 --stream-to=test.raw

frank133788 · November 9, 2020, 10:37am

We saved the RAW image using the command you provided and found no tearing of the image.Attached is the RAW file we saved.The DVI of TX2 is set at 1024x768 and the 60 frame resolution of the camera is 1024x768 and 30 frames.Could you please help us to analyze what causes the tearing problem?
test.zip (3.5 MB)

ShaneCCC · November 9, 2020, 3:14pm

Try to boost the nvcsi/vi clocks to try.

sudo su
echo 1 > /sys/kernel/debug/bpmp/debug/clk/vi/mrq_rate_locked
echo 1 > /sys/kernel/debug/bpmp/debug/clk/isp/mrq_rate_locked
echo 1 > /sys/kernel/debug/bpmp/debug/clk/nvcsi/mrq_rate_locked
cat /sys/kernel/debug/bpmp/debug/clk/vi/max_rate |tee /sys/kernel/debug/bpmp/debug/clk/vi/rate
cat /sys/kernel/debug/bpmp/debug/clk/isp/max_rate | tee  /sys/kernel/debug/bpmp/debug/clk/isp/rate
cat /sys/kernel/debug/bpmp/debug/clk/nvcsi/max_rate | tee /sys/kernel/debug/bpmp/debug/clk/nvcsi/rate

frank133788 · November 10, 2020, 1:13am

We have tried according to the method you provided, but the image still appears tearing phenomenon, what else can cause this phenomenon?Please help us to analyze the reason!thank you

ShaneCCC · November 10, 2020, 4:19am

Could you confirm with v4l2src

gst-launch-1.0 v4l2src device=/dev/video0 ! 'video/x-raw, width=(int)1920, height=(int)1080' ! xvimagesink -ev

frank133788 · November 10, 2020, 7:45am

We tried to capture the video using the following command, and observed that the image was not torn.However, tearing will occur when using the “12_camera_v4L2_cuda” program in the official “L4T_MultimediaAPI” to collect images.Please help us to see the configuration problem of “12_camera_v4L2_cuda” program.

gst - launch - 1.0 v4l2src device = / dev/video0!'video/x-raw, format=(string)UYVY, ww

idth=(int)1024, height=(int)768’ ! nvvidconv ! 'video/x-raw(memory:NVMM), formatt

=(string)I420, width=(int)1024, height=(int)768’ ! nvoverlaysink async=false synn

c=false

ShaneCCC · November 10, 2020, 8:02am

Boost the system to performance to try.

sudo nvpmodel -m 2
sudo jetson_clocks

frank133788 · November 11, 2020, 2:05am

Hello, we have executed the commands of “sudo NVpmodel-M 2” and “Sudo Jetson_clocks” according to your method, but the images have not been improved at all, and the tearing phenomenon still appears.Is it possible that there is a display problem in the “12_camera_v4L2_cuda” program?

ShaneCCC · November 11, 2020, 4:07am

There is no update from you for a period, assuming this is not an issue any more.
Hence we are closing this topic. If need further support, please open a new one.
Thanks

@frank133788
Could you help to break down the sample code to check if any cuda process cause the tearing.

frank133788 · December 4, 2020, 4:17am

Hi
We on TX2 platform configuration two way HDMI to DVI output parameters are 1024 x768 60 frames per second, in the previous 12 _camera_v4l2_cuda program configuration NvEglRenderer: : createEglRenderer (" renderer0 “, 1024, 768, 0, 0), image output appear horizontal tear phenomenon.Then we modify the configuration NvEglRenderer _camera_v4l2_cuda applications: : createEglRenderer (” renderer0 ", 1024, 769, 0, 0), at the same time to collect two road camera “video0 1024 x768, 1024 x768 video1” image output transverse tear disappear, but will occasionally appear image output of longitudinal tear phenomenon.

Could you please help us to analyze what may be the cause of the tearing problem of our output image?How to solve this image tearing problem

ShaneCCC · December 4, 2020, 4:22am

Could you break down the cuda sample code pipeline to confirm which stage cause the problem.

DaneLLL · December 4, 2020, 6:06am

Hi,
Do you observe the issue in running v4l2-ctl? Or you have any modification in 12_camera_v4l2_cuda. If you can capture good frames in v4l2-ctl, it should also work in running 12_camera_v4l2_cuda.

You may also try gstreamer. Please refer to
Jetson Nano FAQ
Q: I have a USB camera. How can I launch it on Jetson Nano?