Camera Half FPS Problem

hburaks · May 10, 2019, 6:11am

I try to get my external FPGA-CSI2 camera to work using OV5693.c

Pattern Generator generated 60 RGB888 fps and we could only get 30.
Now, the camera generates 50 fps but we can only capture 25.

We tried capturing with the same setup, with a Tx1, and Tx1 could get the right FPS’es. 60 from pattern generator and 50 from the camera, respectively.

Tx2 always seem to downsample the FPS by 1/2. Do you know why is that?

same as:
https://devtalk.nvidia.com/default/topic/1027275/jetson-tx2/why-my-camera-in-tx2-always-12-496-fps-/
https://devtalk.nvidia.com/default/topic/1030053/jetson-tx2/framerate-and-latency-issues-questions-on-tx2/
https://devtalk.nvidia.com/default/topic/1026128/jetson-tx2/tegra-multimedia-apis-could-get-raw-image-via-v4l2-only-at-15fps/6

Followed the topics, but couldn’t find a solution.

They suggested boosting up the Tegra clock, (we did), no FPS increase.
They suggested writing to camera registers at init, (we didnt), since our CSI stream is fed from an FPGA.

(Notice that we can get 50 FPS with Tx1, with the same configuration)

nvidia@tegra-ubuntu:~$ v4l2-ctl --set-fmt-video=width=1280,height=720,pixelformat=BGRA --set-ctrl bypass_mode=0 --stream-mmap --stream-count=100 -d /dev/video0
<<<<<<<<<<<<<<<<<<<<<<<<<< 25.00 fps
<<<<<<<<<<<<<<<<<<<<<<<<<< 25.12 fps
<<<<<<<<<<<<<<<<<<<<<<<< 25.00 fps
<<<<<<<<<<<<<<<<<<<<<<<<

[ 4455.636742] nvcsi 150c0000.nvcsi: csi4_stream_check_status (0) ERROR_STATUS2VI_VC0 = 0x00000004
[ 4486.598894] ov5693 2-0046: camera_common_try_fmt: size 1280 x 720
[ 4486.605171] ov5693 2-0046: camera_common_s_fmt(4106) size 1280 x 720
[ 4486.611645] ov5693 2-0046: camera_common_try_fmt: size 1280 x 720
[ 4486.626334] ov5693 2-0046: camera_common_g_fmt++
[ 4490.753901] nvcsi 150c0000.nvcsi: csi4_stream_check_status (0) ERROR_STATUS2VI_VC0 = 0x00000004
nvidia@tegra-ubuntu:~$

nvidia@tegra-ubuntu:~$ sudo cat /sys/kernel/debug/tracing/trace
# tracer: nop
#
# entries-in-buffer/entries-written: 544/544   #P:4
#
#                              _-----=> irqs-off
#                             / _----=> need-resched
#                            | / _---=> hardirq/softirq
#                            || / _--=> preempt-depth
#                            ||| /     delay
#           TASK-PID   CPU#  ||||    TIMESTAMP  FUNCTION
#              | |       |   ||||       |         |
     kworker/0:0-3034  [000] ...1  4634.608281: rtos_queue_peek_from_isr_failed: tstamp:145160295794 queue:0x0b4a3c58
     kworker/0:0-3034  [000] ...1  4634.608288: rtcpu_start: tstamp:145160297001
     kworker/0:0-3034  [000] ...1  4634.608290: rtcpu_vinotify_handle_msg: tstamp:145160331877 tag:CSIMUX_STREAM channel:0xff frame:0 vi_tstamp:3426410668 data:0x00000001
     kworker/0:0-3034  [000] ...1  4634.608292: rtcpu_vinotify_handle_msg: tstamp:145160828723 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:3426907383 data:0x00000001
     kworker/0:0-3034  [000] ...1  4634.608293: rtcpu_vinotify_handle_msg: tstamp:145160828911 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:3426907391 data:0x00000000
     kworker/0:0-3034  [000] ...1  4634.608294: rtcpu_vinotify_handle_msg: tstamp:145160831523 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:3426910324 data:0x08000000
     kworker/0:0-3034  [000] ...1  4634.661562: rtcpu_vinotify_handle_msg: tstamp:145161428275 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:3427507068 data:0x02cf0002
     kworker/0:0-3034  [000] ...1  4634.661606: rtcpu_vinotify_handle_msg: tstamp:145161453504 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:3427532256 data:0x00000000
     kworker/0:0-3034  [000] ...1  4634.661615: rtcpu_vinotify_handle_msg: tstamp:145162078618 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:3428157298 data:0x00000001
     kworker/0:0-3034  [000] ...1  4634.661624: rtcpu_vinotify_handle_msg: tstamp:145162078804 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:3428157306 data:0x00000000
     kworker/0:0-3034  [000] ...1  4634.661634: rtcpu_vinotify_handle_msg: tstamp:145162081293 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:3428160082 data:0x08000000
     kworker/0:0-3034  [000] ...1  4634.661644: rtcpu_vinotify_handle_msg: tstamp:145162678730 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:3428756983 data:0x02cf0002
     kworker/0:0-3034  [000] ...1  4634.712597: rtcpu_vinotify_handle_msg: tstamp:145162703898 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:3428782172 data:0x00000000
     kworker/0:0-3034  [000] ...1  4634.712630: rtcpu_vinotify_handle_msg: tstamp:145163329093 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:3429407213 data:0x00000001
     kworker/0:0-3034  [000] ...1  4634.712639: rtcpu_vinotify_handle_msg: tstamp:145163330367 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:3429407222 data:0x00000000
     kworker/0:0-3034  [000] ...1  4634.712649: rtcpu_vinotify_handle_msg: tstamp:145163348141 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:3429426476 data:0x08000000
     kworker/0:0-3034  [000] ...1  4634.712658: rtcpu_vinotify_handle_msg: tstamp:145163928579 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:3430006898 data:0x02cf0002
     kworker/0:0-3034  [000] ...1  4634.712672: rtcpu_vinotify_handle_msg: tstamp:145163953815 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:3430032088 data:0x00000000
     kworker/0:0-3034  [000] ...1  4634.764402: rtcpu_vinotify_handle_msg: tstamp:145164578932 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:3430657129 data:0x00000001
     kworker/0:0-3034  [000] ...1  4634.764424: rtcpu_vinotify_handle_msg: tstamp:145164580236 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:3430657137 data:0x00000000
     kworker/0:0-3034  [000] ...1  4634.764433: rtcpu_vinotify_handle_msg: tstamp:145164593648 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:3430671893 data:0x08000000
     kworker/0:0-3034  [000] ...1  4634.764442: rtcpu_vinotify_handle_msg: tstamp:145165178531 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:3431256814 data:0x02cf0002
     kworker/0:0-3034  [000] ...1  4634.764452: rtcpu_vinotify_handle_msg: tstamp:145165203727 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:3431282002 data:0x00000000
     kworker/0:0-3034  [000] ...1  4634.764492: rtos_queue_peek_from_isr_failed: tstamp:145165297186 queue:0x0b4a3c58
     kworker/0:0-3034  [000] ...1  4634.764502: rtcpu_vinotify_handle_msg: tstamp:145165828869 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:3431907044 data:0x00000001
     kworker/0:0-3034  [000] ...1  4634.764512: rtcpu_vinotify_handle_msg: tstamp:145165830171 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:3431907053 data:0x00000000
     kworker/0:0-3034  [000] ...1  4634.764523: rtcpu_vinotify_handle_msg: tstamp:145165839528 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:3431917811 data:0x08000000
     kworker/0:0-3034  [000] ...1  4634.816392: rtcpu_vinotify_handle_msg: tstamp:145166428444 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:3432506729 data:0x02cf0002
     kworker/0:0-3034  [000] ...1  4634.816412: rtcpu_vinotify_handle_msg: tstamp:145166453637 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:3432531918 data:0x00000000
     kworker/0:0-3034  [000] ...1  4634.816422: rtcpu_vinotify_handle_msg: tstamp:145167078755 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:3433156959 data:0x00000001
     kworker/0:0-3034  [000] ...1  4634.816431: rtcpu_vinotify_handle_msg: tstamp:145167080118 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:3433156968 data:0x00000000
     kworker/0:0-3034  [000] ...1  4634.816440: rtcpu_vinotify_handle_msg: tstamp:145167087269 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:3433165617 data:0x08000000
     kworker/0:0-3034  [000] ...1  4634.868392: rtcpu_vinotify_handle_msg: tstamp:145167678361 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:3433756644 data:0x02cf0002
     kworker/0:0-3034  [000] ...1  4634.868403: rtcpu_vinotify_handle_msg: tstamp:145167703553 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:3433781833 data:0x00000000
     kworker/0:0-3034  [000] ...1  4634.868413: rtcpu_vinotify_handle_msg: tstamp:145168328671 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:3434406875 data:0x00000001
     kworker/0:0-3034  [000] ...1  4634.868426: rtcpu_vinotify_handle_msg: tstamp:145168329932 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:3434406883 data:0x00000000
     kworker/0:0-3034  [000] ...1  4634.868435: rtcpu_vinotify_handle_msg: tstamp:145168337301 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:3434415626 data:0x08000000
     kworker/0:0-3034  [000] ...1  4634.868445: rtcpu_vinotify_handle_msg: tstamp:145168928277 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:3435006560 data:0x02cf0002
     kworker/0:0-3034  [000] ...1  4634.868455: rtcpu_vinotify_handle_msg: tstamp:145168953466 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:3435031749 data:0x00000000
     kworker/0:0-3034  [000] ...1  4634.920374: rtcpu_vinotify_handle_msg: tstamp:145169578559 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:3435656790 data:0x00000001
     kworker/0:0-3034  [000] ...1  4634.920389: rtcpu_vinotify_handle_msg: tstamp:145169579882 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:3435656798 data:0x00000000
     kworker/0:0-3034  [000] ...1  4634.920398: rtcpu_vinotify_handle_msg: tstamp:145169587532 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:3435665849 data:0x08000000
     kworker/0:0-3034  [000] ...1  4634.920408: rtcpu_vinotify_handle_msg: tstamp:145170178197 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:3436256475 data:0x02cf0002
     kworker/0:0-3034  [000] ...1  4634.920417: rtcpu_vinotify_handle_msg: tstamp:145170203388 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:3436281664 data:0x00000000
     kworker/0:0-3034  [000] ...1  4634.920438: rtos_queue_peek_from_isr_failed: tstamp:145170297691 queue:0x0b4a3c58
     kworker/0:0-3034  [000] ...1  4634.972381: rtcpu_vinotify_handle_msg: tstamp:145170828508 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:3436906706 data:0x00000001
     kworker/0:0-3034  [000] ...1  4634.972393: rtcpu_vinotify_handle_msg: tstamp:145170829783 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:3436906715 data:0x00000000
     kworker/0:0-3034  [000] ...1  4634.972403: rtcpu_vinotify_handle_msg: tstamp:145170836386 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:3436914701 data:0x08000000
     kworker/0:0-3034  [000] ...1  4634.972415: rtcpu_vinotify_handle_msg: tstamp:145171428143 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:3437506391 data:0x02cf0002
     kworker/0:0-3034  [000] ...1  4634.972424: rtcpu_vinotify_handle_msg: tstamp:145171453305 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:3437531580 data:0x00000000
     kworker/0:0-3034  [000] ...1  4634.972435: rtcpu_vinotify_handle_msg: tstamp:145172078434 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:3438156621 data:0x00000001
     kworker/0:0-3034  [000] ...1  4634.972445: rtcpu_vinotify_handle_msg: tstamp:145172079712 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:3438156629 data:0x00000000
     kworker/0:0-3034  [000] ...1  4634.972455: rtcpu_vinotify_handle_msg: tstamp:145172085950 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:3438164286 data:0x08000000
     kworker/0:0-3034  [000] ...1  4635.024377: rtcpu_vinotify_handle_msg: tstamp:145172678027 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:3438756306 data:0x02cf0002
     kworker/0:0-3034  [000] ...1  4635.024405: rtcpu_vinotify_handle_msg: tstamp:145172703219 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:3438781495 data:0x00000000
     kworker/0:0-3034  [000] ...1  4635.024414: rtcpu_vinotify_handle_msg: tstamp:145173328332 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:3439406536 data:0x00000001
     kworker/0:0-3034  [000] ...1  4635.024424: rtcpu_vinotify_handle_msg: tstamp:145173329603 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:3439406545 data:0x00000000
     kworker/0:0-3034  [000] ...1  4635.024433: rtcpu_vinotify_handle_msg: tstamp:145173337035 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:3439415362 data:0x08000000
     kworker/0:0-3034  [000] ...1  4635.024443: rtcpu_vinotify_handle_msg: tstamp:145173927943 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:3440006222 data:0x02cf0002
     kworker/0:0-3034  [000] ...1  4635.024452: rtcpu_vinotify_handle_msg: tstamp:145173953132 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:3440031411 data:0x00000000
     kworker/0:0-3034  [000] ...1  4635.076382: rtcpu_vinotify_handle_msg: tstamp:145174578234 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:3440656452 data:0x00000001
     kworker/0:0-3034  [000] ...1  4635.076394: rtcpu_vinotify_handle_msg: tstamp:145174579586 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:3440656460 data:0x00000000
     kworker/0:0-3034  [000] ...1  4635.076404: rtcpu_vinotify_handle_msg: tstamp:145174585929 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:3440664259 data:0x08000000
     kworker/0:0-3034  [000] ...1  4635.076413: rtcpu_vinotify_handle_msg: tstamp:145175177792 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:3441256136 data:0x02cf0002
     kworker/0:0-3034  [000] ...1  4635.076423: rtcpu_vinotify_handle_msg: tstamp:145175203050 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:3441281326 data:0x00000000
     kworker/0:0-3034  [000] ...1  4635.076445: rtos_queue_peek_from_isr_failed: tstamp:145175298202 queue:0x0b4a3c58
     kworker/0:0-3034  [000] ...1  4635.128862: rtcpu_vinotify_handle_msg: tstamp:145175828168 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:3441906368 data:0x00000001
     kworker/0:0-3034  [000] ...1  4635.128928: rtcpu_vinotify_handle_msg: tstamp:145175829449 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:3441906376 data:0x00000000
     kworker/0:0-3034  [000] ...1  4635.128939: rtcpu_vinotify_handle_msg: tstamp:145175835845 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:3441914161 data:0x08000000
     kworker/0:0-3034  [000] ...1  4635.128948: rtcpu_vinotify_handle_msg: tstamp:145176427769 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:3442506052 data:0x02cf0002
     kworker/0:0-3034  [000] ...1  4635.128962: rtcpu_vinotify_handle_msg: tstamp:145176452937 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:3442531241 data:0x00000000
     kworker/0:0-3034  [000] ...1  4635.128977: rtcpu_vinotify_handle_msg: tstamp:145177077651 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:3443156282 data:0x00000001
     kworker/0:0-3034  [000] ...1  4635.128986: rtcpu_vinotify_handle_msg: tstamp:145177077918 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:3443156290 data:0x00000000
     kworker/0:0-3034  [000] ...1  4635.128996: rtcpu_vinotify_handle_msg: tstamp:145177081681 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:3443160466 data:0x08000000
     kworker/0:0-3034  [000] ...1  4635.180550: rtcpu_vinotify_handle_msg: tstamp:145177677875 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:3443755967 data:0x02cf0002
     kworker/0:0-3034  [000] ...1  4635.180603: rtcpu_vinotify_handle_msg: tstamp:145177702878 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:3443781157 data:0x00000000
     kworker/0:0-3034  [000] ...1  4635.180615: rtcpu_vinotify_handle_msg: tstamp:145178327998 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:3444406198 data:0x00000001
     kworker/0:0-3034  [000] ...1  4635.180626: rtcpu_vinotify_handle_msg: tstamp:145178329266 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:3444406207 data:0x00000000
     kworker/0:0-3034  [000] ...1  4635.180635: rtcpu_vinotify_handle_msg: tstamp:145178345952 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:3444424271 data:0x08000000
     kworker/0:0-3034  [000] ...1  4635.232398: rtcpu_vinotify_handle_msg: tstamp:145178927601 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:3445005883 data:0x02cf0002
     kworker/0:0-3034  [000] ...1  4635.232421: rtcpu_vinotify_handle_msg: tstamp:145178952791 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:3445031072 data:0x00000000
     kworker/0:0-3034  [000] ...1  4635.232431: rtcpu_vinotify_handle_msg: tstamp:145179577990 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:3445656114 data:0x00000001
     kworker/0:0-3034  [000] ...1  4635.232442: rtcpu_vinotify_handle_msg: tstamp:145179579415 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:3445656122 data:0x00000000
     kworker/0:0-3034  [000] ...1  4635.232452: rtcpu_vinotify_handle_msg: tstamp:145179592556 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:3445670882 data:0x08000000
     kworker/0:0-3034  [000] ...1  4635.232461: rtcpu_vinotify_handle_msg: tstamp:145180177521 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:3446255798 data:0x02cf0002
     kworker/0:0-3034  [000] ...1  4635.232471: rtcpu_vinotify_handle_msg: tstamp:145180202706 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:3446280987 data:0x00000000
     kworker/0:0-3034  [000] ...1  4635.232514: rtos_queue_peek_from_isr_failed: tstamp:145180298703 queue:0x0b4a3c58
     kworker/0:0-3034  [000] ...1  4635.284424: rtcpu_vinotify_handle_msg: tstamp:145180827828 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:3446906028 data:0x00000001
     kworker/0:0-3034  [000] ...1  4635.284441: rtcpu_vinotify_handle_msg: tstamp:145180829101 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:3446906037 data:0x00000000
     kworker/0:0-3034  [000] ...1  4635.284451: rtcpu_vinotify_handle_msg: tstamp:145180837010 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:3446915329 data:0x08000000
     kworker/0:0-3034  [000] ...1  4635.284461: rtcpu_vinotify_handle_msg: tstamp:145181427506 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:3447505714 data:0x02cf0002
     kworker/0:0-3034  [000] ...1  4635.284471: rtcpu_vinotify_handle_msg: tstamp:145181452628 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:3447530902 data:0x00000000
     kworker/0:0-3034  [000] ...1  4635.284480: rtcpu_vinotify_handle_msg: tstamp:145182077807 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:3448155944 data:0x00000001
     kworker/0:0-3034  [000] ...1  4635.284489: rtcpu_vinotify_handle_msg: tstamp:145182079237 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:3448155952 data:0x00000000
     kworker/0:0-3034  [000] ...1  4635.284501: rtcpu_vinotify_handle_msg: tstamp:145182086914 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:3448165229 data:0x08000000
     kworker/0:0-3034  [000] ...1  4635.336395: rtcpu_vinotify_handle_msg: tstamp:145182677312 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:3448755629 data:0x02cf0002
     kworker/0:0-3034  [000] ...1  4635.336406: rtcpu_vinotify_handle_msg: tstamp:145182702545 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:3448780818 data:0x00000000
     kworker/0:0-3034  [000] ...1  4635.336416: rtcpu_vinotify_handle_msg: tstamp:145183327637 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:3449405859 data:0x00000001
     kworker/0:0-3034  [000] ...1  4635.336425: rtcpu_vinotify_handle_msg: tstamp:145183328936 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:3449405868 data:0x00000000
     kworker/0:0-3034  [000] ...1  4635.336435: rtcpu_vinotify_handle_msg: tstamp:145183337256 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:3449415567 data:0x08000000
     kworker/0:0-3034  [000] ...1  4635.388379: rtcpu_vinotify_handle_msg: tstamp:145183927397 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:3450005544 data:0x02cf0002
     kworker/0:0-3034  [000] ...1  4635.388390: rtcpu_vinotify_handle_msg: tstamp:145183952461 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:3450030733 data:0x00000000
     kworker/0:0-3034  [000] ...1  4635.388400: rtcpu_vinotify_handle_msg: tstamp:145184577577 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:3450655775 data:0x00000001
     kworker/0:0-3034  [000] ...1  4635.388409: rtcpu_vinotify_handle_msg: tstamp:145184578852 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:3450655783 data:0x00000000
     kworker/0:0-3034  [000] ...1  4635.388419: rtcpu_vinotify_handle_msg: tstamp:145184585382 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:3450663722 data:0x08000000
     kworker/0:0-3034  [000] ...1  4635.388432: rtcpu_vinotify_handle_msg: tstamp:145185177144 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:3451255459 data:0x02cf0002
     kworker/0:0-3034  [000] ...1  4635.388442: rtcpu_vinotify_handle_msg: tstamp:145185202435 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:3451280649 data:0x00000000
     kworker/0:0-3034  [000] ...1  4635.388457: rtos_queue_peek_from_isr_failed: tstamp:145185299211 queue:0x0b4a3c58

But I get constant 25 fps. The mclk of FPGA is 74250 kHz and the pixel clock is also set as 74250;
We calculated the Line Length as: 1280 + 4(EOL) + 692(Horizontal Blanking) + 4(SOL) = 1980 (The camera we use is Tamron MP1010M-VC)

mode0 { //OV5693_MODE_1280X720
				    mclk_khz = "74250";
					num_lanes = "4";
					tegra_sinterface = "serial_a";
					discontinuous_clk = "no";
					dpcm_enable = "false";
					cil_settletime = "0";

					active_w = "1280";
					active_h = "720";
					pixel_t = "rgb888";
					readout_orientation = "90";
					line_length = "1980";
					inherent_gain = "1";
					mclk_multiplier = "1";
					pix_clk_hz = "74250000";

					min_gain_val = "1.0";
					max_gain_val = "16";
					min_hdr_ratio = "1";
					max_hdr_ratio = "64";
					min_framerate = "1.816577";
					max_framerate = "60";
					min_exp_time = "34";
					max_exp_time = "550385";
			};

This is our mode that we use to stream 1280x720x50fps. Do we need to adjust anything else? I don’t think any setting by itself can have such a big impact of making the FPS 1/2.

What do we need to configure? If you can explain and direct us we’d be really gratefull. Thank you.

hburaks · May 10, 2019, 6:52am

At first we had problems getting data, and the forum moderator ShaneCCC suggested disabling the ECC check. We did. And after that we are getting data successfully (but 1/2 fps)

Before we disabled the ECC check the trace was like this, maybe it is useful to debug the issue;

root@tegra-ubuntu:/home/nvidia# echo 1 > /sys/kernel/debug/tracing/tracing_on
root@tegra-ubuntu:/home/nvidia# echo 30720 > /sys/kernel/debug/tracing/buffer_size_kb
root@tegra-ubuntu:/home/nvidia# echo 1 > /sys/kernel/debug/tracing/events/tegra_rtcpu/enable
root@tegra-ubuntu:/home/nvidia# echo 1 > /sys/kernel/debug/tracing/events/freertos/enable
root@tegra-ubuntu:/home/nvidia# echo 2 > /sys/kernel/debug/camrtc/log-level
root@tegra-ubuntu:/home/nvidia# echo > /sys/kernel/debug/tracing/trace
root@tegra-ubuntu:/home/nvidia# v4l2-ctl -d /dev/video0 --set-fmt-video=width=1280,height=720,pixelformat=RG10 --set-ctrl bypass_mode=0 --stream-mmap --stream-count=1 --stream-to=test.raw
<
root@tegra-ubuntu:/home/nvidia# sudo cat /sys/kernel/debug/tracing/trace
# tracer: nop
#
# entries-in-buffer/entries-written: 345/345   #P:4
#
#                              _-----=> irqs-off
#                             / _----=> need-resched
#                            | / _---=> hardirq/softirq
#                            || / _--=> preempt-depth
#                            ||| /     delay
#           TASK-PID   CPU#  ||||    TIMESTAMP  FUNCTION
#              | |       |   ||||       |         |
     kworker/0:2-2803  [000] ...1  1231.584335: rtos_queue_peek_from_isr_failed: tstamp:38816056863 queue:0x0b4a3c58
     kworker/0:2-2803  [000] ...1  1231.584341: rtcpu_start: tstamp:38816058023
     kworker/0:2-2803  [000] ...1  1231.584343: rtcpu_vinotify_handle_msg: tstamp:38816090291 tag:CSIMUX_STREAM channel:0xff frame:0 vi_tstamp:161384185 data:0x00000001
     kworker/0:2-2803  [000] ...1  1231.584345: rtcpu_vinotify_handle_msg: tstamp:38816980849 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:162274448 data:0x00400060
     kworker/0:2-2803  [000] ...1  1231.584346: rtcpu_vinotify_handle_msg: tstamp:38816981009 tag:CHANSEL_SHORT_FRAME channel:0x01 frame:0 vi_tstamp:162274448 data:0x00000001
     kworker/0:2-2803  [000] ...1  1231.584347: rtcpu_vinotify_handle_msg: tstamp:38816981168 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:162274451 data:0x00000001
     kworker/0:2-2803  [000] ...1  1231.636249: rtcpu_vinotify_handle_msg: tstamp:38817501378 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:162795276 data:0x00400060
     kworker/0:2-2803  [000] ...1  1231.636252: rtcpu_vinotify_handle_msg: tstamp:38818022212 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:163316105 data:0x00400060
     kworker/0:2-2803  [000] ...1  1231.636253: rtcpu_vinotify_handle_msg: tstamp:38818543033 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:163836933 data:0x00400060
     kworker/0:2-2803  [000] ...1  1231.688437: rtcpu_vinotify_handle_msg: tstamp:38819063861 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:164357761 data:0x00400060
     kworker/0:2-2803  [000] ...1  1231.688449: rtcpu_vinotify_handle_msg: tstamp:38819584691 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:164878589 data:0x00400060
     kworker/0:2-2803  [000] ...1  1231.688459: rtcpu_vinotify_handle_msg: tstamp:38820105994 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:165399418 data:0x00400060
     kworker/0:2-2803  [000] ...1  1231.740422: rtcpu_vinotify_handle_msg: tstamp:38820626823 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:165920246 data:0x00400060
     kworker/0:2-2803  [000] ...1  1231.740438: rtos_queue_peek_from_isr_failed: tstamp:38821057774 queue:0x0b4a3c58
     kworker/0:2-2803  [000] ...1  1231.740449: rtcpu_vinotify_handle_msg: tstamp:38821147184 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:166441076 data:0x00400060
     kworker/0:2-2803  [000] ...1  1231.740459: rtcpu_vinotify_handle_msg: tstamp:38821668486 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:166961904 data:0x00400060
     kworker/0:2-2803  [000] ...1  1231.792432: rtcpu_vinotify_handle_msg: tstamp:38822189313 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:167482732 data:0x00400060
     kworker/0:2-2803  [000] ...1  1231.792447: rtcpu_vinotify_handle_msg: tstamp:38822710142 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:168003561 data:0x00400060
     kworker/0:2-2803  [000] ...1  1231.792456: rtcpu_vinotify_handle_msg: tstamp:38823230969 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:168524391 data:0x00400060
     kworker/0:2-2803  [000] ...1  1231.792465: rtcpu_vinotify_handle_msg: tstamp:38823751773 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:169045219 data:0x00400060
     kworker/0:2-2803  [000] ...1  1231.844660: rtcpu_vinotify_handle_msg: tstamp:38824272629 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:169566048 data:0x00400060
     kworker/0:2-2803  [000] ...1  1231.844710: rtcpu_vinotify_handle_msg: tstamp:38824793426 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:170086877 data:0x00400060
     kworker/0:2-2803  [000] ...1  1231.844720: rtcpu_vinotify_handle_msg: tstamp:38825314260 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:170607706 data:0x00400060
     kworker/0:2-2803  [000] ...1  1231.896379: rtcpu_vinotify_handle_msg: tstamp:38825834655 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:171128536 data:0x00400060
     kworker/0:2-2803  [000] ...1  1231.896389: rtos_queue_peek_from_isr_failed: tstamp:38826058327 queue:0x0b4a3c58
     kworker/0:2-2803  [000] ...1  1231.896391: rtcpu_vinotify_handle_msg: tstamp:38826355484 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:171649364 data:0x00400060
     kworker/0:2-2803  [000] ...1  1231.896393: rtcpu_vinotify_handle_msg: tstamp:38826876331 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:172170194 data:0x00400060
     kworker/0:2-2803  [000] ...1  1231.948330: rtcpu_vinotify_handle_msg: tstamp:38827397143 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:172691022 data:0x00400060
     kworker/0:2-2803  [000] ...1  1231.948333: rtcpu_vinotify_handle_msg: tstamp:38827917970 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:173211851 data:0x00400060
     kworker/0:2-2803  [000] ...1  1231.948335: rtcpu_vinotify_handle_msg: tstamp:38828438799 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:173732681 data:0x00400060
     kworker/0:2-2803  [000] ...1  1232.000327: rtcpu_vinotify_handle_msg: tstamp:38828959628 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:174253510 data:0x00400060
     kworker/0:2-2803  [000] ...1  1232.000330: rtcpu_vinotify_handle_msg: tstamp:38829480459 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:174774339 data:0x00400060
     kworker/0:2-2803  [000] ...1  1232.000332: rtcpu_vinotify_handle_msg: tstamp:38830001288 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:175295168 data:0x00400060
     kworker/0:2-2803  [000] ...1  1232.052751: rtcpu_vinotify_handle_msg: tstamp:38830522569 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:175815996 data:0x00400060
     kworker/0:2-2803  [000] ...1  1232.052803: rtcpu_vinotify_handle_msg: tstamp:38831043399 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:176336826 data:0x00400060
     kworker/0:2-2803  [000] ...1  1232.052838: rtos_queue_peek_from_isr_failed: tstamp:38831059243 queue:0x0b4a3c58
     kworker/0:2-2803  [000] ...1  1232.052847: rtcpu_vinotify_handle_msg: tstamp:38831564230 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:176857655 data:0x00400060
     kworker/0:2-2803  [000] ...1  1232.104360: rtcpu_vinotify_handle_msg: tstamp:38832085058 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:177378483 data:0x00400060
     kworker/0:2-2803  [000] ...1  1232.104375: rtcpu_vinotify_handle_msg: tstamp:38832605889 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:177899313 data:0x00400060
     kworker/0:2-2803  [000] ...1  1232.104388: rtcpu_vinotify_handle_msg: tstamp:38833126719 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:178420141 data:0x00400060
     kworker/0:2-2803  [000] ...1  1232.156344: rtcpu_vinotify_handle_msg: tstamp:38833647552 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:178940971 data:0x00400060
     kworker/0:2-2803  [000] ...1  1232.156354: rtcpu_vinotify_handle_msg: tstamp:38834168379 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:179461800 data:0x00400060
     kworker/0:2-2803  [000] ...1  1232.156365: rtcpu_vinotify_handle_msg: tstamp:38834689207 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:179982629 data:0x00400060
     kworker/0:2-2803  [000] ...1  1232.208327: rtcpu_vinotify_handle_msg: tstamp:38835210042 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:180503458 data:0x00400060
     kworker/0:2-2803  [000] ...1  1232.208338: rtcpu_vinotify_handle_msg: tstamp:38835730866 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:181024286 data:0x00400060
     kworker/0:2-2803  [000] ...1  1232.208352: rtos_queue_peek_from_isr_failed: tstamp:38836059756 queue:0x0b4a3c58
     kworker/0:2-2803  [000] ...1  1232.208362: rtcpu_vinotify_handle_msg: tstamp:38836251667 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:181545116 data:0x00400060
     kworker/0:2-2803  [000] ...1  1232.260374: rtcpu_vinotify_handle_msg: tstamp:38836772524 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:182065945 data:0x00400060
     kworker/0:2-2803  [000] ...1  1232.260391: rtcpu_vinotify_handle_msg: tstamp:38837293371 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:182586773 data:0x00400060
     kworker/0:2-2803  [000] ...1  1232.260402: rtcpu_vinotify_handle_msg: tstamp:38837814184 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:183107603 data:0x00400060
     kworker/0:2-2803  [000] ...1  1232.260411: rtcpu_vinotify_handle_msg: tstamp:38838335014 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:183628431 data:0x00400060
     kworker/0:2-2803  [000] ...1  1232.312336: rtcpu_vinotify_handle_msg: tstamp:38838855839 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:184149261 data:0x00400060
     kworker/0:2-2803  [000] ...1  1232.312346: rtcpu_vinotify_handle_msg: tstamp:38839376671 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:184670090 data:0x00400060
     kworker/0:2-2803  [000] ...1  1232.312356: rtcpu_vinotify_handle_msg: tstamp:38839897498 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:185190919 data:0x00400060
     kworker/0:2-2803  [000] ...1  1232.364330: rtcpu_vinotify_handle_msg: tstamp:38840418329 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:185711747 data:0x00400060
     kworker/0:2-2803  [000] ...1  1232.364341: rtcpu_vinotify_handle_msg: tstamp:38840939218 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:186232576 data:0x00400060
     kworker/0:2-2803  [000] ...1  1232.364355: rtos_queue_peek_from_isr_failed: tstamp:38841060256 queue:0x0b4a3c58
     kworker/0:2-2803  [000] ...1  1232.364368: rtcpu_vinotify_handle_msg: tstamp:38841459979 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:186753406 data:0x00400060
     kworker/0:2-2803  [000] ...1  1232.416340: rtcpu_vinotify_handle_msg: tstamp:38841980809 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:187274235 data:0x00400060
     kworker/0:2-2803  [000] ...1  1232.416354: rtcpu_vinotify_handle_msg: tstamp:38842501638 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:187795064 data:0x00400060
     kworker/0:2-2803  [000] ...1  1232.416363: rtcpu_vinotify_handle_msg: tstamp:38843022465 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:188315892 data:0x00400060
     kworker/0:2-2803  [000] ...1  1232.468342: rtcpu_vinotify_handle_msg: tstamp:38843543297 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:188836722 data:0x00400060
     kworker/0:2-2803  [000] ...1  1232.468353: rtcpu_vinotify_handle_msg: tstamp:38844064125 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:189357551 data:0x00400060
     kworker/0:2-2803  [000] ...1  1232.468363: rtcpu_vinotify_handle_msg: tstamp:38844584953 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:189878380 data:0x00400060
     kworker/0:2-2803  [000] ...1  1232.520527: rtcpu_vinotify_handle_msg: tstamp:38845105784 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:190399209 data:0x00400060
     kworker/0:2-2803  [000] ...1  1232.520557: rtcpu_vinotify_handle_msg: tstamp:38845626614 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:190920037 data:0x00400060
     kworker/0:2-2803  [000] ...1  1232.520579: rtos_queue_peek_from_isr_failed: tstamp:38846060738 queue:0x0b4a3c58
     kworker/0:2-2803  [000] ...1  1232.520588: rtcpu_vinotify_handle_msg: tstamp:38846147412 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:191440867 data:0x00400060
     kworker/0:2-2803  [000] ...1  1232.572457: rtcpu_vinotify_handle_msg: tstamp:38846668270 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:191961696 data:0x00400060
     kworker/0:2-2803  [000] ...1  1232.572498: rtcpu_vinotify_handle_msg: tstamp:38847189098 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:192482525 data:0x00400060
     kworker/0:2-2803  [000] ...1  1232.572508: rtcpu_vinotify_handle_msg: tstamp:38847709947 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:193003354 data:0x00400060
     kworker/0:2-2803  [000] ...1  1232.624405: rtcpu_vinotify_handle_msg: tstamp:38848231126 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:193524183 data:0x00400060
     kworker/0:2-2803  [000] ...1  1232.624426: rtcpu_vinotify_handle_msg: tstamp:38848232162 tag:CHANSEL_SHORT_FRAME channel:0x01 frame:0 vi_tstamp:193524183 data:0x00000001
     kworker/0:2-2803  [000] ...1  1232.624435: rtcpu_vinotify_handle_msg: tstamp:38848233203 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:193524185 data:0x00000001
     kworker/0:2-2803  [000] ...1  1232.624445: rtcpu_vinotify_handle_msg: tstamp:38848751593 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:194045011 data:0x00400060
     kworker/0:2-2803  [000] ...1  1232.624454: rtcpu_vinotify_handle_msg: tstamp:38849272422 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:194565841 data:0x00400060
     kworker/0:2-2803  [000] ...1  1232.676582: rtcpu_vinotify_handle_msg: tstamp:38849793243 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:195086670 data:0x00400060
     kworker/0:2-2803  [000] ...1  1232.676645: rtcpu_vinotify_handle_msg: tstamp:38850314043 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:195607498 data:0x00400060
     kworker/0:2-2803  [000] ...1  1232.676656: rtcpu_vinotify_handle_msg: tstamp:38850834448 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:196128326 data:0x00400060
     kworker/0:2-2803  [000] ...1  1232.676699: rtos_queue_peek_from_isr_failed: tstamp:38851061434 queue:0x0b4a3c58
     kworker/0:2-2803  [000] ...1  1232.676709: rtcpu_vinotify_handle_msg: tstamp:38851355730 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:196649155 data:0x00400060
     kworker/0:2-2803  [000] ...1  1232.728372: rtcpu_vinotify_handle_msg: tstamp:38851876563 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:197169985 data:0x00400060
     kworker/0:2-2803  [000] ...1  1232.728387: rtcpu_vinotify_handle_msg: tstamp:38852397389 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:197690813 data:0x00400060
     kworker/0:2-2803  [000] ...1  1232.728396: rtcpu_vinotify_handle_msg: tstamp:38852918220 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:198211642 data:0x00400060
     kworker/0:2-2803  [000] ...1  1232.780399: rtcpu_vinotify_handle_msg: tstamp:38853439052 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:198732471 data:0x00400060
     kworker/0:2-2803  [000] ...1  1232.780422: rtcpu_vinotify_handle_msg: tstamp:38853959877 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:199253301 data:0x00400060
     kworker/0:2-2803  [000] ...1  1232.780432: rtcpu_vinotify_handle_msg: tstamp:38854480708 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:199774130 data:0x00400060
     kworker/0:2-2803  [000] ...1  1232.832313: rtcpu_vinotify_handle_msg: tstamp:38855001603 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:200294959 data:0x00400060
     kworker/0:2-2803  [000] ...1  1232.832324: rtcpu_vinotify_handle_msg: tstamp:38855522363 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:200815787 data:0x00400060
     kworker/0:2-2803  [000] ...1  1232.832334: rtcpu_vinotify_handle_msg: tstamp:38856043194 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:201336616 data:0x00400060
     kworker/0:2-2803  [000] ...1  1232.832351: rtos_queue_peek_from_isr_failed: tstamp:38856061782 queue:0x0b4a3c58
     kworker/0:2-2803  [000] ...1  1232.884349: rtcpu_vinotify_handle_msg: tstamp:38856564019 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:201857446 data:0x00400060
     kworker/0:2-2803  [000] ...1  1232.884360: rtcpu_vinotify_handle_msg: tstamp:38857084850 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:202378274 data:0x00400060
     kworker/0:2-2803  [000] ...1  1232.884370: rtcpu_vinotify_handle_msg: tstamp:38857605678 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:202899103 data:0x00400060
     kworker/0:2-2803  [000] ...1  1232.936338: rtcpu_vinotify_handle_msg: tstamp:38858126523 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:203419931 data:0x00400060
     kworker/0:2-2803  [000] ...1  1232.936348: rtcpu_vinotify_handle_msg: tstamp:38858647334 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:203940761 data:0x00400060
     kworker/0:2-2803  [000] ...1  1232.936357: rtcpu_vinotify_handle_msg: tstamp:38859168164 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:204461590 data:0x00400060
     kworker/0:2-2803  [000] ...1  1232.988338: rtcpu_vinotify_handle_msg: tstamp:38859688993 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:204982419 data:0x00400060
     kworker/0:2-2803  [000] ...1  1232.988351: rtcpu_vinotify_handle_msg: tstamp:38860209824 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:205503248 data:0x00400060
     kworker/0:2-2803  [000] ...1  1232.988360: rtcpu_vinotify_handle_msg: tstamp:38860730654 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:206024077 data:0x00400060
     kworker/0:2-2803  [000] ...1  1232.988378: rtos_queue_peek_from_isr_failed: tstamp:38861062285 queue:0x0b4a3c58
     kworker/0:2-2803  [000] ...1  1233.040646: rtcpu_vinotify_handle_msg: tstamp:38861251480 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:206544906 data:0x00400060
     kworker/0:2-2803  [000] ...1  1233.040704: rtcpu_vinotify_handle_msg: tstamp:38861772283 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:207065735 data:0x00400060
     kworker/0:2-2803  [000] ...1  1233.040714: rtcpu_vinotify_handle_msg: tstamp:38862293216 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:207586565 data:0x00400060
     kworker/0:2-2803  [000] ...1  1233.092317: rtcpu_vinotify_handle_msg: tstamp:38862813958 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:208107394 data:0x00400060
     kworker/0:2-2803  [000] ...1  1233.092323: rtcpu_vinotify_handle_msg: tstamp:38863334352 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:208628223 data:0x00400060
     kworker/0:2-2803  [000] ...1  1233.092326: rtcpu_vinotify_handle_msg: tstamp:38863855190 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:209149051 data:0x00400060
     kworker/0:2-2803  [000] ...1  1233.092327: rtcpu_vinotify_handle_msg: tstamp:38864375991 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:209669881 data:0x00400060
     kworker/0:2-2803  [000] ...1  1233.144412: rtcpu_vinotify_handle_msg: tstamp:38864897292 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:210190710 data:0x00400060
     kworker/0:2-2803  [000] ...1  1233.144431: rtcpu_vinotify_handle_msg: tstamp:38865418121 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:210711539 data:0x00400060
     kworker/0:2-2803  [000] ...1  1233.144440: rtcpu_vinotify_handle_msg: tstamp:38865938948 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:211232368 data:0x00400060
     kworker/0:2-2803  [000] ...1  1233.196388: rtos_queue_peek_from_isr_failed: tstamp:38866062799 queue:0x0b4a3c58
     kworker/0:2-2803  [000] ...1  1233.196411: rtcpu_vinotify_handle_msg: tstamp:38866459777 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:211753196 data:0x00400060
     kworker/0:2-2803  [000] ...1  1233.196421: rtcpu_vinotify_handle_msg: tstamp:38866980145 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:212274025 data:0x00400060
     kworker/0:2-2803  [000] ...1  1233.196430: rtcpu_vinotify_handle_msg: tstamp:38867501434 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:212794855 data:0x00400060
     kworker/0:2-2803  [000] ...1  1233.248414: rtcpu_vinotify_handle_msg: tstamp:38868022263 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:213315683 data:0x00400060
     kworker/0:2-2803  [000] ...1  1233.248444: rtcpu_vinotify_handle_msg: tstamp:38868543111 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:213836513 data:0x00400060
     kworker/0:2-2803  [000] ...1  1233.248454: rtcpu_vinotify_handle_msg: tstamp:38869063924 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:214357342 data:0x00400060
     kworker/0:2-2803  [000] ...1  1233.300330: rtcpu_vinotify_handle_msg: tstamp:38869584289 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:214878170 data:0x00400060
     kworker/0:2-2803  [000] ...1  1233.300342: rtcpu_vinotify_handle_msg: tstamp:38870105649 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:215399000 data:0x00400060
     kworker/0:2-2803  [000] ...1  1233.300351: rtcpu_vinotify_handle_msg: tstamp:38870626414 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:215919829 data:0x00400060
     kworker/0:2-2803  [000] ...1  1233.352336: rtos_queue_peek_from_isr_failed: tstamp:38871063303 queue:0x0b4a3c58
     kworker/0:2-2803  [000] ...1  1233.352346: rtcpu_vinotify_handle_msg: tstamp:38871147241 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:216440658 data:0x00400060
     kworker/0:2-2803  [000] ...1  1233.352356: rtcpu_vinotify_handle_msg: tstamp:38871668068 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:216961487 data:0x00400060
     kworker/0:2-2803  [000] ...1  1233.352366: rtcpu_vinotify_handle_msg: tstamp:38872188897 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:217482316 data:0x00400060
     kworker/0:2-2803  [000] ...1  1233.404332: rtcpu_vinotify_handle_msg: tstamp:38872709728 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:218003145 data:0x00400060
     kworker/0:2-2803  [000] ...1  1233.404347: rtcpu_vinotify_handle_msg: tstamp:38873230558 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:218523975 data:0x00400060
     kworker/0:2-2803  [000] ...1  1233.404357: rtcpu_vinotify_handle_msg: tstamp:38873751383 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:219044804 data:0x00400060
     kworker/0:2-2803  [000] ...1  1233.456375: rtcpu_vinotify_handle_msg: tstamp:38874272212 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:219565633 data:0x00400060
     kworker/0:2-2803  [000] ...1  1233.456386: rtcpu_vinotify_handle_msg: tstamp:38874793043 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:220086462 data:0x00400060
     kworker/0:2-2803  [000] ...1  1233.456395: rtcpu_vinotify_handle_msg: tstamp:38875313873 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:220607291 data:0x00400060
     kworker/0:2-2803  [000] ...1  1233.508615: rtcpu_vinotify_handle_msg: tstamp:38875834702 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:221128120 data:0x00400060
     kworker/0:2-2803  [000] ...1  1233.508659: rtos_queue_peek_from_isr_failed: tstamp:38876063813 queue:0x0b4a3c58
     kworker/0:2-2803  [000] ...1  1233.508668: rtcpu_vinotify_handle_msg: tstamp:38876355529 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:221648949 data:0x00400060
     kworker/0:2-2803  [000] ...1  1233.508679: rtcpu_vinotify_handle_msg: tstamp:38876876361 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:222169779 data:0x00400060
     kworker/0:2-2803  [000] ...1  1233.560943: rtcpu_vinotify_handle_msg: tstamp:38877397222 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:222690608 data:0x00400060
     kworker/0:2-2803  [000] ...1  1233.560996: rtcpu_vinotify_handle_msg: tstamp:38877918013 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:223211436 data:0x00400060
     kworker/0:2-2803  [000] ...1  1233.561006: rtcpu_vinotify_handle_msg: tstamp:38878438842 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:223732265 data:0x00400060
     kworker/0:2-2803  [000] ...1  1233.561015: rtcpu_vinotify_handle_msg: tstamp:38878959656 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:224253094 data:0x00400060
     kworker/0:2-2803  [000] ...1  1233.612401: rtcpu_vinotify_handle_msg: tstamp:38879480795 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:224773924 data:0x00400060
     kworker/0:2-2803  [000] ...1  1233.612420: rtcpu_vinotify_handle_msg: tstamp:38879481827 tag:CHANSEL_SHORT_FRAME channel:0x01 frame:0 vi_tstamp:224773924 data:0x00000001
     kworker/0:2-2803  [000] ...1  1233.612429: rtcpu_vinotify_handle_msg: tstamp:38879482871 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:224773927 data:0x00000001
     kworker/0:2-2803  [000] ...1  1233.612439: rtcpu_vinotify_handle_msg: tstamp:38880001332 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:225294752 data:0x00400060
     kworker/0:2-2803  [000] ...1  1233.612449: rtcpu_vinotify_handle_msg: tstamp:38880522159 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:225815580 data:0x00400060
     kworker/0:2-2803  [000] ...1  1233.664360: rtcpu_vinotify_handle_msg: tstamp:38881042980 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:226336409 data:0x00400060
     kworker/0:2-2803  [000] ...1  1233.664407: rtos_queue_peek_from_isr_failed: tstamp:38881064309 queue:0x0b4a3c58
     kworker/0:2-2803  [000] ...1  1233.664418: rtcpu_vinotify_handle_msg: tstamp:38881563814 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:226857237 data:0x00400060
     kworker/0:2-2803  [000] ...1  1233.664427: rtcpu_vinotify_handle_msg: tstamp:38882084639 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:227378065 data:0x00400060
     kworker/0:2-2803  [000] ...1  1233.716336: rtcpu_vinotify_handle_msg: tstamp:38882605468 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:227898895 data:0x00400060
     kworker/0:2-2803  [000] ...1  1233.716346: rtcpu_vinotify_handle_msg: tstamp:38883126298 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:228419724 data:0x00400060
     kworker/0:2-2803  [000] ...1  1233.716355: rtcpu_vinotify_handle_msg: tstamp:38883647127 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:228940554 data:0x00400060
     kworker/0:2-2803  [000] ...1  1233.768335: rtcpu_vinotify_handle_msg: tstamp:38884167961 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:229461382 data:0x00400060
     kworker/0:2-2803  [000] ...1  1233.768346: rtcpu_vinotify_handle_msg: tstamp:38884688788 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:229982210 data:0x00400060
     kworker/0:2-2803  [000] ...1  1233.768355: rtcpu_vinotify_handle_msg: tstamp:38885209617 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:230503039 data:0x00400060
     kworker/0:2-2803  [000] ...1  1233.820338: rtcpu_vinotify_handle_msg: tstamp:38885730444 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:231023866 data:0x00400060
     kworker/0:2-2803  [000] ...1  1233.820353: rtos_queue_peek_from_isr_failed: tstamp:38886064821 queue:0x0b4a3c58

ShaneCCC · May 10, 2019, 9:37am

Can you enable below “vi4 got SOF syncpt” message to check the time for each frame gap.

static int tegra_channel_capture_frame(struct tegra_channel *chan,
                                        struct tegra_channel_buffer *buf)
{
        struct timespec ts;
        unsigned long flags;
        bool is_streaming = atomic_read(&chan->is_streaming);
        int restart_version = 0;
        int err = false;
        int i;

        for (i = 0; i < chan->valid_ports; i++)
                tegra_channel_surface_setup(chan, buf, i);

        restart_version = atomic_read(&chan->restart_version);
        if (!is_streaming ||
                restart_version != chan->capture_version) {

                chan->capture_version = restart_version;
                err = tegra_channel_set_stream(chan, true);
                if (err < 0)
                        return err;
        }

        for (i = 0; i < chan->valid_ports; i++) {
                vi4_channel_write(chan, chan->vnc_id[i], CHANNEL_COMMAND, LOAD);
                vi4_channel_write(chan, chan->vnc_id[i],
                        CONTROL, SINGLESHOT | MATCH_STATE_EN);
        }

        /* wait for vi notifier events */
        vi_notify_wait(chan, &ts);
        dev_dbg(&chan->video.dev,
                "%s: vi4 got SOF syncpt buf[%p]\n", __func__, buf);

        vi4_check_status(chan);

        spin_lock_irqsave(&chan->capture_state_lock, flags);
        if (chan->capture_state != CAPTURE_ERROR)
                chan->capture_state = CAPTURE_GOOD;
        spin_unlock_irqrestore(&chan->capture_state_lock, flags);

        if (chan->capture_state == CAPTURE_GOOD) {
                /*
                 * Set the buffer version to match

hburaks · May 10, 2019, 11:09am

In vi4_fops.c, the function tegra_channel_capture_frame was exactly like you’ve written here.

I added #define DEBUG to top of the file.

nvidia@tegra-ubuntu:~$ sudo su
[sudo] password for nvidia: 
root@tegra-ubuntu:/home/nvidia# echo 1 > /sys/kernel/debug/tracing/tracing_on
root@tegra-ubuntu:/home/nvidia# echo 30720 > /sys/kernel/debug/tracing/buffer_size_kb
root@tegra-ubuntu:/home/nvidia# echo 1 > /sys/kernel/debug/tracing/events/tegra_rtcpu/enable
root@tegra-ubuntu:/home/nvidia# echo 1 > /sys/kernel/debug/tracing/events/freertos/enable
root@tegra-ubuntu:/home/nvidia# echo 2 > /sys/kernel/debug/camrtc/log-level
root@tegra-ubuntu:/home/nvidia# echo > /sys/kernel/debug/tracing/trace
root@tegra-ubuntu:/home/nvidia# v4l2-ctl --set-fmt-video=width=1280,height=720,pixelformat=BGRA --set-ctrl bypass_mode=0 --stream-mmap --stream-count=100 -d /dev/video0 --stream-to=ov491.raw
<<<<<<<<<<<<<<<<<<<<<<<<<<< 25.00 fps
<<<<<<<<<<<<<<<<<<<<<<<< 24.63 fps
<<<<<<<<<<<<<<<<<<<<<<<<< 24.75 fps
<<<<<<<<<<<<<<<<<<<<<<<< 24.56 fps

root@tegra-ubuntu:/home/nvidia# sudo cat /sys/kernel/debug/tracing/trace
# tracer: nop
#
# entries-in-buffer/entries-written: 543/543   #P:4
#
#                              _-----=> irqs-off
#                             / _----=> need-resched
#                            | / _---=> hardirq/softirq
#                            || / _--=> preempt-depth
#                            ||| /     delay
#           TASK-PID   CPU#  ||||    TIMESTAMP  FUNCTION
#              | |       |   ||||       |         |
     kworker/4:3-1747  [004] ...1   120.231831: rtos_queue_peek_from_isr_failed: tstamp:4085562854 queue:0x0b4a3c58
     kworker/4:3-1747  [004] ...1   120.231838: rtcpu_start: tstamp:4085563851
     kworker/4:3-1747  [004] ...1   120.231840: rtcpu_vinotify_handle_msg: tstamp:4085835556 tag:CSIMUX_STREAM channel:0xff frame:0 vi_tstamp:4085835128 data:0x00000001
     kworker/4:3-1747  [004] ...1   120.231841: rtcpu_vinotify_handle_msg: tstamp:4086024917 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:4086024364 data:0x00000001
     kworker/4:3-1747  [004] ...1   120.231842: rtcpu_vinotify_handle_msg: tstamp:4086025068 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:4086024372 data:0x00000000
     kworker/4:3-1747  [004] ...1   120.231843: rtcpu_vinotify_handle_msg: tstamp:4086316044 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:4086315632 data:0x08000000
     kworker/4:3-1747  [004] ...1   120.231844: rtcpu_vinotify_handle_msg: tstamp:4086624486 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:4086624050 data:0x02cf0002
     kworker/4:3-1747  [004] ...1   120.231846: rtcpu_vinotify_handle_msg: tstamp:4086649706 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:4086649238 data:0x00000000
     kworker/4:3-1747  [004] ...1   120.283839: rtcpu_vinotify_handle_msg: tstamp:4087274845 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:4087274282 data:0x00000001
     kworker/4:3-1747  [004] ...1   120.283844: rtcpu_vinotify_handle_msg: tstamp:4087275038 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:4087274291 data:0x00000000
     kworker/4:3-1747  [004] ...1   120.283846: rtcpu_vinotify_handle_msg: tstamp:4087568813 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:4087568379 data:0x08000000
     kworker/4:3-1747  [004] ...1   120.283847: rtcpu_vinotify_handle_msg: tstamp:4087874399 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:4087873968 data:0x02cf0002
     kworker/4:3-1747  [004] ...1   120.283848: rtcpu_vinotify_handle_msg: tstamp:4087899636 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:4087899157 data:0x00000000
     kworker/4:3-1747  [004] ...1   120.335837: rtcpu_vinotify_handle_msg: tstamp:4088524784 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:4088524200 data:0x00000001
     kworker/4:3-1747  [004] ...1   120.335842: rtcpu_vinotify_handle_msg: tstamp:4088525026 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:4088524208 data:0x00000000
     kworker/4:3-1747  [004] ...1   120.335843: rtcpu_vinotify_handle_msg: tstamp:4088818510 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:4088818051 data:0x08000000
     kworker/4:3-1747  [004] ...1   120.335844: rtcpu_vinotify_handle_msg: tstamp:4089124344 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:4089123886 data:0x02cf0002
     kworker/4:3-1747  [004] ...1   120.335846: rtcpu_vinotify_handle_msg: tstamp:4089149557 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:4089149075 data:0x00000000
     kworker/4:3-1747  [004] ...1   120.335847: rtcpu_vinotify_handle_msg: tstamp:4089774677 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:4089774118 data:0x00000001
     kworker/4:3-1747  [004] ...1   120.335848: rtcpu_vinotify_handle_msg: tstamp:4089774869 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:4089774126 data:0x00000000
     kworker/4:3-1747  [004] ...1   120.390216: rtcpu_vinotify_handle_msg: tstamp:4090067217 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:4090066782 data:0x08000000
     kworker/4:3-1747  [004] ...1   120.390221: rtcpu_vinotify_handle_msg: tstamp:4090374257 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:4090373804 data:0x02cf0002
     kworker/4:3-1747  [004] ...1   120.390222: rtcpu_vinotify_handle_msg: tstamp:4090399475 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:4090398993 data:0x00000000
     kworker/4:3-1747  [004] ...1   120.390226: rtos_queue_peek_from_isr_failed: tstamp:4090563748 queue:0x0b4a3c58
     kworker/4:3-1747  [004] ...1   120.390227: rtcpu_vinotify_handle_msg: tstamp:4091024593 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:4091024036 data:0x00000001
     kworker/4:3-1747  [004] ...1   120.390229: rtcpu_vinotify_handle_msg: tstamp:4091024786 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:4091024044 data:0x00000000
     kworker/4:3-1747  [004] ...1   120.390230: rtcpu_vinotify_handle_msg: tstamp:4091321615 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:4091321184 data:0x08000000
     kworker/4:3-1747  [004] ...1   120.439882: rtcpu_vinotify_handle_msg: tstamp:4091624148 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:4091623722 data:0x02cf0002
     kworker/4:3-1747  [004] ...1   120.439889: rtcpu_vinotify_handle_msg: tstamp:4091649375 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:4091648911 data:0x00000000
     kworker/4:3-1747  [004] ...1   120.439891: rtcpu_vinotify_handle_msg: tstamp:4092274507 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:4092273954 data:0x00000001
     kworker/4:3-1747  [004] ...1   120.439892: rtcpu_vinotify_handle_msg: tstamp:4092274700 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:4092273962 data:0x00000000
     kworker/4:3-1747  [004] ...1   120.439894: rtcpu_vinotify_handle_msg: tstamp:4092567336 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:4092566904 data:0x08000000
     kworker/4:3-1747  [004] ...1   120.439896: rtcpu_vinotify_handle_msg: tstamp:4092874095 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:4092873640 data:0x02cf0002
     kworker/4:3-1747  [004] ...1   120.439898: rtcpu_vinotify_handle_msg: tstamp:4092899314 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:4092898829 data:0x00000000
     kworker/4:3-1747  [004] ...1   120.491860: rtcpu_vinotify_handle_msg: tstamp:4093524429 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:4093523873 data:0x00000001
     kworker/4:3-1747  [004] ...1   120.491865: rtcpu_vinotify_handle_msg: tstamp:4093524621 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:4093523881 data:0x00000000
     kworker/4:3-1747  [004] ...1   120.491866: rtcpu_vinotify_handle_msg: tstamp:4093818661 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:4093818232 data:0x08000000
     kworker/4:3-1747  [004] ...1   120.491867: rtcpu_vinotify_handle_msg: tstamp:4094123986 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:4094123558 data:0x02cf0002
     kworker/4:3-1747  [004] ...1   120.491868: rtcpu_vinotify_handle_msg: tstamp:4094149211 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:4094148747 data:0x00000000
     kworker/4:3-1747  [004] ...1   120.491869: rtcpu_vinotify_handle_msg: tstamp:4094774346 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:4094773790 data:0x00000001
     kworker/4:3-1747  [004] ...1   120.491870: rtcpu_vinotify_handle_msg: tstamp:4094774538 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:4094773798 data:0x00000000
     kworker/4:3-1747  [004] ...1   120.543830: rtcpu_vinotify_handle_msg: tstamp:4095067845 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:4095067412 data:0x08000000
     kworker/4:3-1747  [004] ...1   120.543835: rtcpu_vinotify_handle_msg: tstamp:4095373908 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:4095373476 data:0x02cf0002
     kworker/4:3-1747  [004] ...1   120.543836: rtcpu_vinotify_handle_msg: tstamp:4095399131 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:4095398665 data:0x00000000
     kworker/4:3-1747  [004] ...1   120.543841: rtos_queue_peek_from_isr_failed: tstamp:4095564234 queue:0x0b4a3c58
     kworker/4:3-1747  [004] ...1   120.543842: rtcpu_vinotify_handle_msg: tstamp:4096024267 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:4096023708 data:0x00000001
     kworker/4:3-1747  [004] ...1   120.543844: rtcpu_vinotify_handle_msg: tstamp:4096024459 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:4096023717 data:0x00000000
     kworker/4:3-1747  [004] ...1   120.543845: rtcpu_vinotify_handle_msg: tstamp:4096318985 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:4096318550 data:0x08000000
     kworker/4:3-1747  [004] ...1   120.595841: rtcpu_vinotify_handle_msg: tstamp:4096623827 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:4096623394 data:0x02cf0002
     kworker/4:3-1747  [004] ...1   120.595846: rtcpu_vinotify_handle_msg: tstamp:4096649049 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:4096648583 data:0x00000000
     kworker/4:3-1747  [004] ...1   120.595848: rtcpu_vinotify_handle_msg: tstamp:4097274184 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:4097273625 data:0x00000001
     kworker/4:3-1747  [004] ...1   120.595849: rtcpu_vinotify_handle_msg: tstamp:4097274377 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:4097273634 data:0x00000000
     kworker/4:3-1747  [004] ...1   120.595850: rtcpu_vinotify_handle_msg: tstamp:4097571105 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:4097570671 data:0x08000000
     kworker/4:3-1747  [004] ...1   120.595852: rtcpu_vinotify_handle_msg: tstamp:4097873757 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:4097873312 data:0x02cf0002
     kworker/4:3-1747  [004] ...1   120.595853: rtcpu_vinotify_handle_msg: tstamp:4097898965 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:4097898501 data:0x00000000
     kworker/4:3-1747  [004] ...1   120.647814: rtcpu_vinotify_handle_msg: tstamp:4098524108 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:4098523544 data:0x00000001
     kworker/4:3-1747  [004] ...1   120.647818: rtcpu_vinotify_handle_msg: tstamp:4098524303 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:4098523552 data:0x00000000
     kworker/4:3-1747  [004] ...1   120.647820: rtcpu_vinotify_handle_msg: tstamp:4098820200 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:4098819765 data:0x08000000
     kworker/4:3-1747  [004] ...1   120.647821: rtcpu_vinotify_handle_msg: tstamp:4099123686 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:4099123230 data:0x02cf0002
     kworker/4:3-1747  [004] ...1   120.647822: rtcpu_vinotify_handle_msg: tstamp:4099148901 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:4099148419 data:0x00000000
     kworker/4:3-1747  [004] ...1   120.699845: rtcpu_vinotify_handle_msg: tstamp:4099774020 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:4099773463 data:0x00000001
     kworker/4:3-1747  [004] ...1   120.699850: rtcpu_vinotify_handle_msg: tstamp:4099774213 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:4099773471 data:0x00000000
     kworker/4:3-1747  [004] ...1   120.699851: rtcpu_vinotify_handle_msg: tstamp:4100073087 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:4100072630 data:0x08000000
     kworker/4:3-1747  [004] ...1   120.699852: rtcpu_vinotify_handle_msg: tstamp:4100373614 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:4100373149 data:0x02cf0002
     kworker/4:3-1747  [004] ...1   120.699853: rtcpu_vinotify_handle_msg: tstamp:4100398819 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:4100398338 data:0x00000000
     kworker/4:3-1747  [004] ...1   120.699856: rtos_queue_peek_from_isr_failed: tstamp:4100564759 queue:0x0b4a3c58
     kworker/4:3-1747  [004] ...1   120.699857: rtcpu_vinotify_handle_msg: tstamp:4101023940 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:4101023380 data:0x00000001
     kworker/4:3-1747  [004] ...1   120.699858: rtcpu_vinotify_handle_msg: tstamp:4101024133 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:4101023388 data:0x00000000
     kworker/4:3-1747  [004] ...1   120.751855: rtcpu_vinotify_handle_msg: tstamp:4101316090 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:4101315656 data:0x08000000
     kworker/4:3-1747  [004] ...1   120.751863: rtcpu_vinotify_handle_msg: tstamp:4101623496 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:4101623066 data:0x02cf0002
     kworker/4:3-1747  [004] ...1   120.751864: rtcpu_vinotify_handle_msg: tstamp:4101648740 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:4101648255 data:0x00000000
     kworker/4:3-1747  [004] ...1   120.751866: rtcpu_vinotify_handle_msg: tstamp:4102273854 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:4102273299 data:0x00000001
     kworker/4:3-1747  [004] ...1   120.751868: rtcpu_vinotify_handle_msg: tstamp:4102274047 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:4102273307 data:0x00000000
     kworker/4:3-1747  [004] ...1   120.751869: rtcpu_vinotify_handle_msg: tstamp:4102567134 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:4102566703 data:0x08000000
     kworker/4:3-1747  [004] ...1   120.751871: rtcpu_vinotify_handle_msg: tstamp:4102873434 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:4102872984 data:0x02cf0002
     kworker/4:3-1747  [004] ...1   120.751872: rtcpu_vinotify_handle_msg: tstamp:4102898657 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:4102898173 data:0x00000000
     kworker/4:3-1747  [004] ...1   120.803851: rtcpu_vinotify_handle_msg: tstamp:4103523771 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:4103523216 data:0x00000001
     kworker/4:3-1747  [004] ...1   120.803859: rtcpu_vinotify_handle_msg: tstamp:4103523967 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:4103523224 data:0x00000000
     kworker/4:3-1747  [004] ...1   120.803860: rtcpu_vinotify_handle_msg: tstamp:4103820404 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:4103819975 data:0x08000000
     kworker/4:3-1747  [004] ...1   120.803862: rtcpu_vinotify_handle_msg: tstamp:4104123365 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:4104122902 data:0x02cf0002
     kworker/4:3-1747  [004] ...1   120.803863: rtcpu_vinotify_handle_msg: tstamp:4104148572 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:4104148090 data:0x00000000
     kworker/4:3-1747  [004] ...1   120.855877: rtcpu_vinotify_handle_msg: tstamp:4104773689 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:4104773134 data:0x00000001
     kworker/4:3-1747  [004] ...1   120.855883: rtcpu_vinotify_handle_msg: tstamp:4104773882 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:4104773143 data:0x00000000
     kworker/4:3-1747  [004] ...1   120.855884: rtcpu_vinotify_handle_msg: tstamp:4105068775 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:4105068345 data:0x08000000
     kworker/4:3-1747  [004] ...1   120.855885: rtcpu_vinotify_handle_msg: tstamp:4105373282 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:4105372820 data:0x02cf0002
     kworker/4:3-1747  [004] ...1   120.855886: rtcpu_vinotify_handle_msg: tstamp:4105398496 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:4105398009 data:0x00000000
     kworker/4:3-1747  [004] ...1   120.855890: rtos_queue_peek_from_isr_failed: tstamp:4105565268 queue:0x0b4a3c58
     kworker/4:3-1747  [004] ...1   120.855891: rtcpu_vinotify_handle_msg: tstamp:4106023614 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:4106023052 data:0x00000001
     kworker/4:3-1747  [004] ...1   120.855893: rtcpu_vinotify_handle_msg: tstamp:4106023807 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:4106023060 data:0x00000000
     kworker/4:3-1747  [004] ...1   120.907852: rtcpu_vinotify_handle_msg: tstamp:4106321069 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:4106320630 data:0x08000000
     kworker/4:3-1747  [004] ...1   120.907859: rtcpu_vinotify_handle_msg: tstamp:4106623196 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:4106622738 data:0x02cf0002
     kworker/4:3-1747  [004] ...1   120.907860: rtcpu_vinotify_handle_msg: tstamp:4106648411 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:4106647927 data:0x00000000
     kworker/4:3-1747  [004] ...1   120.907861: rtcpu_vinotify_handle_msg: tstamp:4107273529 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:4107272970 data:0x00000001
     kworker/4:3-1747  [004] ...1   120.907863: rtcpu_vinotify_handle_msg: tstamp:4107273722 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:4107272978 data:0x00000000
     kworker/4:3-1747  [004] ...1   120.907864: rtcpu_vinotify_handle_msg: tstamp:4107569722 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:4107569288 data:0x08000000
     kworker/4:3-1747  [004] ...1   120.959899: rtcpu_vinotify_handle_msg: tstamp:4107873112 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:4107872657 data:0x02cf0002
     kworker/4:3-1747  [004] ...1   120.959905: rtcpu_vinotify_handle_msg: tstamp:4107898327 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:4107897845 data:0x00000000
     kworker/4:3-1747  [004] ...1   120.959906: rtcpu_vinotify_handle_msg: tstamp:4108523446 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:4108522888 data:0x00000001
     kworker/4:3-1747  [004] ...1   120.959907: rtcpu_vinotify_handle_msg: tstamp:4108523642 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:4108522896 data:0x00000000
     kworker/4:3-1747  [004] ...1   120.959908: rtcpu_vinotify_handle_msg: tstamp:4108815966 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:4108815532 data:0x08000000
     kworker/4:3-1747  [004] ...1   120.959909: rtcpu_vinotify_handle_msg: tstamp:4109123005 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:4109122574 data:0x02cf0002
     kworker/4:3-1747  [004] ...1   120.959911: rtcpu_vinotify_handle_msg: tstamp:4109148224 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:4109147763 data:0x00000000
     kworker/4:3-1747  [004] ...1   121.011821: rtcpu_vinotify_handle_msg: tstamp:4109773364 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:4109772807 data:0x00000001
     kworker/4:3-1747  [004] ...1   121.011826: rtcpu_vinotify_handle_msg: tstamp:4109773561 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:4109772815 data:0x00000000
     kworker/4:3-1747  [004] ...1   121.011827: rtcpu_vinotify_handle_msg: tstamp:4110073143 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:4110072688 data:0x08000000
     kworker/4:3-1747  [004] ...1   121.011828: rtcpu_vinotify_handle_msg: tstamp:4110372949 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:4110372493 data:0x02cf0002
     kworker/4:3-1747  [004] ...1   121.011829: rtcpu_vinotify_handle_msg: tstamp:4110398179 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:4110397681 data:0x00000000
     kworker/4:3-1747  [004] ...1   121.011833: rtos_queue_peek_from_isr_failed: tstamp:4110565752 queue:0x0b4a3c58
     kworker/4:3-1747  [004] ...1   121.011834: rtcpu_vinotify_handle_msg: tstamp:4111023287 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:4111022725 data:0x00000001
     kworker/4:3-1747  [004] ...1   121.011836: rtcpu_vinotify_handle_msg: tstamp:4111023480 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:4111022733 data:0x00000000
     kworker/4:3-1747  [004] ...1   121.070110: rtcpu_vinotify_handle_msg: tstamp:4111318030 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:4111317596 data:0x08000000
     kworker/4:3-1747  [004] ...1   121.070114: rtcpu_vinotify_handle_msg: tstamp:4111622843 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:4111622411 data:0x02cf0002
     kworker/4:3-1747  [004] ...1   121.070116: rtcpu_vinotify_handle_msg: tstamp:4111648062 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:4111647599 data:0x00000000
     kworker/4:3-1747  [004] ...1   121.070117: rtcpu_vinotify_handle_msg: tstamp:4112273199 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:4112272643 data:0x00000001
     kworker/4:3-1747  [004] ...1   121.070119: rtcpu_vinotify_handle_msg: tstamp:4112273391 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:4112272651 data:0x00000000
     kworker/4:3-1747  [004] ...1   121.070120: rtcpu_vinotify_handle_msg: tstamp:4112569257 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:4112568824 data:0x08000000
     kworker/4:3-1747  [004] ...1   121.119845: rtcpu_vinotify_handle_msg: tstamp:4112872761 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:4112872328 data:0x02cf0002
     kworker/4:3-1747  [004] ...1   121.119850: rtcpu_vinotify_handle_msg: tstamp:4112897984 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:4112897517 data:0x00000000
     kworker/4:3-1747  [004] ...1   121.119852: rtcpu_vinotify_handle_msg: tstamp:4113523097 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:4113522560 data:0x00000001
     kworker/4:3-1747  [004] ...1   121.119853: rtcpu_vinotify_handle_msg: tstamp:4113523247 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:4113522569 data:0x00000000
     kworker/4:3-1747  [004] ...1   121.119854: rtcpu_vinotify_handle_msg: tstamp:4113815531 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:4113815097 data:0x08000000
     kworker/4:3-1747  [004] ...1   121.119855: rtcpu_vinotify_handle_msg: tstamp:4114122692 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:4114122246 data:0x02cf0002
     kworker/4:3-1747  [004] ...1   121.119856: rtcpu_vinotify_handle_msg: tstamp:4114147901 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:4114147435 data:0x00000000
     kworker/4:3-1747  [004] ...1   121.171839: rtcpu_vinotify_handle_msg: tstamp:4114773038 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:4114772478 data:0x00000001
     kworker/4:3-1747  [004] ...1   121.171845: rtcpu_vinotify_handle_msg: tstamp:4114773230 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:4114772487 data:0x00000000
     kworker/4:3-1747  [004] ...1   121.171846: rtcpu_vinotify_handle_msg: tstamp:4115064664 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:4115064253 data:0x08000000
     kworker/4:3-1747  [004] ...1   121.171847: rtcpu_vinotify_handle_msg: tstamp:4115372607 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:4115372164 data:0x02cf0002
     kworker/4:3-1747  [004] ...1   121.171849: rtcpu_vinotify_handle_msg: tstamp:4115397815 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:4115397354 data:0x00000000
     kworker/4:3-1747  [004] ...1   121.171852: rtos_queue_peek_from_isr_failed: tstamp:4115566260 queue:0x0b4a3c58
     kworker/4:3-1747  [004] ...1   121.171853: rtcpu_vinotify_handle_msg: tstamp:4116022955 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:4116022396 data:0x00000001
     kworker/4:3-1747  [004] ...1   121.171855: rtcpu_vinotify_handle_msg: tstamp:4116023151 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:4116022404 data:0x00000000
     kworker/4:3-1747  [004] ...1   121.229893: rtcpu_vinotify_handle_msg: tstamp:4116319416 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:4116318982 data:0x08000000
     kworker/4:3-1747  [004] ...1   121.229901: rtcpu_vinotify_handle_msg: tstamp:4116622514 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:4116622083 data:0x02cf0002
     kworker/4:3-1747  [004] ...1   121.229902: rtcpu_vinotify_handle_msg: tstamp:4116647735 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:4116647272 data:0x00000000
     kworker/4:3-1747  [004] ...1   121.229904: rtcpu_vinotify_handle_msg: tstamp:4117272872 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:4117272314 data:0x00000001
     kworker/4:3-1747  [004] ...1   121.229906: rtcpu_vinotify_handle_msg: tstamp:4117273069 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:4117272322 data:0x00000000
     kworker/4:3-1747  [004] ...1   121.229908: rtcpu_vinotify_handle_msg: tstamp:4117565107 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:4117564673 data:0x08000000
     kworker/4:3-1747  [004] ...1   121.279839: rtcpu_vinotify_handle_msg: tstamp:4117872455 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:4117872000 data:0x02cf0002
     kworker/4:3-1747  [004] ...1   121.279844: rtcpu_vinotify_handle_msg: tstamp:4117897672 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:4117897189 data:0x00000000
     kworker/4:3-1747  [004] ...1   121.279846: rtcpu_vinotify_handle_msg: tstamp:4118522790 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:4118522232 data:0x00000001
     kworker/4:3-1747  [004] ...1   121.279847: rtcpu_vinotify_handle_msg: tstamp:4118522986 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:4118522240 data:0x00000000
     kworker/4:3-1747  [004] ...1   121.279848: rtcpu_vinotify_handle_msg: tstamp:4118819618 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:4118819182 data:0x08000000
     kworker/4:3-1747  [004] ...1   121.279849: rtcpu_vinotify_handle_msg: tstamp:4119122352 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:4119121918 data:0x02cf0002
     kworker/4:3-1747  [004] ...1   121.279850: rtcpu_vinotify_handle_msg: tstamp:4119147572 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:4119147107 data:0x00000000
     kworker/4:3-1747  [004] ...1   121.331826: rtcpu_vinotify_handle_msg: tstamp:4119772710 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:4119772151 data:0x00000001
     kworker/4:3-1747  [004] ...1   121.331830: rtcpu_vinotify_handle_msg: tstamp:4119772903 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:4119772159 data:0x00000000
     kworker/4:3-1747  [004] ...1   121.331831: rtcpu_vinotify_handle_msg: tstamp:4120065146 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:4120064710 data:0x08000000
     kworker/4:3-1747  [004] ...1   121.331832: rtcpu_vinotify_handle_msg: tstamp:4120372292 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:4120371836 data:0x02cf0002
     kworker/4:3-1747  [004] ...1   121.331833: rtcpu_vinotify_handle_msg: tstamp:4120397507 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:4120397025 data:0x00000000
     kworker/4:3-1747  [004] ...1   121.331837: rtos_queue_peek_from_isr_failed: tstamp:4120566769 queue:0x0b4a3c58
     kworker/4:3-1747  [004] ...1   121.331838: rtcpu_vinotify_handle_msg: tstamp:4121022629 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:4121022069 data:0x00000001
     kworker/4:3-1747  [004] ...1   121.331839: rtcpu_vinotify_handle_msg: tstamp:4121022826 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:4121022077 data:0x00000000
     kworker/4:3-1747  [004] ...1   121.383845: rtcpu_vinotify_handle_msg: tstamp:4121318049 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:4121317613 data:0x08000000
     kworker/4:3-1747  [004] ...1   121.383851: rtcpu_vinotify_handle_msg: tstamp:4121622210 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:4121621754 data:0x02cf0002
     kworker/4:3-1747  [004] ...1   121.383852: rtcpu_vinotify_handle_msg: tstamp:4121647428 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:4121646943 data:0x00000000
     kworker/4:3-1747  [004] ...1   121.383853: rtcpu_vinotify_handle_msg: tstamp:4122272546 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:4122271986 data:0x00000001
     kworker/4:3-1747  [004] ...1   121.383854: rtcpu_vinotify_handle_msg: tstamp:4122272739 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:4122271995 data:0x00000000
     kworker/4:3-1747  [004] ...1   121.383855: rtcpu_vinotify_handle_msg: tstamp:4122569922 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:4122569488 data:0x08000000
     kworker/4:3-1747  [004] ...1   121.435882: rtcpu_vinotify_handle_msg: tstamp:4122872104 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:4122871672 data:0x02cf0002
     kworker/4:3-1747  [004] ...1   121.435890: rtcpu_vinotify_handle_msg: tstamp:4122897324 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:4122896861 data:0x00000000
     kworker/4:3-1747  [004] ...1   121.435891: rtcpu_vinotify_handle_msg: tstamp:4123522462 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:4123521904 data:0x00000001
     kworker/4:3-1747  [004] ...1   121.435893: rtcpu_vinotify_handle_msg: tstamp:4123522656 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:4123521912 data:0x00000000
     kworker/4:3-1747  [004] ...1   121.435895: rtcpu_vinotify_handle_msg: tstamp:4123817825 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:4123817393 data:0x08000000
     kworker/4:3-1747  [004] ...1   121.435897: rtcpu_vinotify_handle_msg: tstamp:4124122045 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:4124121590 data:0x02cf0002
     kworker/4:3-1747  [004] ...1   121.435899: rtcpu_vinotify_handle_msg: tstamp:4124147263 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:4124146779 data:0x00000000
     kworker/4:3-1747  [004] ...1   121.487871: rtcpu_vinotify_handle_msg: tstamp:4124772381 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:4124771822 data:0x00000001
     kworker/4:3-1747  [004] ...1   121.487877: rtcpu_vinotify_handle_msg: tstamp:4124772573 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:4124771831 data:0x00000000
     kworker/4:3-1747  [004] ...1   121.487878: rtcpu_vinotify_handle_msg: tstamp:4125067748 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:4125067291 data:0x08000000
     kworker/4:3-1747  [004] ...1   121.487879: rtcpu_vinotify_handle_msg: tstamp:4125371965 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:4125371508 data:0x02cf0002
     kworker/4:3-1747  [004] ...1   121.487881: rtcpu_vinotify_handle_msg: tstamp:4125397180 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:4125396698 data:0x00000000
     kworker/4:3-1747  [004] ...1   121.487885: rtos_queue_peek_from_isr_failed: tstamp:4125567282 queue:0x0b4a3c58
     kworker/4:3-1747  [004] ...1   121.539827: rtcpu_vinotify_handle_msg: tstamp:4126022312 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:4126021741 data:0x00000001
     kworker/4:3-1747  [004] ...1   121.539832: rtcpu_vinotify_handle_msg: tstamp:4126022508 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:4126021749 data:0x00000000
     kworker/4:3-1747  [004] ...1   121.539833: rtcpu_vinotify_handle_msg: tstamp:4126319327 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:4126318893 data:0x08000000
     kworker/4:3-1747  [004] ...1   121.539834: rtcpu_vinotify_handle_msg: tstamp:4126621882 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:4126621426 data:0x02cf0002
     kworker/4:3-1747  [004] ...1   121.539836: rtcpu_vinotify_handle_msg: tstamp:4126647110 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:4126646615 data:0x00000000
     kworker/4:3-1747  [004] ...1   121.539837: rtcpu_vinotify_handle_msg: tstamp:4127272223 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:4127271658 data:0x00000001
     kworker/4:3-1747  [004] ...1   121.539838: rtcpu_vinotify_handle_msg: tstamp:4127272416 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:4127271666 data:0x00000000
     kworker/4:3-1747  [004] ...1   121.591842: rtcpu_vinotify_handle_msg: tstamp:4127567708 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:4127567274 data:0x08000000
     kworker/4:3-1747  [004] ...1   121.591848: rtcpu_vinotify_handle_msg: tstamp:4127871801 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:4127871345 data:0x02cf0002
     kworker/4:3-1747  [004] ...1   121.591850: rtcpu_vinotify_handle_msg: tstamp:4127897017 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:4127896533 data:0x00000000
     kworker/4:3-1747  [004] ...1   121.591851: rtcpu_vinotify_handle_msg: tstamp:4128522151 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:4128521577 data:0x00000001
     kworker/4:3-1747  [004] ...1   121.591852: rtcpu_vinotify_handle_msg: tstamp:4128522347 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:4128521585 data:0x00000000
     kworker/4:3-1747  [004] ...1   121.591854: rtcpu_vinotify_handle_msg: tstamp:4128818853 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:4128818419 data:0x08000000
     kworker/4:3-1747  [004] ...1   121.591855: rtcpu_vinotify_handle_msg: tstamp:4129121695 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:4129121263 data:0x02cf0002
     kworker/4:3-1747  [004] ...1   121.591856: rtcpu_vinotify_handle_msg: tstamp:4129146919 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:4129146451 data:0x00000000
     kworker/4:3-1747  [004] ...1   121.643831: rtcpu_vinotify_handle_msg: tstamp:4129772050 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:4129771495 data:0x00000001
     kworker/4:3-1747  [004] ...1   121.643836: rtcpu_vinotify_handle_msg: tstamp:4129772242 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:4129771503 data:0x00000000
     kworker/4:3-1747  [004] ...1   121.643837: rtcpu_vinotify_handle_msg: tstamp:4130066951 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:4130066522 data:0x08000000
     kworker/4:3-1747  [004] ...1   121.643839: rtcpu_vinotify_handle_msg: tstamp:4130371635 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:4130371180 data:0x02cf0002
     kworker/4:3-1747  [004] ...1   121.643840: rtcpu_vinotify_handle_msg: tstamp:4130396853 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:4130396369 data:0x00000000
     kworker/4:3-1747  [004] ...1   121.643844: rtos_queue_peek_from_isr_failed: tstamp:4130567781 queue:0x0b4a3c58
     kworker/4:3-1747  [004] ...1   121.695834: rtcpu_vinotify_handle_msg: tstamp:4131021973 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:4131021412 data:0x00000001
     kworker/4:3-1747  [004] ...1   121.695839: rtcpu_vinotify_handle_msg: tstamp:4131022169 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:4131021421 data:0x00000000
     kworker/4:3-1747  [004] ...1   121.695840: rtcpu_vinotify_handle_msg: tstamp:4131315591 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:4131315138 data:0x08000000
     kworker/4:3-1747  [004] ...1   121.695841: rtcpu_vinotify_handle_msg: tstamp:4131621552 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:4131621098 data:0x02cf0002
     kworker/4:3-1747  [004] ...1   121.695842: rtcpu_vinotify_handle_msg: tstamp:4131646767 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:4131646287 data:0x00000000
     kworker/4:3-1747  [004] ...1   121.695843: rtcpu_vinotify_handle_msg: tstamp:4132271886 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:4132271330 data:0x00000001
     kworker/4:3-1747  [004] ...1   121.695844: rtcpu_vinotify_handle_msg: tstamp:4132272078 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:4132271338 data:0x00000000
     kworker/4:3-1747  [004] ...1   121.747821: rtcpu_vinotify_handle_msg: tstamp:4132567669 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:4132567237 data:0x08000000
     kworker/4:3-1747  [004] ...1   121.747826: rtcpu_vinotify_handle_msg: tstamp:4132871451 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:4132871017 data:0x02cf0002
     kworker/4:3-1747  [004] ...1   121.747827: rtcpu_vinotify_handle_msg: tstamp:4132896670 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:4132896205 data:0x00000000
     kworker/4:3-1747  [004] ...1   121.747828: rtcpu_vinotify_handle_msg: tstamp:4133521784 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:4133521248 data:0x00000001
     kworker/4:3-1747  [004] ...1   121.747829: rtcpu_vinotify_handle_msg: tstamp:4133521933 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:4133521257 data:0x00000000
     kworker/4:3-1747  [004] ...1   121.747830: rtcpu_vinotify_handle_msg: tstamp:4133820195 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:4133819760 data:0x08000000
     kworker/4:3-1747  [004] ...1   121.799836: rtcpu_vinotify_handle_msg: tstamp:4134121366 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:4134120934 data:0x02cf0002
     kworker/4:3-1747  [004] ...1   121.799841: rtcpu_vinotify_handle_msg: tstamp:4134146588 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:4134146123 data:0x00000000
     kworker/4:3-1747  [004] ...1   121.799842: rtcpu_vinotify_handle_msg: tstamp:4134771725 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:4134771166 data:0x00000001
     kworker/4:3-1747  [004] ...1   121.799843: rtcpu_vinotify_handle_msg: tstamp:4134771917 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:4134771175 data:0x00000000
     kworker/4:3-1747  [004] ...1   121.799844: rtcpu_vinotify_handle_msg: tstamp:4135064737 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:4135064303 data:0x08000000
     kworker/4:3-1747  [004] ...1   121.799845: rtcpu_vinotify_handle_msg: tstamp:4135371283 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:4135370853 data:0x02cf0002
     kworker/4:3-1747  [004] ...1   121.799846: rtcpu_vinotify_handle_msg: tstamp:4135396518 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:4135396042 data:0x00000000
     kworker/4:3-1747  [004] ...1   121.799850: rtos_queue_peek_from_isr_failed: tstamp:4135568286 queue:0x0b4a3c58
     kworker/4:3-1747  [004] ...1   121.851825: rtcpu_vinotify_handle_msg: tstamp:4136021620 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:4136021085 data:0x00000001
     kworker/4:3-1747  [004] ...1   121.851830: rtcpu_vinotify_handle_msg: tstamp:4136021769 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:4136021093 data:0x00000000
     kworker/4:3-1747  [004] ...1   121.851831: rtcpu_vinotify_handle_msg: tstamp:4136313518 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:4136313085 data:0x08000000
     kworker/4:3-1747  [004] ...1   121.851832: rtcpu_vinotify_handle_msg: tstamp:4136621205 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:4136620770 data:0x02cf0002
     kworker/4:3-1747  [004] ...1   121.851834: rtcpu_vinotify_handle_msg: tstamp:4136646424 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:4136645959 data:0x00000000
     kworker/4:3-1747  [004] ...1   121.851835: rtcpu_vinotify_handle_msg: tstamp:4137271562 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:4137271002 data:0x00000001
     kworker/4:3-1747  [004] ...1   121.851836: rtcpu_vinotify_handle_msg: tstamp:4137271755 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:4137271011 data:0x00000000
     kworker/4:3-1747  [004] ...1   121.903825: rtcpu_vinotify_handle_msg: tstamp:4137871130 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:4137870688 data:0x02cf0002
     kworker/4:3-1747  [004] ...1   121.903831: rtcpu_vinotify_handle_msg: tstamp:4137896344 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:4137895877 data:0x00000000
     kworker/4:3-1747  [004] ...1   121.955840: rtcpu_vinotify_handle_msg: tstamp:4139771397 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:4139770838 data:0x00000001
     kworker/4:3-1747  [004] ...1   121.955846: rtcpu_vinotify_handle_msg: tstamp:4139771593 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:4139770847 data:0x00000000
     kworker/4:3-1747  [004] ...1   121.955847: rtcpu_vinotify_handle_msg: tstamp:4140064168 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:4140063755 data:0x08000000
     kworker/4:3-1747  [004] ...1   121.955848: rtcpu_vinotify_handle_msg: tstamp:4140370955 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:4140370524 data:0x02cf0002
     kworker/4:3-1747  [004] ...1   121.955850: rtcpu_vinotify_handle_msg: tstamp:4140396176 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:4140395713 data:0x00000000
     kworker/4:3-1747  [004] ...1   122.007847: rtos_queue_peek_from_isr_failed: tstamp:4140568796 queue:0x0b4a3c58
     kworker/4:3-1747  [004] ...1   122.007859: rtcpu_vinotify_handle_msg: tstamp:4141021312 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:4141020756 data:0x00000001
     kworker/4:3-1747  [004] ...1   122.007860: rtcpu_vinotify_handle_msg: tstamp:4141021505 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:4141020764 data:0x00000000
     kworker/4:3-1747  [004] ...1   122.007862: rtcpu_vinotify_handle_msg: tstamp:4141316063 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:4141315629 data:0x08000000
     kworker/4:3-1747  [004] ...1   122.007864: rtcpu_vinotify_handle_msg: tstamp:4141620873 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:4141620442 data:0x02cf0002
     kworker/4:3-1747  [004] ...1   122.007865: rtcpu_vinotify_handle_msg: tstamp:4141646096 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:4141645632 data:0x00000000
     kworker/4:3-1747  [004] ...1   122.059857: rtcpu_vinotify_handle_msg: tstamp:4142271233 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:4142270674 data:0x00000001
     kworker/4:3-1747  [004] ...1   122.059862: rtcpu_vinotify_handle_msg: tstamp:4142271429 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:4142270682 data:0x00000000
     kworker/4:3-1747  [004] ...1   122.059863: rtcpu_vinotify_handle_msg: tstamp:4142567423 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:4142566970 data:0x08000000
     kworker/4:3-1747  [004] ...1   122.059864: rtcpu_vinotify_handle_msg: tstamp:4142870817 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:4142870360 data:0x02cf0002
     kworker/4:3-1747  [004] ...1   122.059865: rtcpu_vinotify_handle_msg: tstamp:4142896031 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:4142895550 data:0x00000000
     kworker/4:3-1747  [004] ...1   122.059866: rtcpu_vinotify_handle_msg: tstamp:4143521155 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:4143520592 data:0x00000001
     kworker/4:3-1747  [004] ...1   122.059867: rtcpu_vinotify_handle_msg: tstamp:4143521347 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:4143520600 data:0x00000000
     kworker/4:3-1747  [004] ...1   122.111846: rtcpu_vinotify_handle_msg: tstamp:4143813800 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:4143813373 data:0x08000000
     kworker/4:3-1747  [004] ...1   122.111852: rtcpu_vinotify_handle_msg: tstamp:4144120709 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:4144120278 data:0x02cf0002
     kworker/4:3-1747  [004] ...1   122.111854: rtcpu_vinotify_handle_msg: tstamp:4144145936 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:4144145467 data:0x00000000
     kworker/4:3-1747  [004] ...1   122.111855: rtcpu_vinotify_handle_msg: tstamp:4144771068 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:4144770511 data:0x00000001
     kworker/4:3-1747  [004] ...1   122.111856: rtcpu_vinotify_handle_msg: tstamp:4144771263 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:4144770519 data:0x00000000
     kworker/4:3-1747  [004] ...1   122.111857: rtcpu_vinotify_handle_msg: tstamp:4145064099 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:4145063666 data:0x08000000
     kworker/4:3-1747  [004] ...1   122.111858: rtcpu_vinotify_handle_msg: tstamp:4145370630 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:4145370196 data:0x02cf0002
     kworker/4:3-1747  [004] ...1   122.111860: rtcpu_vinotify_handle_msg: tstamp:4145395853 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:4145395385 data:0x00000000
     kworker/4:3-1747  [004] ...1   122.163909: rtos_queue_peek_from_isr_failed: tstamp:4145569321 queue:0x0b4a3c58
     kworker/4:3-1747  [004] ...1   122.163915: rtcpu_vinotify_handle_msg: tstamp:4146020993 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:4146020429 data:0x00000001
     kworker/4:3-1747  [004] ...1   122.163916: rtcpu_vinotify_handle_msg: tstamp:4146021186 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:4146020437 data:0x00000000
     kworker/4:3-1747  [004] ...1   122.163917: rtcpu_vinotify_handle_msg: tstamp:4146313604 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:4146313169 data:0x08000000
     kworker/4:3-1747  [004] ...1   122.163918: rtcpu_vinotify_handle_msg: tstamp:4146620572 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:4146620114 data:0x02cf0002
     kworker/4:3-1747  [004] ...1   122.163919: rtcpu_vinotify_handle_msg: tstamp:4146645788 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:4146645303 data:0x00000000
     kworker/4:3-1747  [004] ...1   122.215831: rtcpu_vinotify_handle_msg: tstamp:4147270906 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:4147270346 data:0x00000001
     kworker/4:3-1747  [004] ...1   122.215836: rtcpu_vinotify_handle_msg: tstamp:4147271102 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:4147270355 data:0x00000000
     kworker/4:3-1747  [004] ...1   122.215837: rtcpu_vinotify_handle_msg: tstamp:4147563283 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:4147562849 data:0x08000000
     kworker/4:3-1747  [004] ...1   122.215838: rtcpu_vinotify_handle_msg: tstamp:4147870486 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:4147870032 data:0x02cf0002
     kworker/4:3-1747  [004] ...1   122.215839: rtcpu_vinotify_handle_msg: tstamp:4147895705 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:4147895221 data:0x00000000
     kworker/4:3-1747  [004] ...1   122.215840: rtcpu_vinotify_handle_msg: tstamp:4148520823 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:4148520264 data:0x00000001
     kworker/4:3-1747  [004] ...1   122.215841: rtcpu_vinotify_handle_msg: tstamp:4148521015 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:4148520273 data:0x00000000
     kworker/4:3-1747  [004] ...1   122.269964: rtcpu_vinotify_handle_msg: tstamp:4148813322 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:4148812889 data:0x08000000
     kworker/4:3-1747  [004] ...1   122.269970: rtcpu_vinotify_handle_msg: tstamp:4149120409 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:4149119950 data:0x02cf0002
     kworker/4:3-1747  [004] ...1   122.269971: rtcpu_vinotify_handle_msg: tstamp:4149145628 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:4149145139 data:0x00000000
     kworker/4:3-1747  [004] ...1   122.269973: rtcpu_vinotify_handle_msg: tstamp:4149770741 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:4149770182 data:0x00000001
     kworker/4:3-1747  [004] ...1   122.269974: rtcpu_vinotify_handle_msg: tstamp:4149770935 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:4149770190 data:0x00000000
     kworker/4:3-1747  [004] ...1   122.269975: rtcpu_vinotify_handle_msg: tstamp:4150065288 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:4150064856 data:0x08000000
     kworker/4:3-1747  [004] ...1   122.319868: rtcpu_vinotify_handle_msg: tstamp:4150370366 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:4150369868 data:0x02cf0002
     kworker/4:3-1747  [004] ...1   122.319876: rtcpu_vinotify_handle_msg: tstamp:4150395552 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:4150395057 data:0x00000000
     kworker/4:3-1747  [004] ...1   122.319882: rtos_queue_peek_from_isr_failed: tstamp:4150569828 queue:0x0b4a3c58
     kworker/4:3-1747  [004] ...1   122.319884: rtcpu_vinotify_handle_msg: tstamp:4151020663 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:4151020100 data:0x00000001
     kworker/4:3-1747  [004] ...1   122.319886: rtcpu_vinotify_handle_msg: tstamp:4151020856 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:4151020108 data:0x00000000
     kworker/4:3-1747  [004] ...1   122.319888: rtcpu_vinotify_handle_msg: tstamp:4151314654 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:4151314223 data:0x08000000
     kworker/4:3-1747  [004] ...1   122.319890: rtcpu_vinotify_handle_msg: tstamp:4151620252 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:4151619786 data:0x02cf0002
     kworker/4:3-1747  [004] ...1   122.319891: rtcpu_vinotify_handle_msg: tstamp:4151645457 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:4151644975 data:0x00000000
     kworker/4:3-1747  [004] ...1   122.375834: rtcpu_vinotify_handle_msg: tstamp:4152270581 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:4152270018 data:0x00000001
     kworker/4:3-1747  [004] ...1   122.375839: rtcpu_vinotify_handle_msg: tstamp:4152270777 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:4152270026 data:0x00000000
     kworker/4:3-1747  [004] ...1   122.375840: rtcpu_vinotify_handle_msg: tstamp:4152563862 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:4152563428 data:0x08000000
     kworker/4:3-1747  [004] ...1   122.375841: rtcpu_vinotify_handle_msg: tstamp:4152870171 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:4152869704 data:0x02cf0002
     kworker/4:3-1747  [004] ...1   122.375843: rtcpu_vinotify_handle_msg: tstamp:4152895387 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:4152894893 data:0x00000000
     kworker/4:3-1747  [004] ...1   122.375844: rtcpu_vinotify_handle_msg: tstamp:4153520497 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:4153519937 data:0x00000001
     kworker/4:3-1747  [004] ...1   122.375845: rtcpu_vinotify_handle_msg: tstamp:4153520691 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:4153519945 data:0x00000000
     kworker/4:3-1747  [004] ...1   122.423825: rtcpu_vinotify_handle_msg: tstamp:4153818344 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:4153817911 data:0x08000000
     kworker/4:3-1747  [004] ...1   122.423830: rtcpu_vinotify_handle_msg: tstamp:4154120056 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:4154119622 data:0x02cf0002
     kworker/4:3-1747  [004] ...1   122.423832: rtcpu_vinotify_handle_msg: tstamp:4154145275 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:4154144811 data:0x00000000
     kworker/4:3-1747  [004] ...1   122.423833: rtcpu_vinotify_handle_msg: tstamp:4154770412 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:4154769855 data:0x00000001
     kworker/4:3-1747  [004] ...1   122.423834: rtcpu_vinotify_handle_msg: tstamp:4154770610 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:4154769863 data:0x00000000
     kworker/4:3-1747  [004] ...1   122.423835: rtcpu_vinotify_handle_msg: tstamp:4155063768 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:4155063332 data:0x08000000
     kworker/4:3-1747  [004] ...1   122.475898: rtcpu_vinotify_handle_msg: tstamp:4155369973 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:4155369541 data:0x02cf0002
     kworker/4:3-1747  [004] ...1   122.475905: rtcpu_vinotify_handle_msg: tstamp:4155395195 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:4155394729 data:0x00000000
     kworker/4:3-1747  [004] ...1   122.475911: rtos_queue_peek_from_isr_failed: tstamp:4155570315 queue:0x0b4a3c58
root@tegra-ubuntu:/home/nvidia#

nvidia@tegra-ubuntu:~$ dmesg
[   24.797615] video4linux video0: tegra_channel_capture_frame: vi4 got SOF syncpt buf[ffffffc1c8f9b400]
[   24.806885] video4linux video0: tegra_channel_release_frame: vi4 got EOF syncpt buf[ffffffc1c8f9b400]
[   24.837614] video4linux video0: tegra_channel_capture_frame: vi4 got SOF syncpt buf[ffffffc1c8f9a400]
[   24.846884] video4linux video0: tegra_channel_release_frame: vi4 got EOF syncpt buf[ffffffc1c8f9a400]
[   24.877600] video4linux video0: tegra_channel_capture_frame: vi4 got SOF syncpt buf[ffffffc1c8f9bc00]
[   24.887003] video4linux video0: tegra_channel_release_frame: vi4 got EOF syncpt buf[ffffffc1c8f9bc00]
[   24.917601] video4linux video0: tegra_channel_capture_frame: vi4 got SOF syncpt buf[ffffffc1c8f98800]
[   24.926848] video4linux video0: tegra_channel_release_frame: vi4 got EOF syncpt buf[ffffffc1c8f98800]
[   24.957589] video4linux video0: tegra_channel_capture_frame: vi4 got SOF syncpt buf[ffffffc1c8f9b400]
[   24.966888] video4linux video0: tegra_channel_release_frame: vi4 got EOF syncpt buf[ffffffc1c8f9b400]
[   24.997599] video4linux video0: tegra_channel_capture_frame: vi4 got SOF syncpt buf[ffffffc1c8f9a400]
[   25.006906] video4linux video0: tegra_channel_release_frame: vi4 got EOF syncpt buf[ffffffc1c8f9a400]
[   25.037628] video4linux video0: tegra_channel_capture_frame: vi4 got SOF syncpt buf[ffffffc1c8f9bc00]
[   25.046991] video4linux video0: tegra_channel_release_frame: vi4 got EOF syncpt buf[ffffffc1c8f9bc00]
[   25.077604] video4linux video0: tegra_channel_capture_frame: vi4 got SOF syncpt buf[ffffffc1c8f98800]
[   25.086913] video4linux video0: tegra_channel_release_frame: vi4 got EOF syncpt buf[ffffffc1c8f98800]
[   25.095820] tegra-i2c 3190000.i2c: rx dma timeout txlen:28 rxlen:128
[   25.095824] tegra-i2c 3190000.i2c: --- register dump for debugging ----
[   25.095828] tegra-i2c 3190000.i2c: I2C_CNFG - 0x22c00
[   25.095832] tegra-i2c 3190000.i2c: I2C_PACKET_TRANSFER_STATUS - 0x10001
[   25.095835] tegra-i2c 3190000.i2c: I2C_FIFO_CONTROL - 0x1c
[   25.095838] tegra-i2c 3190000.i2c: I2C_FIFO_STATUS - 0x800040
[   25.095842] tegra-i2c 3190000.i2c: I2C_INT_MASK - 0x6c
[   25.095845] tegra-i2c 3190000.i2c: I2C_INT_STATUS - 0x2
[   25.095881] tegra-i2c 3190000.i2c: i2c transfer timed out addr: 0x50
[   25.148845] video4linux video0: tegra_channel_capture_frame: vi4 got SOF syncpt buf[ffffffc1c8f9b400]
[   25.158150] video4linux video0: tegra_channel_release_frame: vi4 got EOF syncpt buf[ffffffc1c8f9b400]
[   25.177583] video4linux video0: tegra_channel_capture_frame: vi4 got SOF syncpt buf[ffffffc1c8f9a400]
[   25.187086] video4linux video0: tegra_channel_release_frame: vi4 got EOF syncpt buf[ffffffc1c8f9a400]
[   25.217599] video4linux video0: tegra_channel_capture_frame: vi4 got SOF syncpt buf[ffffffc1c8f9bc00]
[   25.226927] video4linux video0: tegra_channel_release_frame: vi4 got EOF syncpt buf[ffffffc1c8f9bc00]
[   25.257579] video4linux video0: tegra_channel_capture_frame: vi4 got SOF syncpt buf[ffffffc1c8f98800]
[   25.267054] video4linux video0: tegra_channel_release_frame: vi4 got EOF syncpt buf[ffffffc1c8f98800]
[   25.297594] video4linux video0: tegra_channel_capture_frame: vi4 got SOF syncpt buf[ffffffc1c8f9b400]
[   25.306946] video4linux video0: tegra_channel_release_frame: vi4 got EOF syncpt buf[ffffffc1c8f9b400]
[   25.337674] video4linux video0: tegra_channel_capture_frame: vi4 got SOF syncpt buf[ffffffc1c8f9a400]
[   25.347301] video4linux video0: tegra_channel_release_frame: vi4 got EOF syncpt buf[ffffffc1c8f9a400]
[   25.377616] video4linux video0: tegra_channel_capture_frame: vi4 got SOF syncpt buf[ffffffc1c8f9bc00]
[   25.387025] video4linux video0: tegra_channel_release_frame: vi4 got EOF syncpt buf[ffffffc1c8f9bc00]
[   25.417603] video4linux video0: tegra_channel_capture_frame: vi4 got SOF syncpt buf[ffffffc1c8f98800]
[   25.426997] video4linux video0: tegra_channel_release_frame: vi4 got EOF syncpt buf[ffffffc1c8f98800]

https://paste.ubuntu.com/p/54nYy6hB8f/
The rest can be found here, the post didnt let me write it all.

ShaneCCC · May 14, 2019, 9:32am

Looks like the SOF to SOF is about 0.03999s then the frame rate ~= 25

hburaks · May 14, 2019, 9:39am

How does Tx1 gets twice the SOF then? I didn’t even need to do the csi4_fops.c modification on that one to disabling the ECC check.

ShaneCCC · May 14, 2019, 9:51am

Could the FPGA gen a frame with frame count may be show the number each frame or different color for debug?

53216142 · May 14, 2019, 10:51am

You can measure the gap between SOF and EOF. May be it does’t match mipi timing.

hburaks · May 14, 2019, 11:43am

Since we could get TX1 working with the exact same setup, our FPGA friend is working on another project. So I think I can’t make him generate another pattern.

I’m trying to get both Tx1 and Tx2 work, because in the future we’ll need Tx2 as well.

The FPGA generates the same thing for Tx1 and Tx2. Tx1 gets full frame, Tx2 can’t. If it didn’t match the mipi timing, how can Tx1 get it? I’m just confused about this.

ShaneCCC · May 16, 2019, 6:50am

Does FPGA need input clock? Could you check the FPGA working clock is the same on TX1.

Topic		Replies	Views
Half fps Jetson TX2	6	751	October 18, 2021
Resulting fps is half of expected fps Jetson TX2 decoder	7	622	October 18, 2021
Jetson AGX Xavier MIPI CSI-2 Half FPS Problem Jetson AGX Xavier camera	11	319	May 6, 2024
Capture framerate is reduced by half after porting driver to JetPack 4.3 Jetson TX2	6	647	October 18, 2021
Receiving half the framerate Jetson TX2 camera	16	1294	January 21, 2021
Jetpack3.3 TX2 CSI-MIPI can suport 1080P60 in 2 lane? Jetson TX2	22	1377	October 18, 2021
Porting i2c camera driver 4.4->4.9 Jetson TX2 camera	18	1463	December 10, 2020
Questions about MIPI recievement on TX2 side Jetson TX2	9	1169	October 18, 2021
CSI0/CSI2 camera on NX TX2 Jetson TX2 camera	3	471	January 25, 2023
TX2 EMV ov5693 trace issue Jetson TX2	4	470	February 25, 2019

Camera Half FPS Problem

Related topics