[L4T R32.5.1] VI got no reply from camera processor while capturing frames

Hello !

I am trying to acquire a 4-lanes and 1080p25 CSI stream but datas does not seem to be computed and some request timeouts are triggered. I used the following command to launch the acquisition:

V4l2-ctl --device /dev/video0  --set-fmt-video=width=1920,height=1080,pixelformat=UYVY --stream-mmap --stream-to=frame.uyvy --stream-count=1

Below are the content of my kern.log and the trace :

Sep 14 09:54:25 xnx kernel: [ 1163.604279] t194-nvcsi 15a00000.nvcsi: csi5_power_on
Sep 14 09:54:25 xnx kernel: [ 1163.604362] t194-nvcsi 15a00000.nvcsi: settle time reading from props
Sep 14 09:54:25 xnx kernel: [ 1163.605569] t194-nvcsi 15a00000.nvcsi: settle time reading from props
Sep 14 09:54:25 xnx kernel: [ 1163.605575] t194-nvcsi 15a00000.nvcsi: csi5_mipi_cal
Sep 14 09:54:25 xnx kernel: [ 1163.605579] t194-nvcsi 15a00000.nvcsi: csi_port:0
Sep 14 09:54:25 xnx kernel: [ 1163.605703] t194-nvcsi 15a00000.nvcsi: settle time reading from props
Sep 14 09:54:25 xnx kernel: [ 1163.605707] t194-nvcsi 15a00000.nvcsi: csi5_mipi_cal
Sep 14 09:54:25 xnx kernel: [ 1163.605711] t194-nvcsi 15a00000.nvcsi: csi_port:2
Sep 14 09:54:25 xnx kernel: [ 1163.605830] t194-nvcsi 15a00000.nvcsi: settle time reading from props
Sep 14 09:54:25 xnx kernel: [ 1163.605835] t194-nvcsi 15a00000.nvcsi: csi5_mipi_cal
Sep 14 09:54:25 xnx kernel: [ 1163.605838] t194-nvcsi 15a00000.nvcsi: csi_port:2
Sep 14 09:54:25 xnx kernel: [ 1163.619206] t194-nvcsi 15a00000.nvcsi: csi5_start_streaming: csi_pt=0, st_id=0, vc_id=0, pg_mode=0x0
Sep 14 09:54:25 xnx kernel: [ 1163.619217] t194-nvcsi 15a00000.nvcsi: settle time reading from props
Sep 14 09:54:25 xnx kernel: [ 1163.619223] t194-nvcsi 15a00000.nvcsi: discontinuous_clk = 0 reading from props
Sep 14 09:54:25 xnx kernel: [ 1163.619229] t194-nvcsi 15a00000.nvcsi: csi5_stream_set_config: stream_id=0, csi_port=0
Sep 14 09:54:25 xnx kernel: [ 1163.619235] t194-nvcsi 15a00000.nvcsi: csi5_stream_open: stream_id=0, csi_port=0
Sep 14 09:54:25 xnx kernel: [ 1163.630464] tegra194-vi5 15c10000.vi: corr_err: discarding frame 0, flags: 6, err_data 512
Sep 14 09:54:25 xnx kernel: [ 1163.665416] [RCE] Configuring VI GoS.
Sep 14 09:54:25 xnx kernel: [ 1163.665444] [RCE] VM GOS[#0] addr=0xc2100000
Sep 14 09:54:25 xnx kernel: [ 1163.665453] [RCE] VM GOS[#1] addr=0xc2101000
Sep 14 09:54:25 xnx kernel: [ 1163.665462] [RCE] VM GOS[#2] addr=0xc2102000
Sep 14 09:54:25 xnx kernel: [ 1163.665468] [RCE] VM GOS[#3] addr=0xc2103000
Sep 14 09:54:25 xnx kernel: [ 1163.665474] [RCE] VM GOS[#4] addr=0xc2104000
Sep 14 09:54:25 xnx kernel: [ 1163.665481] [RCE] VM GOS[#5] addr=0xc2105000
Sep 14 09:54:25 xnx kernel: [ 1163.665489] [RCE] vi5_hwinit: firmware CL2018101701 protocol version 2.2
Sep 14 09:54:25 xnx kernel: [ 1163.665517] [RCE] VI GOS[#0] set to VM GOS[4] base 0xc2104000
Sep 14 09:54:25 xnx kernel: [ 1163.670471] tegra194-vi5 15c10000.vi: corr_err: discarding frame 0, flags: 96, err_data 4194400
Sep 14 09:54:25 xnx kernel: [ 1163.710548] tegra194-vi5 15c10000.vi: corr_err: discarding frame 0, flags: 96, err_data 4194400
...
Sep 14 09:54:28 xnx kernel: [ 1167.390511] tegra194-vi5 15c10000.vi: corr_err: discarding frame 0, flags: 96, err_data 4194400
Sep 14 09:54:28 xnx kernel: [ 1167.430518] tegra194-vi5 15c10000.vi: corr_err: discarding frame 0, flags: 96, err_data 4194400
Sep 14 09:54:28 xnx kernel: [ 1167.430781] t194-nvcsi 15a00000.nvcsi: csi5_stop_streaming: csi_pt=0, st_id=0, vc_id=0, pg_mode=0x0
Sep 14 09:54:28 xnx kernel: [ 1167.430808] t194-nvcsi 15a00000.nvcsi: csi5_stream_close: stream_id=0, csi_port=0
Sep 14 09:54:28 xnx kernel: [ 1167.435874] t194-nvcsi 15a00000.nvcsi: csi5_power_off

trace :

# tracer: nop
#
# entries-in-buffer/entries-written: 207900/207900   #P:4
#
#                              _-----=> irqs-off
#                             / _----=> need-resched
#                            | / _---=> hardirq/softirq
#                            || / _--=> preempt-depth
#                            ||| /     delay
#           TASK-PID   CPU#  ||||    TIMESTAMP  FUNCTION
#              | |       |   ||||       |         |
     kworker/0:2-1149  [000] ....   940.201366: rtos_queue_peek_from_isr_failed: tstamp:29702350563 queue:0x0bcbcf78
     kworker/0:2-1149  [000] ....   940.369348: rtos_queue_peek_from_isr_failed: tstamp:29707350561 queue:0x0bcbcf78
     kworker/0:2-1149  [000] ....   940.481345: rtos_queue_peek_from_isr_failed: tstamp:29712350561 queue:0x0bcbcf78
        v4l2-ctl-17094 [002] ....  1163.601977: tegra_channel_open: vi-output, csifpga 8-0001
        v4l2-ctl-17094 [000] ....  1163.604182: tegra_channel_set_power: csifpga 8-0001 : 0x1
        v4l2-ctl-17094 [000] ....  1163.604202: camera_common_s_power: status : 0x1
        v4l2-ctl-17094 [000] ....  1163.604253: tegra_channel_set_power: 15a00000.nvcsi--3 : 0x1
        v4l2-ctl-17094 [000] ....  1163.604256: csi_s_power: enable : 0x1
        v4l2-ctl-17094 [000] ....  1163.611977: tegra_channel_capture_setup: vnc_id 0 W 1920 H 1080 fmt 13
        v4l2-ctl-17094 [002] ....  1163.615238: tegra_channel_set_stream: enable : 0x1
        v4l2-ctl-17094 [002] ....  1163.619187: tegra_channel_set_stream: 15a00000.nvcsi--3 : 0x1
        v4l2-ctl-17094 [002] ....  1163.619191: csi_s_stream: enable : 0x1
        v4l2-ctl-17094 [002] ....  1163.619238: tegra_channel_set_stream: csifpga 8-0001 : 0x1
     kworker/0:2-1149  [000] ....  1163.665384: rtos_queue_peek_from_isr_failed: tstamp:36685309415 queue:0x0bcbcf78
     kworker/0:2-1149  [000] ....  1163.665389: rtcpu_start: tstamp:36685310827
     kworker/0:2-1149  [000] ....  1163.665391: rtos_queue_send_from_isr_failed: tstamp:36685319283 queue:0x0bcb41f8
     kworker/0:2-1149  [000] ....  1163.665392: rtos_queue_send_from_isr_failed: tstamp:36685319433 queue:0x0bcb8a60
     kworker/0:2-1149  [000] ....  1163.665395: rtcpu_string: tstamp:36685320341 id:0x04010000 str:"Configuring VI GoS.
     kworker/0:2-1149  [000] ....  1163.665437: rtcpu_string: tstamp:36685320517 id:0x04010000 str:"VM GOS[#0] addr=0xc2100000
     kworker/0:2-1149  [000] ....  1163.665447: rtcpu_string: tstamp:36685320775 id:0x04010000 str:"VM GOS[#1] addr=0xc2101000
     kworker/0:2-1149  [000] ....  1163.665456: rtcpu_string: tstamp:36685321046 id:0x04010000 str:"VM GOS[#2] addr=0xc2102000
     kworker/0:2-1149  [000] ....  1163.665464: rtcpu_string: tstamp:36685321277 id:0x04010000 str:"VM GOS[#3] addr=0xc2103000
     kworker/0:2-1149  [000] ....  1163.665470: rtcpu_string: tstamp:36685321509 id:0x04010000 str:"VM GOS[#4] addr=0xc2104000
     kworker/0:2-1149  [000] ....  1163.665477: rtcpu_string: tstamp:36685321741 id:0x04010000 str:"VM GOS[#5] addr=0xc2105000
     kworker/0:2-1149  [000] ....  1163.665484: rtcpu_string: tstamp:36685330486 id:0x04010000 str:"vi5_hwinit: firmware CL2018101701 protocol vers"
     kworker/0:2-1149  [000] ....  1163.665485: rtcpu_string: tstamp:36685330604 id:0x04010000 str:"on 2.2
     kworker/0:2-1149  [000] ....  1163.665492: rtos_queue_send_from_isr_failed: tstamp:36685344822 queue:0x0bcb41f8
     kworker/0:2-1149  [000] ....  1163.665493: rtos_queue_send_from_isr_failed: tstamp:36685344992 queue:0x0bcb8a60
     kworker/0:2-1149  [000] ....  1163.665493: rtos_queue_send_from_isr_failed: tstamp:36685345145 queue:0x0bcba5e0
     kworker/0:2-1149  [000] ....  1163.665496: rtcpu_string: tstamp:36685346359 id:0x04010000 str:"VI GOS[#0] set to VM GOS[4] base 0xc2104000
     kworker/0:2-1149  [000] ....  1163.665520: rtos_queue_send_from_isr_failed: tstamp:36685470869 queue:0x0bcb41f8
     kworker/0:2-1149  [000] ....  1163.665521: rtos_queue_send_from_isr_failed: tstamp:36685471039 queue:0x0bcb8a60
     kworker/0:2-1149  [000] ....  1163.665522: rtos_queue_send_from_isr_failed: tstamp:36685471193 queue:0x0bcba5e0
     kworker/0:2-1149  [000] ....  1163.665523: rtos_queue_send_from_isr_failed: tstamp:36685471339 queue:0x0bcbb3a0
     kworker/0:2-1149  [000] ....  1163.665523: rtos_queue_send_from_isr_failed: tstamp:36685471486 queue:0x0bcbc160
     kworker/0:2-1149  [000] ....  1163.665525: rtcpu_nvcsi_intr: tstamp:36685474016 class:GLOBAL type:PHY_INTR0 phy:0 cil:0 st:0 vc:0 status:0x00000001
     kworker/0:2-1149  [000] ....  1163.665526: rtcpu_nvcsi_intr: tstamp:36685478426 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:2-1149  [000] ....  1163.665527: rtcpu_nvcsi_intr: tstamp:36685478426 class:CORRECTABLE_ERR type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:2-1149  [000] ....  1163.665528: rtcpu_vinotify_error: tstamp:36685479280 tag:CSIMUX_STREAM channel:0x00 frame:0 vi_tstamp:36685477826 data:0x00000001
     kworker/0:2-1149  [000] ....  1163.665529: rtcpu_nvcsi_intr: tstamp:36685479437 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:2-1149  [000] ....  1163.665530: rtcpu_nvcsi_intr: tstamp:36685479437 class:CORRECTABLE_ERR type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:2-1149  [000] ....  1163.665531: rtcpu_nvcsi_intr: tstamp:36685480550 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:2-1149  [000] ....  1163.665531: rtcpu_nvcsi_intr: tstamp:36685480550 class:CORRECTABLE_ERR type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:2-1149  [000] ....  1163.665532: rtcpu_nvcsi_intr: tstamp:36685481687 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:2-1149  [000] ....  1163.665533: rtcpu_nvcsi_intr: tstamp:36685481687 class:CORRECTABLE_ERR type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
	 ...
     kworker/0:2-1149  [000] ....  1163.666286: rtcpu_vinotify_event: tstamp:36686009267 tag:FS channel:0x00 frame:0 vi_tstamp:36685815169 data:0x00000010
     kworker/0:2-1149  [000] ....  1163.666286: rtcpu_vinotify_event: tstamp:36686009996 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:36685815170 data:0x00000000
     kworker/0:2-1149  [000] ....  1163.666287: rtcpu_nvcsi_intr: tstamp:36686009467 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:2-1149  [000] ....  1163.666288: rtcpu_nvcsi_intr: tstamp:36686009467 class:CORRECTABLE_ERR type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:2-1149  [000] ....  1163.666288: rtcpu_vinotify_event: tstamp:36686010167 tag:CHANSEL_PXL_SOF channel:0x23 frame:0 vi_tstamp:36685815609 data:0x00000001
     kworker/0:2-1149  [000] ....  1163.666289: rtcpu_vinotify_event: tstamp:36686010312 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:35779767136 data:0x08020001
     kworker/0:2-1149  [000] ....  1163.666290: rtcpu_vinotify_event: tstamp:36686010472 tag:CHANSEL_FAULT channel:0x23 frame:0 vi_tstamp:36685816060 data:0x00000200
     kworker/0:2-1149  [000] ....  1163.666291: rtcpu_nvcsi_intr: tstamp:36686010577 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:2-1149  [000] ....  1163.666291: rtcpu_nvcsi_intr: tstamp:36686010577 class:CORRECTABLE_ERR type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:2-1149  [000] ....  1163.666292: rtcpu_vinotify_event: tstamp:36686011216 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:35779782464 data:0x01020001
     kworker/0:2-1149  [000] ....  1163.666293: rtcpu_nvcsi_intr: tstamp:36686011696 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:2-1149  [000] ....  1163.666293: rtcpu_nvcsi_intr: tstamp:36686011696 class:CORRECTABLE_ERR type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:2-1149  [000] ....  1163.666294: rtcpu_nvcsi_intr: tstamp:36686012807 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:2-1149  [000] ....  1163.666295: rtcpu_nvcsi_intr: tstamp:36686012807 class:CORRECTABLE_ERR type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
	 ...
     kworker/0:2-1149  [000] ....  1163.721987: rtcpu_vinotify_event: tstamp:36687331566 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:36687065167 data:0x00400060
     kworker/0:2-1149  [000] ....  1163.721988: rtcpu_nvcsi_intr: tstamp:36687331686 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:2-1149  [000] ....  1163.721989: rtcpu_nvcsi_intr: tstamp:36687331686 class:CORRECTABLE_ERR type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:2-1149  [000] ....  1163.721990: rtcpu_vinotify_event: tstamp:36687332313 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:36687065168 data:0x00000000
     kworker/0:2-1149  [000] ....  1163.721990: rtcpu_vinotify_event: tstamp:36687332479 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:35819757312 data:0x07020002
     kworker/0:2-1149  [000] ....  1163.721991: rtcpu_vinotify_event: tstamp:36687332619 tag:FS channel:0x00 frame:0 vi_tstamp:36687065186 data:0x00000010
     kworker/0:2-1149  [000] ....  1163.721992: rtcpu_vinotify_event: tstamp:36687333349 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:36687065186 data:0x00000000
     kworker/0:2-1149  [000] ....  1163.721992: rtcpu_nvcsi_intr: tstamp:36687332821 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:2-1149  [000] ....  1163.721993: rtcpu_nvcsi_intr: tstamp:36687332821 class:CORRECTABLE_ERR type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:2-1149  [000] ....  1163.721994: rtcpu_vinotify_event: tstamp:36687333496 tag:CHANSEL_PXL_SOF channel:0x23 frame:0 vi_tstamp:36687065626 data:0x00000001
     kworker/0:2-1149  [000] ....  1163.721995: rtcpu_vinotify_event: tstamp:36687333655 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:35819771680 data:0x08020002
     kworker/0:2-1149  [000] ....  1163.721995: rtcpu_vinotify_event: tstamp:36687333790 tag:CHANSEL_FAULT channel:0x23 frame:0 vi_tstamp:36687066077 data:0x00000200
     kworker/0:2-1149  [000] ....  1163.721996: rtcpu_nvcsi_intr: tstamp:36687333908 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:2-1149  [000] ....  1163.721997: rtcpu_nvcsi_intr: tstamp:36687333908 class:CORRECTABLE_ERR type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:2-1149  [000] ....  1163.721998: rtcpu_vinotify_event: tstamp:36687334555 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:35819784064 data:0x01020002
     kworker/0:2-1149  [000] ....  1163.721998: rtcpu_vinotify_event: tstamp:36687334690 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:35819812352 data:0x10000000
     kworker/0:2-1149  [000] ....  1163.721999: rtcpu_vinotify_event: tstamp:36687334847 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:35819820800 data:0x31000003
     kworker/0:2-1149  [000] ....  1163.722000: rtcpu_nvcsi_intr: tstamp:36687335040 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:2-1149  [000] ....  1163.722001: rtcpu_nvcsi_intr: tstamp:36687335040 class:CORRECTABLE_ERR type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:2-1149  [000] ....  1163.722002: rtcpu_nvcsi_intr: tstamp:36687336162 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:2-1149  [000] ....  1163.722003: rtcpu_nvcsi_intr: tstamp:36687336162 class:CORRECTABLE_ERR type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:2-1149  [000] ....  1163.722003: rtcpu_nvcsi_intr: tstamp:36687337269 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:2-1149  [000] ....  1163.722004: rtcpu_nvcsi_intr: tstamp:36687337269 class:CORRECTABLE_ERR type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
	 ...

From where the issue could comes from ? Could it be a device tree configuration issue or more a driver one ?
Plus how can we translate the trace errors ? We already tried using Jetson/l4t/Camera BringUp - eLinux.org but without any results.

Thanks for your help !

Hi @J-VDA

This image on an older post contained information from the CHANSEL_FAULT errors: TX2 CSI2: interpreting the VI errors - #2 by ShaneCCC

I think is similar, if not equal, to the information from the camera bringup. What I can notice is that you are getting this line:

 kworker/0:2-1149  [000] ....  1163.721995: rtcpu_vinotify_event: tstamp:36687333790 tag:CHANSEL_FAULT channel:0x23 frame:0 vi_tstamp:36687066077 data:0x00000200

The data is 0x200 = 0b1000000000, bit 9 starting from 0 is on, and taking a look at the error meanings, it could mean you are having a

bit 9 PIXEL_SHORT_LINE

This issue happens when a line has fewer pixels than expected width, so you can try modifying the device tree section with entry active_w in the mode of the sensor and try decrease it in order to see if the error changes, or you can share it.

If you have any question, feel free to ask

Best regards,
Roberto Gutierrez,
Embedded Software Engineer,

Hi @robertogs2

Thank you very much for your quick response, I will check this as soon as possible.

Hello again !

You were right, it turned out that the input has been set wrongly so we were not sending 1920x1080 to the XNX. However after fixing this issue, the previous CHANSEL_FAULT message disappeared but it still doesn’t work. Here are the new logs we obtain :

trace :

# tracer: nop
#
# entries-in-buffer/entries-written: 870443/917397   #P:4
#
#                              _-----=> irqs-off
#                             / _----=> need-resched
#                            | / _---=> hardirq/softirq
#                            || / _--=> preempt-depth
#                            ||| /     delay
#           TASK-PID   CPU#  ||||    TIMESTAMP  FUNCTION
#              | |       |   ||||       |         |
        v4l2-ctl-15449 [003] ....   223.208095: tegra_channel_open: vi-output, csifpga 8-0001
        v4l2-ctl-15449 [002] ....   223.221018: tegra_channel_set_stream: enable : 0x1
     kworker/0:1-787   [000] ....   224.126413: rtcpu_nvcsi_intr: tstamp:7325181597 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:1-787   [000] ....   224.126414: rtcpu_nvcsi_intr: tstamp:7325181597 class:CORRECTABLE_ERR type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
										...
     kworker/0:1-787   [000] ....   224.126519: rtcpu_nvcsi_intr: tstamp:7325398266 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:1-787   [000] ....   224.126520: rtcpu_nvcsi_intr: tstamp:7325398266 class:CORRECTABLE_ERR type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:1-787   [000] ....   224.126520: rtcpu_nvcsi_intr: tstamp:7325399353 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:1-787   [000] ....   224.126520: rtcpu_vinotify_event: tstamp:7325400001 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:6769629696 data:0x02020015
     kworker/0:1-787   [000] ....   224.126521: rtcpu_vinotify_event: tstamp:7325400141 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:7325139901 data:0x00400060
     kworker/0:1-787   [000] ....   224.126521: rtcpu_vinotify_event: tstamp:7325400303 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:7325139902 data:0x00000000
     kworker/0:1-787   [000] ....   224.126521: rtcpu_vinotify_event: tstamp:7325401010 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:6771215296 data:0x00020015
     kworker/0:1-787   [000] ....   224.126522: rtcpu_nvcsi_intr: tstamp:7325400482 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:1-787   [000] ....   224.126522: rtcpu_nvcsi_intr: tstamp:7325400482 class:CORRECTABLE_ERR type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:1-787   [000] ....   224.126522: rtcpu_vinotify_event: tstamp:7325401177 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:6771220640 data:0x07020016
     kworker/0:1-787   [000] ....   224.126522: rtcpu_vinotify_event: tstamp:7325401317 tag:FS channel:0x00 frame:0 vi_tstamp:7325139920 data:0x00000010
     kworker/0:1-787   [000] ....   224.126523: rtcpu_vinotify_event: tstamp:7325401475 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:7325139921 data:0x00000000
     kworker/0:1-787   [000] ....   224.126523: rtcpu_nvcsi_intr: tstamp:7325401580 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:1-787   [000] ....   224.126523: rtcpu_nvcsi_intr: tstamp:7325401580 class:CORRECTABLE_ERR type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:1-787   [000] ....   224.126523: rtcpu_vinotify_event: tstamp:7325402213 tag:CHANSEL_PXL_SOF channel:0x23 frame:0 vi_tstamp:7325140713 data:0x00000001
     kworker/0:1-787   [000] ....   224.126524: rtcpu_vinotify_event: tstamp:7325402371 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:6771237248 data:0x08020016
     kworker/0:1-787   [000] ....   224.126524: rtcpu_vinotify_event: tstamp:7325402506 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:6771448384 data:0x10000000
     kworker/0:1-787   [000] ....   224.126525: rtcpu_vinotify_event: tstamp:7325403235 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:6771457184 data:0x31000017
     kworker/0:1-787   [000] ....   224.126525: rtcpu_nvcsi_intr: tstamp:7325402703 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:1-787   [000] ....   224.126525: rtcpu_nvcsi_intr: tstamp:7325402703 class:CORRECTABLE_ERR type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:1-787   [000] ....   224.126525: rtcpu_nvcsi_intr: tstamp:7325403826 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
											...
     kworker/0:1-787   [000] ....   224.126939: rtcpu_nvcsi_intr: tstamp:7326392734 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:1-787   [000] ....   224.126939: rtcpu_nvcsi_intr: tstamp:7326392734 class:CORRECTABLE_ERR type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:1-787   [000] ....   224.126939: rtcpu_vinotify_error: tstamp:7326393499 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:7326389922 data:0x00400060
     kworker/0:1-787   [000] ....   224.126940: rtcpu_nvcsi_intr: tstamp:7326393813 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:1-787   [000] ....   224.126940: rtcpu_nvcsi_intr: tstamp:7326393813 class:CORRECTABLE_ERR type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:1-787   [000] ....   224.126940: rtcpu_vinotify_event: tstamp:7326394525 tag:CHANSEL_PXL_EOF channel:0x23 frame:0 vi_tstamp:7326340423 data:0x04370002
     kworker/0:1-787   [000] ....   224.126941: rtcpu_vinotify_event: tstamp:7326394686 tag:ATOMP_FRAME_DONE channel:0x23 frame:0 vi_tstamp:7326340442 data:0x00000000
     kworker/0:1-787   [000] ....   224.126941: rtcpu_vinotify_event: tstamp:7326394825 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:6809628864 data:0x02020016
     kworker/0:1-787   [000] ....   224.126941: rtcpu_nvcsi_intr: tstamp:7326394930 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:1-787   [000] ....   224.126941: rtcpu_nvcsi_intr: tstamp:7326394930 class:CORRECTABLE_ERR type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:1-787   [000] ....   224.126942: rtcpu_vinotify_event: tstamp:7326395605 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:7326389922 data:0x00400060
     kworker/0:1-787   [000] ....   224.126942: rtcpu_vinotify_event: tstamp:7326395747 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:7326389922 data:0x00000000
     kworker/0:1-787   [000] ....   224.126943: rtcpu_nvcsi_intr: tstamp:7326396055 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:1-787   [000] ....   224.126943: rtcpu_nvcsi_intr: tstamp:7326396055 class:CORRECTABLE_ERR type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
											...
     kworker/0:1-787   [000] ....   224.126947: rtcpu_nvcsi_intr: tstamp:7326406060 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:1-787   [000] ....   224.126947: rtcpu_nvcsi_intr: tstamp:7326406060 class:CORRECTABLE_ERR type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:1-787   [000] ....   224.126948: rtos_queue_send_from_isr_failed: tstamp:7326406876 queue:0x0bcb41f8
     kworker/0:1-787   [000] ....   224.126948: rtos_queue_send_from_isr_failed: tstamp:7326407034 queue:0x0bcb8a60
     kworker/0:1-787   [000] ....   224.126948: rtos_queue_send_from_isr_failed: tstamp:7326407187 queue:0x0bcba5e0
     kworker/0:1-787   [000] ....   224.126949: rtos_queue_send_from_isr_failed: tstamp:7326407336 queue:0x0bcbb3a0
     kworker/0:1-787   [000] ....   224.126949: rtos_queue_send_from_isr_failed: tstamp:7326407483 queue:0x0bcbc160
     kworker/0:1-787   [000] ....   224.126950: rtcpu_nvcsi_intr: tstamp:7326407655 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:1-787   [000] ....   224.126950: rtcpu_nvcsi_intr: tstamp:7326407655 class:CORRECTABLE_ERR type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
											...
     kworker/0:1-787   [000] ....   224.182296: rtcpu_nvcsi_intr: tstamp:7326720509 class:CORRECTABLE_ERR type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:1-787   [000] ....   224.182296: rtcpu_nvcsi_intr: tstamp:7326721597 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:1-787   [000] ....   224.182297: rtcpu_vinotify_event: tstamp:7326722244 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:6811217408 data:0x00020016
     kworker/0:1-787   [000] ....   224.182297: rtcpu_vinotify_event: tstamp:7326722386 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:6811222880 data:0x07020017
     kworker/0:1-787   [000] ....   224.182315: rtcpu_vinotify_event: tstamp:7326722546 tag:FS channel:0x00 frame:0 vi_tstamp:7326389940 data:0x00000010
     kworker/0:1-787   [000] ....   224.182316: rtcpu_vinotify_event: tstamp:7326723257 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:7326389940 data:0x00000000
     kworker/0:1-787   [000] ....   224.182316: rtcpu_nvcsi_intr: tstamp:7326722727 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:1-787   [000] ....   224.182317: rtcpu_nvcsi_intr: tstamp:7326722727 class:CORRECTABLE_ERR type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:1-787   [000] ....   224.182317: rtcpu_vinotify_event: tstamp:7326723422 tag:CHANSEL_PXL_SOF channel:0x23 frame:0 vi_tstamp:7326390734 data:0x00000001
     kworker/0:1-787   [000] ....   224.182318: rtcpu_vinotify_event: tstamp:7326723563 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:6811239040 data:0x08020017
     kworker/0:1-787   [000] ....   224.182318: rtcpu_vinotify_event: tstamp:7326723720 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:6811519488 data:0x10000000
     kworker/0:1-787   [000] ....   224.182318: rtcpu_nvcsi_intr: tstamp:7326723825 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:1-787   [000] ....   224.182318: rtcpu_nvcsi_intr: tstamp:7326723825 class:CORRECTABLE_ERR type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:1-787   [000] ....   224.182319: rtcpu_vinotify_event: tstamp:7326724477 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:6811527904 data:0x31000018
     kworker/0:1-787   [000] ....   224.182319: rtcpu_nvcsi_intr: tstamp:7326724958 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:1-787   [000] ....   224.182319: rtcpu_nvcsi_intr: tstamp:7326724958 class:CORRECTABLE_ERR type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
											...
     kworker/0:1-787   [000] ....  6248.378254: rtcpu_vinotify_error: tstamp:195582920658 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:195582917116 data:0x00400060
     kworker/0:1-787   [000] ....  6248.378254: rtcpu_nvcsi_intr: tstamp:195582921006 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:1-787   [000] ....  6248.378254: rtcpu_nvcsi_intr: tstamp:195582921006 class:CORRECTABLE_ERR type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:1-787   [000] ....  6248.378256: rtcpu_nvcsi_intr: tstamp:195582922118 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
										...
     kworker/0:1-787   [000] ....  6248.378259: rtos_queue_send_from_isr_failed: tstamp:195582930780 queue:0x0bcb41f8
     kworker/0:1-787   [000] ....  6248.378259: rtos_queue_send_from_isr_failed: tstamp:195582930937 queue:0x0bcb8a60
     kworker/0:1-787   [000] ....  6248.378259: rtos_queue_send_from_isr_failed: tstamp:195582931090 queue:0x0bcba5e0
     kworker/0:1-787   [000] ....  6248.378260: rtos_queue_send_from_isr_failed: tstamp:195582931239 queue:0x0bcbb3a0
     kworker/0:1-787   [000] ....  6248.378260: rtos_queue_send_from_isr_failed: tstamp:195582931386 queue:0x0bcbc160
     kworker/0:1-787   [000] ....  6248.378260: rtcpu_nvcsi_intr: tstamp:195582931557 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:1-787   [000] ....  6248.378260: rtcpu_nvcsi_intr: tstamp:195582931557 class:CORRECTABLE_ERR type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:1-787   [000] ....  6248.378260: rtcpu_nvcsi_intr: tstamp:195582932161 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
										...
     kworker/0:1-787   [000] ....  6248.378275: rtcpu_vinotify_event: tstamp:195582992768 tag:CHANSEL_PXL_EOF channel:0x23 frame:0 vi_tstamp:195582867618 data:0x04370002
     kworker/0:1-787   [000] ....  6248.378275: rtcpu_vinotify_event: tstamp:195582992909 tag:ATOMP_FRAME_DONE channel:0x23 frame:0 vi_tstamp:195582867637 data:0x00000000
     kworker/0:1-787   [000] ....  6248.378275: rtcpu_vinotify_event: tstamp:195582993070 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:194157943840 data:0x02020039
     kworker/0:1-787   [000] ....  6248.378276: rtcpu_vinotify_event: tstamp:195582993781 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:195582917116 data:0x00400060
     kworker/0:1-787   [000] ....  6248.378276: rtcpu_nvcsi_intr: tstamp:195582993249 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:1-787   [000] ....  6248.378276: rtcpu_nvcsi_intr: tstamp:195582993249 class:CORRECTABLE_ERR type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:1-787   [000] ....  6248.378276: rtcpu_vinotify_event: tstamp:195582993949 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:195582917117 data:0x00000000
     kworker/0:1-787   [000] ....  6248.378276: rtcpu_vinotify_event: tstamp:195582994088 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:194159530912 data:0x00020039
     kworker/0:1-787   [000] ....  6248.378277: rtcpu_vinotify_event: tstamp:195582994246 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:194159536256 data:0x0702003a
     kworker/0:1-787   [000] ....  6248.378277: rtcpu_nvcsi_intr: tstamp:195582994351 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:1-787   [000] ....  6248.378277: rtcpu_nvcsi_intr: tstamp:195582994351 class:CORRECTABLE_ERR type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:1-787   [000] ....  6248.378277: rtcpu_vinotify_event: tstamp:195582994987 tag:FS channel:0x00 frame:0 vi_tstamp:195582917135 data:0x00000010
     kworker/0:1-787   [000] ....  6248.378277: rtcpu_vinotify_event: tstamp:195582995146 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:195582917136 data:0x00000000
     kworker/0:1-787   [000] ....  6248.378278: rtcpu_vinotify_event: tstamp:195582995282 tag:CHANSEL_PXL_SOF channel:0x23 frame:0 vi_tstamp:195582917928 data:0x00000001
     kworker/0:1-787   [000] ....  6248.378278: rtcpu_vinotify_event: tstamp:195582996006 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:194159552832 data:0x0802003a
     kworker/0:1-787   [000] ....  6248.378278: rtcpu_nvcsi_intr: tstamp:195582995478 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:1-787   [000] ....  6248.378278: rtcpu_nvcsi_intr: tstamp:195582995478 class:CORRECTABLE_ERR type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:1-787   [000] ....  6248.378278: rtcpu_vinotify_event: tstamp:195582996149 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:194159762432 data:0x10000000
     kworker/0:1-787   [000] ....  6248.378279: rtcpu_vinotify_event: tstamp:195582996309 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:194159770816 data:0x3100003b
     kworker/0:1-787   [000] ....  6248.378279: rtcpu_nvcsi_intr: tstamp:195582996592 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:1-787   [000] ....  6248.378279: rtcpu_nvcsi_intr: tstamp:195582996592 class:CORRECTABLE_ERR type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:1-787   [000] ....  6248.378279: rtcpu_nvcsi_intr: tstamp:195582997703 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
										...
     kworker/0:1-787   [000] ....  6248.378542: rtcpu_vinotify_event: tstamp:195584118846 tag:CHANSEL_PXL_EOF channel:0x23 frame:0 vi_tstamp:195584117636 data:0x04370002
     kworker/0:1-787   [000] ....  6248.378542: rtcpu_nvcsi_intr: tstamp:195584168887 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:1-787   [000] ....  6248.378542: rtcpu_nvcsi_intr: tstamp:195584168887 class:CORRECTABLE_ERR type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:1-787   [000] ....  6248.378542: rtcpu_nvcsi_intr: tstamp:195584169911 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:1-787   [000] ....  6248.378542: rtcpu_vinotify_error: tstamp:195584170521 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:195584167134 data:0x00400060
     kworker/0:1-787   [000] ....  6248.378544: rtcpu_nvcsi_intr: tstamp:195584171047 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:1-787   [000] ....  6248.378544: rtcpu_nvcsi_intr: tstamp:195584171047 class:CORRECTABLE_ERR type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:1-787   [000] ....  6248.378544: rtcpu_nvcsi_intr: tstamp:195584172134 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
										...
     kworker/0:1-787   [000] ....  6248.378546: rtos_queue_send_from_isr_failed: tstamp:195584181710 queue:0x0bcb41f8
     kworker/0:1-787   [000] ....  6248.378547: rtos_queue_send_from_isr_failed: tstamp:195584181868 queue:0x0bcb8a60
     kworker/0:1-787   [000] ....  6248.378547: rtos_queue_send_from_isr_failed: tstamp:195584182021 queue:0x0bcba5e0
     kworker/0:1-787   [000] ....  6248.378547: rtos_queue_send_from_isr_failed: tstamp:195584182169 queue:0x0bcbb3a0
     kworker/0:1-787   [000] ....  6248.378547: rtos_queue_send_from_isr_failed: tstamp:195584182314 queue:0x0bcbc160
     kworker/0:1-787   [000] ....  6248.378548: rtcpu_nvcsi_intr: tstamp:195584182484 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:1-787   [000] ....  6248.378548: rtcpu_nvcsi_intr: tstamp:195584182484 class:CORRECTABLE_ERR type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:1-787   [000] ....  6248.378548: rtcpu_nvcsi_intr: tstamp:195584183245 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
										...
        v4l2-ctl-16014 [001] ....  6248.389535: tegra_channel_close: vi-output, csifpga 8-0001
        v4l2-ctl-16014 [002] ....  6248.412905: tegra_channel_set_stream: enable : 0x0
        v4l2-ctl-16014 [002] ....  6248.412910: tegra_channel_set_stream: csifpga 8-0001 : 0x0
        v4l2-ctl-16014 [002] ....  6248.412926: tegra_channel_set_stream: 15a00000.nvcsi--3 : 0x0
        v4l2-ctl-16014 [002] ....  6248.412928: csi_s_stream: enable : 0x0
        v4l2-ctl-16014 [000] ....  6248.419615: tegra_channel_set_power: csifpga 8-0001 : 0x0
        v4l2-ctl-16014 [000] ....  6248.419634: camera_common_s_power: status : 0x0
        v4l2-ctl-16014 [000] ....  6248.419687: tegra_channel_set_power: 15a00000.nvcsi--3 : 0x0
        v4l2-ctl-16014 [000] ....  6248.419688: csi_s_power: enable : 0x0
     kworker/0:1-787   [000] ....  6248.438165: rtcpu_nvcsi_intr: tstamp:195584347723 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:1-787   [000] ....  6248.438165: rtcpu_nvcsi_intr: tstamp:195584347723 class:CORRECTABLE_ERR type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:1-787   [000] ....  6248.438165: rtcpu_nvcsi_intr: tstamp:195584348834 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
										...
     kworker/0:1-787   [000] ....  6248.438201: rtcpu_vinotify_event: tstamp:195584450571 tag:ATOMP_FRAME_DONE channel:0x23 frame:0 vi_tstamp:195584117655 data:0x00000000
     kworker/0:1-787   [000] ....  6248.438202: rtcpu_vinotify_event: tstamp:195584450714 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:194197945888 data:0x0202003a
     kworker/0:1-787   [000] ....  6248.438202: rtcpu_vinotify_event: tstamp:195584450875 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:195584167134 data:0x00400060
     kworker/0:1-787   [000] ....  6248.438202: rtcpu_vinotify_event: tstamp:195584451584 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:195584167135 data:0x00000000
     kworker/0:1-787   [000] ....  6248.438202: rtcpu_nvcsi_intr: tstamp:195584451056 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:1-787   [000] ....  6248.438203: rtcpu_nvcsi_intr: tstamp:195584451056 class:CORRECTABLE_ERR type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:1-787   [000] ....  6248.438203: rtcpu_vinotify_event: tstamp:195584451750 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:194199531520 data:0x0002003a
     kworker/0:1-787   [000] ....  6248.438203: rtcpu_vinotify_event: tstamp:195584451889 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:194199536832 data:0x0702003b
     kworker/0:1-787   [000] ....  6248.438204: rtcpu_vinotify_event: tstamp:195584452046 tag:FS channel:0x00 frame:0 vi_tstamp:195584167153 data:0x00000010
     kworker/0:1-787   [000] ....  6248.438204: rtcpu_nvcsi_intr: tstamp:195584452151 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:1-787   [000] ....  6248.438204: rtcpu_nvcsi_intr: tstamp:195584452151 class:CORRECTABLE_ERR type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:1-787   [000] ....  6248.438204: rtcpu_vinotify_event: tstamp:195584452786 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:195584167154 data:0x00000000
     kworker/0:1-787   [000] ....  6248.438205: rtcpu_vinotify_event: tstamp:195584452943 tag:CHANSEL_PXL_SOF channel:0x23 frame:0 vi_tstamp:195584167946 data:0x00000001
     kworker/0:1-787   [000] ....  6248.438206: rtcpu_vinotify_event: tstamp:195584453078 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:194199559168 data:0x0802003b
     kworker/0:1-787   [000] ....  6248.438206: rtcpu_vinotify_event: tstamp:195584453799 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:194199759776 data:0x10000000
     kworker/0:1-787   [000] ....  6248.438206: rtcpu_nvcsi_intr: tstamp:195584453271 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:1-787   [000] ....  6248.438206: rtcpu_nvcsi_intr: tstamp:195584453271 class:CORRECTABLE_ERR type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:1-787   [000] ....  6248.438206: rtcpu_vinotify_event: tstamp:195584453940 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:194199768224 data:0x3100003c
     kworker/0:1-787   [000] ....  6248.438207: rtcpu_nvcsi_intr: tstamp:195584454393 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:1-787   [000] ....  6248.438207: rtcpu_nvcsi_intr: tstamp:195584454393 class:CORRECTABLE_ERR type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:1-787   [000] ....  6248.438207: rtcpu_nvcsi_intr: tstamp:195584455503 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
										...
     kworker/0:1-787   [000] ....  6248.438406: rtcpu_vinotify_error: tstamp:195585420735 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:195585417153 data:0x00400060
     kworker/0:1-787   [000] ....  6248.438407: rtcpu_nvcsi_intr: tstamp:195585421046 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:1-787   [000] ....  6248.438407: rtcpu_nvcsi_intr: tstamp:195585421046 class:CORRECTABLE_ERR type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:1-787   [000] ....  6248.438407: rtcpu_vinotify_event: tstamp:195585421767 tag:CHANSEL_PXL_EOF channel:0x23 frame:0 vi_tstamp:195585367654 data:0x04370002
     kworker/0:1-787   [000] ....  6248.438407: rtcpu_vinotify_event: tstamp:195585421907 tag:ATOMP_FRAME_DONE channel:0x23 frame:0 vi_tstamp:195585367674 data:0x00000000
     kworker/0:1-787   [000] ....  6248.438408: rtcpu_vinotify_event: tstamp:195585422065 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:194237944960 data:0x0202003b
     kworker/0:1-787   [000] ....  6248.438408: rtcpu_nvcsi_intr: tstamp:195585422170 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:1-787   [000] ....  6248.438408: rtcpu_nvcsi_intr: tstamp:195585422170 class:CORRECTABLE_ERR type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:1-787   [000] ....  6248.438408: rtcpu_vinotify_event: tstamp:195585422806 tag:CSIMUX_FRAME channel:0x00 frame:0 vi_tstamp:195585417153 data:0x00400060
     kworker/0:1-787   [000] ....  6248.438411: rtcpu_nvcsi_intr: tstamp:195585423262 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:1-787   [000] ....  6248.438411: rtcpu_nvcsi_intr: tstamp:195585423262 class:CORRECTABLE_ERR type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:1-787   [000] ....  6248.438412: rtcpu_nvcsi_intr: tstamp:195585424376 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
										...
     kworker/0:1-787   [000] ....  6248.438415: rtos_queue_send_from_isr_failed: tstamp:195585435057 queue:0x0bcb41f8
     kworker/0:1-787   [000] ....  6248.438416: rtos_queue_send_from_isr_failed: tstamp:195585435216 queue:0x0bcb8a60
     kworker/0:1-787   [000] ....  6248.438416: rtos_queue_send_from_isr_failed: tstamp:195585435387 queue:0x0bcba5e0
     kworker/0:1-787   [000] ....  6248.438417: rtos_queue_send_from_isr_failed: tstamp:195585435535 queue:0x0bcbb3a0
     kworker/0:1-787   [000] ....  6248.438417: rtos_queue_send_from_isr_failed: tstamp:195585435682 queue:0x0bcbc160
     kworker/0:1-787   [000] ....  6248.438417: rtcpu_nvcsi_intr: tstamp:195585435854 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:1-787   [000] ....  6248.438417: rtcpu_nvcsi_intr: tstamp:195585435854 class:CORRECTABLE_ERR type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:1-787   [000] ....  6248.438417: rtcpu_nvcsi_intr: tstamp:195585436597 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:1-787   [000] ....  6248.438418: rtos_queue_send_from_isr_failed: tstamp:195585492729 queue:0x0bcb41f8
     kworker/0:1-787   [000] ....  6248.438418: rtos_queue_send_from_isr_failed: tstamp:195585492899 queue:0x0bcb8a60
     kworker/0:1-787   [000] ....  6248.438418: rtos_queue_send_from_isr_failed: tstamp:195585493051 queue:0x0bcba5e0
     kworker/0:1-787   [000] ....  6248.438419: rtos_queue_send_from_isr_failed: tstamp:195585493197 queue:0x0bcbb3a0
     kworker/0:1-787   [000] ....  6248.438419: rtos_queue_send_from_isr_failed: tstamp:195585493344 queue:0x0bcbc160
     kworker/0:1-787   [000] ....  6248.438420: rtos_queue_peek_from_isr_failed: tstamp:195585507921 queue:0x0bcbcf78
     kworker/0:1-787   [000] ....  6248.438420: rtcpu_vinotify_event: tstamp:195585738331 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:195585417154 data:0x00000000
     kworker/0:1-787   [000] ....  6248.438421: rtcpu_vinotify_event: tstamp:195585738475 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:194239533568 data:0x0002003b
     kworker/0:1-787   [000] ....  6248.438421: rtcpu_vinotify_event: tstamp:195585738637 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:194239539008 data:0x0702003c
     kworker/0:1-787   [000] ....  6248.438421: rtcpu_vinotify_event: tstamp:195585738774 tag:FS channel:0x00 frame:0 vi_tstamp:195585417172 data:0x00000010
     kworker/0:1-787   [000] ....  6248.438421: rtcpu_vinotify_event: tstamp:195585738932 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:195585417172 data:0x00000000
     kworker/0:1-787   [000] ....  6248.438422: rtcpu_vinotify_event: tstamp:195585739067 tag:CHANSEL_PXL_SOF channel:0x23 frame:0 vi_tstamp:195585417965 data:0x00000001
     kworker/0:1-787   [000] ....  6248.438422: rtcpu_vinotify_event: tstamp:195585739224 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:194239555168 data:0x0802003c
     kworker/0:1-787   [000] ....  6248.438422: rtcpu_vinotify_event: tstamp:195585739359 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:194239805056 data:0x10000000
     kworker/0:1-787   [000] ....  6248.438422: rtcpu_vinotify_event: tstamp:195585739516 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:194239813472 data:0x3100003d
     kworker/0:1-787   [000] ....  6248.438423: rtcpu_vinotify_event: tstamp:195585739657 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:195585493925 data:0x380003d2
     kworker/0:1-787   [000] ....  6248.438423: rtcpu_vinotify_event: tstamp:195585739818 tag:CHANSEL_FAULT_FE channel:0x01 frame:0 vi_tstamp:195585493925 data:0x00000000
     kworker/0:1-787   [000] ....  6248.438423: rtcpu_vinotify_event: tstamp:195585739996 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:195585493925 data:0x00000000
     kworker/0:1-787   [000] ....  6248.606156: rtos_queue_peek_from_isr_failed: tstamp:195590507961 queue:0x0bcbcf78
     kworker/0:1-787   [000] ....  6248.774158: rtos_queue_peek_from_isr_failed: tstamp:195595507956 queue:0x0bcbcf78
										...

kern.log :

Sep 14 11:40:44 xnx kernel: [ 7543.858076] t194-nvcsi 15a00000.nvcsi: csi5_power_on
Sep 14 11:40:44 xnx kernel: [ 7543.858193] t194-nvcsi 15a00000.nvcsi: settle time reading from props
Sep 14 11:40:44 xnx kernel: [ 7543.859433] t194-nvcsi 15a00000.nvcsi: settle time reading from props
Sep 14 11:40:44 xnx kernel: [ 7543.859438] t194-nvcsi 15a00000.nvcsi: csi5_mipi_cal
Sep 14 11:40:44 xnx kernel: [ 7543.859442] t194-nvcsi 15a00000.nvcsi: csi_port:0
Sep 14 11:40:44 xnx kernel: [ 7543.859570] t194-nvcsi 15a00000.nvcsi: settle time reading from props
Sep 14 11:40:44 xnx kernel: [ 7543.859593] t194-nvcsi 15a00000.nvcsi: csi5_mipi_cal
Sep 14 11:40:44 xnx kernel: [ 7543.859596] t194-nvcsi 15a00000.nvcsi: csi_port:2
Sep 14 11:40:44 xnx kernel: [ 7543.859716] t194-nvcsi 15a00000.nvcsi: settle time reading from props
Sep 14 11:40:44 xnx kernel: [ 7543.859720] t194-nvcsi 15a00000.nvcsi: csi5_mipi_cal
Sep 14 11:40:44 xnx kernel: [ 7543.859723] t194-nvcsi 15a00000.nvcsi: csi_port:2
Sep 14 11:40:44 xnx kernel: [ 7543.870336] t194-nvcsi 15a00000.nvcsi: csi5_start_streaming: csi_pt=0, st_id=0, vc_id=0, pg_mode=0x0
Sep 14 11:40:44 xnx kernel: [ 7543.870346] t194-nvcsi 15a00000.nvcsi: settle time reading from props
Sep 14 11:40:44 xnx kernel: [ 7543.870352] t194-nvcsi 15a00000.nvcsi: discontinuous_clk = 0 reading from props
Sep 14 11:40:44 xnx kernel: [ 7543.870357] t194-nvcsi 15a00000.nvcsi: csi5_stream_set_config: stream_id=0, csi_port=0
Sep 14 11:40:44 xnx kernel: [ 7543.870365] t194-nvcsi 15a00000.nvcsi: csi5_stream_open: stream_id=0, csi_port=0
Sep 14 11:40:45 xnx kernel: [ 7543.906200] [RCE] Configuring VI GoS.
Sep 14 11:40:45 xnx kernel: [ 7543.906210] [RCE] VM GOS[#0] addr=0xc2100000
Sep 14 11:40:45 xnx kernel: [ 7543.906217] [RCE] VM GOS[#1] addr=0xc2101000
Sep 14 11:40:45 xnx kernel: [ 7543.906223] [RCE] VM GOS[#2] addr=0xc2102000
Sep 14 11:40:45 xnx kernel: [ 7543.906229] [RCE] VM GOS[#3] addr=0xc2103000
Sep 14 11:40:45 xnx kernel: [ 7543.906236] [RCE] VM GOS[#4] addr=0xc2104000
Sep 14 11:40:45 xnx kernel: [ 7543.906242] [RCE] VM GOS[#5] addr=0xc2105000
Sep 14 11:40:45 xnx kernel: [ 7543.906249] [RCE] vi5_hwinit: firmware CL2018101701 protocol version 2.2
Sep 14 11:40:45 xnx kernel: [ 7543.906256] [RCE] VI GOS[#0] set to VM GOS[4] base 0xc2104000
Sep 14 11:40:45 xnx kernel: [ 7543.911921] tegra194-vi5 15c10000.vi: corr_err: discarding frame 0, flags: 102, err_data 4194400
Sep 14 11:40:45 xnx kernel: [ 7543.951973] tegra194-vi5 15c10000.vi: corr_err: discarding frame 0, flags: 96, err_data 4194400
											....
Sep 14 11:40:49 xnx kernel: [ 7548.832307] t194-nvcsi 15a00000.nvcsi: csi5_stop_streaming: csi_pt=0, st_id=0, vc_id=0, pg_mode=0x0
Sep 14 11:40:49 xnx kernel: [ 7548.832316] t194-nvcsi 15a00000.nvcsi: csi5_stream_close: stream_id=0, csi_port=0
Sep 14 11:40:49 xnx kernel: [ 7548.837130] t194-nvcsi 15a00000.nvcsi: csi5_power_off

In addition here is our device-tree config in case of wrong mapping/configuration :

#include <dt-bindings/media/camera.h>

/ {
    host1x {
        vi@15c10000  {
            num-channels = <1>;
            ports {
                #address-cells = <1>;
                #size-cells = <0>;
                vi_port0: port@0 {
                    reg = <0>;
                    csifpga_vi_in0: endpoint {
                        vc-id = <0>;
                        port-index = <0>;
                        bus-width = <4>;
                        remote-endpoint = <&csifpga_csi_out0>;
                    };
                };
            };
        };

        nvcsi@15a00000 {
            status = "okay";
            num-channels = <1>;
            #address-cells = <1>;
            #size-cells = <0>;
            csi_chan0: channel@0 {
                reg = <0>;
                ports {
                    #address-cells = <1>;
                    #size-cells = <0>;
                    csi_chan0_port0: port@0 {
                        reg = <0>;
                        csifpga_csi_in0: endpoint@0 {
                            port-index = <0>;
                            bus-width = <4>;
                            remote-endpoint = <&csifpga_out0>;
                        };
                    };
                    csi_chan0_port1: port@1 {
                        reg = <1>;
                        csifpga_csi_out0: endpoint@1 {
                            remote-endpoint = <&csifpga_vi_in0>;
                        };
                    };
                };
            };
        };
    };

    i2c@31e0000{
        status = "okay";
        #address-cells = <1>;
        #size-cells = <0>;

        csifpga_cam0: csifpga@01 {
            compatible = "*****,csifpga";

            /* I2C device address */
            reg = <0x01>;

            /* V4L2 device node location */
            // devnode = "video0";

            /* Physical dimensions of sensor */
            physical_w = "3.674";
            physical_h = "2.738";

            /* Sensor output flip settings */
            vertical-flip = "false";

            mode0 { // CSIFPGA_MODE_1920X1080_25
                readout_orientation = "0";
                num_lanes = "4"; /* Mandatory ! */
                pix_clk_hz = "74250000"; /* Mandatory ! */
                cil_settletime = "26"; /* 26 */
                discontinuous_clk = "no";
                dpcm_enable = "false";
                tegra_sinterface = "serial_a"; /* Mandatory ! */
                phy_mode = "DPHY"; /* Mandatory ! */

                /* Image props */
                active_w = "1920"; /* Mandatory ! */
                active_h = "1080"; /* Mandatory ! */
                line_length = "2640"; /* Mandatory ! */
                embedded_metadata_height = "0";
                pixel_phase = "uyvy"; /* Mandatory ! */
                mode_type = "yuv"; /* Mandatory ! */
                csi_pixel_bit_depth = "16"; /* Mandatory ! */

                /* DV timings */
                horz_front_porch = "0";
                horz_sync = "0";
                horz_back_porch = "0";
                vert_front_porch = "0";
                vert_sync = "0";
                vert_back_porch = "0";

                /* Control props */
                gain_factor = "10";
                min_gain_val = "10";/* 1DB*/
                max_gain_val = "160";/* 16DB*/
                step_gain_val = "1";
                default_gain = "10";
                min_hdr_ratio = "1";
                max_hdr_ratio = "1";
                framerate_factor = "1000000";
                min_framerate = "25000000";
                max_framerate = "25000000";
                step_framerate = "1";
                default_framerate = "25000000";
                exposure_factor = "1000000";
                min_exp_time = "34";/* us */
                max_exp_time = "550385";/* us */
                step_exp_time = "1";
                default_exp_time = "33334";/* us */

                dynamic_pixel_bit_depth = "16";
            };

            ports {
                #address-cells = <1>;
                #size-cells = <0>;
                port@0 {
                    reg = <0>;
                    csifpga_out0: endpoint {
                        vc-id = <0>;
                        port-index = <0>;
                        bus-width = <4>;
                        remote-endpoint = <&csifpga_csi_in0>;
                        link-frequencies = /bits/ 64 <297000000>;
                        data-lanes = <1 2 3 4>;
                        clock-lanes = <0>;
                        clock-noncontinuous;
                    };
                };
            };
        };
    };

    tcp: tegra-camera-platform {
        compatible = "nvidia, tegra-camera-platform";

        num_csi_lanes = <4>;
        max_lane_speed = <1500000>;
        min_bits_per_pixel = <10>;
        vi_peak_byte_per_pixel = <2>;
        vi_bw_margin_pct = <25>;
        max_pixel_rate = <240000>;
        isp_peak_byte_per_pixel = <5>;
        isp_bw_margin_pct = <25>;

        modules {
            cam_module0: module0 {
                badge = "csifpga_bottom_123456";
                position = "bottom";
                orientation = "0";
                cam_module0_drivernode0: drivernode0 {
                    pcl_id = "v4l2_sensor";
                    devname = "csifpga 0-0001";
                    proc-device-tree = "/proc/device-tree/i2c@31e0000/csifpga@01";
                };
            };
        };
    };
};

Into the trace file we saw the CSMUX_FRAME message indicating a CRC error on payload (bit22). Which is normal because currently there is no CRC sent. We are working to add this to the payload but do you see anything else that could be wrong ? Maybe our timing calculations are wrong as we took the same as for our TX2.

Thank you again for your help

With CRCs it works, problem solved !

Thank you very much !

Hello,

I’m late and I saw you solved it, great! Thanks for the feedback!

Regards,
Roberto