IMX297 raw image acquisition

Autonomous Machines Jetson & Embedded Systems Jetson Xavier NX
1

Hello, I am trying to acquire a raw frame from IMX297 MIPI sensor connected to Xavier devkit MIPI port 0.
A CSI 2:1 aggregator is connected between sensor and Jetson port. Just a single sensor is enabled for streaming, transmitting to virtual channel 0.

Here the command, already verified in other setups, which unfortunately results in acquisition timeout, and a properly sized but full black raw output:
v4l2-ctl -d /dev/video0 --set-fmt-video=width=1440,height=1080,pixelformat='Y10 ' --set-ctrl bypass_mode=0 --stream-mmap --stream-count=1 --stream-to=test.raw

Trace output:

# tracer: nop
#
# entries-in-buffer/entries-written: 500/500   #P:6
#
#                              _-----=> irqs-off
#                             / _----=> need-resched
#                            | / _---=> hardirq/softirq
#                            || / _--=> preempt-depth
#                            ||| /     delay
#           TASK-PID   CPU#  ||||    TIMESTAMP  FUNCTION
#              | |       |   ||||       |         |
        v4l2-ctl-5524  [004] ....   199.286637: tegra_channel_open: vi-output, vc_mipi 2-001a
        v4l2-ctl-5524  [000] ....   199.288866: tegra_channel_set_power: vc_mipi 2-001a : 0x1
        v4l2-ctl-5524  [000] ....   199.288877: camera_common_s_power: status : 0x1
        v4l2-ctl-5524  [000] ....   199.288908: tegra_channel_set_power: 15a00000.nvcsi--3 : 0x1
        v4l2-ctl-5524  [000] ....   199.288911: csi_s_power: enable : 0x1
        v4l2-ctl-5524  [000] ....   199.292967: tegra_channel_capture_setup: vnc_id 0 W 736 H 540 fmt c5
        v4l2-ctl-5524  [000] ....   199.304581: tegra_channel_set_stream: enable : 0x1
        v4l2-ctl-5524  [002] ....   199.312064: tegra_channel_set_stream: 15a00000.nvcsi--3 : 0x1
        v4l2-ctl-5524  [002] ....   199.312070: csi_s_stream: enable : 0x1
        v4l2-ctl-5524  [002] ....   199.312081: tegra_channel_set_stream: vc_mipi 2-001a : 0x1
     kworker/0:4-4503  [000] ....   199.322209: rtos_queue_peek_from_isr_failed: tstamp:6603589454 queue:0x0bcbbbb8
     kworker/0:4-4503  [000] ....   199.322214: rtcpu_start: tstamp:6603590795
     kworker/0:4-4503  [000] ....   199.322215: rtos_queue_send_from_isr_failed: tstamp:6603730583 queue:0x0bcb2e38
     kworker/0:4-4503  [000] ....   199.322217: rtos_queue_send_from_isr_failed: tstamp:6603730736 queue:0x0bcb76a0
     kworker/0:4-4503  [000] ....   199.322218: rtos_queue_send_from_isr_failed: tstamp:6603730885 queue:0x0bcb9220
     kworker/0:4-4503  [000] ....   199.322219: rtos_queue_send_from_isr_failed: tstamp:6603731032 queue:0x0bcb9fe0
     kworker/0:4-4503  [000] ....   199.322220: rtos_queue_send_from_isr_failed: tstamp:6603731177 queue:0x0bcbada0
     kworker/0:4-4503  [000] ....   199.322222: rtcpu_string: tstamp:6603731618 id:0x04010000 str:"Configuring VI GoS.
"
     kworker/0:4-4503  [000] ....   199.322236: rtcpu_string: tstamp:6603731824 id:0x04010000 str:"VM GOS[#0] addr=0xc2100000
"
     kworker/0:4-4503  [000] ....   199.322241: rtcpu_string: tstamp:6603732076 id:0x04010000 str:"VM GOS[#1] addr=0xc2101000
"
     kworker/0:4-4503  [000] ....   199.322246: rtcpu_string: tstamp:6603732317 id:0x04010000 str:"VM GOS[#2] addr=0xc2102000
"
     kworker/0:4-4503  [000] ....   199.322252: rtcpu_string: tstamp:6603732549 id:0x04010000 str:"VM GOS[#3] addr=0xc2103000
"
     kworker/0:4-4503  [000] ....   199.322256: rtcpu_string: tstamp:6603732798 id:0x04010000 str:"VM GOS[#4] addr=0xc2104000
"
     kworker/0:4-4503  [000] ....   199.322261: rtcpu_string: tstamp:6603733030 id:0x04010000 str:"VM GOS[#5] addr=0xc2105000
"
     kworker/0:4-4503  [000] ....   199.322265: rtcpu_string: tstamp:6603741815 id:0x04010000 str:"vi5_hwinit: firmware CL2018101701 protocol vers"
     kworker/0:4-4503  [000] ....   199.322269: rtcpu_string: tstamp:6603741947 id:0x04010000 str:"on 2.2
"
     kworker/0:4-4503  [000] ....   199.322274: rtos_queue_send_from_isr_failed: tstamp:6603755234 queue:0x0bcb2e38
     kworker/0:4-4503  [000] ....   199.322275: rtos_queue_send_from_isr_failed: tstamp:6603755386 queue:0x0bcb76a0
     kworker/0:4-4503  [000] ....   199.322276: rtos_queue_send_from_isr_failed: tstamp:6603755540 queue:0x0bcb9220
     kworker/0:4-4503  [000] ....   199.322298: rtos_queue_send_from_isr_failed: tstamp:6603755688 queue:0x0bcb9fe0
     kworker/0:4-4503  [000] ....   199.322298: rtos_queue_send_from_isr_failed: tstamp:6603755834 queue:0x0bcbada0
     kworker/0:4-4503  [000] ....   199.322299: rtcpu_string: tstamp:6603756776 id:0x04010000 str:"VI GOS[#0] set to VM GOS[4] base 0xc2104000
"
     kworker/0:4-4503  [000] ....   199.322305: rtos_queue_send_from_isr_failed: tstamp:6603990582 queue:0x0bcb2e38
     kworker/0:4-4503  [000] ....   199.322306: rtos_queue_send_from_isr_failed: tstamp:6603990739 queue:0x0bcb76a0
     kworker/0:4-4503  [000] ....   199.322307: rtos_queue_send_from_isr_failed: tstamp:6603990885 queue:0x0bcb9220
     kworker/0:4-4503  [000] ....   199.322308: rtos_queue_send_from_isr_failed: tstamp:6603991024 queue:0x0bcb9fe0
     kworker/0:4-4503  [000] ....   199.322309: rtos_queue_send_from_isr_failed: tstamp:6603991164 queue:0x0bcbada0
     kworker/0:4-4503  [000] ....   199.322311: rtcpu_vinotify_event: tstamp:6604129984 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:5161826080 data:0x10000000
     kworker/0:4-4503  [000] ....   199.322312: rtcpu_vinotify_event: tstamp:6604130136 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:5161834272 data:0x31000001
     kworker/0:4-4503  [000] ....   199.322313: rtcpu_vinotify_event: tstamp:6604130288 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:5161836416 data:0x07020001
     kworker/0:4-4503  [000] ....   199.322314: rtcpu_vinotify_event: tstamp:6604130416 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:5161876096 data:0x10000000
     kworker/0:4-4503  [000] ....   199.322315: rtcpu_vinotify_event: tstamp:6604130563 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:5161884352 data:0x31000002
 vi-output, vc_m-5526  [000] ....   199.364116: tegra_channel_capture_frame: sof:0.0
 vi-output, vc_m-5526  [000] ....   199.364120: tegra_channel_capture_frame: eof:6764.145223680
     kworker/0:4-4503  [000] ....   199.378193: rtcpu_vinotify_event: tstamp:6605286269 tag:FS channel:0x00 frame:2 vi_tstamp:6605106840 data:0x00000010
     kworker/0:4-4503  [000] ....   199.378195: rtcpu_vinotify_event: tstamp:6605286426 tag:ATOMP_FS channel:0x00 frame:2 vi_tstamp:6605106842 data:0x00000000
     kworker/0:4-4503  [000] ....   199.378197: rtcpu_nvcsi_intr: tstamp:6605614219 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:4-4503  [000] ....   199.378198: rtcpu_nvcsi_intr: tstamp:6605614219 class:CORRECTABLE_ERR type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:4-4503  [000] ....   199.378199: rtcpu_vinotify_event: tstamp:6605671902 tag:CHANSEL_EMBED_SOF channel:0x23 frame:2 vi_tstamp:6605610314 data:0x00000004
     kworker/0:4-4503  [000] ....   199.378200: rtcpu_vinotify_event: tstamp:6605672054 tag:CHANSEL_FAULT channel:0x23 frame:2 vi_tstamp:6605610468 data:0x00002000
     kworker/0:4-4503  [000] ....   199.378201: rtcpu_vinotify_event: tstamp:6605672186 tag:RESERVED_19 channel:0x23 frame:2 vi_tstamp:5221108480 data:0x01020001
     kworker/0:4-4503  [000] ....   199.434590: rtcpu_nvcsi_intr: tstamp:6606621164 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:4-4503  [000] ....   199.434596: rtcpu_nvcsi_intr: tstamp:6606621164 class:CORRECTABLE_ERR type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:4-4503  [000] ....   199.434600: rtcpu_vinotify_event: tstamp:6606828234 tag:CHANSEL_FAULT channel:0x23 frame:2 vi_tstamp:6606617412 data:0x00013008
     kworker/0:4-4503  [000] ....   199.434604: rtcpu_vinotify_event: tstamp:6606828366 tag:RESERVED_19 channel:0x23 frame:2 vi_tstamp:5253330752 data:0x01020001
     kworker/0:4-4503  [000] ....   199.434607: rtcpu_vinotify_event: tstamp:6606828515 tag:ATOMP_EMB_DATA_DONE channel:0x23 frame:2 vi_tstamp:6606617428 data:0x00000000
     kworker/0:4-4503  [000] ....   199.434609: rtcpu_vinotify_event: tstamp:6606828642 tag:RESERVED_19 channel:0x23 frame:2 vi_tstamp:5253333056 data:0x03020001
     kworker/0:4-4503  [000] ....   199.434612: rtcpu_vinotify_event: tstamp:6607625649 tag:CHANSEL_FAULT channel:0x23 frame:2 vi_tstamp:6607624202 data:0x00023800
     kworker/0:4-4503  [000] ....   199.434615: rtcpu_vinotify_event: tstamp:6607625783 tag:RESERVED_19 channel:0x23 frame:2 vi_tstamp:5285548160 data:0x01020001
     kworker/0:4-4503  [000] ....   199.434618: rtcpu_nvcsi_intr: tstamp:6607628104 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:4-4503  [000] ....   199.434621: rtcpu_nvcsi_intr: tstamp:6607628104 class:CORRECTABLE_ERR type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:4-4503  [000] ....   199.490488: rtos_queue_peek_from_isr_failed: tstamp:6608589797 queue:0x0bcbbbb8
     kworker/0:4-4503  [000] ....   199.490510: rtcpu_nvcsi_intr: tstamp:6608635054 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:4-4503  [000] ....   199.490523: rtcpu_nvcsi_intr: tstamp:6608635054 class:CORRECTABLE_ERR type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:4-4503  [000] ....   199.546297: rtcpu_nvcsi_intr: tstamp:6609641995 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:4-4503  [000] ....   199.546299: rtcpu_nvcsi_intr: tstamp:6609641995 class:CORRECTABLE_ERR type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:4-4503  [000] ....   199.546300: rtcpu_nvcsi_intr: tstamp:6610648942 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:4-4503  [000] ....   199.546301: rtcpu_nvcsi_intr: tstamp:6610648942 class:CORRECTABLE_ERR type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:4-4503  [000] ....   199.602538: rtcpu_nvcsi_intr: tstamp:6611655885 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:4-4503  [000] ....   199.602543: rtcpu_nvcsi_intr: tstamp:6611655885 class:CORRECTABLE_ERR type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:4-4503  [000] ....   199.602547: rtos_queue_send_from_isr_failed: tstamp:6611901763 queue:0x0bcb2e38
     kworker/0:4-4503  [000] ....   199.602549: rtos_queue_send_from_isr_failed: tstamp:6611901911 queue:0x0bcb76a0
     kworker/0:4-4503  [000] ....   199.602551: rtos_queue_send_from_isr_failed: tstamp:6611902056 queue:0x0bcb9220
     kworker/0:4-4503  [000] ....   199.602553: rtos_queue_send_from_isr_failed: tstamp:6611902196 queue:0x0bcb9fe0
     kworker/0:4-4503  [000] ....   199.602555: rtos_queue_send_from_isr_failed: tstamp:6611902336 queue:0x0bcbada0
     kworker/0:4-4503  [000] ....   199.602556: rtcpu_nvcsi_intr: tstamp:6612662829 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:4-4503  [000] ....   199.602558: rtcpu_nvcsi_intr: tstamp:6612662829 class:CORRECTABLE_ERR type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:4-4503  [000] ....   199.658579: rtos_queue_peek_from_isr_failed: tstamp:6613589797 queue:0x0bcbbbb8
     kworker/0:4-4503  [000] ....   199.658588: rtcpu_nvcsi_intr: tstamp:6613669773 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:4-4503  [000] ....   199.658594: rtcpu_nvcsi_intr: tstamp:6613669773 class:CORRECTABLE_ERR type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:4-4503  [000] ....   199.658599: rtcpu_nvcsi_intr: tstamp:6614676718 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:4-4503  [000] ....   199.658603: rtcpu_nvcsi_intr: tstamp:6614676718 class:CORRECTABLE_ERR type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:4-4503  [000] ....   199.714440: rtcpu_nvcsi_intr: tstamp:6615683660 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:4-4503  [000] ....   199.714466: rtcpu_nvcsi_intr: tstamp:6615683660 class:CORRECTABLE_ERR type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:4-4503  [000] ....   199.770405: rtcpu_nvcsi_intr: tstamp:6616690604 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:4-4503  [000] ....   199.770424: rtcpu_nvcsi_intr: tstamp:6616690604 class:CORRECTABLE_ERR type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:4-4503  [000] ....   199.770479: rtcpu_nvcsi_intr: tstamp:6617697549 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:4-4503  [000] ....   199.770494: rtcpu_nvcsi_intr: tstamp:6617697549 class:CORRECTABLE_ERR type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:4-4503  [000] ....   199.826367: rtos_queue_peek_from_isr_failed: tstamp:6618589796 queue:0x0bcbbbb8
     kworker/0:4-4503  [000] ....   199.826388: rtcpu_nvcsi_intr: tstamp:6618704494 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:4-4503  [000] ....   199.826401: rtcpu_nvcsi_intr: tstamp:6618704494 class:CORRECTABLE_ERR type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:4-4503  [000] ....   199.826412: rtcpu_nvcsi_intr: tstamp:6619711438 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:4-4503  [000] ....   199.826424: rtcpu_nvcsi_intr: tstamp:6619711438 class:CORRECTABLE_ERR type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:4-4503  [000] ....   199.882347: rtcpu_nvcsi_intr: tstamp:6620718383 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:4-4503  [000] ....   199.882365: rtcpu_nvcsi_intr: tstamp:6620718383 class:CORRECTABLE_ERR type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:4-4503  [000] ....   199.882377: rtcpu_nvcsi_intr: tstamp:6621725328 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:4-4503  [000] ....   199.882389: rtcpu_nvcsi_intr: tstamp:6621725328 class:CORRECTABLE_ERR type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:4-4503  [000] ....   199.938546: rtcpu_nvcsi_intr: tstamp:6622732273 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:4-4503  [000] ....   199.938571: rtcpu_nvcsi_intr: tstamp:6622732273 class:CORRECTABLE_ERR type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:4-4503  [000] ....   199.994355: rtos_queue_peek_from_isr_failed: tstamp:6623589797 queue:0x0bcbbbb8
     kworker/0:4-4503  [000] ....   199.994377: rtcpu_nvcsi_intr: tstamp:6623739215 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:4-4503  [000] ....   199.994390: rtcpu_nvcsi_intr: tstamp:6623739215 class:CORRECTABLE_ERR type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:4-4503  [000] ....   199.994401: rtcpu_nvcsi_intr: tstamp:6624746160 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:4-4503  [000] ....   199.994413: rtcpu_nvcsi_intr: tstamp:6624746160 class:CORRECTABLE_ERR type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:4-4503  [000] ....   200.050450: rtcpu_nvcsi_intr: tstamp:6625753103 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:4-4503  [000] ....   200.050469: rtcpu_nvcsi_intr: tstamp:6625753103 class:CORRECTABLE_ERR type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:4-4503  [000] ....   204.362088: rtcpu_nvcsi_intr: tstamp:6760683616 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:4-4503  [000] ....   204.362111: rtcpu_nvcsi_intr: tstamp:6760683616 class:CORRECTABLE_ERR type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:4-4503  [000] ....   204.362127: rtcpu_nvcsi_intr: tstamp:6761690561 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:4-4503  [000] ....   204.362142: rtcpu_nvcsi_intr: tstamp:6761690561 class:CORRECTABLE_ERR type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
 vi-output, vc_m-5526  [000] ....   204.398198: tegra_channel_capture_setup: vnc_id 0 W 736 H 540 fmt c5
        v4l2-ctl-5524  [000] ....   204.400556: tegra_channel_set_stream: enable : 0x0
        v4l2-ctl-5524  [000] ....   204.400590: tegra_channel_set_stream: vc_mipi 2-001a : 0x0
     kworker/0:4-4503  [000] ....   204.422260: rtcpu_nvcsi_intr: tstamp:6762697505 class:GLOBAL type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:4-4503  [000] ....   204.422280: rtcpu_nvcsi_intr: tstamp:6762697505 class:CORRECTABLE_ERR type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
     kworker/0:4-4503  [000] ....   204.422298: rtos_queue_send_from_isr_failed: tstamp:6762782815 queue:0x0bcb2e38
     kworker/0:4-4503  [000] ....   204.422309: rtos_queue_send_from_isr_failed: tstamp:6762782961 queue:0x0bcb76a0
     kworker/0:4-4503  [000] ....   204.422319: rtos_queue_send_from_isr_failed: tstamp:6762783105 queue:0x0bcb9220
     kworker/0:4-4503  [000] ....   204.422328: rtos_queue_send_from_isr_failed: tstamp:6762783245 queue:0x0bcb9fe0
     kworker/0:4-4503  [000] ....   204.422338: rtos_queue_send_from_isr_failed: tstamp:6762783385 queue:0x0bcbada0
     kworker/0:4-4503  [000] ....   204.422349: rtos_queue_send_failed: tstamp:6762783996 queue:0x0bcb6938
     kworker/0:4-4503  [000] ....   204.422359: rtos_queue_send_from_isr_failed: tstamp:6762784599 queue:0x0bcb2e38
     kworker/0:4-4503  [000] ....   204.422368: rtos_queue_send_from_isr_failed: tstamp:6762784757 queue:0x0bcb76a0
     kworker/0:4-4503  [000] ....   204.422379: rtos_queue_send_from_isr_failed: tstamp:6762784899 queue:0x0bcb9220
     kworker/0:4-4503  [000] ....   204.422388: rtos_queue_send_from_isr_failed: tstamp:6762785032 queue:0x0bcb9fe0
     kworker/0:4-4503  [000] ....   204.422397: rtos_queue_send_from_isr_failed: tstamp:6762785162 queue:0x0bcbad38
     kworker/0:4-4503  [000] ....   204.422406: rtos_queue_send_from_isr_failed: tstamp:6762785290 queue:0x0bcbada0
     kworker/0:4-4503  [000] ....   204.422419: rtcpu_vinotify_event: tstamp:6762797076 tag:FE channel:0x00 frame:2 vi_tstamp:6762786123 data:0x00000020
     kworker/0:4-4503  [000] ....   204.422430: rtcpu_vinotify_event: tstamp:6762797213 tag:CHANSEL_SHORT_FRAME channel:0x01 frame:2 vi_tstamp:6762786124 data:0x01000000
     kworker/0:4-4503  [000] ....   204.422573: rtcpu_vinotify_event: tstamp:6762797369 tag:ATOMP_FE channel:0x00 frame:2 vi_tstamp:6762786125 data:0x00000000
     kworker/0:4-4503  [000] ....   204.422584: rtos_queue_send_from_isr_failed: tstamp:6762832195 queue:0x0bcb2e38
     kworker/0:4-4503  [000] ....   204.422594: rtos_queue_send_from_isr_failed: tstamp:6762832340 queue:0x0bcb76a0
     kworker/0:4-4503  [000] ....   204.422604: rtos_queue_send_from_isr_failed: tstamp:6762832485 queue:0x0bcb9220
     kworker/0:4-4503  [000] ....   204.422613: rtos_queue_send_from_isr_failed: tstamp:6762832626 queue:0x0bcb9fe0
     kworker/0:4-4503  [000] ....   204.422622: rtos_queue_send_from_isr_failed: tstamp:6762832764 queue:0x0bcbada0
     kworker/0:4-4503  [000] ....   204.422632: rtos_queue_send_from_isr_failed: tstamp:6762894394 queue:0x0bcb2e38
     kworker/0:4-4503  [000] ....   204.422641: rtos_queue_send_from_isr_failed: tstamp:6762894537 queue:0x0bcb76a0
     kworker/0:4-4503  [000] ....   204.422650: rtos_queue_send_from_isr_failed: tstamp:6762894679 queue:0x0bcb9220
     kworker/0:4-4503  [000] ....   204.422659: rtos_queue_send_from_isr_failed: tstamp:6762894820 queue:0x0bcb9fe0
     kworker/0:4-4503  [000] ....   204.422669: rtos_queue_send_from_isr_failed: tstamp:6762894960 queue:0x0bcbada0
     kworker/0:4-4503  [000] ....   204.422678: rtos_queue_send_from_isr_failed: tstamp:6762906732 queue:0x0bcb2e38
     kworker/0:4-4503  [000] ....   204.422687: rtos_queue_send_from_isr_failed: tstamp:6762906872 queue:0x0bcb76a0
     kworker/0:4-4503  [000] ....   204.422696: rtos_queue_send_from_isr_failed: tstamp:6762907012 queue:0x0bcb9220
     kworker/0:4-4503  [000] ....   204.422706: rtos_queue_send_from_isr_failed: tstamp:6762907151 queue:0x0bcb9fe0
     kworker/0:4-4503  [000] ....   204.422715: rtos_queue_send_from_isr_failed: tstamp:6762907290 queue:0x0bcbada0
     kworker/0:4-4503  [000] ....   204.422724: rtos_queue_send_from_isr_failed: tstamp:6762958066 queue:0x0bcb2e38
     kworker/0:4-4503  [000] ....   204.422733: rtos_queue_send_from_isr_failed: tstamp:6762958210 queue:0x0bcb76a0
     kworker/0:4-4503  [000] ....   204.422743: rtos_queue_send_from_isr_failed: tstamp:6762958354 queue:0x0bcb9220
     kworker/0:4-4503  [000] ....   204.422752: rtos_queue_send_from_isr_failed: tstamp:6762958493 queue:0x0bcb9fe0
     kworker/0:4-4503  [000] ....   204.422761: rtos_queue_send_from_isr_failed: tstamp:6762958629 queue:0x0bcbada0
     kworker/0:4-4503  [000] ....   204.422772: rtcpu_string: tstamp:6762959104 id:0x04010000 str:"Configuring VI GoS.
"
     kworker/0:4-4503  [000] ....   204.422847: rtcpu_string: tstamp:6762959315 id:0x04010000 str:"VM GOS[#0] addr=0xc2100000
"
     kworker/0:4-4503  [000] ....   204.422891: rtcpu_string: tstamp:6762959560 id:0x04010000 str:"VM GOS[#1] addr=0xc2101000
"
     kworker/0:4-4503  [000] ....   204.422933: rtcpu_string: tstamp:6762959795 id:0x04010000 str:"VM GOS[#2] addr=0xc2102000
"
     kworker/0:4-4503  [000] ....   204.422972: rtcpu_string: tstamp:6762960019 id:0x04010000 str:"VM GOS[#3] addr=0xc2103000
"
     kworker/0:4-4503  [000] ....   204.423011: rtcpu_string: tstamp:6762960259 id:0x04010000 str:"VM GOS[#4] addr=0xc2104000
"
     kworker/0:4-4503  [000] ....   204.423188: rtcpu_string: tstamp:6762960482 id:0x04010000 str:"VM GOS[#5] addr=0xc2105000
"
     kworker/0:4-4503  [000] ....   204.423252: rtos_queue_peek_from_isr_failed: tstamp:6763589795 queue:0x0bcbbbb8
        v4l2-ctl-5524  [001] ....   204.454222: tegra_channel_set_stream: 15a00000.nvcsi--3 : 0x0
        v4l2-ctl-5524  [001] ....   204.454266: csi_s_stream: enable : 0x0
        v4l2-ctl-5524  [000] ....   204.475573: tegra_channel_close: vi-output, vc_mipi 2-001a
        v4l2-ctl-5524  [000] ....   204.475593: tegra_channel_set_power: vc_mipi 2-001a : 0x0
        v4l2-ctl-5524  [000] ....   204.475612: camera_common_s_power: status : 0x0
        v4l2-ctl-5524  [000] ....   204.475845: tegra_channel_set_power: 15a00000.nvcsi--3 : 0x0
        v4l2-ctl-5524  [000] ....   204.475854: csi_s_power: enable : 0x0
     kworker/0:4-4503  [000] ....   204.477807: rtos_queue_send_from_isr_failed: tstamp:6764685456 queue:0x0bcb2e38
     kworker/0:4-4503  [000] ....   204.477817: rtos_queue_send_from_isr_failed: tstamp:6764685600 queue:0x0bcb76a0
     kworker/0:4-4503  [000] ....   204.477822: rtos_queue_send_from_isr_failed: tstamp:6764685744 queue:0x0bcb9220
     kworker/0:4-4503  [000] ....   204.477830: rtos_queue_send_from_isr_failed: tstamp:6764685884 queue:0x0bcb9fe0
     kworker/0:4-4503  [000] ....   204.477835: rtos_queue_send_from_isr_failed: tstamp:6764686037 queue:0x0bcbada0
     kworker/0:4-4503  [000] ....   204.477840: rtos_queue_send_from_isr_failed: tstamp:6764935675 queue:0x0bcb2e38
     kworker/0:4-4503  [000] ....   204.477845: rtos_queue_send_from_isr_failed: tstamp:6764935824 queue:0x0bcb76a0
     kworker/0:4-4503  [000] ....   204.477851: rtos_queue_send_from_isr_failed: tstamp:6764935976 queue:0x0bcb9220

Many thanks in advance

Andrea

3

hello andrea.pascolini,

is this your sensor output format types?

Y10 is not a default support pixel formats, did you also modify sensor driver to extent the formats?
for example, $public_sources/kernel_src/kernel/nvidia/drivers/media/platform/tegra/camera/sensor_common.c
static int extract_pixel_format(const char *pixel_t, u32 *format){...}

regarding to below VI tracing logs…
there shows correctable error, STREAM_VC=0x4 which indicate packet payload CRC check failed.
CHANSEL_FAULT shows the pixel spurious errors, it has an issue with embedded metadata.

rtcpu_nvcsi_intr: tstamp:6606621164 class:CORRECTABLE_ERR type:STREAM_VC phy:0 cil:0 st:0 vc:0 status:0x00000004
rtcpu_vinotify_event: tstamp:6606828234 tag:CHANSEL_FAULT channel:0x23 frame:2 vi_tstamp:6606617412 data:0x00013008

is your SerDes chips sending not only camera frames but also embedded data?
please try disable sending embedded metadata for confirmation.

4

Hello Jerry, thanks for your answer.

Yes, I am using a modified driver to support RAW10 data acquisition.

Updates on the issue:

  • I found a configuration problem in CSI aggregator RX stage, fixed, I am now able to get an image
    image
  • there are clearly pixel errors
  • I am still getting CORRECTABLE_ERR in trace logs

I know my CSI aggregator might be affected by TX hardware issues that could explain the artifacts, working to fix them.
If CORRECTABLE_ERR are related to CRC faults, could they really represent the broken pixels we see in the image?

Thanks for the help

Andrea

5

hello andrea.pascolini,

I don’t think CRC faults introduce artifacts, that looks like dirty signaling on the CSI channel.
regarding to your latest VI tracing logs. did you still seeing CHANSEL_FAULT errors?

6

Hello Jerry,

yes, CHANSEL_FAULT messages still there.
I forgot to answer about metadata: when directly connecting my IMX297-based sensor module to a Jetson CSI port, I had to set embedded_metadata_height camera attribute to 2 in the device tree,
Adding the CSI aggregator in between, configured for a different application then the current one, I had to set the same parameter to 0 to avoid periodic channel timeout/reset, as described here.
Now I am not getting channel resets, just band-like artifacts

Thanks

Andrea

7

hello andrea.pascolini,

just for confirmation, is the camera signaling actually sending 2-row metadata or not?

8

According to the default device-tree provided by camera module vendor I would say yes, as the relative parameter is set to 2. CSI aggregator manufacturer does not say anything about metadata. Is there a suggested way to check Jetson-side?

Thanks

Andrea

9

hello andrea.pascolini,

that VI tracing logs already indicate there’s an issue with embedded metadata.

FYI,
we should program with proper settings and update “embedded_metadata_height” param in corresponding DT and rest should be normal like other sensors embedded data path.

furthermore, for the spurious data error code. you may refer to a note from GMSL user guide (re-cap as below). please also review deserializer side,

“Video pipes generate frame start (FS) and frame end (FE) short packets when streaming video.
If two video pipes are carrying two different datatypes (i.e image frames + embedded lines) from the same image,
only one of the FS/FE pairs is needed. Generating the extra FS/FE pair without mapping will result in a line buffer overflow.”

please see-also Topic 235004 for reference,
thanks

10

Hello Jerry,

after changing settings in the CSI aggregator, I did manage to get clean images and stream. I am still having CHANSEL and CORRECTABLE faults in the trace log, but they seem not affecting streaming operation, and trying different metadata settings does not solves. Thanks for suggesting the GMSL user guide excerpt about short packets, this is something worth investigating to remove these last warnings, will look at it asap. Given the working streaming, I do not have other questions on the topic for now

Thanks

Andrea

11

hello andrea.pascolini,

let’s close this topic, and you may initial another new discussion thread for digging into this if necessary.

13

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.