Custom module working in v4l2 but no response in nvgstcapture-1.0 / libargus

Hi!

We designed a custom module based on the AR0521 imager and are currently developing the kernel / device tree modules for it.
I configured the sensor to stream a solid color test pattern and when I use v4l2-ctl I get the correct raw output, specifically the output of the following command:

v4l2-ctl --verbose --list-framesizes=RG10 --set-fmt-video=width=2592,height=1944,pixelformat=RG10 --set-ctrl bypass_mode=0 --stream-mmap --stream-count=1 --stream-to=test.raw -d /dev/video0

is the following:

VIDIOC_QUERYCAP: ok
VIDIOC_S_EXT_CTRLS: ok
VIDIOC_G_FMT: ok
VIDIOC_S_FMT: ok
Format Video Capture:
	Width/Height      : 2592/1944
	Pixel Format      : 'RG10'
	Field             : None
	Bytes per Line    : 5184
	Size Image        : 10077696
	Colorspace        : sRGB
	Transfer Function : Default (maps to sRGB)
	YCbCr/HSV Encoding: Default (maps to ITU-R 601)
	Quantization      : Default (maps to Full Range)
	Flags             : 
VIDIOC_REQBUFS: ok
VIDIOC_QUERYBUF: ok
VIDIOC_QBUF: ok
VIDIOC_QUERYBUF: ok
VIDIOC_QBUF: ok
VIDIOC_QUERYBUF: ok
VIDIOC_QBUF: ok
VIDIOC_QUERYBUF: ok
VIDIOC_QBUF: ok
VIDIOC_STREAMON: ok
	Index    : 0
	Type     : Video Capture
	Flags    : mapped
	Field    : None
	Sequence : 0
	Length   : 10077696
	Bytesused: 10077696
	Timestamp: 135.227435s (Monotonic, End-of-Frame)

VIDIOC_STREAMOFF: ok

ioctl: VIDIOC_ENUM_FRAMESIZES
	Size: Discrete 2592x1944

And the test.raw file has the expected data. However when I run nvgstcapture-1.0 I get no response from the sensor.
Below is the kernel trace output both with v4l2-ctl and nvgstcapture (v4l2 is around 181 seconds and shows no errors, nvgstcapture starts at about 188 seconds and shows no activity at all on the MIPI lane).

     kworker/0:2-1144  [000] ....   177.497714: rtos_queue_send_from_isr_failed: tstamp:6080670573 queue:0x0bcb41f8
     kworker/0:2-1144  [000] ....   177.497715: rtos_queue_send_from_isr_failed: tstamp:6080671079 queue:0x0bcb8a60
     kworker/0:2-1144  [000] ....   177.497716: rtos_queue_send_from_isr_failed: tstamp:6080671595 queue:0x0bcba5e0
     kworker/0:2-1144  [000] ....   177.497716: rtos_queue_send_from_isr_failed: tstamp:6080672097 queue:0x0bcbb3a0
     kworker/0:2-1144  [000] ....   177.497717: rtos_queue_send_from_isr_failed: tstamp:6080672598 queue:0x0bcbc160
     kworker/0:2-1144  [000] ....   177.553623: rtos_queue_peek_from_isr_failed: tstamp:6082012861 queue:0x0bcbcf78
     kworker/0:2-1144  [000] ....   177.721611: rtos_queue_peek_from_isr_failed: tstamp:6087012853 queue:0x0bcbcf78
     kworker/0:2-1144  [000] ....   177.889599: rtos_queue_peek_from_isr_failed: tstamp:6092012854 queue:0x0bcbcf78
     kworker/0:2-1144  [000] ....   178.001593: rtos_queue_peek_from_isr_failed: tstamp:6097012858 queue:0x0bcbcf78
     kworker/0:2-1144  [000] ....   178.169593: rtos_queue_peek_from_isr_failed: tstamp:6102012854 queue:0x0bcbcf78
     kworker/0:2-1144  [000] ....   178.337646: rtos_queue_peek_from_isr_failed: tstamp:6107012854 queue:0x0bcbcf78
     kworker/0:2-1144  [000] ....   178.505585: rtos_queue_peek_from_isr_failed: tstamp:6112012856 queue:0x0bcbcf78
     kworker/0:2-1144  [000] ....   178.673615: rtos_queue_peek_from_isr_failed: tstamp:6117012854 queue:0x0bcbcf78
     kworker/0:2-1144  [000] ....   178.841624: rtos_queue_peek_from_isr_failed: tstamp:6122012853 queue:0x0bcbcf78
     kworker/0:2-1144  [000] ....   179.009574: rtos_queue_peek_from_isr_failed: tstamp:6127012865 queue:0x0bcbcf78
     kworker/0:2-1144  [000] ....   179.121609: rtos_queue_peek_from_isr_failed: tstamp:6132012854 queue:0x0bcbcf78
     kworker/0:2-1144  [000] ....   179.289657: rtos_queue_peek_from_isr_failed: tstamp:6137012853 queue:0x0bcbcf78
     kworker/0:2-1144  [000] ....   179.457580: rtos_queue_peek_from_isr_failed: tstamp:6142012853 queue:0x0bcbcf78
     kworker/0:2-1144  [000] ....   179.625561: rtos_queue_peek_from_isr_failed: tstamp:6147012853 queue:0x0bcbcf78
     kworker/0:2-1144  [000] ....   179.793644: rtos_queue_peek_from_isr_failed: tstamp:6152012853 queue:0x0bcbcf78
     kworker/0:2-1144  [000] ....   179.961592: rtos_queue_peek_from_isr_failed: tstamp:6157012859 queue:0x0bcbcf78
     kworker/0:2-1144  [000] ....   180.129574: rtos_queue_peek_from_isr_failed: tstamp:6162012853 queue:0x0bcbcf78
     kworker/0:2-1144  [000] ....   180.241577: rtos_queue_peek_from_isr_failed: tstamp:6167012854 queue:0x0bcbcf78
     kworker/0:2-1144  [000] ....   180.409575: rtos_queue_peek_from_isr_failed: tstamp:6172012853 queue:0x0bcbcf78
     kworker/0:2-1144  [000] ....   180.577590: rtos_queue_peek_from_isr_failed: tstamp:6177012867 queue:0x0bcbcf78
     kworker/0:2-1144  [000] ....   180.745594: rtos_queue_peek_from_isr_failed: tstamp:6182012862 queue:0x0bcbcf78
     kworker/0:2-1144  [000] ....   180.913546: rtos_queue_peek_from_isr_failed: tstamp:6187012850 queue:0x0bcbcf78
     kworker/0:2-1144  [000] ....   181.081565: rtos_queue_peek_from_isr_failed: tstamp:6192012854 queue:0x0bcbcf78
        v4l2-ctl-7981  [000] ....   181.111026: tegra_channel_open: vi-output, ovc4cam 9-0010
        v4l2-ctl-7981  [000] ....   181.111038: tegra_channel_set_power: ovc4cam 9-0010 : 0x1
        v4l2-ctl-7981  [000] ....   181.111052: camera_common_s_power: status : 0x1
        v4l2-ctl-7981  [000] ....   181.111254: tegra_channel_set_power: 15a00000.nvcsi--1 : 0x1
        v4l2-ctl-7981  [000] ....   181.111257: csi_s_power: enable : 0x1
        v4l2-ctl-7981  [000] ....   181.120640: tegra_channel_capture_setup: vnc_id 0 W 2592 H 1944 fmt c4
        v4l2-ctl-7981  [000] ....   181.121246: tegra_channel_set_stream: enable : 0x1
        v4l2-ctl-7981  [000] ....   181.123172: tegra_channel_set_stream: 15a00000.nvcsi--1 : 0x1
        v4l2-ctl-7981  [000] ....   181.123175: csi_s_stream: enable : 0x1
        v4l2-ctl-7981  [000] ....   181.123182: tegra_channel_set_stream: ovc4cam 9-0010 : 0x1
     kworker/0:2-1144  [000] ....   181.137619: rtos_queue_send_from_isr_failed: tstamp:6194605481 queue:0x0bcb41f8
     kworker/0:2-1144  [000] ....   181.137622: rtos_queue_send_from_isr_failed: tstamp:6194605633 queue:0x0bcb8a60
     kworker/0:2-1144  [000] ....   181.137623: rtos_queue_send_from_isr_failed: tstamp:6194605782 queue:0x0bcba5e0
     kworker/0:2-1144  [000] ....   181.137624: rtos_queue_send_from_isr_failed: tstamp:6194605930 queue:0x0bcbb3a0
     kworker/0:2-1144  [000] ....   181.137625: rtos_queue_send_from_isr_failed: tstamp:6194606075 queue:0x0bcbc160
     kworker/0:2-1144  [000] ....   181.137627: rtcpu_string: tstamp:6194606504 id:0x04010000 str:"Configuring VI GoS.
"
     kworker/0:2-1144  [000] ....   181.137657: rtcpu_string: tstamp:6194606683 id:0x04010000 str:"VM GOS[#0] addr=0xc2100000
"
     kworker/0:2-1144  [000] ....   181.137742: rtcpu_string: tstamp:6194606940 id:0x04010000 str:"VM GOS[#1] addr=0xc2101000
"
     kworker/0:2-1144  [000] ....   181.137750: rtcpu_string: tstamp:6194607208 id:0x04010000 str:"VM GOS[#2] addr=0xc2102000
"
     kworker/0:2-1144  [000] ....   181.137759: rtcpu_string: tstamp:6194607442 id:0x04010000 str:"VM GOS[#3] addr=0xc2103000
"
     kworker/0:2-1144  [000] ....   181.137767: rtcpu_string: tstamp:6194607674 id:0x04010000 str:"VM GOS[#4] addr=0xc2104000
"
     kworker/0:2-1144  [000] ....   181.137774: rtcpu_string: tstamp:6194607906 id:0x04010000 str:"VM GOS[#5] addr=0xc2105000
"
     kworker/0:2-1144  [000] ....   181.137783: rtos_queue_send_from_isr_failed: tstamp:6194615055 queue:0x0bcb41f8
     kworker/0:2-1144  [000] ....   181.137784: rtos_queue_send_from_isr_failed: tstamp:6194615205 queue:0x0bcb8a60
     kworker/0:2-1144  [000] ....   181.137785: rtos_queue_send_from_isr_failed: tstamp:6194615357 queue:0x0bcba5e0
     kworker/0:2-1144  [000] ....   181.137785: rtos_queue_send_from_isr_failed: tstamp:6194615502 queue:0x0bcbb3a0
     kworker/0:2-1144  [000] ....   181.137786: rtos_queue_send_from_isr_failed: tstamp:6194615647 queue:0x0bcbc160
     kworker/0:2-1144  [000] ....   181.137787: rtos_queue_send_from_isr_failed: tstamp:6194677254 queue:0x0bcb41f8
     kworker/0:2-1144  [000] ....   181.137788: rtos_queue_send_from_isr_failed: tstamp:6194677403 queue:0x0bcb8a60
     kworker/0:2-1144  [000] ....   181.137788: rtos_queue_send_from_isr_failed: tstamp:6194677555 queue:0x0bcba5e0
     kworker/0:2-1144  [000] ....   181.137789: rtos_queue_send_from_isr_failed: tstamp:6194677703 queue:0x0bcbb3a0
     kworker/0:2-1144  [000] ....   181.137790: rtos_queue_send_from_isr_failed: tstamp:6194677849 queue:0x0bcbc160
     kworker/0:2-1144  [000] ....   181.137792: rtcpu_vinotify_error: tstamp:6194686429 tag:CSIMUX_STREAM channel:0x00 frame:0 vi_tstamp:6194683580 data:0x00000001
     kworker/0:2-1144  [000] ....   181.137794: rtcpu_vinotify_event: tstamp:6194858149 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:4954224768 data:0x10000000
     kworker/0:2-1144  [000] ....   181.137795: rtcpu_vinotify_event: tstamp:6194858316 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:4954233088 data:0x31000001
     kworker/0:2-1144  [000] ....   181.137796: rtcpu_vinotify_event: tstamp:6194858456 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:4954235264 data:0x07020001
     kworker/0:2-1144  [000] ....   181.137797: rtcpu_vinotify_event: tstamp:6194858614 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:4954269152 data:0x10000000
     kworker/0:2-1144  [000] ....   181.137798: rtcpu_vinotify_event: tstamp:6194858749 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:4954277536 data:0x31000002
     kworker/0:2-1144  [000] ....   181.137798: rtcpu_vinotify_event: tstamp:6194858915 tag:CSIMUX_STREAM channel:0x00 frame:0 vi_tstamp:6194683580 data:0x00000001
 vi-output, ovc4-7983  [000] ....   181.169175: tegra_channel_capture_frame: sof:198.248740224
 vi-output, ovc4-7983  [000] ....   181.169180: tegra_channel_capture_frame: eof:198.275412544
     kworker/0:2-1144  [000] ....   181.193545: rtcpu_vinotify_event: tstamp:6195277301 tag:FS channel:0x00 frame:38 vi_tstamp:6195273109 data:0x00000010
     kworker/0:2-1144  [000] ....   181.193547: rtcpu_vinotify_event: tstamp:6195277463 tag:ATOMP_FS channel:0x00 frame:38 vi_tstamp:6195273111 data:0x00000000
     kworker/0:2-1144  [000] ....   181.193548: rtcpu_vinotify_event: tstamp:6195277600 tag:CHANSEL_PXL_SOF channel:0x23 frame:38 vi_tstamp:6195273132 data:0x00000001
     kworker/0:2-1144  [000] ....   181.193554: rtcpu_vinotify_event: tstamp:6195780769 tag:RESERVED_19 channel:0x23 frame:38 vi_tstamp:4975234176 data:0x08020001
     kworker/0:2-1144  [000] ....   181.193555: rtcpu_vinotify_event: tstamp:6196323263 tag:CHANSEL_PXL_EOF channel:0x23 frame:38 vi_tstamp:6196106616 data:0x07970002
     kworker/0:2-1144  [000] ....   181.193556: rtcpu_vinotify_event: tstamp:6196323422 tag:FE channel:0x00 frame:38 vi_tstamp:6196106633 data:0x00000020
     kworker/0:2-1144  [000] ....   181.193556: rtcpu_vinotify_event: tstamp:6196323566 tag:ATOMP_FE channel:0x00 frame:38 vi_tstamp:6196106635 data:0x00000000
     kworker/0:2-1144  [000] ....   181.193557: rtcpu_vinotify_event: tstamp:6196323724 tag:ATOMP_FRAME_DONE channel:0x23 frame:38 vi_tstamp:6196106642 data:0x00000000
     kworker/0:2-1144  [000] ....   181.193557: rtcpu_vinotify_event: tstamp:6196323860 tag:RESERVED_19 channel:0x23 frame:38 vi_tstamp:5001904576 data:0x02020001
     kworker/0:2-1144  [000] ....   181.193558: rtcpu_vinotify_event: tstamp:6196324017 tag:RESERVED_19 channel:0x23 frame:38 vi_tstamp:5001916832 data:0x00020001
     kworker/0:2-1144  [000] ....   181.193558: rtcpu_vinotify_event: tstamp:6196324154 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:5001938656 data:0x07020002
     kworker/0:2-1144  [000] ....   181.193581: rtcpu_vinotify_event: tstamp:6196865818 tag:FS channel:0x00 frame:39 vi_tstamp:6196453071 data:0x00000010
     kworker/0:2-1144  [000] ....   181.193582: rtcpu_vinotify_event: tstamp:6196865964 tag:ATOMP_FS channel:0x00 frame:39 vi_tstamp:6196453073 data:0x00000000
     kworker/0:2-1144  [000] ....   181.193582: rtcpu_vinotify_event: tstamp:6196866123 tag:CHANSEL_PXL_SOF channel:0x23 frame:39 vi_tstamp:6196453093 data:0x00000001
     kworker/0:2-1144  [000] ....   181.193583: rtcpu_vinotify_event: tstamp:6196866259 tag:RESERVED_19 channel:0x23 frame:39 vi_tstamp:5012986912 data:0x08020002
     kworker/0:2-1144  [000] ....   181.193583: rtcpu_vinotify_event: tstamp:6196866420 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:5013169952 data:0x10000000
     kworker/0:2-1144  [000] ....   181.193584: rtcpu_vinotify_event: tstamp:6196866555 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:5013199648 data:0x31000003
 vi-output, ovc4-7983  [000] ....   181.206986: tegra_channel_capture_frame: sof:198.286498976
 vi-output, ovc4-7983  [000] ....   181.206990: tegra_channel_capture_frame: eof:198.313171264
 vi-output, ovc4-7983  [000] ....   181.244747: tegra_channel_capture_frame: sof:198.324257792
 vi-output, ovc4-7983  [000] ....   181.244752: tegra_channel_capture_frame: eof:198.350930080
        v4l2-ctl-7981  [000] ....   181.244833: tegra_channel_set_stream: enable : 0x0
        v4l2-ctl-7981  [000] ....   181.244836: tegra_channel_set_stream: ovc4cam 9-0010 : 0x0
        v4l2-ctl-7981  [000] ....   181.244848: tegra_channel_set_stream: 15a00000.nvcsi--1 : 0x0
        v4l2-ctl-7981  [000] ....   181.244850: csi_s_stream: enable : 0x0
     kworker/0:2-1144  [000] ....   181.249536: rtos_queue_peek_from_isr_failed: tstamp:6197012679 queue:0x0bcbcf78
     kworker/0:2-1144  [000] ....   181.249539: rtcpu_vinotify_event: tstamp:6197291510 tag:CHANSEL_PXL_EOF channel:0x23 frame:39 vi_tstamp:6197286578 data:0x07970002
     kworker/0:2-1144  [000] ....   181.249541: rtcpu_vinotify_event: tstamp:6197291651 tag:FE channel:0x00 frame:39 vi_tstamp:6197286594 data:0x00000020
     kworker/0:2-1144  [000] ....   181.249547: rtos_queue_send_from_isr_failed: tstamp:6197600052 queue:0x0bcb41f8
     kworker/0:2-1144  [000] ....   181.249548: rtos_queue_send_from_isr_failed: tstamp:6197600205 queue:0x0bcb8a60
     kworker/0:2-1144  [000] ....   181.249549: rtos_queue_send_from_isr_failed: tstamp:6197600358 queue:0x0bcba5e0
     kworker/0:2-1144  [000] ....   181.249550: rtos_queue_send_from_isr_failed: tstamp:6197600503 queue:0x0bcbb3a0
     kworker/0:2-1144  [000] ....   181.249550: rtos_queue_send_from_isr_failed: tstamp:6197600647 queue:0x0bcbc160
     kworker/0:2-1144  [000] ....   181.249552: rtcpu_vinotify_event: tstamp:6197788199 tag:ATOMP_FE channel:0x00 frame:39 vi_tstamp:6197286598 data:0x00000000
     kworker/0:2-1144  [000] ....   181.249553: rtcpu_vinotify_event: tstamp:6197788343 tag:ATOMP_FRAME_DONE channel:0x23 frame:39 vi_tstamp:6197286602 data:0x00000000
     kworker/0:2-1144  [000] ....   181.249554: rtcpu_vinotify_event: tstamp:6197788505 tag:RESERVED_19 channel:0x23 frame:39 vi_tstamp:5039669248 data:0x02020002
     kworker/0:2-1144  [000] ....   181.249555: rtcpu_vinotify_event: tstamp:6197788641 tag:RESERVED_19 channel:0x23 frame:39 vi_tstamp:5039681824 data:0x00020002
     kworker/0:2-1144  [000] ....   181.249555: rtcpu_vinotify_event: tstamp:6197788800 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:5039704128 data:0x07020003
     kworker/0:2-1144  [000] ....   181.249556: rtcpu_vinotify_event: tstamp:6197788938 tag:FS channel:0x00 frame:40 vi_tstamp:6197633032 data:0x00000010
     kworker/0:2-1144  [000] ....   181.249557: rtcpu_vinotify_event: tstamp:6197789098 tag:ATOMP_FS channel:0x00 frame:40 vi_tstamp:6197633036 data:0x00000000
     kworker/0:2-1144  [000] ....   181.249558: rtcpu_vinotify_event: tstamp:6197789233 tag:CHANSEL_PXL_SOF channel:0x23 frame:40 vi_tstamp:6197633056 data:0x00000001
     kworker/0:2-1144  [000] ....   181.249559: rtcpu_vinotify_event: tstamp:6197789391 tag:RESERVED_19 channel:0x23 frame:40 vi_tstamp:5050745760 data:0x08020003
     kworker/0:2-1144  [000] ....   181.249560: rtcpu_vinotify_event: tstamp:6197789524 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:5050935840 data:0x10000000
     kworker/0:2-1144  [000] ....   181.249560: rtcpu_vinotify_event: tstamp:6197789681 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:5050965504 data:0x31000004
     kworker/0:2-1144  [000] ....   181.249561: rtcpu_vinotify_event: tstamp:6198471476 tag:CHANSEL_PXL_EOF channel:0x23 frame:40 vi_tstamp:6198466541 data:0x07970002
     kworker/0:2-1144  [000] ....   181.249562: rtcpu_vinotify_event: tstamp:6198471638 tag:FE channel:0x00 frame:40 vi_tstamp:6198466557 data:0x00000020
     kworker/0:2-1144  [000] ....   181.249563: rtcpu_vinotify_event: tstamp:6198471783 tag:ATOMP_FE channel:0x00 frame:40 vi_tstamp:6198466559 data:0x00000000
     kworker/0:2-1144  [000] ....   181.249564: rtcpu_vinotify_event: tstamp:6198471943 tag:ATOMP_FRAME_DONE channel:0x23 frame:40 vi_tstamp:6198466565 data:0x00000000
     kworker/0:2-1144  [000] ....   181.249565: rtcpu_vinotify_event: tstamp:6198472080 tag:RESERVED_19 channel:0x23 frame:40 vi_tstamp:5077422144 data:0x02020003
     kworker/0:2-1144  [000] ....   181.249591: rtos_queue_send_from_isr_failed: tstamp:6198479623 queue:0x0bcb41f8
     kworker/0:2-1144  [000] ....   181.249592: rtos_queue_send_from_isr_failed: tstamp:6198479777 queue:0x0bcb8a60
     kworker/0:2-1144  [000] ....   181.249593: rtos_queue_send_from_isr_failed: tstamp:6198479930 queue:0x0bcba5e0
     kworker/0:2-1144  [000] ....   181.249594: rtos_queue_send_from_isr_failed: tstamp:6198480078 queue:0x0bcbb3a0
     kworker/0:2-1144  [000] ....   181.249594: rtos_queue_send_from_isr_failed: tstamp:6198480223 queue:0x0bcbc160
     kworker/0:2-1144  [000] ....   181.249595: rtos_queue_send_from_isr_failed: tstamp:6198569134 queue:0x0bcb41f8
     kworker/0:2-1144  [000] ....   181.249596: rtos_queue_send_from_isr_failed: tstamp:6198569282 queue:0x0bcb8a60
     kworker/0:2-1144  [000] ....   181.249597: rtos_queue_send_from_isr_failed: tstamp:6198569432 queue:0x0bcba5e0
     kworker/0:2-1144  [000] ....   181.249597: rtos_queue_send_from_isr_failed: tstamp:6198569580 queue:0x0bcbb3a0
     kworker/0:2-1144  [000] ....   181.249598: rtos_queue_send_from_isr_failed: tstamp:6198569727 queue:0x0bcbc160
        v4l2-ctl-7981  [000] ....   181.263944: tegra_channel_close: vi-output, ovc4cam 9-0010
        v4l2-ctl-7981  [000] ....   181.266153: tegra_channel_set_power: ovc4cam 9-0010 : 0x0
        v4l2-ctl-7981  [000] ....   181.266161: camera_common_s_power: status : 0x0
        v4l2-ctl-7981  [000] ....   181.266234: tegra_channel_set_power: 15a00000.nvcsi--1 : 0x0
        v4l2-ctl-7981  [000] ....   181.266236: csi_s_power: enable : 0x0
     kworker/0:2-1144  [000] ....   181.305547: rtcpu_vinotify_event: tstamp:6198800265 tag:RESERVED_19 channel:0x23 frame:40 vi_tstamp:5077440672 data:0x00020003
     kworker/0:2-1144  [000] ....   181.305551: rtcpu_vinotify_event: tstamp:6198800758 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:5077462976 data:0x07020004
     kworker/0:2-1144  [000] ....   181.361529: rtos_queue_peek_from_isr_failed: tstamp:6202012680 queue:0x0bcbcf78
     kworker/0:2-1144  [000] ....   181.529564: rtos_queue_peek_from_isr_failed: tstamp:6207012883 queue:0x0bcbcf78
     kworker/0:2-1144  [000] ....   181.697591: rtos_queue_peek_from_isr_failed: tstamp:6212012852 queue:0x0bcbcf78
     kworker/0:2-1144  [000] ....   181.865610: rtos_queue_peek_from_isr_failed: tstamp:6217012863 queue:0x0bcbcf78
     kworker/0:2-1144  [000] ....   182.033551: rtos_queue_peek_from_isr_failed: tstamp:6222012853 queue:0x0bcbcf78
     kworker/0:2-1144  [000] ....   182.201550: rtos_queue_peek_from_isr_failed: tstamp:6227012853 queue:0x0bcbcf78
     kworker/0:2-1144  [000] ....   182.369518: rtos_queue_peek_from_isr_failed: tstamp:6232012853 queue:0x0bcbcf78
     kworker/0:2-1144  [000] ....   182.481555: rtos_queue_peek_from_isr_failed: tstamp:6237012853 queue:0x0bcbcf78
     kworker/0:2-1144  [000] ....   182.649557: rtos_queue_peek_from_isr_failed: tstamp:6242012863 queue:0x0bcbcf78
     kworker/0:2-1144  [000] ....   182.817542: rtos_queue_peek_from_isr_failed: tstamp:6247012852 queue:0x0bcbcf78
     kworker/0:2-1144  [000] ....   182.985525: rtos_queue_peek_from_isr_failed: tstamp:6252012853 queue:0x0bcbcf78
     kworker/0:2-1144  [000] ....   183.153643: rtos_queue_peek_from_isr_failed: tstamp:6257012858 queue:0x0bcbcf78
     kworker/0:2-1144  [000] ....   183.321587: rtos_queue_peek_from_isr_failed: tstamp:6262012859 queue:0x0bcbcf78
     kworker/0:2-1144  [000] ....   183.489601: rtos_queue_peek_from_isr_failed: tstamp:6267012865 queue:0x0bcbcf78
     kworker/0:2-1144  [000] ....   183.601562: rtos_queue_peek_from_isr_failed: tstamp:6272012871 queue:0x0bcbcf78
     kworker/0:2-1144  [000] ....   183.769568: rtos_queue_peek_from_isr_failed: tstamp:6277012854 queue:0x0bcbcf78
     kworker/0:2-1144  [000] ....   183.937536: rtos_queue_peek_from_isr_failed: tstamp:6282012857 queue:0x0bcbcf78
     kworker/0:2-1144  [000] ....   184.105595: rtos_queue_peek_from_isr_failed: tstamp:6287012856 queue:0x0bcbcf78
     kworker/0:2-1144  [000] ....   184.273553: rtos_queue_peek_from_isr_failed: tstamp:6292012850 queue:0x0bcbcf78
     kworker/0:2-1144  [000] ....   184.441510: rtos_queue_peek_from_isr_failed: tstamp:6297012858 queue:0x0bcbcf78
     kworker/0:2-1144  [000] ....   184.609570: rtos_queue_peek_from_isr_failed: tstamp:6302012858 queue:0x0bcbcf78
     kworker/0:2-1144  [000] ....   184.721601: rtos_queue_peek_from_isr_failed: tstamp:6307012853 queue:0x0bcbcf78
     kworker/0:2-1144  [000] ....   184.889530: rtos_queue_peek_from_isr_failed: tstamp:6312012857 queue:0x0bcbcf78
     kworker/0:2-1144  [000] ....   185.057528: rtos_queue_peek_from_isr_failed: tstamp:6317012867 queue:0x0bcbcf78
     kworker/0:2-1144  [000] ....   185.225606: rtos_queue_peek_from_isr_failed: tstamp:6322012857 queue:0x0bcbcf78
     kworker/0:2-1144  [000] ....   185.393516: rtos_queue_peek_from_isr_failed: tstamp:6327012850 queue:0x0bcbcf78
     kworker/0:2-1144  [000] ....   185.561558: rtos_queue_peek_from_isr_failed: tstamp:6332012856 queue:0x0bcbcf78
     kworker/0:2-1144  [000] ....   185.729835: rtos_queue_peek_from_isr_failed: tstamp:6337012852 queue:0x0bcbcf78
     kworker/0:2-1144  [000] ....   185.841561: rtos_queue_peek_from_isr_failed: tstamp:6342012852 queue:0x0bcbcf78
     kworker/0:2-1144  [000] ....   186.009509: rtos_queue_peek_from_isr_failed: tstamp:6347012853 queue:0x0bcbcf78
     kworker/0:2-1144  [000] ....   186.177617: rtos_queue_peek_from_isr_failed: tstamp:6352012879 queue:0x0bcbcf78
     kworker/0:2-1144  [000] ....   186.289534: rtos_queue_peek_from_isr_failed: tstamp:6354877684 queue:0x0bcbcf78
 gst-plugin-scan-7985  [001] ....   187.916429: tegra_channel_open: vi-output, ovc4cam 9-0010
 gst-plugin-scan-7985  [001] ....   187.917821: tegra_channel_set_power: ovc4cam 9-0010 : 0x1
 gst-plugin-scan-7985  [001] ....   187.917830: camera_common_s_power: status : 0x1
 gst-plugin-scan-7985  [001] ....   187.918022: tegra_channel_set_power: 15a00000.nvcsi--1 : 0x1
 gst-plugin-scan-7985  [001] ....   187.918025: csi_s_power: enable : 0x1
 gst-plugin-scan-7985  [001] ....   187.919479: tegra_channel_close: vi-output, ovc4cam 9-0010
 gst-plugin-scan-7985  [001] ....   187.919482: tegra_channel_set_power: ovc4cam 9-0010 : 0x0
 gst-plugin-scan-7985  [001] ....   187.919486: camera_common_s_power: status : 0x0
 gst-plugin-scan-7985  [001] ....   187.919544: tegra_channel_set_power: 15a00000.nvcsi--1 : 0x0
 gst-plugin-scan-7985  [001] ....   187.919546: csi_s_power: enable : 0x0
     kworker/0:1-723   [000] ....   188.417566: rtos_queue_peek_from_isr_failed: tstamp:6421111031 queue:0x0bcbcf78
     kworker/0:1-723   [000] ....   188.417575: rtcpu_start: tstamp:6421112709
     kworker/0:1-723   [000] ....   188.417577: rtos_queue_send_from_isr_failed: tstamp:6421121393 queue:0x0bcb41f8
     kworker/0:1-723   [000] ....   188.417577: rtos_queue_send_from_isr_failed: tstamp:6421121545 queue:0x0bcb8a60
     kworker/0:1-723   [000] ....   188.417598: rtos_queue_send_from_isr_failed: tstamp:6421121696 queue:0x0bcba5e0
     kworker/0:1-723   [000] ....   188.417598: rtos_queue_send_from_isr_failed: tstamp:6421121844 queue:0x0bcbb3a0
     kworker/0:1-723   [000] ....   188.417599: rtos_queue_send_from_isr_failed: tstamp:6421121991 queue:0x0bcbc160
     kworker/0:1-723   [000] ....   188.417600: rtcpu_string: tstamp:6421122451 id:0x04010000 str:"Configuring ISP GoS.
"
     kworker/0:1-723   [000] ....   188.417634: rtcpu_string: tstamp:6421122630 id:0x04010000 str:"  VM GOS[#0] addr=0xc2100000
"
     kworker/0:1-723   [000] ....   188.417646: rtcpu_string: tstamp:6421122889 id:0x04010000 str:"  VM GOS[#1] addr=0xc2101000
"
     kworker/0:1-723   [000] ....   188.417657: rtcpu_string: tstamp:6421123164 id:0x04010000 str:"  VM GOS[#2] addr=0xc2102000
"
     kworker/0:1-723   [000] ....   188.417671: rtcpu_string: tstamp:6421123400 id:0x04010000 str:"  VM GOS[#3] addr=0xc2103000
"
     kworker/0:1-723   [000] ....   188.417682: rtcpu_string: tstamp:6421123636 id:0x04010000 str:"  VM GOS[#4] addr=0xc2104000
"
     kworker/0:1-723   [000] ....   188.417691: rtcpu_string: tstamp:6421123871 id:0x04010000 str:"  VM GOS[#5] addr=0xc2105000
"
     kworker/0:1-723   [000] ....   188.417700: rtcpu_string: tstamp:6421136973 id:0x04010000 str:"WARNING: t194/isp5.c:901 [config_channel] ""
     kworker/0:1-723   [000] ....   188.417701: rtcpu_string: tstamp:6421137351 id:0x04010000 str:"All error notifications not enabled: correctable"
     kworker/0:1-723   [000] ....   188.417702: rtcpu_string: tstamp:6421137469 id:0x04010000 str:"=0x00 uncorrectable=0x00"
     kworker/0:1-723   [000] ....   188.417703: rtcpu_string: tstamp:6421137662 id:0x04010000 str:""
"
     kworker/0:1-723   [000] ....   188.529475: rtos_queue_peek_from_isr_failed: tstamp:6426111399 queue:0x0bcbcf78
  nvargus-daemon-7994  [000] ....   188.621303: tegra_channel_open: vi-output, ovc4cam 9-0010
  nvargus-daemon-7994  [000] ....   188.621314: tegra_channel_set_power: ovc4cam 9-0010 : 0x1
  nvargus-daemon-7994  [000] ....   188.621320: camera_common_s_power: status : 0x1
  nvargus-daemon-7994  [000] ....   188.622722: tegra_channel_set_power: 15a00000.nvcsi--1 : 0x1
  nvargus-daemon-7994  [000] ....   188.622727: csi_s_power: enable : 0x1
  nvargus-daemon-7994  [000] ....   188.622829: tegra_channel_close: vi-output, ovc4cam 9-0010
  nvargus-daemon-7994  [000] ....   188.622832: tegra_channel_set_power: ovc4cam 9-0010 : 0x0
  nvargus-daemon-7994  [000] ....   188.622836: camera_common_s_power: status : 0x0
  nvargus-daemon-7994  [000] ....   188.622893: tegra_channel_set_power: 15a00000.nvcsi--1 : 0x0
  nvargus-daemon-7994  [000] ....   188.622894: csi_s_power: enable : 0x0
  nvargus-daemon-7994  [000] ....   188.625363: tegra_channel_open: vi-output, ovc4cam 9-0010
  nvargus-daemon-7994  [000] ....   188.625368: tegra_channel_set_power: ovc4cam 9-0010 : 0x1
  nvargus-daemon-7994  [000] ....   188.625371: camera_common_s_power: status : 0x1
  nvargus-daemon-7994  [000] ....   188.627876: tegra_channel_set_power: 15a00000.nvcsi--1 : 0x1
  nvargus-daemon-7994  [000] ....   188.627879: csi_s_power: enable : 0x1
  nvargus-daemon-7994  [000] ....   188.627958: tegra_channel_close: vi-output, ovc4cam 9-0010
  nvargus-daemon-7994  [000] ....   188.627961: tegra_channel_set_power: ovc4cam 9-0010 : 0x0
  nvargus-daemon-7994  [000] ....   188.627964: camera_common_s_power: status : 0x0
  nvargus-daemon-7994  [000] ....   188.628018: tegra_channel_set_power: 15a00000.nvcsi--1 : 0x0
  nvargus-daemon-7994  [000] ....   188.628020: csi_s_power: enable : 0x0
  nvargus-daemon-7994  [000] ....   188.649083: tegra_channel_open: vi-output, ovc4cam 9-0010
  nvargus-daemon-7994  [000] ....   188.649093: tegra_channel_set_power: ovc4cam 9-0010 : 0x1
  nvargus-daemon-7994  [000] ....   188.649102: camera_common_s_power: status : 0x1
  nvargus-daemon-7994  [000] ....   188.649288: tegra_channel_set_power: 15a00000.nvcsi--1 : 0x1
  nvargus-daemon-7994  [000] ....   188.649291: csi_s_power: enable : 0x1
  nvargus-daemon-7994  [000] ....   188.649316: tegra_channel_close: vi-output, ovc4cam 9-0010
  nvargus-daemon-7994  [000] ....   188.649319: tegra_channel_set_power: ovc4cam 9-0010 : 0x0
  nvargus-daemon-7994  [000] ....   188.649322: camera_common_s_power: status : 0x0
  nvargus-daemon-7994  [000] ....   188.649372: tegra_channel_set_power: 15a00000.nvcsi--1 : 0x0
  nvargus-daemon-7994  [000] ....   188.649373: csi_s_power: enable : 0x0
  nvargus-daemon-7994  [000] ....   188.651677: tegra_channel_open: vi-output, ovc4cam 9-0010
  nvargus-daemon-7994  [000] ....   188.651682: tegra_channel_set_power: ovc4cam 9-0010 : 0x1
  nvargus-daemon-7994  [000] ....   188.651686: camera_common_s_power: status : 0x1
  nvargus-daemon-7994  [000] ....   188.651859: tegra_channel_set_power: 15a00000.nvcsi--1 : 0x1
  nvargus-daemon-7994  [000] ....   188.651860: csi_s_power: enable : 0x1
  nvargus-daemon-7994  [000] ....   188.651964: tegra_channel_close: vi-output, ovc4cam 9-0010
  nvargus-daemon-7994  [000] ....   188.651966: tegra_channel_set_power: ovc4cam 9-0010 : 0x0
  nvargus-daemon-7994  [000] ....   188.651968: camera_common_s_power: status : 0x0
  nvargus-daemon-7994  [000] ....   188.652017: tegra_channel_set_power: 15a00000.nvcsi--1 : 0x0
  nvargus-daemon-7994  [000] ....   188.652018: csi_s_power: enable : 0x0
  nvargus-daemon-7994  [000] ....   188.652846: tegra_channel_open: vi-output, ovc4cam 9-0010
  nvargus-daemon-7994  [000] ....   188.652849: tegra_channel_set_power: ovc4cam 9-0010 : 0x1
  nvargus-daemon-7994  [000] ....   188.652852: camera_common_s_power: status : 0x1
  nvargus-daemon-7994  [000] ....   188.653020: tegra_channel_set_power: 15a00000.nvcsi--1 : 0x1
  nvargus-daemon-7994  [000] ....   188.653021: csi_s_power: enable : 0x1
  nvargus-daemon-7994  [000] ....   188.653075: tegra_channel_close: vi-output, ovc4cam 9-0010
  nvargus-daemon-7994  [000] ....   188.653077: tegra_channel_set_power: ovc4cam 9-0010 : 0x0
  nvargus-daemon-7994  [000] ....   188.653079: camera_common_s_power: status : 0x0
  nvargus-daemon-7994  [000] ....   188.653126: tegra_channel_set_power: 15a00000.nvcsi--1 : 0x0
  nvargus-daemon-7994  [000] ....   188.653127: csi_s_power: enable : 0x0
     kworker/0:1-723   [000] ....   188.697484: rtos_queue_peek_from_isr_failed: tstamp:6431111399 queue:0x0bcbcf78
     kworker/0:1-723   [000] ....   188.753476: rtos_queue_send_from_isr_failed: tstamp:6431539159 queue:0x0bcb41f8
     kworker/0:1-723   [000] ....   188.753481: rtos_queue_send_from_isr_failed: tstamp:6431539314 queue:0x0bcb8a60
     kworker/0:1-723   [000] ....   188.753482: rtos_queue_send_from_isr_failed: tstamp:6431539467 queue:0x0bcba5e0
     kworker/0:1-723   [000] ....   188.753482: rtos_queue_send_from_isr_failed: tstamp:6431539615 queue:0x0bcbb3a0
     kworker/0:1-723   [000] ....   188.753483: rtos_queue_send_from_isr_failed: tstamp:6431539762 queue:0x0bcbc160
     kworker/0:1-723   [000] ....   188.753485: rtcpu_string: tstamp:6431540201 id:0x04010000 str:"Configuring VI GoS.
"
     kworker/0:1-723   [000] ....   188.753514: rtcpu_string: tstamp:6431540380 id:0x04010000 str:"VM GOS[#0] addr=0xc2100000
"
     kworker/0:1-723   [000] ....   188.753530: rtcpu_string: tstamp:6431540632 id:0x04010000 str:"VM GOS[#1] addr=0xc2101000
"
     kworker/0:1-723   [000] ....   188.753559: rtcpu_string: tstamp:6431540896 id:0x04010000 str:"VM GOS[#2] addr=0xc2102000
"
     kworker/0:1-723   [000] ....   188.753568: rtcpu_string: tstamp:6431541127 id:0x04010000 str:"VM GOS[#3] addr=0xc2103000
"
     kworker/0:1-723   [000] ....   188.753574: rtcpu_string: tstamp:6431541360 id:0x04010000 str:"VM GOS[#4] addr=0xc2104000
"
     kworker/0:1-723   [000] ....   188.753580: rtcpu_string: tstamp:6431541594 id:0x04010000 str:"VM GOS[#5] addr=0xc2105000
"
     kworker/0:1-723   [000] ....   188.753585: rtcpu_string: tstamp:6431550297 id:0x04010000 str:"vi5_hwinit: firmware CL2018101701 protocol versi"
     kworker/0:1-723   [000] ....   188.753587: rtcpu_string: tstamp:6431550415 id:0x04010000 str:"on 2.2
"
     kworker/0:1-723   [000] ....   188.753593: rtos_queue_send_from_isr_failed: tstamp:6431560729 queue:0x0bcb41f8
     kworker/0:1-723   [000] ....   188.753593: rtos_queue_send_from_isr_failed: tstamp:6431560898 queue:0x0bcb8a60
     kworker/0:1-723   [000] ....   188.753594: rtos_queue_send_from_isr_failed: tstamp:6431561053 queue:0x0bcba5e0
     kworker/0:1-723   [000] ....   188.753595: rtos_queue_send_from_isr_failed: tstamp:6431561198 queue:0x0bcbb3a0
     kworker/0:1-723   [000] ....   188.753595: rtos_queue_send_from_isr_failed: tstamp:6431561345 queue:0x0bcbc160
     kworker/0:1-723   [000] ....   188.865510: rtos_queue_peek_from_isr_failed: tstamp:6436111401 queue:0x0bcbcf78
     kworker/0:1-723   [000] ....   189.033481: rtos_queue_peek_from_isr_failed: tstamp:6441111397 queue:0x0bcbcf78
 CaptureSchedule-8014  [000] ....   189.174251: tegra_channel_open: vi-output, ovc4cam 9-0010
 CaptureSchedule-8014  [000] ....   189.174267: tegra_channel_set_power: ovc4cam 9-0010 : 0x1
 CaptureSchedule-8014  [000] ....   189.174277: camera_common_s_power: status : 0x1
 CaptureSchedule-8014  [000] ....   189.174495: tegra_channel_set_power: 15a00000.nvcsi--1 : 0x1
 CaptureSchedule-8014  [000] ....   189.174498: csi_s_power: enable : 0x1
 CaptureSchedule-8014  [000] ....   189.186358: tegra_channel_set_stream: enable : 0x1
 CaptureSchedule-8014  [000] ....   189.188100: tegra_channel_set_stream: 15a00000.nvcsi--1 : 0x1
 CaptureSchedule-8014  [000] ....   189.188104: csi_s_stream: enable : 0x1
 CaptureSchedule-8014  [000] ....   189.188106: tegra_channel_set_stream: ovc4cam 9-0010 : 0x1
     kworker/0:1-723   [000] ....   189.201498: rtos_queue_send_from_isr_failed: tstamp:6446105092 queue:0x0bcb41f8
     kworker/0:1-723   [000] ....   189.201502: rtos_queue_send_from_isr_failed: tstamp:6446105243 queue:0x0bcb8a60
     kworker/0:1-723   [000] ....   189.201502: rtos_queue_send_from_isr_failed: tstamp:6446105393 queue:0x0bcba5e0
     kworker/0:1-723   [000] ....   189.201503: rtos_queue_send_from_isr_failed: tstamp:6446105541 queue:0x0bcbb3a0
     kworker/0:1-723   [000] ....   189.201503: rtos_queue_send_from_isr_failed: tstamp:6446105686 queue:0x0bcbc160
     kworker/0:1-723   [000] ....   189.201504: rtos_queue_send_from_isr_failed: tstamp:6446105894 queue:0x0bcb4190
     kworker/0:1-723   [000] ....   189.201505: rtos_queue_send_from_isr_failed: tstamp:6446106031 queue:0x0bcb41f8
     kworker/0:1-723   [000] ....   189.201505: rtos_queue_send_from_isr_failed: tstamp:6446106166 queue:0x0bcb89f8
     kworker/0:1-723   [000] ....   189.201509: rtos_queue_send_from_isr_failed: tstamp:6446106301 queue:0x0bcb8a60
     kworker/0:1-723   [000] ....   189.201511: rtos_queue_send_from_isr_failed: tstamp:6446106438 queue:0x0bcba578
     kworker/0:1-723   [000] ....   189.201512: rtos_queue_send_from_isr_failed: tstamp:6446106587 queue:0x0bcba5e0
     kworker/0:1-723   [000] ....   189.201512: rtos_queue_send_from_isr_failed: tstamp:6446106722 queue:0x0bcbb338
     kworker/0:1-723   [000] ....   189.201513: rtos_queue_send_from_isr_failed: tstamp:6446106855 queue:0x0bcbb3a0
     kworker/0:1-723   [000] ....   189.201513: rtos_queue_send_from_isr_failed: tstamp:6446106989 queue:0x0bcbc0f8
     kworker/0:1-723   [000] ....   189.201514: rtos_queue_send_from_isr_failed: tstamp:6446107123 queue:0x0bcbc160
     kworker/0:1-723   [000] ....   189.201515: rtos_queue_peek_from_isr_failed: tstamp:6446111362 queue:0x0bcbcf78
     kworker/0:1-723   [000] ....   189.201516: rtos_queue_send_from_isr_failed: tstamp:6446136945 queue:0x0bcb41f8
     kworker/0:1-723   [000] ....   189.201516: rtos_queue_send_from_isr_failed: tstamp:6446137097 queue:0x0bcb8a60
     kworker/0:1-723   [000] ....   189.201517: rtos_queue_send_from_isr_failed: tstamp:6446137247 queue:0x0bcba5e0
     kworker/0:1-723   [000] ....   189.201517: rtos_queue_send_from_isr_failed: tstamp:6446137394 queue:0x0bcbb3a0
     kworker/0:1-723   [000] ....   189.201518: rtos_queue_send_from_isr_failed: tstamp:6446137539 queue:0x0bcbc160
     kworker/0:1-723   [000] ....   189.201518: rtos_queue_send_from_isr_failed: tstamp:6446222438 queue:0x0bcb41f8
     kworker/0:1-723   [000] ....   189.201518: rtos_queue_send_from_isr_failed: tstamp:6446222585 queue:0x0bcb8a60
     kworker/0:1-723   [000] ....   189.201519: rtos_queue_send_from_isr_failed: tstamp:6446222735 queue:0x0bcba5e0
     kworker/0:1-723   [000] ....   189.201519: rtos_queue_send_from_isr_failed: tstamp:6446222880 queue:0x0bcbb3a0
     kworker/0:1-723   [000] ....   189.201520: rtos_queue_send_from_isr_failed: tstamp:6446223027 queue:0x0bcbc160
     kworker/0:1-723   [000] ....   189.201520: rtos_queue_send_from_isr_failed: tstamp:6446307111 queue:0x0bcb41f8
     kworker/0:1-723   [000] ....   189.201521: rtos_queue_send_from_isr_failed: tstamp:6446307262 queue:0x0bcb8a60
     kworker/0:1-723   [000] ....   189.201521: rtos_queue_send_from_isr_failed: tstamp:6446307413 queue:0x0bcba5e0
     kworker/0:1-723   [000] ....   189.201522: rtos_queue_send_from_isr_failed: tstamp:6446307561 queue:0x0bcbb3a0
     kworker/0:1-723   [000] ....   189.201522: rtos_queue_send_from_isr_failed: tstamp:6446307708 queue:0x0bcbc160
     kworker/0:1-723   [000] ....   189.201524: rtcpu_string: tstamp:6446308155 id:0x04010000 str:"Configuring VI GoS.
"
     kworker/0:1-723   [000] ....   189.201558: rtcpu_string: tstamp:6446308335 id:0x04010000 str:"VM GOS[#0] addr=0xc2100000
"
     kworker/0:1-723   [000] ....   189.201569: rtcpu_string: tstamp:6446308588 id:0x04010000 str:"VM GOS[#1] addr=0xc2101000
"
     kworker/0:1-723   [000] ....   189.201575: rtcpu_string: tstamp:6446308859 id:0x04010000 str:"VM GOS[#2] addr=0xc2102000
"
     kworker/0:1-723   [000] ....   189.201580: rtcpu_string: tstamp:6446309091 id:0x04010000 str:"VM GOS[#3] addr=0xc2103000
"
     kworker/0:1-723   [000] ....   189.201585: rtcpu_string: tstamp:6446309323 id:0x04010000 str:"VM GOS[#4] addr=0xc2104000
"
     kworker/0:1-723   [000] ....   189.201591: rtcpu_string: tstamp:6446309558 id:0x04010000 str:"VM GOS[#5] addr=0xc2105000
"
     kworker/0:1-723   [000] ....   189.201596: rtos_queue_send_from_isr_failed: tstamp:6446312901 queue:0x0bcb41f8
     kworker/0:1-723   [000] ....   189.201597: rtos_queue_send_from_isr_failed: tstamp:6446313050 queue:0x0bcb8a60
     kworker/0:1-723   [000] ....   189.201597: rtos_queue_send_from_isr_failed: tstamp:6446313200 queue:0x0bcba5e0
     kworker/0:1-723   [000] ....   189.201598: rtos_queue_send_from_isr_failed: tstamp:6446313347 queue:0x0bcbb3a0
     kworker/0:1-723   [000] ....   189.201598: rtos_queue_send_from_isr_failed: tstamp:6446313492 queue:0x0bcbc160
     kworker/0:1-723   [000] ....   189.201599: rtos_queue_send_from_isr_failed: tstamp:6446330593 queue:0x0bcb41f8
     kworker/0:1-723   [000] ....   189.201599: rtos_queue_send_from_isr_failed: tstamp:6446330739 queue:0x0bcb8a60
     kworker/0:1-723   [000] ....   189.201600: rtos_queue_send_from_isr_failed: tstamp:6446330890 queue:0x0bcba5e0
     kworker/0:1-723   [000] ....   189.201600: rtos_queue_send_from_isr_failed: tstamp:6446331036 queue:0x0bcbb3a0
     kworker/0:1-723   [000] ....   189.201601: rtos_queue_send_from_isr_failed: tstamp:6446331184 queue:0x0bcbc160
     kworker/0:1-723   [000] ....   189.201601: rtos_queue_send_from_isr_failed: tstamp:6446729641 queue:0x0bcb41f8
     kworker/0:1-723   [000] ....   189.201602: rtos_queue_send_from_isr_failed: tstamp:6446729790 queue:0x0bcb8a60
     kworker/0:1-723   [000] ....   189.201602: rtos_queue_send_from_isr_failed: tstamp:6446729941 queue:0x0bcba5e0
     kworker/0:1-723   [000] ....   189.201602: rtos_queue_send_from_isr_failed: tstamp:6446730087 queue:0x0bcbb3a0
     kworker/0:1-723   [000] ....   189.201603: rtos_queue_send_from_isr_failed: tstamp:6446730232 queue:0x0bcbc160
     kworker/0:1-723   [000] ....   189.201603: rtcpu_string: tstamp:6446731058 id:0x04010000 str:"VI GOS[#0] set to VM GOS[4] base 0xc2104000
"
     kworker/0:1-723   [000] ....   189.201614: rtcpu_vinotify_event: tstamp:6446747017 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:4432032544 data:0x10000000
     kworker/0:1-723   [000] ....   189.201615: rtcpu_vinotify_event: tstamp:6446747163 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:4432061984 data:0x31000001
     kworker/0:1-723   [000] ....   189.201615: rtcpu_vinotify_event: tstamp:6446747324 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:4432070624 data:0x07020001
     kworker/0:1-723   [000] ....   189.257500: rtos_queue_send_from_isr_failed: tstamp:6447786923 queue:0x0bcb41f8
     kworker/0:1-723   [000] ....   189.257504: rtos_queue_send_from_isr_failed: tstamp:6447787078 queue:0x0bcb8a60
     kworker/0:1-723   [000] ....   189.257505: rtos_queue_send_from_isr_failed: tstamp:6447787229 queue:0x0bcba5e0
     kworker/0:1-723   [000] ....   189.257505: rtos_queue_send_from_isr_failed: tstamp:6447787376 queue:0x0bcbb3a0
     kworker/0:1-723   [000] ....   189.257506: rtos_queue_send_from_isr_failed: tstamp:6447787522 queue:0x0bcbc160
     kworker/0:1-723   [000] ....   189.257506: rtos_queue_send_from_isr_failed: tstamp:6447796184 queue:0x0bcb41f8
     kworker/0:1-723   [000] ....   189.257507: rtos_queue_send_from_isr_failed: tstamp:6447796333 queue:0x0bcb8a60
     kworker/0:1-723   [000] ....   189.257507: rtos_queue_send_from_isr_failed: tstamp:6447796485 queue:0x0bcba5e0
     kworker/0:1-723   [000] ....   189.257508: rtos_queue_send_from_isr_failed: tstamp:6447796630 queue:0x0bcbb3a0
     kworker/0:1-723   [000] ....   189.257508: rtos_queue_send_from_isr_failed: tstamp:6447796775 queue:0x0bcbc160
     kworker/0:1-723   [000] ....   189.257510: rtcpu_vinotify_event: tstamp:6447832758 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:4465858144 data:0x10000000
     kworker/0:1-723   [000] ....   189.257511: rtcpu_vinotify_event: tstamp:6447832924 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:4465887840 data:0x31000002
     kworker/0:1-723   [000] ....   189.369493: rtos_queue_peek_from_isr_failed: tstamp:6451111407 queue:0x0bcbcf78
     kworker/0:1-723   [000] ....   189.537466: rtos_queue_peek_from_isr_failed: tstamp:6456111394 queue:0x0bcbcf78
     kworker/0:1-723   [000] ....   189.649474: rtos_queue_peek_from_isr_failed: tstamp:6461111393 queue:0x0bcbcf78
     kworker/0:1-723   [000] ....   189.817465: rtos_queue_peek_from_isr_failed: tstamp:6466111394 queue:0x0bcbcf78
     kworker/0:1-723   [000] ....   189.985478: rtos_queue_peek_from_isr_failed: tstamp:6471111394 queue:0x0bcbcf78
     kworker/0:1-723   [000] ....   190.153495: rtos_queue_peek_from_isr_failed: tstamp:6476111394 queue:0x0bcbcf78
     kworker/0:1-723   [000] ....   190.321478: rtos_queue_peek_from_isr_failed: tstamp:6481111394 queue:0x0bcbcf78
     kworker/0:1-723   [000] ....   190.489479: rtos_queue_peek_from_isr_failed: tstamp:6486111393 queue:0x0bcbcf78
     kworker/0:1-723   [000] ....   190.657471: rtos_queue_peek_from_isr_failed: tstamp:6491111394 queue:0x0bcbcf78
     kworker/0:1-723   [000] ....   190.769470: rtos_queue_peek_from_isr_failed: tstamp:6496111394 queue:0x0bcbcf78
     kworker/0:1-723   [000] ....   190.937446: rtos_queue_peek_from_isr_failed: tstamp:6501111394 queue:0x0bcbcf78
     kworker/0:1-723   [000] ....   191.105452: rtos_queue_peek_from_isr_failed: tstamp:6506111394 queue:0x0bcbcf78
     kworker/0:1-723   [000] ....   191.273450: rtos_queue_peek_from_isr_failed: tstamp:6511111395 queue:0x0bcbcf78
     kworker/0:1-723   [000] ....   191.441475: rtos_queue_peek_from_isr_failed: tstamp:6516111393 queue:0x0bcbcf78
     kworker/0:1-723   [000] ....   191.609481: rtos_queue_peek_from_isr_failed: tstamp:6521111393 queue:0x0bcbcf78
     kworker/0:1-723   [000] ....   191.777453: rtos_queue_peek_from_isr_failed: tstamp:6526111395 queue:0x0bcbcf78
     kworker/0:1-723   [000] ....   191.889489: rtos_queue_peek_from_isr_failed: tstamp:6531111395 queue:0x0bcbcf78
     kworker/0:1-723   [000] ....   192.057467: rtos_queue_peek_from_isr_failed: tstamp:6536111393 queue:0x0bcbcf78
     kworker/0:1-723   [000] ....   192.225441: rtos_queue_peek_from_isr_failed: tstamp:6541111394 queue:0x0bcbcf78
     kworker/0:1-723   [000] ....   192.281478: rtos_queue_send_from_isr_failed: tstamp:6542464862 queue:0x0bcb41f8
     kworker/0:1-723   [000] ....   192.281482: rtos_queue_send_from_isr_failed: tstamp:6542465015 queue:0x0bcb8a60
     kworker/0:1-723   [000] ....   192.281482: rtos_queue_send_from_isr_failed: tstamp:6542465168 queue:0x0bcba5e0
     kworker/0:1-723   [000] ....   192.281483: rtos_queue_send_from_isr_failed: tstamp:6542465315 queue:0x0bcbb3a0
     kworker/0:1-723   [000] ....   192.281483: rtos_queue_send_from_isr_failed: tstamp:6542465462 queue:0x0bcbc160
     kworker/0:1-723   [000] ....   192.281484: rtos_queue_send_from_isr_failed: tstamp:6542476609 queue:0x0bcb41f8
     kworker/0:1-723   [000] ....   192.281484: rtos_queue_send_from_isr_failed: tstamp:6542476756 queue:0x0bcb8a60
     kworker/0:1-723   [000] ....   192.281485: rtos_queue_send_from_isr_failed: tstamp:6542476905 queue:0x0bcba5e0
     kworker/0:1-723   [000] ....   192.281485: rtos_queue_send_from_isr_failed: tstamp:6542477050 queue:0x0bcbb3a0
     kworker/0:1-723   [000] ....   192.281486: rtos_queue_send_from_isr_failed: tstamp:6542477197 queue:0x0bcbc160
     kworker/0:1-723   [000] ....   192.393437: rtos_queue_peek_from_isr_failed: tstamp:6546111395 queue:0x0bcbcf78
     kworker/0:1-723   [000] ....   192.561435: rtos_queue_peek_from_isr_failed: tstamp:6551111394 queue:0x0bcbcf78
     kworker/0:1-723   [000] ....   192.729436: rtos_queue_peek_from_isr_failed: tstamp:6556111394 queue:0x0bcbcf78
     kworker/0:1-723   [000] ....   192.897433: rtos_queue_peek_from_isr_failed: tstamp:6561111397 queue:0x0bcbcf78
     kworker/0:1-723   [000] ....   193.009433: rtos_queue_peek_from_isr_failed: tstamp:6566111389 queue:0x0bcbcf78
     kworker/0:1-723   [000] ....   193.177432: rtos_queue_peek_from_isr_failed: tstamp:6571111394 queue:0x0bcbcf78
     kworker/0:1-723   [000] ....   193.345432: rtos_queue_peek_from_isr_failed: tstamp:6576111394 queue:0x0bcbcf78
     kworker/0:1-723   [000] ....   193.513429: rtos_queue_peek_from_isr_failed: tstamp:6581111394 queue:0x0bcbcf78
     kworker/0:1-723   [000] ....   193.681440: rtos_queue_peek_from_isr_failed: tstamp:6586111393 queue:0x0bcbcf78
     kworker/0:1-723   [000] ....   193.849535: rtos_queue_peek_from_isr_failed: tstamp:6591111395 queue:0x0bcbcf78
     kworker/0:1-723   [000] ....   194.017478: rtos_queue_peek_from_isr_failed: tstamp:6596111394 queue:0x0bcbcf78
     kworker/0:1-723   [000] ....   194.129489: rtos_queue_peek_from_isr_failed: tstamp:6601111394 queue:0x0bcbcf78
     kworker/0:1-723   [000] ....   194.297488: rtos_queue_peek_from_isr_failed: tstamp:6606111394 queue:0x0bcbcf78
     kworker/0:1-723   [000] ....   194.465480: rtos_queue_peek_from_isr_failed: tstamp:6611111394 queue:0x0bcbcf78
     kworker/0:1-723   [000] ....   194.633492: rtos_queue_peek_from_isr_failed: tstamp:6616111394 queue:0x0bcbcf78
     kworker/0:1-723   [000] ....   194.801491: rtos_queue_peek_from_isr_failed: tstamp:6621111394 queue:0x0bcbcf78
     kworker/0:1-723   [000] ....   194.969465: rtos_queue_peek_from_isr_failed: tstamp:6626111394 queue:0x0bcbcf78
     kworker/0:1-723   [000] ....   195.137506: rtos_queue_peek_from_isr_failed: tstamp:6631111398 queue:0x0bcbcf78
     kworker/0:1-723   [000] ....   195.249466: rtos_queue_peek_from_isr_failed: tstamp:6636111394 queue:0x0bcbcf78
     kworker/0:1-723   [000] ....   195.417440: rtos_queue_peek_from_isr_failed: tstamp:6641111394 queue:0x0bcbcf78
     kworker/0:1-723   [000] ....   195.585441: rtos_queue_peek_from_isr_failed: tstamp:6646111394 queue:0x0bcbcf78
     kworker/0:1-723   [000] ....   195.753436: rtos_queue_peek_from_isr_failed: tstamp:6651111394 queue:0x0bcbcf78
     kworker/0:1-723   [000] ....   195.921479: rtos_queue_peek_from_isr_failed: tstamp:6656111398 queue:0x0bcbcf78

My guess was that it must be something in the tegra-camera-platform but I can’t find anything wrong with it, attaching my camera dtsi (customized from the imx219 example):

/*
 * Copyright (c) 2018-2020, NVIDIA CORPORATION.  All rights reserved.
 *
 * This program is free software; you can redistribute it and/or modify
 * it under the terms of the GNU General Public License as published by
 * the Free Software Foundation; either version 2 of the License, or
 * (at your option) any later version.
 *
 * This program is distributed in the hope that it will be useful, but WITHOUT
 * ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or
 * FITNESS FOR A PARTICULAR PURPOSE.  See the GNU General Public License for
 * more details.
 *
 * You should have received a copy of the GNU General Public License
 * along with this program.  If not, see <http://www.gnu.org/licenses/>.
 */
#include <dt-bindings/media/camera.h>

/ {
	host1x {
		vi@15c10000  {
			num-channels = <1>;
			ports {
				#address-cells = <1>;
				#size-cells = <0>;
				vi_port0: port@0 {
					reg = <0>;
					ovc4cam_vi_in0: endpoint {
						port-index = <0>;
						bus-width = <2>;
						remote-endpoint = <&ovc4cam_csi_out0>;
					};
				};
			};
		};

		nvcsi@15a00000 {
			num-channels = <1>;
			#address-cells = <1>;
			#size-cells = <0>;
			csi_chan0: channel@0 {
				reg = <0>;
				ports {
					#address-cells = <1>;
					#size-cells = <0>;
					csi_chan0_port0: port@0 {
						reg = <0>;
						ovc4cam_csi_in0: endpoint@0 {
							port-index = <0>;
							bus-width = <2>;
							remote-endpoint = <&ovc4cam_out0>;
						};
					};
					csi_chan0_port1: port@1 {
						reg = <1>;
						ovc4cam_csi_out0: endpoint@1 {
							remote-endpoint = <&ovc4cam_vi_in0>;
						};
					};
				};
			};
		};
	};

	cam_i2cmux {
		i2c_0:i2c@0 {
			ovc4cam_cam0: ovc4cam_a@10 {
				compatible = "nvidia,ovc4cam";
				/* I2C device address */
				reg = <0x10>;

				/* V4L2 device node location */
				devnode = "video0";

        /* OVC4 sensor index */
        sensor_id = <0>;

				/* Physical dimensions of sensor */
				physical_w = "3.680";
				physical_h = "2.760";

				sensor_model = "ovc4cam";

				use_sensor_mode_id = "true";

				mode0 { /* 2592X1944_30FPS */
					mclk_khz = "27000";
					num_lanes = "2";
					tegra_sinterface = "serial_a";
					phy_mode = "DPHY";
					discontinuous_clk = "no";
					dpcm_enable = "false";
					cil_settletime = "0";

					active_w = "2592";
					active_h = "1944";
					mode_type = "bayer";
					pixel_phase = "rggb"; // CHECK, should be bgrg?
					dynamic_pixel_bit_depth = "10";
					csi_pixel_bit_depth = "10";
					readout_orientation = "90";
					line_length = "5620";
					inherent_gain = "1";
					mclk_multiplier = "24";
					pix_clk_hz = "232000000";

					gain_factor = "16";
					framerate_factor = "1000000";
					exposure_factor = "1000000";
					min_gain_val = "16"; /* 1.00x */
					max_gain_val = "356"; /* 22x */ // FIX
					step_gain_val = "1";
					default_gain = "16"; /* 1.00x */
					min_hdr_ratio = "1";
					max_hdr_ratio = "1";
					min_framerate = "2000000"; /* 2.0 fps */
					max_framerate = "30000000"; /* 30.0 fps */
					step_framerate = "1";
					default_framerate = "30000000"; /* 30.0 fps */
					min_exp_time = "13"; /* us */
					max_exp_time = "10000"; /* us */
					step_exp_time = "1";
					default_exp_time = "2495"; /* us */

					embedded_metadata_height = "0";
				};

				ports {
					#address-cells = <1>;
					#size-cells = <0>;
					port@0 {
						reg = <0>;
						ovc4cam_out0: endpoint {
							port-index = <0>;
							bus-width = <2>;
							remote-endpoint = <&ovc4cam_csi_in0>;
						};
					};
				};
			};
		};
  };
};
/ {
	tcp: tegra-camera-platform {
		compatible = "nvidia, tegra-camera-platform";
		/**
		* Physical settings to calculate max ISO BW
		*
		* num_csi_lanes = <>;
		* Total number of CSI lanes when all cameras are active
		*
		* max_lane_speed = <>;
		* Max lane speed in Kbit/s
		*
		* min_bits_per_pixel = <>;
		* Min bits per pixel
		*
		* vi_peak_byte_per_pixel = <>;
		* Max byte per pixel for the VI ISO case
		*
		* vi_bw_margin_pct = <>;
		* Vi bandwidth margin in percentage
		*
		* max_pixel_rate = <>;
		* Max pixel rate in Kpixel/s for the ISP ISO case
		*
		* isp_peak_byte_per_pixel = <>;
		* Max byte per pixel for the ISP ISO case
		*
		* isp_bw_margin_pct = <>;
		* Isp bandwidth margin in percentage
		*/
		num_csi_lanes = <2>;
		max_lane_speed = <2500000>;
		min_bits_per_pixel = <10>;
		vi_peak_byte_per_pixel = <2>;
		vi_bw_margin_pct = <25>;
		//max_pixel_rate = <7500000>;
		max_pixel_rate = <240000>;
		isp_peak_byte_per_pixel = <5>;
		isp_bw_margin_pct = <25>;

		/**
		 * The general guideline for naming badge_info contains 3 parts, and is as follows,
		 * The first part is the camera_board_id for the module; if the module is in a FFD
		 * platform, then use the platform name for this part.
		 * The second part contains the position of the module, ex. "rear" or "front".
		 * The third part contains the last 6 characters of a part number which is found
		 * in the module's specsheet from the vendor.
		 */
/*
  CAM4 = topleft
  CAM2 = topright
  CAM5 = middleleft
  CAM0 = middleright
  CAM3 = bottomleft
  CAM1 = bottomright
*/
// Position below are the nvidia ones, not the actual OVC mounting ones
		modules {
			cam_module0: module0 {
				badge = "ovc4cam_rear_ovc4";
				position = "rear";
				orientation = "3";
				cam_module0_drivernode0: drivernode0 {
					pcl_id = "v4l2_sensor";
					devname = "ovc4cam 9-0010";
					proc-device-tree = "/proc/device-tree/cam_i2cmux/i2c@0/ovc4cam_a@10";
				};
			};
		};
	};
};

Any input?
Thanks!
/Luca

Looks like nvcsi/vi didn’t get any validate package from the MIPI bus.
You can try discontinuous_clk and boost the nvcsi/vi/isp clocks to try. Otherwise need to probe the signal make sure the sensor was output data correctly with gst command.

Hi Shane!

If I change the value of discontinuous_clk v4l2-ctl also stops working. I also tried to boost the clocks both through jetson_clocks and the instructions in Jetson TX2 Camera BringUp - eLinux.org without success.

I don’t know if it is any help but this is a preconfigured MIPI stream (the kernel module I2C functions have been changed to dummy functions and the imager is configured and set to streaming mode through an external device prior to launching the v4l / argus).
Also, after the sensor has been externally configured v4l2-ctl always succeeds, and nvgstcapture always fails no matter the sequence / number of times they are ran.
Finally We are using a custom carrier board and both the CAM_I2C and CAM_PWDN / clock are not connected so it is impossible for the kernel module to change the sensor configuration in any way.

I guess my question is if we are 100% confident that the sensor is streaming, what could cause such an output at the argus level but not at the v4l2 level?

Does the device always streaming after system boot up to OS or it can start/stop streaming by device driver.

And does this device output package by discontinuous clocks mode?

The device clock is always running and it is enabled once by running a userspace software that I do before using v4l2-ctl / nvgst. I tried to reset and reconfigure it while nvgstcapture is running but the behavior in that case is very erratic, for example right now I managed to capture a few frames before it started failing (attaching a snippet of the trace). I guess it is not a great idea to reset the sensor while acquisition is running.

     kworker/0:1-780   [000] ....   103.324483: rtcpu_vinotify_event: tstamp:3666098601 tag:CHANSEL_PXL_SOF channel:0x23 frame:40 vi_tstamp:3665553971 data:0x00000001
     kworker/0:1-780   [000] ....   103.324484: rtcpu_vinotify_event: tstamp:3666098744 tag:RESERVED_19 channel:0x23 frame:40 vi_tstamp:5628599616 data:0x08020028
     kworker/0:1-780   [000] ....   103.324484: rtcpu_vinotify_event: tstamp:3666098906 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:5628849280 data:0x10000000
     kworker/0:1-780   [000] ....   103.324485: rtcpu_vinotify_event: tstamp:3666099042 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:5628878976 data:0x31000029
     kworker/0:1-780   [000] ....   103.324486: rtcpu_vinotify_event: tstamp:3666641326 tag:CHANSEL_PXL_EOF channel:0x23 frame:40 vi_tstamp:3666387462 data:0x07970002
     kworker/0:1-780   [000] ....   103.324487: rtcpu_vinotify_event: tstamp:3666641468 tag:FE channel:0x00 frame:40 vi_tstamp:3666387478 data:0x00000020
     kworker/0:1-780   [000] ....   103.324488: rtcpu_vinotify_event: tstamp:3666641632 tag:ATOMP_FE channel:0x00 frame:40 vi_tstamp:3666387480 data:0x00000000
     kworker/0:1-780   [000] ....   103.324489: rtcpu_vinotify_event: tstamp:3666641769 tag:ATOMP_FRAME_DONE channel:0x23 frame:40 vi_tstamp:3666387488 data:0x00000000
     kworker/0:1-780   [000] ....   103.324489: rtcpu_vinotify_event: tstamp:3666641927 tag:RESERVED_19 channel:0x23 frame:40 vi_tstamp:5655270272 data:0x02020028
     kworker/0:1-780   [000] ....   103.324490: rtcpu_vinotify_event: tstamp:3666642066 tag:RESERVED_19 channel:0x23 frame:40 vi_tstamp:5655282528 data:0x00020028
     kworker/0:1-780   [000] ....   103.324491: rtcpu_vinotify_event: tstamp:3666642223 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:5655304352 data:0x07020029
     kworker/0:1-780   [000] ....   103.324492: rtcpu_vinotify_event: tstamp:3666742320 tag:FS channel:0x00 frame:41 vi_tstamp:3666733918 data:0x00000010
     kworker/0:1-780   [000] ....   103.324493: rtcpu_vinotify_event: tstamp:3666742482 tag:ATOMP_FS channel:0x00 frame:41 vi_tstamp:3666733921 data:0x00000000
     kworker/0:1-780   [000] ....   103.324493: rtcpu_vinotify_event: tstamp:3666742625 tag:CHANSEL_PXL_SOF channel:0x23 frame:41 vi_tstamp:3666733941 data:0x00000001
     kworker/0:1-780   [000] ....   103.324494: rtcpu_vinotify_event: tstamp:3666742784 tag:RESERVED_19 channel:0x23 frame:41 vi_tstamp:5666352736 data:0x08020029
     kworker/0:1-780   [000] ....   103.324495: rtcpu_vinotify_event: tstamp:3666742922 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:5666529152 data:0x10000000
     kworker/0:1-780   [000] ....   103.324496: rtcpu_vinotify_event: tstamp:3667238009 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:5666647872 data:0x3100002a
     kworker/0:1-780   [000] ....   103.324497: rtcpu_vinotify_event: tstamp:3667780474 tag:CHANSEL_PXL_EOF channel:0x23 frame:41 vi_tstamp:3667567432 data:0x07970002
     kworker/0:1-780   [000] ....   103.324497: rtcpu_vinotify_event: tstamp:3667780634 tag:FE channel:0x00 frame:41 vi_tstamp:3667567448 data:0x00000020
     kworker/0:1-780   [000] ....   103.324498: rtcpu_vinotify_event: tstamp:3667780777 tag:ATOMP_FE channel:0x00 frame:41 vi_tstamp:3667567451 data:0x00000000
     kworker/0:1-780   [000] ....   103.324499: rtcpu_vinotify_event: tstamp:3667780935 tag:ATOMP_FRAME_DONE channel:0x23 frame:41 vi_tstamp:3667567458 data:0x00000000
     kworker/0:1-780   [000] ....   103.324500: rtcpu_vinotify_event: tstamp:3667781074 tag:RESERVED_19 channel:0x23 frame:41 vi_tstamp:5693029312 data:0x02020029
     kworker/0:1-780   [000] ....   103.324500: rtcpu_vinotify_event: tstamp:3667781232 tag:RESERVED_19 channel:0x23 frame:41 vi_tstamp:5693041568 data:0x00020029
     kworker/0:1-780   [000] ....   103.324501: rtcpu_vinotify_event: tstamp:3667781371 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:5693063392 data:0x0702002a
     kworker/0:1-780   [000] ....   103.324502: rtcpu_vinotify_event: tstamp:3668323526 tag:FS channel:0x00 frame:42 vi_tstamp:3667913889 data:0x00000010
     kworker/0:1-780   [000] ....   103.324503: rtcpu_vinotify_event: tstamp:3668323709 tag:ATOMP_FS channel:0x00 frame:42 vi_tstamp:3667913892 data:0x00000000
     kworker/0:1-780   [000] ....   103.324504: rtcpu_vinotify_event: tstamp:3668323870 tag:CHANSEL_PXL_SOF channel:0x23 frame:42 vi_tstamp:3667913913 data:0x00000001
     kworker/0:1-780   [000] ....   103.324504: rtcpu_vinotify_event: tstamp:3668324011 tag:RESERVED_19 channel:0x23 frame:42 vi_tstamp:5704111808 data:0x0802002a
     kworker/0:1-780   [000] ....   103.324505: rtcpu_vinotify_event: tstamp:3668752213 tag:CHANSEL_PXL_EOF channel:0x23 frame:42 vi_tstamp:3668747402 data:0x07970002
     kworker/0:1-780   [000] ....   103.324506: rtcpu_vinotify_event: tstamp:3668752351 tag:FE channel:0x00 frame:42 vi_tstamp:3668747419 data:0x00000020
     kworker/0:1-780   [000] ....   103.324507: rtcpu_vinotify_event: tstamp:3668752508 tag:ATOMP_FE channel:0x00 frame:42 vi_tstamp:3668747421 data:0x00000000
     kworker/0:1-780   [000] ....   103.324507: rtcpu_vinotify_event: tstamp:3668752644 tag:ATOMP_FRAME_DONE channel:0x23 frame:42 vi_tstamp:3668747428 data:0x00000000
     kworker/0:1-780   [000] ....   103.324552: rtcpu_vinotify_error: tstamp:3669096739 tag:CHANSEL_NOMATCH channel:0x01 frame:43 vi_tstamp:3669093883 data:0x00000569
     kworker/0:1-780   [000] ....   103.324553: rtcpu_vinotify_event: tstamp:3669245828 tag:RESERVED_19 channel:0x23 frame:42 vi_tstamp:5730794272 data:0x0202002a
     kworker/0:1-780   [000] ....   103.324554: rtcpu_vinotify_event: tstamp:3669245970 tag:RESERVED_19 channel:0x23 frame:42 vi_tstamp:5730806816 data:0x0002002a
     kworker/0:1-780   [000] ....   103.324555: rtcpu_vinotify_event: tstamp:3669246131 tag:FS channel:0x00 frame:43 vi_tstamp:3669093859 data:0x00000010
     kworker/0:1-780   [000] ....   103.324556: rtcpu_vinotify_event: tstamp:3669246269 tag:CHANSEL_NOMATCH channel:0x01 frame:43 vi_tstamp:3669093883 data:0x00000569
     kworker/0:1-780   [000] ....   103.324557: rtos_queue_peek_from_isr_failed: tstamp:3669720743 queue:0x0bcbcf78
     kworker/0:1-780   [000] ....   103.324558: rtcpu_vinotify_error: tstamp:3670276707 tag:CHANSEL_NOMATCH channel:0x01 frame:44 vi_tstamp:3670273853 data:0x00000569
     kworker/0:1-780   [000] ....   103.324676: rtcpu_vinotify_event: tstamp:3670330453 tag:FE channel:0x00 frame:43 vi_tstamp:3669927389 data:0x00000020
     kworker/0:1-780   [000] ....   103.324678: rtcpu_vinotify_event: tstamp:3670330592 tag:FS channel:0x00 frame:44 vi_tstamp:3670273829 data:0x00000010
     kworker/0:1-780   [000] ....   103.324679: rtcpu_vinotify_event: tstamp:3670330751 tag:CHANSEL_NOMATCH channel:0x01 frame:44 vi_tstamp:3670273853 data:0x00000569
     kworker/0:1-780   [000] ....   103.324679: rtcpu_vinotify_event: tstamp:3671415699 tag:FE channel:0x00 frame:44 vi_tstamp:3671107359 data:0x00000020
     kworker/0:1-780   [000] ....   103.324680: rtcpu_vinotify_error: tstamp:3671456668 tag:CHANSEL_NOMATCH channel:0x01 frame:45 vi_tstamp:3671453823 data:0x00000569
     kworker/0:1-780   [000] ....   103.324681: rtcpu_vinotify_event: tstamp:3671958448 tag:FS channel:0x00 frame:45 vi_tstamp:3671453800 data:0x00000010
     kworker/0:1-780   [000] ....   103.324682: rtcpu_vinotify_event: tstamp:3671958587 tag:CHANSEL_NOMATCH channel:0x01 frame:45 vi_tstamp:3671453823 data:0x00000569
     kworker/0:1-780   [000] ....   103.324683: rtcpu_vinotify_event: tstamp:3672501134 tag:FE channel:0x00 frame:45 vi_tstamp:3672287331 data:0x00000020
     kworker/0:1-780   [000] ....   103.324683: rtcpu_vinotify_error: tstamp:3672636678 tag:CHANSEL_NOMATCH channel:0x01 frame:46 vi_tstamp:3672633794 data:0x00000569
     kworker/0:1-780   [000] ....   103.324684: rtcpu_vinotify_event: tstamp:3673043146 tag:FS channel:0x00 frame:46 vi_tstamp:3672633771 data:0x00000010
     kworker/0:1-780   [000] ....   103.324685: rtcpu_vinotify_event: tstamp:3673043304 tag:CHANSEL_NOMATCH channel:0x01 frame:46 vi_tstamp:3672633794 data:0x00000569
     kworker/0:1-780   [000] ....   103.324686: rtcpu_vinotify_event: tstamp:3673585767 tag:FE channel:0x00 frame:46 vi_tstamp:3673467301 data:0x00000020
     kworker/0:1-780   [000] ....   103.377157: rtcpu_vinotify_error: tstamp:3673816755 tag:CHANSEL_NOMATCH channel:0x01 frame:47 vi_tstamp:3673813765 data:0x00000569
     kworker/0:1-780   [000] ....   103.377161: rtcpu_vinotify_event: tstamp:3673817105 tag:FS channel:0x00 frame:47 vi_tstamp:3673813741 data:0x00000010
     kworker/0:1-780   [000] ....   103.377162: rtcpu_vinotify_event: tstamp:3673817254 tag:CHANSEL_NOMATCH channel:0x01 frame:47 vi_tstamp:3673813765 data:0x00000569
     kworker/0:1-780   [000] ....   103.377163: rtcpu_vinotify_event: tstamp:3674671296 tag:FE channel:0x00 frame:47 vi_tstamp:3674647271 data:0x00000020
     kworker/0:1-780   [000] ....   103.377165: rtos_queue_peek_from_isr_failed: tstamp:3674720737 queue:0x0bcbcf78
     kworker/0:1-780   [000] ....   103.377167: rtcpu_vinotify_error: tstamp:3674996581 tag:CHANSEL_NOMATCH channel:0x01 frame:48 vi_tstamp:3674993735 data:0x00000569
     kworker/0:1-780   [000] ....   103.377168: rtcpu_vinotify_event: tstamp:3675213246 tag:FS channel:0x00 frame:48 vi_tstamp:3674993713 data:0x00000010
     kworker/0:1-780   [000] ....   103.377169: rtcpu_vinotify_event: tstamp:3675213421 tag:CHANSEL_NOMATCH channel:0x01 frame:48 vi_tstamp:3674993735 data:0x00000569
     kworker/0:1-780   [000] ....   103.377170: rtcpu_vinotify_error: tstamp:3676176551 tag:CHANSEL_NOMATCH channel:0x01 frame:49 vi_tstamp:3676173705 data:0x00000569
     kworker/0:1-780   [000] ....   103.377170: rtcpu_vinotify_event: tstamp:3676298673 tag:FE channel:0x00 frame:48 vi_tstamp:3675827242 data:0x00000020
     kworker/0:1-780   [000] ....   103.377171: rtcpu_vinotify_event: tstamp:3676298832 tag:FS channel:0x00 frame:49 vi_tstamp:3676173682 data:0x00000010
     kworker/0:1-780   [000] ....   103.377172: rtcpu_vinotify_event: tstamp:3676298968 tag:CHANSEL_NOMATCH channel:0x01 frame:49 vi_tstamp:3676173705 data:0x00000569
     kworker/0:1-780   [000] ....   103.377173: rtcpu_vinotify_error: tstamp:3677356577 tag:CHANSEL_NOMATCH channel:0x01 frame:50 vi_tstamp:3677353677 data:0x00000569
     kworker/0:1-780   [000] ....   103.377174: rtcpu_vinotify_event: tstamp:3677383294 tag:FE channel:0x00 frame:49 vi_tstamp:3677007213 data:0x00000020
     kworker/0:1-780   [000] ....   103.377175: rtcpu_vinotify_event: tstamp:3677383430 tag:FS channel:0x00 frame:50 vi_tstamp:3677353653 data:0x00000010
     kworker/0:1-780   [000] ....   103.377176: rtcpu_vinotify_event: tstamp:3677383587 tag:CHANSEL_NOMATCH channel:0x01 frame:50 vi_tstamp:3677353677 data:0x00000569
     kworker/0:1-780   [000] ....   103.377176: rtcpu_vinotify_event: tstamp:3678468540 tag:FE channel:0x00 frame:50 vi_tstamp:3678187183 data:0x00000020
     kworker/0:1-780   [000] ....   103.377177: rtcpu_vinotify_error: tstamp:3678536490 tag:CHANSEL_NOMATCH channel:0x01 frame:51 vi_tstamp:3678533647 data:0x00000569
     kworker/0:1-780   [000] ....   103.377178: rtcpu_vinotify_event: tstamp:3679011332 tag:FS channel:0x00 frame:51 vi_tstamp:3678533624 data:0x00000010
     kworker/0:1-780   [000] ....   103.377179: rtcpu_vinotify_event: tstamp:3679011468 tag:CHANSEL_NOMATCH channel:0x01 frame:51 vi_tstamp:3678533647 data:0x00000569
     kworker/0:1-780   [000] ....   103.377180: rtcpu_vinotify_event: tstamp:3679553964 tag:FE channel:0x00 frame:51 vi_tstamp:3679367154 data:0x00000020
     kworker/0:1-780   [000] ....   103.377181: rtcpu_vinotify_error: tstamp:3679716467 tag:CHANSEL_NOMATCH channel:0x01 frame:52 vi_tstamp:3679713617 data:0x00000569
     kworker/0:1-780   [000] ....   103.377181: rtos_queue_peek_from_isr_failed: tstamp:3679720737 queue:0x0bcbcf78
     kworker/0:1-780   [000] ....   103.377182: rtcpu_vinotify_event: tstamp:3680096729 tag:FS channel:0x00 frame:52 vi_tstamp:3679713595 data:0x00000010
     kworker/0:1-780   [000] ....   103.377183: rtcpu_vinotify_event: tstamp:3680096887 tag:CHANSEL_NOMATCH channel:0x01 frame:52 vi_tstamp:3679713617 data:0x00000569
     kworker/0:1-780   [000] ....   103.377184: rtcpu_vinotify_event: tstamp:3680549558 tag:FE channel:0x00 frame:52 vi_tstamp:3680547124 data:0x00000020
     kworker/0:1-780   [000] ....   103.377185: rtcpu_vinotify_error: tstamp:3680896433 tag:CHANSEL_NOMATCH channel:0x01 frame:53 vi_tstamp:3680893588 data:0x00000569
     kworker/0:1-780   [000] ....   103.377186: rtcpu_vinotify_event: tstamp:3681072756 tag:FS channel:0x00 frame:53 vi_tstamp:3680893565 data:0x00000010

For the always streaming device would suggest to configure as discontinuous clocks to try.

OK! I set the device as discontinuous clock and changed the device tree entry to “yes”, now when I run v4l2-ctl I get these errors (repeated a lot):

     kworker/0:4-1633  [000] ....    48.161055: rtcpu_nvcsi_intr: tstamp:2038264918 class:CORRECTABLE_ERR type:PHY_INTR phy:0 cil:0 st:0 vc:0 status:0x00000042
     kworker/0:4-1633  [000] ....    48.161055: rtcpu_nvcsi_intr: tstamp:2038265500 class:GLOBAL type:PHY_INTR0 phy:0 cil:0 st:0 vc:0 status:0x00000042
     kworker/0:4-1633  [000] ....    48.161056: rtcpu_nvcsi_intr: tstamp:2038265500 class:CORRECTABLE_ERR type:PHY_INTR phy:0 cil:0 st:0 vc:0 status:0x00000040
     kworker/0:4-1633  [000] ....    48.161056: rtcpu_nvcsi_intr: tstamp:2038266083 class:GLOBAL type:PHY_INTR0 phy:0 cil:0 st:0 vc:0 status:0x00000042
     kworker/0:4-1633  [000] ....    48.161056: rtcpu_nvcsi_intr: tstamp:2038266083 class:CORRECTABLE_ERR type:PHY_INTR phy:0 cil:0 st:0 vc:0 status:0x00000042
     kworker/0:4-1633  [000] ....    48.161056: rtcpu_nvcsi_intr: tstamp:2038266662 class:GLOBAL type:PHY_INTR0 phy:0 cil:0 st:0 vc:0 status:0x00000040
     kworker/0:4-1633  [000] ....    48.161056: rtcpu_nvcsi_intr: tstamp:2038266662 class:CORRECTABLE_ERR type:PHY_INTR phy:0 cil:0 st:0 vc:0 status:0x00000042
     kworker/0:4-1633  [000] ....    48.161057: rtcpu_nvcsi_intr: tstamp:2038267243 class:GLOBAL type:PHY_INTR0 phy:0 cil:0 st:0 vc:0 status:0x00000042
     kworker/0:4-1633  [000] ....    48.161057: rtcpu_nvcsi_intr: tstamp:2038267243 class:CORRECTABLE_ERR type:PHY_INTR phy:0 cil:0 st:0 vc:0 status:0x00000040
     kworker/0:4-1633  [000] ....    48.161057: rtcpu_nvcsi_intr: tstamp:2038267824 class:GLOBAL type:PHY_INTR0 phy:0 cil:0 st:0 vc:0 status:0x00000042
     kworker/0:4-1633  [000] ....    48.161057: rtcpu_nvcsi_intr: tstamp:2038267824 class:CORRECTABLE_ERR type:PHY_INTR phy:0 cil:0 st:0 vc:0 status:0x00000042
     kworker/0:4-1633  [000] ....    48.161057: rtcpu_nvcsi_intr: tstamp:2038268401 class:GLOBAL type:PHY_INTR0 phy:0 cil:0 st:0 vc:0 status:0x00000040
     kworker/0:4-1633  [000] ....    48.161058: rtcpu_nvcsi_intr: tstamp:2038268401 class:CORRECTABLE_ERR type:PHY_INTR phy:0 cil:0 st:0 vc:0 status:0x00000042
     kworker/0:4-1633  [000] ....    48.161058: rtcpu_nvcsi_intr: tstamp:2038268982 class:GLOBAL type:PHY_INTR0 phy:0 cil:0 st:0 vc:0 status:0x00000042
     kworker/0:4-1633  [000] ....    48.161058: rtcpu_nvcsi_intr: tstamp:2038268982 class:CORRECTABLE_ERR type:PHY_INTR phy:0 cil:0 st:0 vc:0 status:0x00000040
     kworker/0:4-1633  [000] ....    48.161058: rtcpu_nvcsi_intr: tstamp:2038269559 class:GLOBAL type:PHY_INTR0 phy:0 cil:0 st:0 vc:0 status:0x00000042
     kworker/0:4-1633  [000] ....    48.161058: rtcpu_nvcsi_intr: tstamp:2038269559 class:CORRECTABLE_ERR type:PHY_INTR phy:0 cil:0 st:0 vc:0 status:0x00000042
     kworker/0:4-1633  [000] ....    48.161059: rtcpu_nvcsi_intr: tstamp:2038270140 class:GLOBAL type:PHY_INTR0 phy:0 cil:0 st:0 vc:0 status:0x00000040
     kworker/0:4-1633  [000] ....    48.161059: rtcpu_nvcsi_intr: tstamp:2038270140 class:CORRECTABLE_ERR type:PHY_INTR phy:0 cil:0 st:0 vc:0 status:0x00000042
     kworker/0:4-1633  [000] ....    48.161059: rtcpu_nvcsi_intr: tstamp:2038270722 class:GLOBAL type:PHY_INTR0 phy:0 cil:0 st:0 vc:0 status:0x00000042
     kworker/0:4-1633  [000] ....    48.161059: rtcpu_nvcsi_intr: tstamp:2038270722 class:CORRECTABLE_ERR type:PHY_INTR phy:0 cil:0 st:0 vc:0 status:0x00000040
     kworker/0:4-1633  [000] ....    48.161059: rtcpu_nvcsi_intr: tstamp:2038271303 class:GLOBAL type:PHY_INTR0 phy:0 cil:0 st:0 vc:0 status:0x00000042
     kworker/0:4-1633  [000] ....    48.161060: rtcpu_nvcsi_intr: tstamp:2038271303 class:CORRECTABLE_ERR type:PHY_INTR phy:0 cil:0 st:0 vc:0 status:0x00000042
     kworker/0:4-1633  [000] ....    48.161060: rtcpu_nvcsi_intr: tstamp:2038271884 class:GLOBAL type:PHY_INTR0 phy:0 cil:0 st:0 vc:0 status:0x00000040
     kworker/0:4-1633  [000] ....    48.161060: rtcpu_nvcsi_intr: tstamp:2038271884 class:CORRECTABLE_ERR type:PHY_INTR phy:0 cil:0 st:0 vc:0 status:0x00000042
     kworker/0:4-1633  [000] ....    48.161060: rtcpu_nvcsi_intr: tstamp:2038272466 class:GLOBAL type:PHY_INTR0 phy:0 cil:0 st:0 vc:0 status:0x00000042
     kworker/0:4-1633  [000] ....    48.161060: rtcpu_nvcsi_intr: tstamp:2038272466 class:CORRECTABLE_ERR type:PHY_INTR phy:0 cil:0 st:0 vc:0 status:0x00000040
     kworker/0:4-1633  [000] ....    48.161061: rtcpu_nvcsi_intr: tstamp:2038273047 class:GLOBAL type:PHY_INTR0 phy:0 cil:0 st:0 vc:0 status:0x00000042

Just have internal information it might cause some weird errors if you enabled NVCSI/NVCSICIL in the middle of the stream.

I changed the testing sequence to run v4l2-ctl before enabling the sensor’s streaming and I see the same list of errors.

Edit, I also tried following other topics’ suggestions to increase the pix_clk_hz and the error codes changed, again not sure if this a right way to go:

     kworker/0:1-780   [000] ....   225.482736: rtcpu_nvcsi_intr: tstamp:7581555402 class:CORRECTABLE_ERR type:PHY_INTR phy:0 cil:0 st:0 vc:0 status:0x00000044
     kworker/0:1-780   [000] ....   225.482736: rtcpu_nvcsi_intr: tstamp:7581555939 class:GLOBAL type:PHY_INTR0 phy:0 cil:0 st:0 vc:0 status:0x00000044
     kworker/0:1-780   [000] ....   225.482736: rtcpu_nvcsi_intr: tstamp:7581555939 class:CORRECTABLE_ERR type:PHY_INTR phy:0 cil:0 st:0 vc:0 status:0x00000044
     kworker/0:1-780   [000] ....   225.482736: rtcpu_nvcsi_intr: tstamp:7581556477 class:GLOBAL type:PHY_INTR0 phy:0 cil:0 st:0 vc:0 status:0x00000044
     kworker/0:1-780   [000] ....   225.482736: rtcpu_nvcsi_intr: tstamp:7581556477 class:CORRECTABLE_ERR type:PHY_INTR phy:0 cil:0 st:0 vc:0 status:0x00000044
     kworker/0:1-780   [000] ....   225.482737: rtcpu_nvcsi_intr: tstamp:7581557013 class:GLOBAL type:PHY_INTR0 phy:0 cil:0 st:0 vc:0 status:0x00000044
     kworker/0:1-780   [000] ....   225.482737: rtcpu_nvcsi_intr: tstamp:7581557013 class:CORRECTABLE_ERR type:PHY_INTR phy:0 cil:0 st:0 vc:0 status:0x00000044
     kworker/0:1-780   [000] ....   225.482737: rtcpu_nvcsi_intr: tstamp:7581557547 class:GLOBAL type:PHY_INTR0 phy:0 cil:0 st:0 vc:0 status:0x00000044

Hi Shane,

Turns out it was a sensor configuration issue (all the timing registers had to be tuned for the discontinuous_clk mode). After tuning it seems to be working great, thanks for the help!

/Luca

Actually the problem is still there… v4l2-ctl streaming still works great and I can run a capture for several minutes but as soon as I switch to nvgstcapture I start getting CHANSEL_NOMATCH errors after a few successful frames (that also look correct, I’m streaming test patterns and I can validate that the output is right until it starts failing).

Could you try configure the sensor to reduce the frame rate to try.

Still no luck, tried to halve the frame rate from 30 to 15 FPS, v4l2-ctl correctly reports 15 FPS and stream is stable:

root@xaviernx:~# v4l2-ctl  --set-fmt-video=width=2592,height=1944,pixelformat=RG10 --set-ctrl bypass_mode=0 --stream-mmap --stream-count=10000 -d /dev/video0
<<<<<<<<<<<<<<<< 15.00 fps
<<<<<<<<<<<<<<< 15.00 fps
<<<<<<<<<<<<<<< 15.00 fps
<<<<<<<<<<<<<<< 15.00 fps
<<<<<<<<<<<<<<< 15.00 fps
<<<<<<<<<<<<<<< 15.00 fps
<<<<<<<<<<<<<<< 15.00 fps

while nvgstcapture starts outputting the CHANSEL_NOMATCH errors after a few successful frames.

Could you post latest trace log here.

Hi Shane,

The log is pretty much the same as I posted in 10th August, for example here is my latest test where I had about 50 successful frames before it started reporting errors:

     kworker/0:3-1740  [000] ....    59.082405: rtcpu_vinotify_event: tstamp:2367968858 tag:CHANSEL_PXL_EOF channel:0x23 frame:50 vi_tstamp:2367891169 data:0x07970002
     kworker/0:3-1740  [000] ....    59.082406: rtcpu_vinotify_event: tstamp:2367969002 tag:FE channel:0x00 frame:50 vi_tstamp:2367891183 data:0x00000020
     kworker/0:3-1740  [000] ....    59.082407: rtcpu_vinotify_event: tstamp:2367969164 tag:ATOMP_FRAME_DONE channel:0x23 frame:50 vi_tstamp:2367891183 data:0x00000000
     kworker/0:3-1740  [000] ....    59.082407: rtcpu_vinotify_event: tstamp:2367969300 tag:RESERVED_19 channel:0x23 frame:50 vi_tstamp:2758075776 data:0x02020012
     kworker/0:3-1740  [000] ....    59.082421: rtcpu_vinotify_event: tstamp:2367969461 tag:ATOMP_FE channel:0x00 frame:50 vi_tstamp:2367891183 data:0x00000000
     kworker/0:3-1740  [000] ....    59.082422: rtcpu_vinotify_event: tstamp:2367969596 tag:RESERVED_19 channel:0x23 frame:50 vi_tstamp:2758081664 data:0x00020012
     kworker/0:3-1740  [000] ....    59.082422: rtcpu_vinotify_event: tstamp:2367969754 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:2758087232 data:0x07020013
     kworker/0:3-1740  [000] ....    59.082423: rtcpu_vinotify_event: tstamp:2369034042 tag:FS channel:0x00 frame:51 vi_tstamp:2369032655 data:0x00000010
     kworker/0:3-1740  [000] ....    59.082424: rtcpu_vinotify_event: tstamp:2369034204 tag:ATOMP_FS channel:0x00 frame:51 vi_tstamp:2369032656 data:0x00000000
     kworker/0:3-1740  [000] ....    59.082424: rtcpu_vinotify_event: tstamp:2369034343 tag:CHANSEL_PXL_SOF channel:0x23 frame:51 vi_tstamp:2369032678 data:0x00000001
     kworker/0:3-1740  [000] ....    59.082426: rtos_queue_peek_from_isr_failed: tstamp:2369152021 queue:0x0bcbcf78
     kworker/0:3-1740  [000] ....    59.082426: rtos_queue_send_from_isr_failed: tstamp:2369162126 queue:0x0bcb41f8
     kworker/0:3-1740  [000] ....    59.082427: rtos_queue_send_from_isr_failed: tstamp:2369162280 queue:0x0bcb8a60
     kworker/0:3-1740  [000] ....    59.082428: rtos_queue_send_from_isr_failed: tstamp:2369162433 queue:0x0bcba5e0
     kworker/0:3-1740  [000] ....    59.082428: rtos_queue_send_from_isr_failed: tstamp:2369162578 queue:0x0bcbb3a0
     kworker/0:3-1740  [000] ....    59.082429: rtos_queue_send_from_isr_failed: tstamp:2369162725 queue:0x0bcbc160
     kworker/0:3-1740  [000] ....    59.082430: rtcpu_vinotify_event: tstamp:2369359045 tag:RESERVED_19 channel:0x23 frame:51 vi_tstamp:2794606688 data:0x08020013
     kworker/0:3-1740  [000] ....    59.082431: rtcpu_vinotify_event: tstamp:2369359188 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:2794703648 data:0x10000000
     kworker/0:3-1740  [000] ....    59.082431: rtcpu_vinotify_event: tstamp:2369359350 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:2794712096 data:0x31000014
     kworker/0:3-1740  [000] ....    59.082432: rtcpu_vinotify_event: tstamp:2370037157 tag:CHANSEL_PXL_EOF channel:0x23 frame:51 vi_tstamp:2369976888 data:0x07970002
     kworker/0:3-1740  [000] ....    59.082433: rtcpu_vinotify_event: tstamp:2370037320 tag:FE channel:0x00 frame:51 vi_tstamp:2369976903 data:0x00000020
     kworker/0:3-1740  [000] ....    59.082434: rtcpu_vinotify_event: tstamp:2370037460 tag:ATOMP_FRAME_DONE channel:0x23 frame:51 vi_tstamp:2369976903 data:0x00000000
     kworker/0:3-1740  [000] ....    59.082435: rtcpu_vinotify_event: tstamp:2370037619 tag:RESERVED_19 channel:0x23 frame:51 vi_tstamp:2824818816 data:0x02020013
     kworker/0:3-1740  [000] ....    59.082435: rtcpu_vinotify_event: tstamp:2370037760 tag:ATOMP_FE channel:0x00 frame:51 vi_tstamp:2369976903 data:0x00000000
     kworker/0:3-1740  [000] ....    59.082436: rtcpu_vinotify_event: tstamp:2370037917 tag:RESERVED_19 channel:0x23 frame:51 vi_tstamp:2824824704 data:0x00020013
     kworker/0:3-1740  [000] ....    59.082437: rtcpu_vinotify_event: tstamp:2370038053 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:2824830240 data:0x07020014
     kworker/0:3-1740  [000] ....    59.082438: rtcpu_vinotify_event: tstamp:2371121723 tag:FS channel:0x00 frame:52 vi_tstamp:2371118375 data:0x00000010
     kworker/0:3-1740  [000] ....    59.082439: rtcpu_vinotify_event: tstamp:2371121865 tag:ATOMP_FS channel:0x00 frame:52 vi_tstamp:2371118376 data:0x00000000
     kworker/0:3-1740  [000] ....    59.082439: rtcpu_vinotify_event: tstamp:2371122023 tag:CHANSEL_PXL_SOF channel:0x23 frame:52 vi_tstamp:2371118398 data:0x00000001
     kworker/0:3-1740  [000] ....    59.082440: rtcpu_vinotify_event: tstamp:2371122162 tag:RESERVED_19 channel:0x23 frame:52 vi_tstamp:2861348224 data:0x08020014
     kworker/0:3-1740  [000] ....    59.082441: rtcpu_vinotify_event: tstamp:2371122319 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:2861421920 data:0x10000000
     kworker/0:3-1740  [000] ....    59.082441: rtcpu_vinotify_event: tstamp:2371122455 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:2861430336 data:0x31000015
     kworker/0:3-1740  [000] ....    59.082442: rtcpu_vinotify_event: tstamp:2372071694 tag:CHANSEL_PXL_EOF channel:0x23 frame:52 vi_tstamp:2372062608 data:0x07970002
     kworker/0:3-1740  [000] ....    59.082443: rtcpu_vinotify_event: tstamp:2372071834 tag:FE channel:0x00 frame:52 vi_tstamp:2372062622 data:0x00000020
     kworker/0:3-1740  [000] ....    59.082444: rtcpu_vinotify_event: tstamp:2372071991 tag:ATOMP_FRAME_DONE channel:0x23 frame:52 vi_tstamp:2372062623 data:0x00000000
     kworker/0:3-1740  [000] ....    59.082445: rtcpu_vinotify_event: tstamp:2372072127 tag:RESERVED_19 channel:0x23 frame:52 vi_tstamp:2891561792 data:0x02020014
     kworker/0:3-1740  [000] ....    59.082445: rtcpu_vinotify_event: tstamp:2372072293 tag:ATOMP_FE channel:0x00 frame:52 vi_tstamp:2372062623 data:0x00000000
     kworker/0:3-1740  [000] ....    59.082446: rtcpu_vinotify_event: tstamp:2372072428 tag:RESERVED_19 channel:0x23 frame:52 vi_tstamp:2891567680 data:0x00020014
     kworker/0:3-1740  [000] ....    59.082447: rtcpu_vinotify_event: tstamp:2372072585 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:2891573280 data:0x07020015
     kworker/0:3-1740  [000] ....    59.082448: rtcpu_vinotify_event: tstamp:2373428014 tag:FS channel:0x00 frame:53 vi_tstamp:2373204094 data:0x00000010
     kworker/0:3-1740  [000] ....    59.082448: rtcpu_vinotify_event: tstamp:2373428176 tag:ATOMP_FS channel:0x00 frame:53 vi_tstamp:2373204095 data:0x00000000
     kworker/0:3-1740  [000] ....    59.082449: rtcpu_vinotify_event: tstamp:2373428314 tag:CHANSEL_PXL_SOF channel:0x23 frame:53 vi_tstamp:2373204117 data:0x00000001
     kworker/0:3-1740  [000] ....    59.082450: rtcpu_vinotify_event: tstamp:2373428474 tag:RESERVED_19 channel:0x23 frame:53 vi_tstamp:2928091264 data:0x08020015
     kworker/0:3-1740  [000] ....    59.082451: rtcpu_vinotify_event: tstamp:2374149877 tag:CHANSEL_PXL_EOF channel:0x23 frame:53 vi_tstamp:2374148327 data:0x07970002
     kworker/0:3-1740  [000] ....    59.082451: rtcpu_vinotify_event: tstamp:2374150038 tag:FE channel:0x00 frame:53 vi_tstamp:2374148341 data:0x00000020
     kworker/0:3-1740  [000] ....    59.082452: rtcpu_vinotify_event: tstamp:2374150178 tag:ATOMP_FRAME_DONE channel:0x23 frame:53 vi_tstamp:2374148341 data:0x00000000
     kworker/0:3-1740  [000] ....    59.082453: rtcpu_vinotify_event: tstamp:2374150336 tag:RESERVED_19 channel:0x23 frame:53 vi_tstamp:2958304832 data:0x02020015
     kworker/0:3-1740  [000] ....    59.082454: rtcpu_vinotify_event: tstamp:2374150475 tag:ATOMP_FE channel:0x00 frame:53 vi_tstamp:2374148342 data:0x00000000
     kworker/0:3-1740  [000] ....    59.082455: rtos_queue_peek_from_isr_failed: tstamp:2374152018 queue:0x0bcbcf78
     kworker/0:3-1740  [000] ....    59.082455: rtcpu_vinotify_event: tstamp:2374479309 tag:RESERVED_19 channel:0x23 frame:53 vi_tstamp:2958312256 data:0x00020015
     kworker/0:3-1740  [000] ....    59.082456: rtcpu_vinotify_error: tstamp:2375290685 tag:CHANSEL_NOMATCH channel:0x01 frame:54 vi_tstamp:2375289835 data:0x00000569
     kworker/0:3-1740  [000] ....    59.082457: rtcpu_vinotify_event: tstamp:2375496520 tag:FS channel:0x00 frame:54 vi_tstamp:2375289812 data:0x00000010
     kworker/0:3-1740  [000] ....    59.082458: rtcpu_vinotify_event: tstamp:2375496678 tag:CHANSEL_NOMATCH channel:0x01 frame:54 vi_tstamp:2375289835 data:0x00000569
     kworker/0:3-1740  [000] ....    59.082459: rtcpu_vinotify_event: tstamp:2376513806 tag:FE channel:0x00 frame:54 vi_tstamp:2376234058 data:0x00000020
     kworker/0:3-1740  [000] ....    59.082460: rtcpu_vinotify_error: tstamp:2377376397 tag:CHANSEL_NOMATCH channel:0x01 frame:55 vi_tstamp:2377375551 data:0x00000569
     kworker/0:3-1740  [000] ....    59.082460: rtcpu_vinotify_event: tstamp:2377531030 tag:FS channel:0x00 frame:55 vi_tstamp:2377375528 data:0x00000010
     kworker/0:3-1740  [000] ....    59.082461: rtcpu_vinotify_event: tstamp:2377531169 tag:CHANSEL_NOMATCH channel:0x01 frame:55 vi_tstamp:2377375551 data:0x00000569
     kworker/0:3-1740  [000] ....    59.082462: rtcpu_vinotify_event: tstamp:2378548312 tag:FE channel:0x00 frame:55 vi_tstamp:2378319774 data:0x00000020
     kworker/0:3-1740  [000] ....    59.082463: rtos_queue_peek_from_isr_failed: tstamp:2379152022 queue:0x0bcbcf78
     kworker/0:3-1740  [000] ....    59.082463: rtcpu_vinotify_error: tstamp:2379462166 tag:CHANSEL_NOMATCH channel:0x01 frame:56 vi_tstamp:2379461267 data:0x00000569
     kworker/0:3-1740  [000] ....    59.082464: rtcpu_vinotify_event: tstamp:2379565541 tag:FS channel:0x00 frame:56 vi_tstamp:2379461244 data:0x00000010
     kworker/0:3-1740  [000] ....    59.082465: rtcpu_vinotify_event: tstamp:2379565699 tag:CHANSEL_NOMATCH channel:0x01 frame:56 vi_tstamp:2379461267 data:0x00000569
     kworker/0:3-1740  [000] ....    59.082466: rtcpu_vinotify_event: tstamp:2380582822 tag:FE channel:0x00 frame:56 vi_tstamp:2380405490 data:0x00000020
     kworker/0:3-1740  [000] ....    59.082466: rtcpu_vinotify_error: tstamp:2381547826 tag:CHANSEL_NOMATCH channel:0x01 frame:57 vi_tstamp:2381546983 data:0x00000569
     kworker/0:3-1740  [000] ....    59.082467: rtcpu_vinotify_event: tstamp:2381600051 tag:FS channel:0x00 frame:57 vi_tstamp:2381546960 data:0x00000010
     kworker/0:3-1740  [000] ....    59.082468: rtcpu_vinotify_event: tstamp:2381600191 tag:CHANSEL_NOMATCH channel:0x01 frame:57 vi_tstamp:2381546983 data:0x00000569
     kworker/0:3-1740  [000] ....    59.138273: rtcpu_vinotify_event: tstamp:2382617329 tag:FE channel:0x00 frame:57 vi_tstamp:2382491206 data:0x00000020
     kworker/0:3-1740  [000] ....    59.138276: rtcpu_vinotify_error: tstamp:2383633540 tag:CHANSEL_NOMATCH channel:0x01 frame:58 vi_tstamp:2383632698 data:0x00000569
     kworker/0:3-1740  [000] ....    59.138278: rtcpu_vinotify_event: tstamp:2383634547 tag:FS channel:0x00 frame:58 vi_tstamp:2383632676 data:0x00000010
     kworker/0:3-1740  [000] ....    59.138279: rtcpu_vinotify_event: tstamp:2383634706 tag:CHANSEL_NOMATCH channel:0x01 frame:58 vi_tstamp:2383632698 data:0x00000569
     kworker/0:3-1740  [000] ....    59.138281: rtos_queue_peek_from_isr_failed: tstamp:2384152019 queue:0x0bcbcf78
     kworker/0:3-1740  [000] ....    59.194274: rtcpu_vinotify_event: tstamp:2384577586 tag:FE channel:0x00 frame:58 vi_tstamp:2384576921 data:0x00000020
     kworker/0:3-1740  [000] ....    59.194276: rtcpu_vinotify_error: tstamp:2385719260 tag:CHANSEL_NOMATCH channel:0x01 frame:59 vi_tstamp:2385718415 data:0x00000569
     kworker/0:3-1740  [000] ....    59.194278: rtcpu_vinotify_event: tstamp:2385736948 tag:FS channel:0x00 frame:59 vi_tstamp:2385718392 data:0x00000010
     kworker/0:3-1740  [000] ....    59.194278: rtcpu_vinotify_event: tstamp:2385737087 tag:CHANSEL_NOMATCH channel:0x01 frame:59 vi_tstamp:2385718415 data:0x00000569
     kworker/0:3-1740  [000] ....    59.250274: rtcpu_vinotify_event: tstamp:2386754241 tag:FE channel:0x00 frame:59 vi_tstamp:2386662637 data:0x00000020
     kworker/0:3-1740  [000] ....    59.250277: rtcpu_vinotify_error: tstamp:2387804980 tag:CHANSEL_NOMATCH channel:0x01 frame:60 vi_tstamp:2387804132 data:0x00000569
     kworker/0:3-1740  [000] ....    59.306294: rtcpu_vinotify_event: tstamp:2388110549 tag:FS channel:0x00 frame:60 vi_tstamp:2387804109 data:0x00000010
     kworker/0:3-1740  [000] ....    59.306296: rtcpu_vinotify_event: tstamp:2388110711 tag:CHANSEL_NOMATCH channel:0x01 frame:60 vi_tstamp:2387804132 data:0x00000569
     kworker/0:3-1740  [000] ....    59.306297: rtcpu_vinotify_event: tstamp:2388788740 tag:FE channel:0x00 frame:60 vi_tstamp:2388748355 data:0x00000020

From the log you can see there’re no errors before NOMATCH is reported by frame 54; meanwhile the FS/FE events looks good.
This means VI channel failed to match the frame 54’s input data, the reason could be:
VI channel is enabled, but channel matching rules (stream_id, vc_id, frame_id, data_type) failed to match the input frame.

Hi Shane,

I’m not sure what was happening but I managed to solve the issue and get stable streaming by changing the cil_settletime parameter from 0 to a higher value. I guess the “autocalibration” was not working properly.

Cheers!
/Luca