Vi errors occurred for custom sensor driver

I have developed a custom sensor drive based on imx219. The camera module is detected. when running
$ * v4l2-ctl -d /dev/video0 --set-ctrl bypass_mode=0 --stream-mmap --stream-count=100, terminal hangs forever, can quit with ctrl + c.

What could be wrong? thanks.

Here are more details:
$ cat /etc/nv_tegra_release
R32 (release), REVISION: 6.1, GCID: 27863751, BOARD: t186ref, EABI: aarch64, DATE: Mon Jul 26 19:36:31 UTC 2021

$dmesg
[ 2542.532040] imx219 10-0036: imx219_power_on: power on (ov5675)
[ 2542.532238] imx219 10-0036: imx219_power_on: reset gpio to 0 (ov5675)
[ 2542.532368] imx219 10-0036: imx219_power_on: no avdd, iodd, dvdd set, skip power sequence now (ov5675)
[ 2542.534463] imx219 10-0036: imx219_power_on: reset gpio to 1 (ov5675)
[ 2542.581364] imx219 10-0036: imx219_set_mode: enter set_mode (ov5675)
[ 2542.584170] [RCE] Configuring VI GoS.
[ 2542.584195] [RCE] VM GOS[#0] addr=0xc2100000
[ 2542.584207] [RCE] VM GOS[#1] addr=0xc2101000
[ 2542.584218] [RCE] VM GOS[#2] addr=0xc2102000
[ 2542.584234] [RCE] VM GOS[#3] addr=0xc2103000
[ 2542.584245] [RCE] VM GOS[#4] addr=0xc2104000
[ 2542.584256] [RCE] VM GOS[#5] addr=0xc2105000
[ 2542.584277] [RCE] vi5_hwinit: firmware CL2018101701 protocol version 2.2
[ 2542.584318] [RCE] VI GOS[#0] set to VM GOS[4] base 0xc2104000
[ 2542.593154] imx219 10-0036: imx219_set_mode: write table IMX219_MODE_COMMON succeed (ov5675)
[ 2542.628225] imx219 10-0036: imx219_set_mode: write table 0 succeed (ov5675)
[ 2542.628407] imx219 10-0036: imx219_start_streaming: enter start_streaming (ov5675)
[ 2542.682323] tegra194-vi5 15c10000.vi: corr_err: discarding frame 1, flags: 32, err_data 162
[ 2542.708810] tegra194-vi5 15c10000.vi: corr_err: discarding frame 2, flags: 32, err_data 162
[ 2542.734916] tegra194-vi5 15c10000.vi: corr_err: discarding frame 3, flags: 32, err_data 512
[ 2542.735300] tegra194-vi5 15c10000.vi: corr_err: discarding frame 0, flags: 32, err_data 1186

$ v4l2-compliance -d /dev/video0
v4l2-compliance SHA : not available

Driver Info:
Driver name : tegra-video
Card type : vi-output, imx219 10-0036
Bus info : platform:15c10000.vi:2
Driver version: 4.9.253
Capabilities : 0x84200001
Video Capture
Streaming
Extended Pix Format
Device Capabilities
Device Caps : 0x04200001
Video Capture
Streaming
Extended Pix Format

Compliance test for device /dev/video0 (not using libv4l2):

Required ioctls:
test VIDIOC_QUERYCAP: OK

Allow for multiple opens:
test second video open: OK
test VIDIOC_QUERYCAP: OK
test VIDIOC_G/S_PRIORITY: OK
test for unlimited opens: OK

Debug ioctls:
test VIDIOC_DBG_G/S_REGISTER: OK (Not Supported)
test VIDIOC_LOG_STATUS: OK

Input ioctls:
test VIDIOC_G/S_TUNER/ENUM_FREQ_BANDS: OK (Not Supported)
test VIDIOC_G/S_FREQUENCY: OK (Not Supported)
test VIDIOC_S_HW_FREQ_SEEK: OK (Not Supported)
test VIDIOC_ENUMAUDIO: OK (Not Supported)
test VIDIOC_G/S/ENUMINPUT: OK
test VIDIOC_G/S_AUDIO: OK (Not Supported)
Inputs: 1 Audio Inputs: 0 Tuners: 0

Output ioctls:
test VIDIOC_G/S_MODULATOR: OK (Not Supported)
test VIDIOC_G/S_FREQUENCY: OK (Not Supported)
test VIDIOC_ENUMAUDOUT: OK (Not Supported)
test VIDIOC_G/S/ENUMOUTPUT: OK (Not Supported)
test VIDIOC_G/S_AUDOUT: OK (Not Supported)
Outputs: 0 Audio Outputs: 0 Modulators: 0

Input/Output configuration ioctls:
test VIDIOC_ENUM/G/S/QUERY_STD: OK (Not Supported)
test VIDIOC_ENUM/G/S/QUERY_DV_TIMINGS: OK (Not Supported)
test VIDIOC_DV_TIMINGS_CAP: OK (Not Supported)
test VIDIOC_G/S_EDID: OK (Not Supported)

Test input 0:

Control ioctls:
	test VIDIOC_QUERY_EXT_CTRL/QUERYMENU: OK
	test VIDIOC_QUERYCTRL: OK
	test VIDIOC_G/S_CTRL: OK
	test VIDIOC_G/S/TRY_EXT_CTRLS: OK
	test VIDIOC_(UN)SUBSCRIBE_EVENT/DQEVENT: OK
	test VIDIOC_G/S_JPEGCOMP: OK (Not Supported)
	Standard Controls: 1 Private Controls: 20

Format ioctls:
	test VIDIOC_ENUM_FMT/FRAMESIZES/FRAMEINTERVALS: OK
	fail: v4l2-test-formats.cpp(1184): ret && node->has_frmintervals
	test VIDIOC_G/S_PARM: FAIL
	test VIDIOC_G_FBUF: OK (Not Supported)
	test VIDIOC_G_FMT: OK
	test VIDIOC_TRY_FMT: OK
	test VIDIOC_S_FMT: OK
	test VIDIOC_G_SLICED_VBI_CAP: OK (Not Supported)
	test Cropping: OK (Not Supported)
	test Composing: OK (Not Supported)
	test Scaling: OK (Not Supported)

Codec ioctls:
	test VIDIOC_(TRY_)ENCODER_CMD: OK (Not Supported)
	test VIDIOC_G_ENC_INDEX: OK (Not Supported)
	test VIDIOC_(TRY_)DECODER_CMD: OK (Not Supported)

Buffer ioctls:
	test VIDIOC_REQBUFS/CREATE_BUFS/QUERYBUF: OK
	test VIDIOC_EXPBUF: OK

Test input 0:

Total: 43, Succeeded: 42, Failed: 1, Warnings: 0

$ sudo ./enable_trace.sh
tracer: nop

entries-in-buffer/entries-written: 0/0 #P:4

                          _-----=> irqs-off
                         / _----=> need-resched
                        | / _---=> hardirq/softirq
                        || / _--=> preempt-depth
                        ||| /     delay
       TASK-PID   CPU#  ||||    TIMESTAMP  FUNCTION
          | |       |   ||||       |         |

I reloaded the camera module only, no other changes, there is no error anymore. How can I debugger further to know if it’s working properly?

$ v4l2-ctl -d /dev/video0 --set-ctrl bypass_mode=0 --stream-mmap --stream-count=3 --stream-to test.raw --verbose
VIDIOC_QUERYCAP: ok
VIDIOC_S_EXT_CTRLS: ok
VIDIOC_REQBUFS: ok
VIDIOC_QUERYBUF: ok
VIDIOC_QBUF: ok
VIDIOC_QUERYBUF: ok
VIDIOC_QBUF: ok
VIDIOC_QUERYBUF: ok
VIDIOC_QBUF: ok
VIDIOC_QUERYBUF: ok
VIDIOC_QBUF: ok
VIDIOC_STREAMON: ok
Index : 0
Type : Video Capture
Flags : mapped
Field : None
Sequence : 0
Length : 10077696
Bytesused: 10077696
Timestamp: 18087.682640s (Monotonic, End-of-Frame)

Index    : 1
Type     : Video Capture
Flags    : mapped
Field    : None
Sequence : 1
Length   : 10077696
Bytesused: 10077696
Timestamp: 18087.709219s (Monotonic, End-of-Frame)

Index    : 2
Type     : Video Capture
Flags    : mapped
Field    : None
Sequence : 2
Length   : 10077696
Bytesused: 10077696
Timestamp: 18087.735798s (Monotonic, End-of-Frame)

VIDIOC_STREAMOFF: ok

when run with gstreamer, got the following error. Any clue?

$ gst-launch-1.0 nvarguscamerasrc sensor_id=0 ! ‘video/x-raw(memory:NVMM),width=2592, height=1944, framerate=30/1’ ! nvvidconv flip-method=0 ! ‘video/x-raw,width=960, height=540’ ! nvvidconv ! nvegltransform ! nveglglessink -e
Setting pipeline to PAUSED …

Using winsys: x11
Pipeline is live and does not need PREROLL …
Got context from element ‘eglglessink0’: gst.egl.EGLDisplay=context, display=(GstEGLDisplay)NULL;
Setting pipeline to PLAYING …
New clock: GstSystemClock
GST_ARGUS: Creating output stream
CONSUMER: Waiting until producer is connected…
GST_ARGUS: Available Sensor modes :
GST_ARGUS: 2593 x 1944 FR = 29.999999 fps Duration = 33333334 ; Analog Gain range min 1.000000, max 16.000000; Exposure Range min 34000, max 683709000;

GST_ARGUS: Running with following settings:
Camera index = 0
Camera mode = 0
Output Stream W = 2593 H = 1944
seconds to Run = 0
Frame Rate = 29.999999
GST_ARGUS: Setup Complete, Starting captures for 0 seconds
GST_ARGUS: Starting repeat capture requests.
CONSUMER: Producer has connected; continuing.
nvbuf_utils: dmabuf_fd -1 mapped entry NOT found
nvbuf_utils: Can not get HW buffer from FD… Exiting…
CONSUMER: Done Success
Got EOS from element “pipeline0”.
Execution ended after 0:00:04.133499131
Setting pipeline to PAUSED …
Setting pipeline to READY …
GST_ARGUS: Cleaning up
GST_ARGUS: Done Success
Setting pipeline to NULL …
Freeing pipeline …

hello zhuberger,

the resolution is incorrect here, Argus pipeline only support resolution in even numbers.
in addition, please assign sensor support width/height to the gst pipeline to avoid unknown issues.
thanks

Hi Jerry,

Good catch! There was a typo in device tree. I have just fixed it, and run the same command again. it hangs, and dmesg shows

[ 151.868236] tegra194-vi5 15c10000.vi: no reply from camera processor
[ 151.868257] tegra194-vi5 15c10000.vi: vi capture get status failed

More details below:

$ gst-launch-1.0 nvarguscamerasrc sensor_id=0 ! ‘video/x-raw(memory:NVMM),width=2592, height=1944, framerate=30/1’ ! nvvidconv flip-method=0 ! ‘video/x-raw,width=960, height=540’ ! nvvidconv ! nvegltransform ! nveglglessink -e
Setting pipeline to PAUSED …

Using winsys: x11
Pipeline is live and does not need PREROLL …
Got context from element ‘eglglessink0’: gst.egl.EGLDisplay=context, display=(GstEGLDisplay)NULL;
Setting pipeline to PLAYING …
New clock: GstSystemClock
GST_ARGUS: Creating output stream
CONSUMER: Waiting until producer is connected…
GST_ARGUS: Available Sensor modes :
GST_ARGUS: 2592 x 1944 FR = 29.999999 fps Duration = 33333334 ; Analog Gain range min 1.000000, max 16.000000; Exposure Range min 34000, max 683709000;

GST_ARGUS: Running with following settings:
Camera index = 0
Camera mode = 0
Output Stream W = 2592 H = 1944
seconds to Run = 0
Frame Rate = 29.999999
GST_ARGUS: Setup Complete, Starting captures for 0 seconds
GST_ARGUS: Starting repeat capture requests.
CONSUMER: Producer has connected; continuing.
nvbuf_utils: dmabuf_fd -1 mapped entry NOT found
nvbuf_utils: Can not get HW buffer from FD… Exiting…
CONSUMER: ERROR OCCURRED
ERROR: from element /GstPipeline:pipeline0/GstNvArgusCameraSrc:nvarguscamerasrc0: CANCELLED
Additional debug info:
Argus Error Status
EOS on shutdown enabled – waiting for EOS after Error
Waiting for EOS…

$ dmesg
[ 151.984459] imx219 10-0036: imx219_start_streaming: enter start_streaming (ov5675)
[ 153.500200] fence timeout on [ffffffc0fa6a50c0] after 1500ms
[ 153.500208] tegra194-vi5 15c10000.vi: no reply from camera processor
[ 153.500219] tegra194-vi5 15c10000.vi: vi capture get status failed
[ 153.500492] name=[nvhost_sync:39], current value=0 waiting value=22
[ 153.500500] ---- mlocks ----

[ 153.500551] ---- syncpts ----
[ 153.500568] id 2 (disp_a) min 2365 max 2365 refs 1 (previous client : )
[ 153.500576] id 3 (disp_b) min 1 max 1 refs 1 (previous client : )
[ 153.500584] id 4 (disp_c) min 1 max 1 refs 1 (previous client : )
[ 153.500599] id 8 (vblank0) min 11148 max -2 refs 1 (previous client : )
[ 153.500616] id 17 (gv11b_511) min 26508 max 26508 refs 1 (previous client : )
[ 153.500624] id 18 (gv11b_510) min 40 max 40 refs 1 (previous client : )
[ 153.500632] id 19 (gv11b_509) min 6065 max 6065 refs 1 (previous client : gv11b_509)
[ 153.500639] id 20 (gv11b_508) min 3 max 3 refs 1 (previous client : )
[ 153.500646] id 21 (gv11b_507) min 2992 max 2992 refs 1 (previous client : )
[ 153.500663] id 30 (gv11b_505_user) min 28 max 0 refs 1 (previous client : )
[ 153.500684] id 42 (gv11b_501) min 3 max 3 refs 1 (previous client : )
[ 153.500691] id 43 (gv11b_500) min 4 max 4 refs 1 (previous client : )
[ 153.500698] id 44 (gv11b_499) min 3 max 3 refs 1 (previous client : )
[ 153.500705] id 45 (gv11b_498) min 3 max 3 refs 1 (previous client : )
[ 153.500746] id 46 (gv11b_497) min 3 max 3 refs 1 (previous client : )
[ 153.500754] id 47 (gv11b_496) min 3 max 3 refs 1 (previous client : )
[ 153.500957] imx219 10-0036: imx219_stop_streaming: enter stop_streaming (ov5675)

[ 153.501577] ---- channels ----
[ 153.501612]
channel 2 - 15820000.se

[ 153.501618] NvHost basic channel registers:
[ 153.501625] CMDFIFO_STAT_0: 00002040
[ 153.501630] CMDFIFO_RDATA_0: 8269268f
[ 153.501638] CMDP_OFFSET_0: 00000000
[ 153.501644] CMDP_CLASS_0: 00000000
[ 153.501649] CHANNELSTAT_0: 00000000
[ 153.501654] The CDMA sync queue is empty.

[ 153.501665]
channel 3 - 15830000.se

[ 153.501670] NvHost basic channel registers:
[ 153.501676] CMDFIFO_STAT_0: 00002040
[ 153.501681] CMDFIFO_RDATA_0: 84f5a090
[ 153.501688] CMDP_OFFSET_0: 00000000
[ 153.501693] CMDP_CLASS_0: 00000000
[ 153.501698] CHANNELSTAT_0: 00000000
[ 153.501703] The CDMA sync queue is empty.

[ 153.501714]
channel 4 - 15840000.se

[ 153.501718] NvHost basic channel registers:
[ 153.501723] CMDFIFO_STAT_0: 00002040
[ 153.501729] CMDFIFO_RDATA_0: 04008000
[ 153.501735] CMDP_OFFSET_0: 00000000
[ 153.501740] CMDP_CLASS_0: 00000000
[ 153.501745] CHANNELSTAT_0: 00000000
[ 153.501750] The CDMA sync queue is empty.

[ 153.501763]
---- host general irq ----

[ 153.501770] sync_intc0mask = 0x00000001
[ 153.501776] sync_intmask = 0x50000003
[ 153.501781]
---- host syncpt irq mask ----

[ 153.501790]
---- host syncpt irq status ----

[ 153.501797] syncpt_thresh_cpu0_int_status(0) = 0x00000000
[ 153.501803] syncpt_thresh_cpu0_int_status(1) = 0x00000000
[ 153.501810] syncpt_thresh_cpu0_int_status(2) = 0x00000000
[ 153.501817] syncpt_thresh_cpu0_int_status(3) = 0x00000000
[ 153.501824] syncpt_thresh_cpu0_int_status(4) = 0x00000000
[ 153.501830] syncpt_thresh_cpu0_int_status(5) = 0x00000000
[ 153.501837] syncpt_thresh_cpu0_int_status(6) = 0x00000000
[ 153.501844] syncpt_thresh_cpu0_int_status(7) = 0x00000000
[ 153.501851] syncpt_thresh_cpu0_int_status(8) = 0x00000000
[ 153.501857] syncpt_thresh_cpu0_int_status(9) = 0x00000000
[ 153.501863] syncpt_thresh_cpu0_int_status(10) = 0x00000000
[ 153.501869] syncpt_thresh_cpu0_int_status(11) = 0x00000000
[ 153.501875] syncpt_thresh_cpu0_int_status(12) = 0x00000000
[ 153.501881] syncpt_thresh_cpu0_int_status(13) = 0x00000000
[ 153.501887] syncpt_thresh_cpu0_int_status(14) = 0x00000000
[ 153.501893] syncpt_thresh_cpu0_int_status(15) = 0x00000000
[ 153.501899] syncpt_thresh_cpu0_int_status(16) = 0x00000000
[ 153.501905] syncpt_thresh_cpu0_int_status(17) = 0x00000000
[ 153.501911] syncpt_thresh_cpu0_int_status(18) = 0x00000000
[ 153.501916] syncpt_thresh_cpu0_int_status(19) = 0x00000000
[ 153.501922] syncpt_thresh_cpu0_int_status(20) = 0x00000000
[ 153.501928] syncpt_thresh_cpu0_int_status(21) = 0x00000000

And trace log:

tracer: nop

entries-in-buffer/entries-written: 21/21 #P:4

                          _-----=> irqs-off
                         / _----=> need-resched
                        | / _---=> hardirq/softirq
                        || / _--=> preempt-depth
                        ||| /     delay
       TASK-PID   CPU#  ||||    TIMESTAMP  FUNCTION
          | |       |   ||||       |         |
 kworker/1:2-9435  [001] ....  1451.838137: rtos_queue_peek_from_isr_failed: tstamp:45912745491 queue:0x0bcbbbb8
 kworker/1:2-9435  [001] ....  1451.950151: rtos_queue_peek_from_isr_failed: tstamp:45917745491 queue:0x0bcbbbb8
 kworker/1:2-9435  [001] ....  1452.118174: rtos_queue_peek_from_isr_failed: tstamp:45922745495 queue:0x0bcbbbb8
 kworker/1:2-9435  [001] ....  1452.290146: rtos_queue_peek_from_isr_failed: tstamp:45927745492 queue:0x0bcbbbb8
 kworker/1:2-9435  [001] ....  1452.458124: rtos_queue_peek_from_isr_failed: tstamp:45932745489 queue:0x0bcbbbb8
 kworker/1:2-9435  [001] ....  1452.626164: rtos_queue_peek_from_isr_failed: tstamp:45937745495 queue:0x0bcbbbb8
 kworker/1:2-9435  [001] ....  1452.794121: rtos_queue_peek_from_isr_failed: tstamp:45942745495 queue:0x0bcbbbb8
 kworker/1:2-9435  [001] ....  1452.910146: rtos_queue_peek_from_isr_failed: tstamp:45947745492 queue:0x0bcbbbb8
 kworker/1:2-9435  [001] ....  1453.086182: rtos_queue_peek_from_isr_failed: tstamp:45952745494 queue:0x0bcbbbb8
 kworker/1:2-9435  [001] ....  1453.254159: rtos_queue_peek_from_isr_failed: tstamp:45957745492 queue:0x0bcbbbb8
 kworker/1:2-9435  [001] ....  1453.422135: rtos_queue_peek_from_isr_failed: tstamp:45962745492 queue:0x0bcbbbb8
 kworker/1:2-9435  [001] ....  1453.590164: rtos_queue_peek_from_isr_failed: tstamp:45967745491 queue:0x0bcbbbb8
 kworker/1:2-9435  [001] ....  1453.758110: rtos_queue_peek_from_isr_failed: tstamp:45972745491 queue:0x0bcbbbb8
 kworker/1:2-9435  [001] ....  1453.870126: rtos_queue_peek_from_isr_failed: tstamp:45977745495 queue:0x0bcbbbb8
 kworker/1:2-9435  [001] ....  1454.038131: rtos_queue_peek_from_isr_failed: tstamp:45982745491 queue:0x0bcbbbb8
 kworker/1:2-9435  [001] ....  1454.206095: rtos_queue_peek_from_isr_failed: tstamp:45987745494 queue:0x0bcbbbb8
 kworker/1:2-9435  [001] ....  1454.374129: rtos_queue_peek_from_isr_failed: tstamp:45992745495 queue:0x0bcbbbb8
 kworker/1:2-9435  [001] ....  1454.542107: rtos_queue_peek_from_isr_failed: tstamp:45997745494 queue:0x0bcbbbb8
 kworker/1:2-9435  [001] ....  1454.710093: rtos_queue_peek_from_isr_failed: tstamp:46002745491 queue:0x0bcbbbb8
 kworker/1:2-9435  [001] ....  1454.878103: rtos_queue_peek_from_isr_failed: tstamp:46007745495 queue:0x0bcbbbb8
 kworker/1:2-9435  [001] ....  1454.990093: rtos_queue_peek_from_isr_failed: tstamp:46012745491 queue:0x0bcbbbb8

hello zhuberger,

those failure means the camera isn’t response, it may due to device tree settings failures.
how about using v4l2 standard utility…
please check you’re able to parse the available modes,
$ v4l2-ctl -d /dev/video0 --list-formats-ext
please also try to fetch the stream,
$ v4l2-ctl -d /dev/video0 --set-fmt-video=width=1920,height=1080,pixelformat=RG10 --set-ctrl bypass_mode=0 --stream-mmap --stream-count=30

Hi Jerry,

Thank you for your quick response! Both commands look ok. No errors at least. The error shows up as long as I run gstreamer command.

$ v4l2-ctl -d /dev/video0 --list-formats-ext
ioctl: VIDIOC_ENUM_FMT
Index : 0
Type : Video Capture
Pixel Format: ‘BG10’
Name : 10-bit Bayer BGBG/GRGR
Size: Discrete 2592x1944
Interval: Discrete 0.033s (30.000 fps)

$ v4l2-ctl -d /dev/video0 --set-fmt-video=width=1920,height=1080,pixelformat=RG10 --set-ctrl bypass_mode=0 --stream-mmap --stream-count=30
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

$ dmesg | grep vi5
[ 6.274968] tegra194-vi5 15c10000.vi: using default number of vi channels, 36
[ 6.277471] tegra194-vi5 15c10000.vi: initialized
[ 6.282158] tegra194-vi5 15c10000.vi: subdev 15a00000.nvcsi–2 bound
[ 6.282290] tegra194-vi5 15c10000.vi: subdev 15a00000.nvcsi–1 bound
[ 9.160906] tegra194-vi5 15c10000.vi: subdev imx219 10-0036 bound
[ 57.699403] tegra194-vi5 15c10000.vi: subdev imx219 10-0036 unbind
[ 90.609360] tegra194-vi5 15c10000.vi: subdev imx219 10-0036 bound
[ 132.007481] [RCE] vi5_hwinit: firmware CL2018101701 protocol version 2.2

hello zhuberger,

please try below to boost all the clocks, and then launch gstreamer command to enable the preview stream,
for example,

sudo su
echo 1 > /sys/kernel/debug/bpmp/debug/clk/vi/mrq_rate_locked
echo 1 > /sys/kernel/debug/bpmp/debug/clk/isp/mrq_rate_locked
echo 1 > /sys/kernel/debug/bpmp/debug/clk/nvcsi/mrq_rate_locked
cat /sys/kernel/debug/bpmp/debug/clk/vi/max_rate |tee /sys/kernel/debug/bpmp/debug/clk/vi/rate
cat /sys/kernel/debug/bpmp/debug/clk/isp/max_rate | tee  /sys/kernel/debug/bpmp/debug/clk/isp/rate
cat /sys/kernel/debug/bpmp/debug/clk/nvcsi/max_rate | tee /sys/kernel/debug/bpmp/debug/clk/nvcsi/rate

Hi Jerry,

Following your instruction above, I boosted the clocks. It hangs as well when running gstreamer command, and gets the same VI error.

Also I checked RAW image captured by $ v4l2-ctl -d /dev/video0 --set-ctrl bypass_mode=0 --stream-mmap --stream-count=1 --stream-to test_1frame_001.raw. The image looks great! The issue now is how to preview images/videos from camera. Is the issue related with system clock?

$ v4l2-ctl -d /dev/video0 --set-fmt-video=width=1920,height=1080,pixelformat=RG10 --set-ctrl bypass_mode=0 --stream-mmap --stream-count=30
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

$ sudo su
echo 1 > /sys/kernel/debug/bpmp/debug/clk/vi/mrq_rate_locked
echo 1 > /sys/kernel/debug/bpmp/debug/clk/isp/mrq_rate_locked
echo 1 > /sys/kernel/debug/bpmp/debug/clk/nvcsi/mrq_rate_locked

cat /sys/kernel/debug/bpmp/debug/clk/vi/max_rate |tee /sys/kernel/debug/bpmp/debug/clk/vi/rate
460800000
cat /sys/kernel/debug/bpmp/debug/clk/isp/max_rate | tee /sys/kernel/debug/bpmp/debug/clk/isp/rate
576000000
cat /sys/kernel/debug/bpmp/debug/clk/isp/max_rate | tee /sys/kernel/debug/bpmp/debug/clk/isp/rate
576000000

$ gst-launch-1.0 nvarguscamerasrc sensor_id=0 ! ‘video/x-raw(memory:NVMM),width=2592, height=1944, framerate=30/1’ ! nvvidconv flip-method=0 ! ‘video/x-raw,width=960, height=540’ ! nvvidconv ! nvegltransform ! nveglglessink -e
Setting pipeline to PAUSED …

Using winsys: x11
Pipeline is live and does not need PREROLL …
Got context from element ‘eglglessink0’: gst.egl.EGLDisplay=context, display=(GstEGLDisplay)NULL;
Setting pipeline to PLAYING …
New clock: GstSystemClock
GST_ARGUS: Creating output stream
CONSUMER: Waiting until producer is connected…
GST_ARGUS: Available Sensor modes :
GST_ARGUS: 2592 x 1944 FR = 29.999999 fps Duration = 33333334 ; Analog Gain range min 1.000000, max 16.000000; Exposure Range min 34000, max 683709000;

GST_ARGUS: Running with following settings:
Camera index = 0
Camera mode = 0
Output Stream W = 2592 H = 1944
seconds to Run = 0
Frame Rate = 29.999999
GST_ARGUS: Setup Complete, Starting captures for 0 seconds
GST_ARGUS: Starting repeat capture requests.
CONSUMER: Producer has connected; continuing.
nvbuf_utils: dmabuf_fd -1 mapped entry NOT found
nvbuf_utils: Can not get HW buffer from FD… Exiting…
CONSUMER: ERROR OCCURRED
ERROR: from element /GstPipeline:pipeline0/GstNvArgusCameraSrc:nvarguscamerasrc0: CANCELLED
Additional debug info:
Argus Error Status
EOS on shutdown enabled – waiting for EOS after Error
Waiting for EOS…

$ dmesg | grep vi5
[ 4775.386616] [RCE] vi5_hwinit: firmware CL2018101701 protocol version 2.2
[ 4777.294571] tegra194-vi5 15c10000.vi: no reply from camera processor
[ 4777.294733] tegra194-vi5 15c10000.vi: vi capture get status failed
[ 4778.926576] tegra194-vi5 15c10000.vi: no reply from camera processor
[ 4778.926587] tegra194-vi5 15c10000.vi: vi capture get status failed
[ 4780.558550] tegra194-vi5 15c10000.vi: no reply from camera processor
[ 4780.558560] tegra194-vi5 15c10000.vi: vi capture get status failed
[ 4782.190546] tegra194-vi5 15c10000.vi: no reply from camera processor
[ 4782.190710] tegra194-vi5 15c10000.vi: vi capture get status failed

VI trace:
kworker/0:0-8665 [000] … 4774.990583: rtos_queue_peek_from_isr_failed: tstamp:149765642056 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4774.990591: rtcpu_start: tstamp:149765643426
kworker/0:0-8665 [000] … 4774.990593: rtos_queue_send_from_isr_failed: tstamp:149765676338 queue:0x0bcb2e38
kworker/0:0-8665 [000] … 4774.990594: rtos_queue_send_from_isr_failed: tstamp:149765676490 queue:0x0bcb76a0
kworker/0:0-8665 [000] … 4774.990595: rtos_queue_send_from_isr_failed: tstamp:149765676642 queue:0x0bcb9220
kworker/0:0-8665 [000] … 4774.990596: rtos_queue_send_from_isr_failed: tstamp:149765676792 queue:0x0bcb9fe0
kworker/0:0-8665 [000] … 4774.990597: rtos_queue_send_from_isr_failed: tstamp:149765676939 queue:0x0bcbada0
kworker/0:0-8665 [000] … 4774.990599: rtcpu_string: tstamp:149765677408 id:0x04010000 str:“Configuring ISP GoS.
"
kworker/0:0-8665 [000] … 4774.990616: rtcpu_string: tstamp:149765677595 id:0x04010000 str:” VM GOS[#0] addr=0xc2100000
"
kworker/0:0-8665 [000] … 4774.990622: rtcpu_string: tstamp:149765677850 id:0x04010000 str:" VM GOS[#1] addr=0xc2101000
"
kworker/0:0-8665 [000] … 4774.990627: rtcpu_string: tstamp:149765678097 id:0x04010000 str:" VM GOS[#2] addr=0xc2102000
"
kworker/0:0-8665 [000] … 4774.990632: rtcpu_string: tstamp:149765678348 id:0x04010000 str:" VM GOS[#3] addr=0xc2103000
"
kworker/0:0-8665 [000] … 4774.990661: rtcpu_string: tstamp:149765678582 id:0x04010000 str:" VM GOS[#4] addr=0xc2104000
"
kworker/0:0-8665 [000] … 4774.990669: rtcpu_string: tstamp:149765678815 id:0x04010000 str:" VM GOS[#5] addr=0xc2105000
"
kworker/0:0-8665 [000] … 4775.158555: rtos_queue_peek_from_isr_failed: tstamp:149770642455 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4775.330559: rtos_queue_peek_from_isr_failed: tstamp:149775642450 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4775.386551: rtos_queue_send_from_isr_failed: tstamp:149777001079 queue:0x0bcb2e38
kworker/0:0-8665 [000] … 4775.386556: rtos_queue_send_from_isr_failed: tstamp:149777001232 queue:0x0bcb76a0
kworker/0:0-8665 [000] … 4775.386556: rtos_queue_send_from_isr_failed: tstamp:149777001384 queue:0x0bcb9220
kworker/0:0-8665 [000] … 4775.386557: rtos_queue_send_from_isr_failed: tstamp:149777001530 queue:0x0bcb9fe0
kworker/0:0-8665 [000] … 4775.386557: rtos_queue_send_from_isr_failed: tstamp:149777001678 queue:0x0bcbada0
kworker/0:0-8665 [000] … 4775.386559: rtcpu_string: tstamp:149777002115 id:0x04010000 str:"Configuring VI GoS.
"
kworker/0:0-8665 [000] … 4775.386590: rtcpu_string: tstamp:149777002316 id:0x04010000 str:"VM GOS[#0] addr=0xc2100000
"
kworker/0:0-8665 [000] … 4775.386595: rtcpu_string: tstamp:149777002566 id:0x04010000 str:"VM GOS[#1] addr=0xc2101000
"
kworker/0:0-8665 [000] … 4775.386599: rtcpu_string: tstamp:149777002810 id:0x04010000 str:"VM GOS[#2] addr=0xc2102000
"
kworker/0:0-8665 [000] … 4775.386603: rtcpu_string: tstamp:149777003042 id:0x04010000 str:"VM GOS[#3] addr=0xc2103000
"
kworker/0:0-8665 [000] … 4775.386607: rtcpu_string: tstamp:149777003291 id:0x04010000 str:"VM GOS[#4] addr=0xc2104000
"
kworker/0:0-8665 [000] … 4775.386610: rtcpu_string: tstamp:149777003522 id:0x04010000 str:"VM GOS[#5] addr=0xc2105000
"
kworker/0:0-8665 [000] … 4775.386614: rtcpu_string: tstamp:149777012241 id:0x04010000 str:“vi5_hwinit: firmware CL2018101701 protocol vers”
kworker/0:0-8665 [000] … 4775.386615: rtcpu_string: tstamp:149777012359 id:0x04010000 str:"on 2.2
"
kworker/0:0-8665 [000] … 4775.386618: rtos_queue_send_from_isr_failed: tstamp:149777023156 queue:0x0bcb2e38
kworker/0:0-8665 [000] … 4775.386619: rtos_queue_send_from_isr_failed: tstamp:149777023325 queue:0x0bcb76a0
kworker/0:0-8665 [000] … 4775.386619: rtos_queue_send_from_isr_failed: tstamp:149777023479 queue:0x0bcb9220
kworker/0:0-8665 [000] … 4775.386620: rtos_queue_send_from_isr_failed: tstamp:149777023624 queue:0x0bcb9fe0
kworker/0:0-8665 [000] … 4775.386620: rtos_queue_send_from_isr_failed: tstamp:149777023771 queue:0x0bcbada0
kworker/0:0-8665 [000] … 4775.498548: rtos_queue_peek_from_isr_failed: tstamp:149780642452 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4775.610596: rtos_queue_send_from_isr_failed: tstamp:149785277748 queue:0x0bcb2e38
kworker/0:0-8665 [000] … 4775.610600: rtos_queue_send_from_isr_failed: tstamp:149785277896 queue:0x0bcb76a0
kworker/0:0-8665 [000] … 4775.610601: rtos_queue_send_from_isr_failed: tstamp:149785278046 queue:0x0bcb9220
kworker/0:0-8665 [000] … 4775.610601: rtos_queue_send_from_isr_failed: tstamp:149785278194 queue:0x0bcb9fe0
kworker/0:0-8665 [000] … 4775.610602: rtos_queue_send_from_isr_failed: tstamp:149785278339 queue:0x0bcbada0
kworker/0:0-8665 [000] … 4775.610602: rtos_queue_send_from_isr_failed: tstamp:149785278543 queue:0x0bcb2dd0
kworker/0:0-8665 [000] … 4775.610603: rtos_queue_send_from_isr_failed: tstamp:149785278679 queue:0x0bcb2e38
kworker/0:0-8665 [000] … 4775.610604: rtos_queue_send_from_isr_failed: tstamp:149785278815 queue:0x0bcb7638
kworker/0:0-8665 [000] … 4775.610604: rtos_queue_send_from_isr_failed: tstamp:149785278950 queue:0x0bcb76a0
kworker/0:0-8665 [000] … 4775.610604: rtos_queue_send_from_isr_failed: tstamp:149785279086 queue:0x0bcb91b8
kworker/0:0-8665 [000] … 4775.610605: rtos_queue_send_from_isr_failed: tstamp:149785279221 queue:0x0bcb9220
kworker/0:0-8665 [000] … 4775.610605: rtos_queue_send_from_isr_failed: tstamp:149785279357 queue:0x0bcb9f78
kworker/0:0-8665 [000] … 4775.610606: rtos_queue_send_from_isr_failed: tstamp:149785279489 queue:0x0bcb9fe0
kworker/0:0-8665 [000] … 4775.610606: rtos_queue_send_from_isr_failed: tstamp:149785279624 queue:0x0bcbad38
kworker/0:0-8665 [000] … 4775.610607: rtos_queue_send_from_isr_failed: tstamp:149785279758 queue:0x0bcbada0
kworker/0:0-8665 [000] … 4775.666622: rtos_queue_send_from_isr_failed: tstamp:149785301827 queue:0x0bcb2e38
kworker/0:0-8665 [000] … 4775.666626: rtos_queue_send_from_isr_failed: tstamp:149785301979 queue:0x0bcb76a0
kworker/0:0-8665 [000] … 4775.666626: rtos_queue_send_from_isr_failed: tstamp:149785302131 queue:0x0bcb9220
kworker/0:0-8665 [000] … 4775.666627: rtos_queue_send_from_isr_failed: tstamp:149785302277 queue:0x0bcb9fe0
kworker/0:0-8665 [000] … 4775.666628: rtos_queue_send_from_isr_failed: tstamp:149785302422 queue:0x0bcbada0
kworker/0:0-8665 [000] … 4775.666628: rtos_queue_send_from_isr_failed: tstamp:149785305843 queue:0x0bcb2e38
kworker/0:0-8665 [000] … 4775.666628: rtos_queue_send_from_isr_failed: tstamp:149785305988 queue:0x0bcb76a0
kworker/0:0-8665 [000] … 4775.666629: rtos_queue_send_from_isr_failed: tstamp:149785306139 queue:0x0bcb9220
kworker/0:0-8665 [000] … 4775.666629: rtos_queue_send_from_isr_failed: tstamp:149785306284 queue:0x0bcb9fe0
kworker/0:0-8665 [000] … 4775.666630: rtos_queue_send_from_isr_failed: tstamp:149785306429 queue:0x0bcbada0
kworker/0:0-8665 [000] … 4775.666631: rtos_queue_peek_from_isr_failed: tstamp:149785642451 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4775.666632: rtos_queue_send_from_isr_failed: tstamp:149786300949 queue:0x0bcb2e38
kworker/0:0-8665 [000] … 4775.666632: rtos_queue_send_from_isr_failed: tstamp:149786301100 queue:0x0bcb76a0
kworker/0:0-8665 [000] … 4775.666633: rtos_queue_send_from_isr_failed: tstamp:149786301250 queue:0x0bcb9220
kworker/0:0-8665 [000] … 4775.666633: rtos_queue_send_from_isr_failed: tstamp:149786301398 queue:0x0bcb9fe0
kworker/0:0-8665 [000] … 4775.666634: rtos_queue_send_from_isr_failed: tstamp:149786301543 queue:0x0bcbada0
kworker/0:0-8665 [000] … 4775.666636: rtcpu_string: tstamp:149786301984 id:0x04010000 str:"Configuring VI GoS.
"
kworker/0:0-8665 [000] … 4775.666647: rtcpu_string: tstamp:149786302198 id:0x04010000 str:"VM GOS[#0] addr=0xc2100000
"
kworker/0:0-8665 [000] … 4775.666652: rtcpu_string: tstamp:149786302452 id:0x04010000 str:"VM GOS[#1] addr=0xc2101000
"
kworker/0:0-8665 [000] … 4775.666655: rtcpu_string: tstamp:149786302696 id:0x04010000 str:"VM GOS[#2] addr=0xc2102000
"
kworker/0:0-8665 [000] … 4775.666658: rtcpu_string: tstamp:149786302927 id:0x04010000 str:"VM GOS[#3] addr=0xc2103000
"
kworker/0:0-8665 [000] … 4775.666664: rtcpu_string: tstamp:149786303175 id:0x04010000 str:"VM GOS[#4] addr=0xc2104000
"
kworker/0:0-8665 [000] … 4775.666668: rtcpu_string: tstamp:149786303408 id:0x04010000 str:"VM GOS[#5] addr=0xc2105000
"
kworker/0:0-8665 [000] … 4775.666672: rtos_queue_send_from_isr_failed: tstamp:149786314950 queue:0x0bcb2e38
kworker/0:0-8665 [000] … 4775.666672: rtos_queue_send_from_isr_failed: tstamp:149786315100 queue:0x0bcb76a0
kworker/0:0-8665 [000] … 4775.666673: rtos_queue_send_from_isr_failed: tstamp:149786315251 queue:0x0bcb9220
kworker/0:0-8665 [000] … 4775.666673: rtos_queue_send_from_isr_failed: tstamp:149786315397 queue:0x0bcb9fe0
kworker/0:0-8665 [000] … 4775.666674: rtos_queue_send_from_isr_failed: tstamp:149786315546 queue:0x0bcbada0
kworker/0:0-8665 [000] … 4775.666674: rtos_queue_send_from_isr_failed: tstamp:149786321451 queue:0x0bcb2e38
kworker/0:0-8665 [000] … 4775.666675: rtos_queue_send_from_isr_failed: tstamp:149786321617 queue:0x0bcb76a0
kworker/0:0-8665 [000] … 4775.666675: rtos_queue_send_from_isr_failed: tstamp:149786321769 queue:0x0bcb9220
kworker/0:0-8665 [000] … 4775.666675: rtos_queue_send_from_isr_failed: tstamp:149786321919 queue:0x0bcb9fe0
kworker/0:0-8665 [000] … 4775.666676: rtos_queue_send_from_isr_failed: tstamp:149786322065 queue:0x0bcbada0
kworker/0:0-8665 [000] … 4775.778533: rtos_queue_send_from_isr_failed: tstamp:149790207885 queue:0x0bcb2e38
kworker/0:0-8665 [000] … 4775.778537: rtos_queue_send_from_isr_failed: tstamp:149790208035 queue:0x0bcb76a0
kworker/0:0-8665 [000] … 4775.778538: rtos_queue_send_from_isr_failed: tstamp:149790208186 queue:0x0bcb9220
kworker/0:0-8665 [000] … 4775.778539: rtos_queue_send_from_isr_failed: tstamp:149790208333 queue:0x0bcb9fe0
kworker/0:0-8665 [000] … 4775.778539: rtos_queue_send_from_isr_failed: tstamp:149790208478 queue:0x0bcbada0
kworker/0:0-8665 [000] … 4775.778541: rtcpu_string: tstamp:149790209357 id:0x04010000 str:"VI GOS[#0] set to VM GOS[4] base 0xc2104000
"
kworker/0:0-8665 [000] … 4775.778585: rtcpu_vinotify_event: tstamp:149790236690 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:150427091744 data:0x10000000
kworker/0:0-8665 [000] … 4775.778586: rtcpu_vinotify_event: tstamp:149790236836 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:150427099904 data:0x31000001
kworker/0:0-8665 [000] … 4775.778586: rtcpu_vinotify_event: tstamp:149790236997 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:150427102080 data:0x07020001
kworker/0:0-8665 [000] … 4775.834544: rtos_queue_peek_from_isr_failed: tstamp:149790642447 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4775.834550: rtos_queue_send_from_isr_failed: tstamp:149791251030 queue:0x0bcb2e38
kworker/0:0-8665 [000] … 4775.834551: rtos_queue_send_from_isr_failed: tstamp:149791251180 queue:0x0bcb76a0
kworker/0:0-8665 [000] … 4775.834552: rtos_queue_send_from_isr_failed: tstamp:149791251332 queue:0x0bcb9220
kworker/0:0-8665 [000] … 4775.834553: rtos_queue_send_from_isr_failed: tstamp:149791251477 queue:0x0bcb9fe0
kworker/0:0-8665 [000] … 4775.834554: rtos_queue_send_from_isr_failed: tstamp:149791251624 queue:0x0bcbada0
kworker/0:0-8665 [000] … 4775.834554: rtos_queue_send_from_isr_failed: tstamp:149791260442 queue:0x0bcb2e38
kworker/0:0-8665 [000] … 4775.834555: rtos_queue_send_from_isr_failed: tstamp:149791260590 queue:0x0bcb76a0
kworker/0:0-8665 [000] … 4775.834556: rtos_queue_send_from_isr_failed: tstamp:149791260742 queue:0x0bcb9220
kworker/0:0-8665 [000] … 4775.834556: rtos_queue_send_from_isr_failed: tstamp:149791260887 queue:0x0bcb9fe0
kworker/0:0-8665 [000] … 4775.834557: rtos_queue_send_from_isr_failed: tstamp:149791261035 queue:0x0bcbada0
kworker/0:0-8665 [000] … 4775.834559: rtcpu_vinotify_event: tstamp:149791592968 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:150460476704 data:0x10000000
kworker/0:0-8665 [000] … 4775.834560: rtcpu_vinotify_event: tstamp:149791593150 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:150460484992 data:0x31000002
kworker/0:0-8665 [000] … 4775.946563: rtos_queue_peek_from_isr_failed: tstamp:149795642450 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4776.114549: rtos_queue_peek_from_isr_failed: tstamp:149800642447 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4776.282564: rtos_queue_peek_from_isr_failed: tstamp:149805642450 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4776.450554: rtos_queue_peek_from_isr_failed: tstamp:149810642447 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4776.618540: rtos_queue_peek_from_isr_failed: tstamp:149815642451 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4776.786531: rtos_queue_peek_from_isr_failed: tstamp:149820642447 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4776.954523: rtos_queue_peek_from_isr_failed: tstamp:149825642446 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4777.066526: rtos_queue_peek_from_isr_failed: tstamp:149830642447 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4777.234583: rtos_queue_peek_from_isr_failed: tstamp:149835642447 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4777.410537: rtos_queue_peek_from_isr_failed: tstamp:149840642448 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4777.466554: rtos_queue_send_from_isr_failed: tstamp:149841553800 queue:0x0bcb2e38
kworker/0:0-8665 [000] … 4777.466558: rtos_queue_send_from_isr_failed: tstamp:149841553954 queue:0x0bcb76a0
kworker/0:0-8665 [000] … 4777.466558: rtos_queue_send_from_isr_failed: tstamp:149841554104 queue:0x0bcb9220
kworker/0:0-8665 [000] … 4777.466559: rtos_queue_send_from_isr_failed: tstamp:149841554252 queue:0x0bcb9fe0
kworker/0:0-8665 [000] … 4777.466560: rtos_queue_send_from_isr_failed: tstamp:149841554397 queue:0x0bcbada0
kworker/0:0-8665 [000] … 4777.466561: rtos_queue_send_from_isr_failed: tstamp:149842602220 queue:0x0bcb2e38
kworker/0:0-8665 [000] … 4777.466561: rtos_queue_send_from_isr_failed: tstamp:149842602369 queue:0x0bcb76a0
kworker/0:0-8665 [000] … 4777.466562: rtos_queue_send_from_isr_failed: tstamp:149842602520 queue:0x0bcb9220
kworker/0:0-8665 [000] … 4777.466563: rtos_queue_send_from_isr_failed: tstamp:149842602666 queue:0x0bcb9fe0
kworker/0:0-8665 [000] … 4777.466564: rtos_queue_send_from_isr_failed: tstamp:149842602813 queue:0x0bcbada0
kworker/0:0-8665 [000] … 4777.578535: rtos_queue_peek_from_isr_failed: tstamp:149845642460 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4777.746550: rtos_queue_peek_from_isr_failed: tstamp:149850642447 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4777.914548: rtos_queue_peek_from_isr_failed: tstamp:149855642448 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4778.026559: rtos_queue_peek_from_isr_failed: tstamp:149860642447 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4778.194547: rtos_queue_peek_from_isr_failed: tstamp:149865642447 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4778.362547: rtos_queue_peek_from_isr_failed: tstamp:149870642450 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4778.530535: rtos_queue_peek_from_isr_failed: tstamp:149875642447 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4778.698545: rtos_queue_peek_from_isr_failed: tstamp:149880642447 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4778.866549: rtos_queue_peek_from_isr_failed: tstamp:149885642447 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4779.039740: rtos_queue_peek_from_isr_failed: tstamp:149890642447 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4779.094541: rtos_queue_send_from_isr_failed: tstamp:149892573779 queue:0x0bcb2e38
kworker/0:0-8665 [000] … 4779.094546: rtos_queue_send_from_isr_failed: tstamp:149892573931 queue:0x0bcb76a0
kworker/0:0-8665 [000] … 4779.094547: rtos_queue_send_from_isr_failed: tstamp:149892574081 queue:0x0bcb9220
kworker/0:0-8665 [000] … 4779.094548: rtos_queue_send_from_isr_failed: tstamp:149892574227 queue:0x0bcb9fe0
kworker/0:0-8665 [000] … 4779.094549: rtos_queue_send_from_isr_failed: tstamp:149892574374 queue:0x0bcbada0
kworker/0:0-8665 [000] … 4779.094550: rtos_queue_send_from_isr_failed: tstamp:149893628824 queue:0x0bcb2e38
kworker/0:0-8665 [000] … 4779.094551: rtos_queue_send_from_isr_failed: tstamp:149893628976 queue:0x0bcb76a0
kworker/0:0-8665 [000] … 4779.094551: rtos_queue_send_from_isr_failed: tstamp:149893629125 queue:0x0bcb9220
kworker/0:0-8665 [000] … 4779.094552: rtos_queue_send_from_isr_failed: tstamp:149893629272 queue:0x0bcb9fe0
kworker/0:0-8665 [000] … 4779.094553: rtos_queue_send_from_isr_failed: tstamp:149893629419 queue:0x0bcbada0
kworker/0:0-8665 [000] … 4779.150533: rtos_queue_peek_from_isr_failed: tstamp:149895642447 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4779.322537: rtos_queue_peek_from_isr_failed: tstamp:149900642447 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4779.490550: rtos_queue_peek_from_isr_failed: tstamp:149905642447 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4779.658514: rtos_queue_peek_from_isr_failed: tstamp:149910642450 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4779.826529: rtos_queue_peek_from_isr_failed: tstamp:149915642447 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4779.994524: rtos_queue_peek_from_isr_failed: tstamp:149920642447 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4780.106516: rtos_queue_peek_from_isr_failed: tstamp:149925642447 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4780.274510: rtos_queue_peek_from_isr_failed: tstamp:149930642447 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4780.442518: rtos_queue_peek_from_isr_failed: tstamp:149935642447 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4780.610543: rtos_queue_peek_from_isr_failed: tstamp:149940642446 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4780.722527: rtos_queue_send_from_isr_failed: tstamp:149943742814 queue:0x0bcb2e38
kworker/0:0-8665 [000] … 4780.722532: rtos_queue_send_from_isr_failed: tstamp:149943742966 queue:0x0bcb76a0
kworker/0:0-8665 [000] … 4780.722533: rtos_queue_send_from_isr_failed: tstamp:149943743119 queue:0x0bcb9220
kworker/0:0-8665 [000] … 4780.722534: rtos_queue_send_from_isr_failed: tstamp:149943743267 queue:0x0bcb9fe0
kworker/0:0-8665 [000] … 4780.722534: rtos_queue_send_from_isr_failed: tstamp:149943743413 queue:0x0bcbada0
kworker/0:0-8665 [000] … 4780.722535: rtos_queue_send_from_isr_failed: tstamp:149944794912 queue:0x0bcb2e38
kworker/0:0-8665 [000] … 4780.722536: rtos_queue_send_from_isr_failed: tstamp:149944795060 queue:0x0bcb76a0
kworker/0:0-8665 [000] … 4780.722537: rtos_queue_send_from_isr_failed: tstamp:149944795212 queue:0x0bcb9220
kworker/0:0-8665 [000] … 4780.722537: rtos_queue_send_from_isr_failed: tstamp:149944795358 queue:0x0bcb9fe0
kworker/0:0-8665 [000] … 4780.722538: rtos_queue_send_from_isr_failed: tstamp:149944795503 queue:0x0bcbada0
kworker/0:0-8665 [000] … 4780.778528: rtos_queue_peek_from_isr_failed: tstamp:149945642450 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4780.946523: rtos_queue_peek_from_isr_failed: tstamp:149950642447 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4781.114522: rtos_queue_peek_from_isr_failed: tstamp:149955642447 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4781.226618: rtos_queue_peek_from_isr_failed: tstamp:149960642447 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4781.394527: rtos_queue_peek_from_isr_failed: tstamp:149965642447 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4781.562513: rtos_queue_peek_from_isr_failed: tstamp:149970642447 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4781.730539: rtos_queue_peek_from_isr_failed: tstamp:149975642445 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4781.898526: rtos_queue_peek_from_isr_failed: tstamp:149980642447 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4782.066518: rtos_queue_peek_from_isr_failed: tstamp:149985642452 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4782.234523: rtos_queue_peek_from_isr_failed: tstamp:149990642452 queue:0x0bcbbbb8
kworker/0:0-8665 [000] .n… 4782.347130: rtos_queue_peek_from_isr_failed: tstamp:149995642447 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4782.514552: rtos_queue_peek_from_isr_failed: tstamp:150000642447 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4782.682521: rtos_queue_peek_from_isr_failed: tstamp:150005642447 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4782.850521: rtos_queue_peek_from_isr_failed: tstamp:150010642447 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4783.018592: rtos_queue_peek_from_isr_failed: tstamp:150015642447 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4783.186542: rtos_queue_peek_from_isr_failed: tstamp:150020642451 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4783.354549: rtos_queue_peek_from_isr_failed: tstamp:150025642447 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4783.466526: rtos_queue_peek_from_isr_failed: tstamp:150030642447 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4783.634538: rtos_queue_peek_from_isr_failed: tstamp:150035642447 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4783.802516: rtos_queue_peek_from_isr_failed: tstamp:150040642447 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4783.970519: rtos_queue_peek_from_isr_failed: tstamp:150045642447 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4784.138503: rtos_queue_peek_from_isr_failed: tstamp:150050642447 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4784.306558: rtos_queue_peek_from_isr_failed: tstamp:150055642447 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4784.474526: rtos_queue_peek_from_isr_failed: tstamp:150060642447 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4784.586508: rtos_queue_peek_from_isr_failed: tstamp:150065642447 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4784.754503: rtos_queue_peek_from_isr_failed: tstamp:150070642447 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4784.922530: rtos_queue_peek_from_isr_failed: tstamp:150075642447 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4785.090547: rtos_queue_peek_from_isr_failed: tstamp:150080642450 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4785.258543: rtos_queue_peek_from_isr_failed: tstamp:150085642447 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4785.426503: rtos_queue_peek_from_isr_failed: tstamp:150090642450 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4785.594519: rtos_queue_peek_from_isr_failed: tstamp:150095642447 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4785.706514: rtos_queue_peek_from_isr_failed: tstamp:150100642447 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4785.874515: rtos_queue_peek_from_isr_failed: tstamp:150105642447 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4786.042522: rtos_queue_peek_from_isr_failed: tstamp:150110642447 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4786.210497: rtos_queue_peek_from_isr_failed: tstamp:150115642447 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4786.378515: rtos_queue_peek_from_isr_failed: tstamp:150120642447 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4786.550542: rtos_queue_peek_from_isr_failed: tstamp:150125642447 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4786.662512: rtos_queue_peek_from_isr_failed: tstamp:150130642447 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4786.830522: rtos_queue_peek_from_isr_failed: tstamp:150135642447 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4786.998518: rtos_queue_peek_from_isr_failed: tstamp:150140642447 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4787.166513: rtos_queue_peek_from_isr_failed: tstamp:150145642450 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4787.334505: rtos_queue_peek_from_isr_failed: tstamp:150150642447 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4787.502500: rtos_queue_peek_from_isr_failed: tstamp:150155642447 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4787.670490: rtos_queue_peek_from_isr_failed: tstamp:150160642447 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4787.782480: rtos_queue_peek_from_isr_failed: tstamp:150165642451 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4787.950490: rtos_queue_peek_from_isr_failed: tstamp:150170642447 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4788.118489: rtos_queue_peek_from_isr_failed: tstamp:150175642447 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4788.286523: rtos_queue_peek_from_isr_failed: tstamp:150180642450 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4788.454483: rtos_queue_peek_from_isr_failed: tstamp:150185642447 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4788.622498: rtos_queue_peek_from_isr_failed: tstamp:150190642447 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4788.790500: rtos_queue_peek_from_isr_failed: tstamp:150195642447 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4788.902502: rtos_queue_peek_from_isr_failed: tstamp:150200642450 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4789.070481: rtos_queue_peek_from_isr_failed: tstamp:150205642450 queue:0x0bcbbbb8
kworker/0:0-8665 [000] … 4789.238484: rtos_queue_peek_from_isr_failed: tstamp:150210642448 queue:0x0bcbbbb8

hello zhuberger,

I see there’s tegra194-vi5 15c10000.vi: corr_err: discarding frame 1, flags: 32, err_data 162 error in the beginning of your post. but, the latest logs show the camera is not response, tegra194-vi5 15c10000.vi: no reply from camera processor
may I know all the changes you’ve done, please also review your sensor device tree with the reference driver.
thanks

Hi Jerry,

I have configured the camera module as loadable. The only change I did since the beginning of the post is correcting the typo in device tree (active width from 2593 to 2592).

This error (tegra194-vi5 [15c10000.vi](http://15c10000.vi/): corr_err: discarding frame 1, flags: 32, err_data 162 ) is gone after I reloaded the camera module with rmmod and insmod.

For device tree and sensor driver, I kept the structure the same as imx219, and only changed the variables and parameters, which applies to our sensor.

Is there other way to stream images from the Bayer sensor 10 bits?

hello zhuberger,

please also share the device tree settings of tegra-camera-platform{...}
you should check Camera Modules and the Device Tree to review all settings.
thanks

Hi Jerry,

Got you! Please find two *dtsi files attached. There are the only two files where I made changes. Our camera module has its own external master clock and power supply. Could you please kindly check them out?

Thanks,
Zhu

tegra194-camera-jakku-rbpcv2-imx219.dtsi (1.6 KB)

tegra194-camera-rbpcv2-imx219.dtsi (14.7 KB)

hello zhuberger,

have you also enable the cam_i2cmux, i.e. TEGRA194_AON_GPIO(CC, 3) since you’re sharing the same i2c address.
please configure num_csi_lanes as 4-lane if you have couple of 2-lane camera in your system.
for example,

        tcp: tegra-camera-platform {
                compatible = "nvidia, tegra-camera-platform";
                num_csi_lanes = <4>;

Hi Jerry,

Thank you for reviewing the source code. I assume it is enabled, because cam_i2cmux is used in the original device tree for imx219, and this camera works well with Gstreamer. So I only changed num_csi_lanes to <4>. The error is the same as before. What else do you recommend me to look into?

Best,
Zhu

I also noticed one thing. Everytime right after reboot the device, I have to reload imx219.ko. otherwise, there will be error “tegra194-vi5 15c10000.vi: corr_err: discarding frame 1, flags: 0, err_data 512”. Do you think this error is the root cause?

Test 1:
a) reboot the device
b) run v4l2-ctl -d /dev/video0 --set-ctrl bypass_mode=0 --stream-mmap --stream-count=3, not working;
c) reload imx219
d) run v4l2-ctl -d /dev/video0 --set-ctrl bypass_mode=0 --stream-mmap --stream-count=3, working;

Test 2:
a) reboot the device
b) boost all clocks
c) run v4l2-ctl -d /dev/video0 --set-ctrl bypass_mode=0 --stream-mmap --stream-count=3, working;
d) run “gst-launch-1.0 nvarguscamerasrc sensor_id=0 ! ‘video/x-raw(memory:NVMM),width=2592, height=1944, framerate=30/1’ ! nvvidconv flip-method=0 ! ‘video/x-raw,width=960, height=540’ ! nvvidconv ! nvegltransform ! nveglglessink -e”, failed

$ dmesg | grep vi5
[ 6.796311] tegra194-vi5 15c10000.vi: using default number of vi channels, 36
[ 6.802022] tegra194-vi5 15c10000.vi: initialized
[ 6.808613] tegra194-vi5 15c10000.vi: subdev 15a00000.nvcsi–2 bound
[ 6.810540] tegra194-vi5 15c10000.vi: subdev 15a00000.nvcsi–1 bound
[ 9.321991] tegra194-vi5 15c10000.vi: subdev imx219 10-0036 bound
[ 94.713500] [RCE] vi5_hwinit: firmware CL2018101701 protocol version 2.2
[ 497.184454] [RCE] vi5_hwinit: firmware CL2018101701 protocol version 2.2
[ 499.172341] tegra194-vi5 15c10000.vi: no reply from camera processor
[ 499.172503] tegra194-vi5 15c10000.vi: vi capture get status failed
[ 500.676368] tegra194-vi5 15c10000.vi: no reply from camera processor
[ 500.676389] tegra194-vi5 15c10000.vi: vi capture get status failed
[ 502.308340] tegra194-vi5 15c10000.vi: no reply from camera processor
[ 502.308355] tegra194-vi5 15c10000.vi: vi capture get status failed
[ 503.812335] tegra194-vi5 15c10000.vi: no reply from camera processor
[ 503.812495] tegra194-vi5 15c10000.vi: vi capture get status failed

VI trace:
cat /sys/kernel/debug/tracing/trace
tracer: nop

entries-in-buffer/entries-written: 632/632 #P:4

                          _-----=> irqs-off
                         / _----=> need-resched
                        | / _---=> hardirq/softirq
                        || / _--=> preempt-depth
                        ||| /     delay
       TASK-PID   CPU#  ||||    TIMESTAMP  FUNCTION
          | |       |   ||||       |         |
 kworker/1:1-1144  [001] ....    85.696993: rtos_queue_peek_from_isr_failed: tstamp:3220631775 queue:0x0bcbbbb8
 kworker/1:1-1144  [001] ....    85.808973: rtos_queue_peek_from_isr_failed: tstamp:3225631771 queue:0x0bcbbbb8
 kworker/1:1-1144  [001] ....    85.976991: rtos_queue_peek_from_isr_failed: tstamp:3230631776 queue:0x0bcbbbb8
 kworker/1:1-1144  [001] ....    86.144985: rtos_queue_peek_from_isr_failed: tstamp:3235631772 queue:0x0bcbbbb8
 kworker/1:1-1144  [001] ....    86.312972: rtos_queue_peek_from_isr_failed: tstamp:3240631775 queue:0x0bcbbbb8
 kworker/1:1-1144  [001] ....    86.484974: rtos_queue_peek_from_isr_failed: tstamp:3245631776 queue:0x0bcbbbb8
 kworker/1:1-1144  [001] ....    86.653068: rtos_queue_peek_from_isr_failed: tstamp:3250631777 queue:0x0bcbbbb8
 kworker/1:1-1144  [001] ....    86.821016: rtos_queue_peek_from_isr_failed: tstamp:3255631771 queue:0x0bcbbbb8
 kworker/1:1-1144  [001] ....    86.933042: rtos_queue_peek_from_isr_failed: tstamp:3260631775 queue:0x0bcbbbb8
 kworker/1:1-1144  [001] ....    87.101025: rtos_queue_peek_from_isr_failed: tstamp:3265631771 queue:0x0bcbbbb8
 kworker/1:1-1144  [001] ....    87.269038: rtos_queue_peek_from_isr_failed: tstamp:3270631775 queue:0x0bcbbbb8
 kworker/1:1-1144  [001] ....    87.441060: rtos_queue_peek_from_isr_failed: tstamp:3275631776 queue:0x0bcbbbb8
 kworker/1:1-1144  [001] ....    87.613082: rtos_queue_peek_from_isr_failed: tstamp:3280631774 queue:0x0bcbbbb8
 kworker/1:1-1144  [001] ....    87.781055: rtos_queue_peek_from_isr_failed: tstamp:3285631777 queue:0x0bcbbbb8
 kworker/1:1-1144  [001] ....    87.893065: rtos_queue_peek_from_isr_failed: tstamp:3290631776 queue:0x0bcbbbb8
 kworker/1:1-1144  [001] ....    88.061063: rtos_queue_peek_from_isr_failed: tstamp:3295631771 queue:0x0bcbbbb8
 kworker/1:1-1144  [001] ....    88.229071: rtos_queue_peek_from_isr_failed: tstamp:3300631776 queue:0x0bcbbbb8
 kworker/1:1-1144  [001] ....    88.397086: rtos_queue_peek_from_isr_failed: tstamp:3305631771 queue:0x0bcbbbb8
 kworker/1:1-1144  [001] ....    88.565076: rtos_queue_peek_from_isr_failed: tstamp:3310631776 queue:0x0bcbbbb8
 kworker/1:1-1144  [001] ....    88.733122: rtos_queue_peek_from_isr_failed: tstamp:3315631775 queue:0x0bcbbbb8
 kworker/1:1-1144  [001] ....    88.905161: rtos_queue_peek_from_isr_failed: tstamp:3320631777 queue:0x0bcbbbb8
 kworker/1:1-1144  [001] ....    89.017137: rtos_queue_peek_from_isr_failed: tstamp:3325631776 queue:0x0bcbbbb8
 kworker/1:1-1144  [001] ....    89.185170: rtos_queue_peek_from_isr_failed: tstamp:3330631775 queue:0x0bcbbbb8
 kworker/1:1-1144  [001] ....    89.353147: rtos_queue_peek_from_isr_failed: tstamp:3335631775 queue:0x0bcbbbb8
 kworker/1:1-1144  [001] ....    89.525115: rtos_queue_peek_from_isr_failed: tstamp:3340631775 queue:0x0bcbbbb8
 kworker/1:1-1144  [001] ....    89.697143: rtos_queue_peek_from_isr_failed: tstamp:3345631775 queue:0x0bcbbbb8
 kworker/1:1-1144  [001] ....    89.809129: rtos_queue_peek_from_isr_failed: tstamp:3350631775 queue:0x0bcbbbb8
 kworker/1:1-1144  [001] ....    89.977220: rtos_queue_peek_from_isr_failed: tstamp:3355631775 queue:0x0bcbbbb8
 kworker/1:1-1144  [001] ....    90.153147: rtos_queue_peek_from_isr_failed: tstamp:3360631774 queue:0x0bcbbbb8
 kworker/1:1-1144  [001] ....    90.321188: rtos_queue_peek_from_isr_failed: tstamp:3365631777 queue:0x0bcbbbb8
 kworker/1:1-1144  [001] ....    90.493182: rtos_queue_peek_from_isr_failed: tstamp:3370631776 queue:0x0bcbbbb8
 kworker/1:1-1144  [001] ....    90.609190: rtos_queue_peek_from_isr_failed: tstamp:3375631774 queue:0x0bcbbbb8
 kworker/1:1-1144  [001] ....    90.777228: rtos_queue_peek_from_isr_failed: tstamp:3380631771 queue:0x0bcbbbb8
 kworker/1:1-1144  [001] ....    90.945218: rtos_queue_peek_from_isr_failed: tstamp:3385631776 queue:0x0bcbbbb8
 kworker/1:1-1144  [001] ....    91.113188: rtos_queue_peek_from_isr_failed: tstamp:3390631775 queue:0x0bcbbbb8
 kworker/1:1-1144  [001] ....    91.281199: rtos_queue_peek_from_isr_failed: tstamp:3395332321 queue:0x0bcbbbb8
 kworker/1:2-1305  [001] ....    94.713396: rtos_queue_peek_from_isr_failed: tstamp:3503007986 queue:0x0bcbbbb8
 kworker/1:2-1305  [001] ....    94.713402: rtcpu_start: tstamp:3503009223
 kworker/1:2-1305  [001] ....    94.713404: rtos_queue_send_from_isr_failed: tstamp:3503018528 queue:0x0bcb2e38
 kworker/1:2-1305  [001] ....    94.713426: rtos_queue_send_from_isr_failed: tstamp:3503018678 queue:0x0bcb76a0
 kworker/1:2-1305  [001] ....    94.713427: rtos_queue_send_from_isr_failed: tstamp:3503018829 queue:0x0bcb9220
 kworker/1:2-1305  [001] ....    94.713428: rtos_queue_send_from_isr_failed: tstamp:3503018975 queue:0x0bcb9fe0
 kworker/1:2-1305  [001] ....    94.713428: rtos_queue_send_from_isr_failed: tstamp:3503019123 queue:0x0bcbada0
 kworker/1:2-1305  [001] ....    94.713430: rtcpu_string: tstamp:3503019572 id:0x04010000 str:"Configuring VI GoS.

"
kworker/1:2-1305 [001] … 94.713457: rtcpu_string: tstamp:3503019770 id:0x04010000 str:“VM GOS[#0] addr=0xc2100000
"
kworker/1:2-1305 [001] … 94.713463: rtcpu_string: tstamp:3503020028 id:0x04010000 str:“VM GOS[#1] addr=0xc2101000
"
kworker/1:2-1305 [001] … 94.713469: rtcpu_string: tstamp:3503020272 id:0x04010000 str:“VM GOS[#2] addr=0xc2102000
"
kworker/1:2-1305 [001] … 94.713477: rtcpu_string: tstamp:3503020503 id:0x04010000 str:“VM GOS[#3] addr=0xc2103000
"
kworker/1:2-1305 [001] … 94.713483: rtcpu_string: tstamp:3503020752 id:0x04010000 str:“VM GOS[#4] addr=0xc2104000
"
kworker/1:2-1305 [001] … 94.713489: rtcpu_string: tstamp:3503020983 id:0x04010000 str:“VM GOS[#5] addr=0xc2105000
"
kworker/1:2-1305 [001] … 94.713494: rtcpu_string: tstamp:3503029764 id:0x04010000 str:“vi5_hwinit: firmware CL2018101701 protocol vers”
kworker/1:2-1305 [001] … 94.713497: rtcpu_string: tstamp:3503029883 id:0x04010000 str:“on 2.2
"
kworker/1:2-1305 [001] … 94.713503: rtos_queue_send_from_isr_failed: tstamp:3503092765 queue:0x0bcb2e38
kworker/1:2-1305 [001] … 94.713504: rtos_queue_send_from_isr_failed: tstamp:3503092917 queue:0x0bcb76a0
kworker/1:2-1305 [001] … 94.713504: rtos_queue_send_from_isr_failed: tstamp:3503093070 queue:0x0bcb9220
kworker/1:2-1305 [001] … 94.713505: rtos_queue_send_from_isr_failed: tstamp:3503093217 queue:0x0bcb9fe0
kworker/1:2-1305 [001] … 94.713506: rtos_queue_send_from_isr_failed: tstamp:3503093362 queue:0x0bcbada0
kworker/1:2-1305 [001] … 94.713507: rtcpu_string: tstamp:3503094280 id:0x04010000 str:“VI GOS[#0] set to VM GOS[4] base 0xc2104000
"
kworker/1:2-1305 [001] … 94.713512: rtos_queue_send_from_isr_failed: tstamp:3503131145 queue:0x0bcb2e38
kworker/1:2-1305 [001] … 94.713513: rtos_queue_send_from_isr_failed: tstamp:3503131313 queue:0x0bcb76a0
kworker/1:2-1305 [001] … 94.713514: rtos_queue_send_from_isr_failed: tstamp:3503131465 queue:0x0bcb9220
kworker/1:2-1305 [001] … 94.713514: rtos_queue_send_from_isr_failed: tstamp:3503131622 queue:0x0bcb9fe0
kworker/1:2-1305 [001] … 94.713515: rtos_queue_send_from_isr_failed: tstamp:3503131767 queue:0x0bcbada0
kworker/1:2-1305 [001] … 94.713536: rtcpu_vinotify_event: tstamp:3503368748 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:4724871520 data:0x10000000
kworker/1:2-1305 [001] … 94.713537: rtcpu_vinotify_event: tstamp:3503368899 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:4724879744 data:0x31000001
kworker/1:2-1305 [001] … 94.713537: rtcpu_vinotify_event: tstamp:3503369060 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:4724881856 data:0x07020001
kworker/1:2-1305 [001] … 94.713538: rtcpu_vinotify_event: tstamp:3503369197 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:4724915712 data:0x10000000
kworker/1:2-1305 [001] … 94.713539: rtcpu_vinotify_event: tstamp:3503369354 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:4724925888 data:0x31000002
kworker/1:2-1305 [001] … 94.825358: rtcpu_vinotify_event: tstamp:3505742370 tag:FS channel:0x00 frame:1 vi_tstamp:3505502704 data:0x00000012
kworker/1:2-1305 [001] … 94.825362: rtcpu_vinotify_event: tstamp:3505742535 tag:ATOMP_FS channel:0x00 frame:1 vi_tstamp:3505502705 data:0x00000000
kworker/1:2-1305 [001] … 94.825363: rtcpu_vinotify_event: tstamp:3505742676 tag:CHANSEL_PXL_SOF channel:0x23 frame:1 vi_tstamp:3505518298 data:0x00000001
kworker/1:2-1305 [001] … 94.825363: rtcpu_vinotify_event: tstamp:3505742837 tag:RESERVED_19 channel:0x23 frame:1 vi_tstamp:4802404224 data:0x08020001
kworker/1:2-1305 [001] … 94.825364: rtcpu_vinotify_event: tstamp:3506319159 tag:CHANSEL_PXL_EOF channel:0x23 frame:1 vi_tstamp:3506317586 data:0x07970002
kworker/1:2-1305 [001] … 94.825365: rtcpu_vinotify_event: tstamp:3506319323 tag:ATOMP_FRAME_DONE channel:0x23 frame:1 vi_tstamp:3506317603 data:0x00000000
kworker/1:2-1305 [001] … 94.825366: rtcpu_vinotify_event: tstamp:3506319464 tag:RESERVED_19 channel:0x23 frame:1 vi_tstamp:4827982336 data:0x02020001
kworker/1:2-1305 [001] … 94.825366: rtcpu_vinotify_event: tstamp:3506319622 tag:FE channel:0x00 frame:1 vi_tstamp:3506317606 data:0x00000022
kworker/1:2-1305 [001] … 94.825367: rtcpu_vinotify_event: tstamp:3506319761 tag:ATOMP_FE channel:0x00 frame:1 vi_tstamp:3506317607 data:0x00000000
kworker/1:2-1305 [001] … 94.825368: rtcpu_vinotify_event: tstamp:3506319919 tag:RESERVED_19 channel:0x23 frame:1 vi_tstamp:4827988608 data:0x00020001
kworker/1:2-1305 [001] … 94.825368: rtcpu_vinotify_event: tstamp:3506320054 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:4827994176 data:0x07020002
kworker/1:2-1305 [001] … 94.825377: rtos_queue_send_from_isr_failed: tstamp:3506327087 queue:0x0bcb2e38
kworker/1:2-1305 [001] … 94.825378: rtos_queue_send_from_isr_failed: tstamp:3506327243 queue:0x0bcb76a0
kworker/1:2-1305 [001] … 94.825379: rtos_queue_send_from_isr_failed: tstamp:3506327399 queue:0x0bcb9220
kworker/1:2-1305 [001] … 94.825379: rtos_queue_send_from_isr_failed: tstamp:3506327548 queue:0x0bcb9fe0
kworker/1:2-1305 [001] … 94.825380: rtos_queue_send_from_isr_failed: tstamp:3506327694 queue:0x0bcbada0
kworker/1:2-1305 [001] … 94.825381: rtcpu_vinotify_event: tstamp:3506624084 tag:FS channel:0x00 frame:2 vi_tstamp:3506333294 data:0x00000012
kworker/1:2-1305 [001] … 94.825382: rtcpu_vinotify_event: tstamp:3506624250 tag:ATOMP_FS channel:0x00 frame:2 vi_tstamp:3506333295 data:0x00000000
kworker/1:2-1305 [001] … 94.825383: rtcpu_vinotify_event: tstamp:3506624414 tag:CHANSEL_PXL_SOF channel:0x23 frame:2 vi_tstamp:3506348888 data:0x00000001
kworker/1:2-1305 [001] … 94.825384: rtcpu_vinotify_event: tstamp:3506624552 tag:RESERVED_19 channel:0x23 frame:2 vi_tstamp:4828983104 data:0x08020002
kworker/1:2-1305 [001] … 94.825384: rtcpu_vinotify_event: tstamp:3506624711 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:4829061024 data:0x10000000
kworker/1:2-1305 [001] … 94.825385: rtcpu_vinotify_event: tstamp:3506624847 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:4829069280 data:0x31000003
kworker/1:2-1305 [001] … 94.825386: rtos_queue_send_from_isr_failed: tstamp:3507156234 queue:0x0bcb2e38
kworker/1:2-1305 [001] … 94.825387: rtos_queue_send_from_isr_failed: tstamp:3507156390 queue:0x0bcb76a0
kworker/1:2-1305 [001] … 94.825388: rtos_queue_send_from_isr_failed: tstamp:3507156543 queue:0x0bcb9220
kworker/1:2-1305 [001] … 94.825388: rtos_queue_send_from_isr_failed: tstamp:3507156689 queue:0x0bcb9fe0
kworker/1:2-1305 [001] … 94.825389: rtos_queue_send_from_isr_failed: tstamp:3507156834 queue:0x0bcbada0
kworker/1:2-1305 [001] … 94.825390: rtcpu_vinotify_event: tstamp:3507180766 tag:CHANSEL_PXL_EOF channel:0x23 frame:2 vi_tstamp:3507148176 data:0x07970002
kworker/1:2-1305 [001] … 94.825391: rtcpu_vinotify_event: tstamp:3507180907 tag:ATOMP_FRAME_DONE channel:0x23 frame:2 vi_tstamp:3507148193 data:0x00000000
kworker/1:2-1305 [001] … 94.825391: rtcpu_vinotify_event: tstamp:3507181072 tag:RESERVED_19 channel:0x23 frame:2 vi_tstamp:4854561216 data:0x02020002
kworker/1:2-1305 [001] … 94.825392: rtcpu_vinotify_event: tstamp:3507181212 tag:FE channel:0x00 frame:2 vi_tstamp:3507148196 data:0x00000022
kworker/1:2-1305 [001] … 94.825393: rtcpu_vinotify_event: tstamp:3507181372 tag:ATOMP_FE channel:0x00 frame:2 vi_tstamp:3507148197 data:0x00000000
kworker/1:2-1305 [001] … 94.825393: rtcpu_vinotify_event: tstamp:3507181510 tag:RESERVED_19 channel:0x23 frame:2 vi_tstamp:4854567488 data:0x00020002
kworker/1:2-1305 [001] … 94.825394: rtcpu_vinotify_event: tstamp:3507181667 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:4854573024 data:0x07020003
kworker/1:2-1305 [001] … 94.825396: rtcpu_vinotify_event: tstamp:3507181805 tag:FS channel:0x00 frame:3 vi_tstamp:3507163885 data:0x00000012
kworker/1:2-1305 [001] … 94.825396: rtcpu_vinotify_event: tstamp:3507181963 tag:ATOMP_FS channel:0x00 frame:3 vi_tstamp:3507163886 data:0x00000000
kworker/1:2-1305 [001] … 94.825397: rtcpu_vinotify_event: tstamp:3507182098 tag:CHANSEL_PXL_SOF channel:0x23 frame:3 vi_tstamp:3507179479 data:0x00000001
kworker/1:2-1305 [001] … 94.881339: rtcpu_vinotify_event: tstamp:3507505613 tag:RESERVED_19 channel:0x23 frame:3 vi_tstamp:4855563488 data:0x08020003
kworker/1:2-1305 [001] … 94.881343: rtcpu_vinotify_event: tstamp:3507505752 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:4855696640 data:0x10000000
kworker/1:2-1305 [001] … 94.881344: rtcpu_vinotify_event: tstamp:3507505911 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:4855704896 data:0x31000004
kworker/1:2-1305 [001] … 94.881353: rtos_queue_send_from_isr_failed: tstamp:3507985307 queue:0x0bcb2e38
kworker/1:2-1305 [001] … 94.881376: rtos_queue_send_from_isr_failed: tstamp:3507985461 queue:0x0bcb76a0
kworker/1:2-1305 [001] … 94.881377: rtos_queue_send_from_isr_failed: tstamp:3507985614 queue:0x0bcb9220
kworker/1:2-1305 [001] … 94.881378: rtos_queue_send_from_isr_failed: tstamp:3507985761 queue:0x0bcb9fe0
kworker/1:2-1305 [001] … 94.881379: rtos_queue_send_from_isr_failed: tstamp:3507985906 queue:0x0bcbada0
kworker/1:2-1305 [001] … 94.881380: rtos_queue_peek_from_isr_failed: tstamp:3508008337 queue:0x0bcbbbb8
kworker/1:2-1305 [001] … 94.881382: rtcpu_vinotify_event: tstamp:3508013532 tag:CHANSEL_PXL_EOF channel:0x23 frame:3 vi_tstamp:3507978767 data:0x07970002
kworker/1:2-1305 [001] … 94.881383: rtcpu_vinotify_event: tstamp:3508013697 tag:ATOMP_FRAME_DONE channel:0x23 frame:3 vi_tstamp:3507978784 data:0x00000000
kworker/1:2-1305 [001] … 94.881384: rtcpu_vinotify_event: tstamp:3508013839 tag:RESERVED_19 channel:0x23 frame:3 vi_tstamp:4881140128 data:0x02020003
kworker/1:2-1305 [001] … 94.881384: rtcpu_vinotify_event: tstamp:3508013997 tag:FE channel:0x00 frame:3 vi_tstamp:3507978787 data:0x00000022
kworker/1:2-1305 [001] … 94.881385: rtcpu_vinotify_event: tstamp:3508014141 tag:ATOMP_FE channel:0x00 frame:3 vi_tstamp:3507978788 data:0x00000000
kworker/1:2-1305 [001] … 94.881386: rtcpu_vinotify_event: tstamp:3508014301 tag:RESERVED_19 channel:0x23 frame:3 vi_tstamp:4881146400 data:0x00020003
kworker/1:2-1305 [001] … 94.881386: rtcpu_vinotify_event: tstamp:3508014438 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:4881151968 data:0x07020004
kworker/1:2-1305 [001] … 94.881387: rtcpu_vinotify_event: tstamp:3508014595 tag:FS channel:0x00 frame:4 vi_tstamp:3507994476 data:0x00000012
kworker/1:2-1305 [001] … 94.881406: rtcpu_vinotify_event: tstamp:3508014734 tag:ATOMP_FS channel:0x00 frame:4 vi_tstamp:3507994476 data:0x00000000
kworker/1:2-1305 [001] … 94.881407: rtcpu_vinotify_event: tstamp:3508014891 tag:CHANSEL_PXL_SOF channel:0x23 frame:4 vi_tstamp:3508010070 data:0x00000001
kworker/1:2-1305 [001] … 94.881408: rtcpu_vinotify_event: tstamp:3508015026 tag:RESERVED_19 channel:0x23 frame:4 vi_tstamp:4882140896 data:0x08020004
kworker/1:2-1305 [001] … 94.881409: rtcpu_vinotify_event: tstamp:3508015185 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:4882219488 data:0x10000000
kworker/1:2-1305 [001] … 94.881409: rtcpu_vinotify_event: tstamp:3508015320 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:4882227744 data:0x31000005
kworker/1:2-1305 [001] … 94.881410: rtcpu_vinotify_event: tstamp:3508828070 tag:CHANSEL_PXL_EOF channel:0x23 frame:4 vi_tstamp:3508809358 data:0x07970002
kworker/1:2-1305 [001] … 94.881411: rtcpu_vinotify_event: tstamp:3508828210 tag:ATOMP_FRAME_DONE channel:0x23 frame:4 vi_tstamp:3508809375 data:0x00000000
kworker/1:2-1305 [001] … 94.881412: rtcpu_vinotify_event: tstamp:3508828372 tag:RESERVED_19 channel:0x23 frame:4 vi_tstamp:4907719040 data:0x02020004
kworker/1:2-1305 [001] … 94.881413: rtcpu_vinotify_event: tstamp:3508828508 tag:FE channel:0x00 frame:4 vi_tstamp:3508809379 data:0x00000022
kworker/1:2-1305 [001] … 94.881413: rtcpu_vinotify_event: tstamp:3508828668 tag:ATOMP_FE channel:0x00 frame:4 vi_tstamp:3508809379 data:0x00000000
kworker/1:2-1305 [001] … 94.881414: rtcpu_vinotify_event: tstamp:3508828804 tag:RESERVED_19 channel:0x23 frame:4 vi_tstamp:4907725312 data:0x00020004
kworker/1:2-1305 [001] … 94.881415: rtcpu_vinotify_event: tstamp:3508828964 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:4907730880 data:0x07020005
kworker/1:2-1305 [001] … 94.881416: rtcpu_vinotify_event: tstamp:3508829101 tag:FS channel:0x00 frame:5 vi_tstamp:3508825066 data:0x00000012
kworker/1:2-1305 [001] … 94.881416: rtcpu_vinotify_event: tstamp:3508829258 tag:ATOMP_FS channel:0x00 frame:5 vi_tstamp:3508825067 data:0x00000000
kworker/1:2-1305 [001] … 94.881417: rtcpu_vinotify_event: tstamp:3508844455 tag:CHANSEL_PXL_SOF channel:0x23 frame:5 vi_tstamp:3508840660 data:0x00000001
kworker/1:2-1305 [001] … 94.881418: rtcpu_vinotify_event: tstamp:3508844617 tag:RESERVED_19 channel:0x23 frame:5 vi_tstamp:4908719840 data:0x08020005
kworker/1:2-1305 [001] … 94.881419: rtcpu_vinotify_event: tstamp:3508844757 tag:FE channel:0x00 frame:5 vi_tstamp:3508841040 data:0x00000022
kworker/1:2-1305 [001] … 94.881419: rtcpu_vinotify_event: tstamp:3508844915 tag:CHANSEL_SHORT_FRAME channel:0x04 frame:5 vi_tstamp:3508841040 data:0x01000000
kworker/1:2-1305 [001] … 94.881420: rtcpu_vinotify_event: tstamp:3508845053 tag:RESERVED_19 channel:0x23 frame:5 vi_tstamp:4908735296 data:0x01020005
kworker/1:2-1305 [001] … 94.881421: rtcpu_vinotify_event: tstamp:3508845215 tag:ATOMP_FE channel:0x00 frame:5 vi_tstamp:3508841040 data:0x00000000
kworker/1:2-1305 [001] … 94.881422: rtcpu_vinotify_event: tstamp:3508845350 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:4908815136 data:0x10000000
kworker/1:2-1305 [001] … 94.881422: rtcpu_vinotify_event: tstamp:3509167117 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:4908846528 data:0x31000006
kworker/1:2-1305 [001] … 94.881423: rtcpu_vinotify_event: tstamp:3509167253 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:4908848672 data:0x07020006
kworker/1:2-1305 [001] … 94.881424: rtcpu_vinotify_event: tstamp:3509167411 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:4908858592 data:0x10000000
kworker/1:2-1305 [001] … 94.881424: rtcpu_vinotify_event: tstamp:3509167546 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:4908866880 data:0x31000007
kworker/1:2-1305 [001] … 94.937355: rtos_queue_send_from_isr_failed: tstamp:3510424211 queue:0x0bcb2e38
kworker/1:2-1305 [001] … 94.937360: rtos_queue_send_from_isr_failed: tstamp:3510424367 queue:0x0bcb76a0
kworker/1:2-1305 [001] … 94.937361: rtos_queue_send_from_isr_failed: tstamp:3510424521 queue:0x0bcb9220
kworker/1:2-1305 [001] … 94.937362: rtos_queue_send_from_isr_failed: tstamp:3510424669 queue:0x0bcb9fe0
kworker/1:2-1305 [001] … 94.937363: rtos_queue_send_from_isr_failed: tstamp:3510424816 queue:0x0bcbada0
kworker/1:2-1305 [001] … 94.937363: rtos_queue_send_from_isr_failed: tstamp:3510471168 queue:0x0bcb2e38
kworker/1:2-1305 [001] … 94.937364: rtos_queue_send_from_isr_failed: tstamp:3510471317 queue:0x0bcb76a0
kworker/1:2-1305 [001] … 94.937365: rtos_queue_send_from_isr_failed: tstamp:3510471469 queue:0x0bcb9220
kworker/1:2-1305 [001] … 94.937365: rtos_queue_send_from_isr_failed: tstamp:3510471615 queue:0x0bcb9fe0
kworker/1:2-1305 [001] … 94.937366: rtos_queue_send_from_isr_failed: tstamp:3510471763 queue:0x0bcbada0
kworker/1:2-1305 [001] … 95.049363: rtos_queue_peek_from_isr_failed: tstamp:3513008337 queue:0x0bcbbbb8
kworker/1:2-1305 [001] … 95.217355: rtos_queue_peek_from_isr_failed: tstamp:3518008332 queue:0x0bcbbbb8
kworker/1:2-1305 [001] … 95.329350: rtos_queue_peek_from_isr_failed: tstamp:3523008336 queue:0x0bcbbbb8
kworker/1:2-1305 [001] … 95.497371: rtos_queue_peek_from_isr_failed: tstamp:3528008336 queue:0x0bcbbbb8
kworker/1:2-1305 [001] … 95.665382: rtos_queue_peek_from_isr_failed: tstamp:3533008337 queue:0x0bcbbbb8
kworker/1:2-1305 [001] … 95.833370: rtos_queue_peek_from_isr_failed: tstamp:3538008332 queue:0x0bcbbbb8
kworker/1:2-1305 [001] … 96.005375: rtos_queue_peek_from_isr_failed: tstamp:3543008337 queue:0x0bcbbbb8
kworker/1:2-1305 [001] … 96.173428: rtos_queue_peek_from_isr_failed: tstamp:3548008337 queue:0x0bcbbbb8
kworker/1:2-1305 [001] … 96.285428: rtos_queue_peek_from_isr_failed: tstamp:3553008336 queue:0x0bcbbbb8
kworker/1:2-1305 [001] … 96.453419: rtos_queue_peek_from_isr_failed: tstamp:3558008332 queue:0x0bcbbbb8
kworker/1:2-1305 [001] … 96.621428: rtos_queue_peek_from_isr_failed: tstamp:3563008337 queue:0x0bcbbbb8
kworker/1:2-1305 [001] … 96.789413: rtos_queue_peek_from_isr_failed: tstamp:3568008337 queue:0x0bcbbbb8
kworker/1:2-1305 [001] … 96.961446: rtos_queue_peek_from_isr_failed: tstamp:3573008337 queue:0x0bcbbbb8
kworker/1:2-1305 [001] … 97.133380: rtos_queue_peek_from_isr_failed: tstamp:3578008332 queue:0x0bcbbbb8
kworker/1:2-1305 [001] … 97.245453: rtos_queue_peek_from_isr_failed: tstamp:3583008336 queue:0x0bcbbbb8
kworker/1:2-1305 [001] … 97.413439: rtos_queue_peek_from_isr_failed: tstamp:3588008336 queue:0x0bcbbbb8
kworker/1:2-1305 [001] … 97.581434: rtos_queue_peek_from_isr_failed: tstamp:3593008340 queue:0x0bcbbbb8
kworker/1:2-1305 [001] … 97.749457: rtos_queue_peek_from_isr_failed: tstamp:3598008331 queue:0x0bcbbbb8
kworker/1:0-18 [001] … 97.917455: rtos_queue_peek_from_isr_failed: tstamp:3603008336 queue:0x0bcbbbb8
kworker/1:2-1305 [001] … 98.085534: rtos_queue_peek_from_isr_failed: tstamp:3608008336 queue:0x0bcbbbb8
kworker/1:0-18 [001] … 98.253438: rtos_queue_peek_from_isr_failed: tstamp:3613008336 queue:0x0bcbbbb8
kworker/1:0-18 [001] … 98.365489: rtos_queue_peek_from_isr_failed: tstamp:3618008337 queue:0x0bcbbbb8
kworker/1:0-18 [001] … 98.533434: rtos_queue_peek_from_isr_failed: tstamp:3623008336 queue:0x0bcbbbb8
kworker/1:0-18 [001] … 98.701449: rtos_queue_peek_from_isr_failed: tstamp:3628008337 queue:0x0bcbbbb8
kworker/1:0-18 [001] … 98.869479: rtos_queue_peek_from_isr_failed: tstamp:3633008336 queue:0x0bcbbbb8
kworker/1:0-18 [001] … 99.037460: rtos_queue_peek_from_isr_failed: tstamp:3638008339 queue:0x0bcbbbb8
kworker/1:0-18 [001] … 99.205479: rtos_queue_peek_from_isr_failed: tstamp:3643008337 queue:0x0bcbbbb8
kworker/1:0-18 [001] … 99.373465: rtos_queue_peek_from_isr_failed: tstamp:3648008337 queue:0x0bcbbbb8
kworker/1:0-18 [001] .n… 99.485472: rtos_queue_peek_from_isr_failed: tstamp:3653008336 queue:0x0bcbbbb8
kworker/1:0-18 [001] … 99.653461: rtos_queue_peek_from_isr_failed: tstamp:3658008336 queue:0x0bcbbbb8
kworker/1:0-18 [001] … 99.821465: rtos_queue_peek_from_isr_failed: tstamp:3663008349 queue:0x0bcbbbb8
kworker/1:0-18 [001] … 99.989483: rtos_queue_peek_from_isr_failed: tstamp:3668008336 queue:0x0bcbbbb8
kworker/1:0-18 [001] … 100.213524: rtos_queue_peek_from_isr_failed: tstamp:3675341975 queue:0x0bcbbbb8
kworker/1:0-18 [001] … 496.736316: rtos_queue_peek_from_isr_failed: tstamp:16066650897 queue:0x0bcbbbb8
kworker/1:0-18 [001] … 496.736323: rtcpu_start: tstamp:16066652091
kworker/1:0-18 [001] … 496.736325: rtos_queue_send_from_isr_failed: tstamp:16066670787 queue:0x0bcb2e38
kworker/1:0-18 [001] … 496.736326: rtos_queue_send_from_isr_failed: tstamp:16066670937 queue:0x0bcb76a0
kworker/1:0-18 [001] … 496.736327: rtos_queue_send_from_isr_failed: tstamp:16066671089 queue:0x0bcb9220
kworker/1:0-18 [001] … 496.736327: rtos_queue_send_from_isr_failed: tstamp:16066671238 queue:0x0bcb9fe0
kworker/1:0-18 [001] … 496.736328: rtos_queue_send_from_isr_failed: tstamp:16066671383 queue:0x0bcbada0
kworker/1:0-18 [001] … 496.736330: rtcpu_string: tstamp:16066671877 id:0x04010000 str:“Configuring ISP GoS.
"
kworker/1:0-18 [001] … 496.736354: rtcpu_string: tstamp:16066672056 id:0x04010000 str:” VM GOS[#0] addr=0xc2100000
"
kworker/1:0-18 [001] … 496.736360: rtcpu_string: tstamp:16066672312 id:0x04010000 str:” VM GOS[#1] addr=0xc2101000
"
kworker/1:0-18 [001] … 496.736366: rtcpu_string: tstamp:16066672576 id:0x04010000 str:” VM GOS[#2] addr=0xc2102000
"
kworker/1:0-18 [001] … 496.736371: rtcpu_string: tstamp:16066672828 id:0x04010000 str:” VM GOS[#3] addr=0xc2103000
"
kworker/1:0-18 [001] … 496.736376: rtcpu_string: tstamp:16066673061 id:0x04010000 str:” VM GOS[#4] addr=0xc2104000
"
kworker/1:0-18 [001] … 496.736381: rtcpu_string: tstamp:16066673296 id:0x04010000 str:” VM GOS[#5] addr=0xc2105000
"
kworker/1:0-18 [001] … 496.736388: rtcpu_string: tstamp:16066686339 id:0x04010000 str:“WARNING: t194/isp5.c:901 [config_channel] “”
kworker/1:0-18 [001] … 496.736390: rtcpu_string: tstamp:16066686700 id:0x04010000 str:“All error notifications not enabled: correctabl”
kworker/1:0-18 [001] … 496.736391: rtcpu_string: tstamp:16066686818 id:0x04010000 str:”=0x00 uncorrectable=0x00”
kworker/1:0-18 [001] … 496.736392: rtcpu_string: tstamp:16066687011 id:0x04010000 str:””
"
kworker/1:0-18 [001] … 496.904354: rtos_queue_peek_from_isr_failed: tstamp:16071651277 queue:0x0bcbbbb8
kworker/1:0-18 [001] … 497.072344: rtos_queue_peek_from_isr_failed: tstamp:16076651273 queue:0x0bcbbbb8
kworker/1:0-18 [001] … 497.184355: rtos_queue_send_from_isr_failed: tstamp:16080088581 queue:0x0bcb2e38
kworker/1:0-18 [001] … 497.184359: rtos_queue_send_from_isr_failed: tstamp:16080088738 queue:0x0bcb76a0
kworker/1:0-18 [001] … 497.184360: rtos_queue_send_from_isr_failed: tstamp:16080088891 queue:0x0bcb9220
kworker/1:0-18 [001] … 497.184361: rtos_queue_send_from_isr_failed: tstamp:16080089038 queue:0x0bcb9fe0
kworker/1:0-18 [001] … 497.184362: rtos_queue_send_from_isr_failed: tstamp:16080089185 queue:0x0bcbada0
kworker/1:0-18 [001] … 497.184364: rtcpu_string: tstamp:16080089620 id:0x04010000 str:"Configuring VI GoS.
"
kworker/1:0-18 [001] … 497.184389: rtcpu_string: tstamp:16080089818 id:0x04010000 str:"VM GOS[#0] addr=0xc2100000
"
kworker/1:0-18 [001] … 497.184395: rtcpu_string: tstamp:16080090070 id:0x04010000 str:"VM GOS[#1] addr=0xc2101000
"
kworker/1:0-18 [001] … 497.184401: rtcpu_string: tstamp:16080090312 id:0x04010000 str:"VM GOS[#2] addr=0xc2102000
"
kworker/1:0-18 [001] … 497.184433: rtcpu_string: tstamp:16080090544 id:0x04010000 str:"VM GOS[#3] addr=0xc2103000
"
kworker/1:0-18 [001] … 497.184438: rtcpu_string: tstamp:16080090793 id:0x04010000 str:"VM GOS[#4] addr=0xc2104000
"
kworker/1:0-18 [001] … 497.184443: rtcpu_string: tstamp:16080091028 id:0x04010000 str:"VM GOS[#5] addr=0xc2105000
"
kworker/1:0-18 [001] … 497.184448: rtcpu_string: tstamp:16080099792 id:0x04010000 str:“vi5_hwinit: firmware CL2018101701 protocol vers”
kworker/1:0-18 [001] … 497.184451: rtcpu_string: tstamp:16080099910 id:0x04010000 str:"on 2.2
"
kworker/1:0-18 [001] … 497.184457: rtos_queue_send_from_isr_failed: tstamp:16080175320 queue:0x0bcb2e38
kworker/1:0-18 [001] … 497.184458: rtos_queue_send_from_isr_failed: tstamp:16080175472 queue:0x0bcb76a0
kworker/1:0-18 [001] … 497.184458: rtos_queue_send_from_isr_failed: tstamp:16080175627 queue:0x0bcb9220
kworker/1:0-18 [001] … 497.184459: rtos_queue_send_from_isr_failed: tstamp:16080175775 queue:0x0bcb9fe0
kworker/1:0-18 [001] … 497.184460: rtos_queue_send_from_isr_failed: tstamp:16080175920 queue:0x0bcbada0
kworker/1:0-18 [001] … 497.240324: rtos_queue_peek_from_isr_failed: tstamp:16081651278 queue:0x0bcbbbb8
kworker/1:0-18 [001] … 497.408348: rtos_queue_peek_from_isr_failed: tstamp:16086651274 queue:0x0bcbbbb8
kworker/1:0-18 [001] … 497.520346: rtos_queue_send_from_isr_failed: tstamp:16090445451 queue:0x0bcb2e38
kworker/1:0-18 [001] … 497.520351: rtos_queue_send_from_isr_failed: tstamp:16090445603 queue:0x0bcb76a0
kworker/1:0-18 [001] … 497.520351: rtos_queue_send_from_isr_failed: tstamp:16090445753 queue:0x0bcb9220
kworker/1:0-18 [001] … 497.520352: rtos_queue_send_from_isr_failed: tstamp:16090445900 queue:0x0bcb9fe0
kworker/1:0-18 [001] … 497.520353: rtos_queue_send_from_isr_failed: tstamp:16090446047 queue:0x0bcbada0
kworker/1:0-18 [001] … 497.520354: rtos_queue_send_from_isr_failed: tstamp:16090446255 queue:0x0bcb2dd0
kworker/1:0-18 [001] … 497.520354: rtos_queue_send_from_isr_failed: tstamp:16090446391 queue:0x0bcb2e38
kworker/1:0-18 [001] … 497.520355: rtos_queue_send_from_isr_failed: tstamp:16090446531 queue:0x0bcb7638
kworker/1:0-18 [001] … 497.520356: rtos_queue_send_from_isr_failed: tstamp:16090446667 queue:0x0bcb76a0
kworker/1:0-18 [001] … 497.520357: rtos_queue_send_from_isr_failed: tstamp:16090446805 queue:0x0bcb91b8
kworker/1:0-18 [001] … 497.520357: rtos_queue_send_from_isr_failed: tstamp:16090446938 queue:0x0bcb9220
kworker/1:0-18 [001] … 497.520358: rtos_queue_send_from_isr_failed: tstamp:16090447074 queue:0x0bcb9f78
kworker/1:0-18 [001] … 497.520359: rtos_queue_send_from_isr_failed: tstamp:16090447211 queue:0x0bcb9fe0
kworker/1:0-18 [001] … 497.520360: rtos_queue_send_from_isr_failed: tstamp:16090447345 queue:0x0bcbad38
kworker/1:0-18 [001] … 497.520360: rtos_queue_send_from_isr_failed: tstamp:16090447479 queue:0x0bcbada0
kworker/1:0-18 [001] … 497.520361: rtos_queue_send_from_isr_failed: tstamp:16090536299 queue:0x0bcb2e38
kworker/1:0-18 [001] … 497.520362: rtos_queue_send_from_isr_failed: tstamp:16090536465 queue:0x0bcb76a0
kworker/1:0-18 [001] … 497.520362: rtos_queue_send_from_isr_failed: tstamp:16090536617 queue:0x0bcb9220
kworker/1:0-18 [001] … 497.520363: rtos_queue_send_from_isr_failed: tstamp:16090536763 queue:0x0bcb9fe0
kworker/1:0-18 [001] … 497.520364: rtos_queue_send_from_isr_failed: tstamp:16090536908 queue:0x0bcbada0
kworker/1:0-18 [001] … 497.520365: rtos_queue_send_from_isr_failed: tstamp:16090557721 queue:0x0bcb2e38
kworker/1:0-18 [001] … 497.520365: rtos_queue_send_from_isr_failed: tstamp:16090557868 queue:0x0bcb76a0
kworker/1:0-18 [001] … 497.520366: rtos_queue_send_from_isr_failed: tstamp:16090558017 queue:0x0bcb9220
kworker/1:0-18 [001] … 497.520367: rtos_queue_send_from_isr_failed: tstamp:16090558162 queue:0x0bcb9fe0
kworker/1:0-18 [001] … 497.520368: rtos_queue_send_from_isr_failed: tstamp:16090558310 queue:0x0bcbada0
kworker/1:0-18 [001] … 497.520368: rtos_queue_send_from_isr_failed: tstamp:16091572457 queue:0x0bcb2e38
kworker/1:0-18 [001] … 497.520369: rtos_queue_send_from_isr_failed: tstamp:16091572607 queue:0x0bcb76a0
kworker/1:0-18 [001] … 497.520370: rtos_queue_send_from_isr_failed: tstamp:16091572758 queue:0x0bcb9220
kworker/1:0-18 [001] … 497.520371: rtos_queue_send_from_isr_failed: tstamp:16091572908 queue:0x0bcb9fe0
kworker/1:0-18 [001] … 497.520371: rtos_queue_send_from_isr_failed: tstamp:16091573053 queue:0x0bcbada0
kworker/1:0-18 [001] … 497.520373: rtcpu_string: tstamp:16091573475 id:0x04010000 str:"Configuring VI GoS.
"
kworker/1:0-18 [001] … 497.520430: rtcpu_string: tstamp:16091573676 id:0x04010000 str:"VM GOS[#0] addr=0xc2100000
"
kworker/1:0-18 [001] … 497.520446: rtcpu_string: tstamp:16091573931 id:0x04010000 str:"VM GOS[#1] addr=0xc2101000
"
kworker/1:0-18 [001] … 497.520450: rtcpu_string: tstamp:16091574174 id:0x04010000 str:"VM GOS[#2] addr=0xc2102000
"
kworker/1:0-18 [001] … 497.520454: rtcpu_string: tstamp:16091574407 id:0x04010000 str:"VM GOS[#3] addr=0xc2103000
"
kworker/1:0-18 [001] … 497.520457: rtcpu_string: tstamp:16091574656 id:0x04010000 str:"VM GOS[#4] addr=0xc2104000
"
kworker/1:0-18 [001] … 497.520461: rtcpu_string: tstamp:16091574888 id:0x04010000 str:"VM GOS[#5] addr=0xc2105000
"
kworker/1:0-18 [001] … 497.520464: rtos_queue_send_from_isr_failed: tstamp:16091579936 queue:0x0bcb2e38
kworker/1:0-18 [001] … 497.520465: rtos_queue_send_from_isr_failed: tstamp:16091580085 queue:0x0bcb76a0
kworker/1:0-18 [001] … 497.520466: rtos_queue_send_from_isr_failed: tstamp:16091580238 queue:0x0bcb9220
kworker/1:0-18 [001] … 497.520467: rtos_queue_send_from_isr_failed: tstamp:16091580385 queue:0x0bcb9fe0
kworker/1:0-18 [001] … 497.520467: rtos_queue_send_from_isr_failed: tstamp:16091580531 queue:0x0bcbada0
kworker/1:0-18 [001] … 497.520468: rtos_queue_send_from_isr_failed: tstamp:16091585935 queue:0x0bcb2e38
kworker/1:0-18 [001] … 497.520469: rtos_queue_send_from_isr_failed: tstamp:16091586082 queue:0x0bcb76a0
kworker/1:0-18 [001] … 497.520470: rtos_queue_send_from_isr_failed: tstamp:16091586234 queue:0x0bcb9220
kworker/1:0-18 [001] … 497.520470: rtos_queue_send_from_isr_failed: tstamp:16091586379 queue:0x0bcb9fe0
kworker/1:0-18 [001] … 497.520471: rtos_queue_send_from_isr_failed: tstamp:16091586526 queue:0x0bcbada0
kworker/1:0-18 [001] … 497.520473: rtos_queue_peek_from_isr_failed: tstamp:16091651273 queue:0x0bcbbbb8
kworker/1:0-18 [001] … 497.688334: rtos_queue_send_from_isr_failed: tstamp:16095558974 queue:0x0bcb2e38
kworker/1:0-18 [001] … 497.688341: rtos_queue_send_from_isr_failed: tstamp:16095559123 queue:0x0bcb76a0
kworker/1:0-18 [001] … 497.688342: rtos_queue_send_from_isr_failed: tstamp:16095559274 queue:0x0bcb9220
kworker/1:0-18 [001] … 497.688343: rtos_queue_send_from_isr_failed: tstamp:16095559421 queue:0x0bcb9fe0
kworker/1:0-18 [001] … 497.688344: rtos_queue_send_from_isr_failed: tstamp:16095559568 queue:0x0bcbada0
kworker/1:0-18 [001] … 497.688347: rtcpu_string: tstamp:16095560431 id:0x04010000 str:"VI GOS[#0] set to VM GOS[4] base 0xc2104000
"
kworker/1:0-18 [001] … 497.688366: rtcpu_vinotify_event: tstamp:16095596072 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:16841768096 data:0x10000000
kworker/1:0-18 [001] … 497.688368: rtcpu_vinotify_event: tstamp:16095596216 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:16841776256 data:0x31000001
kworker/1:0-18 [001] … 497.688369: rtcpu_vinotify_event: tstamp:16095596378 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:16841778400 data:0x07020001
kworker/1:0-18 [001] … 497.688371: rtos_queue_send_from_isr_failed: tstamp:16096603765 queue:0x0bcb2e38
kworker/1:0-18 [001] … 497.688372: rtos_queue_send_from_isr_failed: tstamp:16096603917 queue:0x0bcb76a0
kworker/1:0-18 [001] … 497.688373: rtos_queue_send_from_isr_failed: tstamp:16096604069 queue:0x0bcb9220
kworker/1:0-18 [001] … 497.688374: rtos_queue_send_from_isr_failed: tstamp:16096604216 queue:0x0bcb9fe0
kworker/1:0-18 [001] … 497.688375: rtos_queue_send_from_isr_failed: tstamp:16096604363 queue:0x0bcbada0
kworker/1:0-18 [001] … 497.688377: rtos_queue_send_from_isr_failed: tstamp:16096613223 queue:0x0bcb2e38
kworker/1:0-18 [001] … 497.688378: rtos_queue_send_from_isr_failed: tstamp:16096613380 queue:0x0bcb76a0
kworker/1:0-18 [001] … 497.688379: rtos_queue_send_from_isr_failed: tstamp:16096613534 queue:0x0bcb9220
kworker/1:0-18 [001] … 497.688380: rtos_queue_send_from_isr_failed: tstamp:16096613704 queue:0x0bcb9fe0
kworker/1:0-18 [001] … 497.688381: rtos_queue_send_from_isr_failed: tstamp:16096613853 queue:0x0bcbada0
kworker/1:0-18 [001] … 497.688382: rtcpu_vinotify_event: tstamp:16096614206 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:16875187488 data:0x10000000
kworker/1:0-18 [001] … 497.688384: rtcpu_vinotify_event: tstamp:16096614368 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:16875195776 data:0x31000002
kworker/1:0-18 [001] … 497.688386: rtos_queue_peek_from_isr_failed: tstamp:16096651274 queue:0x0bcbbbb8
kworker/1:0-18 [001] … 497.856322: rtos_queue_peek_from_isr_failed: tstamp:16101651272 queue:0x0bcbbbb8
kworker/1:0-18 [001] … 498.024315: rtos_queue_peek_from_isr_failed: tstamp:16106651272 queue:0x0bcbbbb8
kworker/1:0-18 [001] … 498.192324: rtos_queue_peek_from_isr_failed: tstamp:16111651270 queue:0x0bcbbbb8
kworker/1:0-18 [001] … 498.360368: rtos_queue_peek_from_isr_failed: tstamp:16116651273 queue:0x0bcbbbb8
kworker/1:0-18 [001] … 498.528319: rtos_queue_peek_from_isr_failed: tstamp:16121651272 queue:0x0bcbbbb8
kworker/1:0-18 [001] … 498.640311: rtos_queue_peek_from_isr_failed: tstamp:16126651273 queue:0x0bcbbbb8

hello zhuberger,

this is due camera stack drop the buffers due to unsuccessfully capture camera frames.
since your driver based-on Rbp IMX219, have your remove those default configurations since it’s reference camera driver.

Hi Jerry,

May I ask what are “those default configurations”? I am not sure if I removed them.
tegra194-camera-jakku-rbpcv2-imx219.dtsi (1.6 KB)
tegra194-camera-rbpcv2-imx219.dtsi (14.7 KB)

hello zhuberger,

those IMX219 related settings, especially the NVCSI/VI node definitions.
BTW,
do you modify the imx219 sensor driver to implement yours? because it’s compatible property searching for the kernel driver, and default imx219 have the same string in the *.c file.

	cam_i2cmux {
		i2c_0:i2c@0 {
			imx219_cam0: rbpcv2_imx219_a@36 {
				compatible = "nvidia,imx219";