Camera preview failed

We upgraded and revised our camera driver to L4t R32.2.1 from R31.1 on AGx and got preview failed.
The thing is our camera works well with R31.1.

Here is the error message we got.
[ 3434.417768] ov5693 2-0048: camera_common_try_fmt: size 1280 x 720
[ 3434.417939] ov5693 2-0048: camera_common_try_fmt: size 1280 x 720
[ 3434.454691] [RCE] vi5_hwinit: firmware CL2018101701 protocol version 2.2
[ 3437.142517] tegra194-vi5 15c10000.vi: no reply from camera processor
[ 3437.142670] tegra194-vi5 15c10000.vi: uncorr_err: request timed out after 2500 ms
[ 3437.142818] tegra194-vi5 15c10000.vi: err_rec: attempting to reset the capture channel
[ 3437.145828] tegra194-vi5 15c10000.vi: err_rec: successfully reset the capture channel
[ 3439.958367] tegra194-vi5 15c10000.vi: no reply from camera processor
[ 3439.958518] tegra194-vi5 15c10000.vi: uncorr_err: request timed out after 2500 ms
[ 3439.958687] tegra194-vi5 15c10000.vi: err_rec: attempting to reset the capture channel
[ 3439.961670] tegra194-vi5 15c10000.vi: err_rec: successfully reset the capture channel
[ 3442.774292] tegra194-vi5 15c10000.vi: no reply from camera processor
[ 3442.774443] tegra194-vi5 15c10000.vi: uncorr_err: request timed out after 2500 ms

Here is the command.

gst-launch-1.0 -v v4l2src device=“/dev/video0” ! “video/x-raw, width=1280,height=720, format=(string)UYVY” ! nvvidconv ! “video/x-raw(memory:NVMM), width=640, height=360, format=(string)I420” ! nvvidconv ! xvimagesink

nva@agx:~$ v4l2-compliance -d /dev/video0
v4l2-compliance SHA : not available

Driver Info:
Driver name : tegra-video
Card type : vi-output, ov5693 2-0048
Bus info : platform:15c10000.vi:0
Driver version: 4.9.140
Capabilities : 0x84200001
Video Capture
Streaming
Extended Pix Format
Device Capabilities
Device Caps : 0x04200001
Video Capture
Streaming
Extended Pix Format

Compliance test for device /dev/video0 (not using libv4l2):

Required ioctls:
test VIDIOC_QUERYCAP: OK

Allow for multiple opens:
test second video open: OK
test VIDIOC_QUERYCAP: OK
test VIDIOC_G/S_PRIORITY: OK
test for unlimited opens: OK

Debug ioctls:
test VIDIOC_DBG_G/S_REGISTER: OK (Not Supported)
test VIDIOC_LOG_STATUS: OK

Input ioctls:
test VIDIOC_G/S_TUNER/ENUM_FREQ_BANDS: OK (Not Supported)
test VIDIOC_G/S_FREQUENCY: OK (Not Supported)
test VIDIOC_S_HW_FREQ_SEEK: OK (Not Supported)
test VIDIOC_ENUMAUDIO: OK (Not Supported)
test VIDIOC_G/S/ENUMINPUT: OK
test VIDIOC_G/S_AUDIO: OK (Not Supported)
Inputs: 1 Audio Inputs: 0 Tuners: 0

Output ioctls:
test VIDIOC_G/S_MODULATOR: OK (Not Supported)
test VIDIOC_G/S_FREQUENCY: OK (Not Supported)
test VIDIOC_ENUMAUDOUT: OK (Not Supported)
test VIDIOC_G/S/ENUMOUTPUT: OK (Not Supported)
test VIDIOC_G/S_AUDOUT: OK (Not Supported)
Outputs: 0 Audio Outputs: 0 Modulators: 0

Input/Output configuration ioctls:
test VIDIOC_ENUM/G/S/QUERY_STD: OK (Not Supported)
test VIDIOC_ENUM/G/S/QUERY_DV_TIMINGS: OK (Not Supported)
test VIDIOC_DV_TIMINGS_CAP: OK (Not Supported)
test VIDIOC_G/S_EDID: OK (Not Supported)

Test input 0:

Control ioctls:
	test VIDIOC_QUERY_EXT_CTRL/QUERYMENU: OK
	test VIDIOC_QUERYCTRL: OK
	test VIDIOC_G/S_CTRL: OK

Stopped here.

Thank you for any advice.

Could you enable the trace to get more information.

https://elinux.org/Jetson_TX2_Camera_BringUp

Hi ShaneCCC,

Thank you for your support.

The information:

[ 811.564065] ov5693 2-0048: camera_common_try_fmt: size 1280 x 720
[ 811.564271] ov5693 2-0048: camera_common_try_fmt: size 1280 x 720
[ 811.597818] [RCE] Configuring VI GoS.
[ 811.597836] [RCE] VM GOS[#0] addr=0xe4900000
[ 811.597847] [RCE] VM GOS[#1] addr=0xe4901000
[ 811.597857] [RCE] VM GOS[#2] addr=0xe4902000
[ 811.597867] [RCE] VM GOS[#3] addr=0xe4903000
[ 811.597876] [RCE] VM GOS[#4] addr=0xe4904000
[ 811.597886] [RCE] VM GOS[#5] addr=0xe4905000
[ 811.597898] [RCE] vi5_hwinit: firmware CL2018101701 protocol version 2.2
[ 811.597916] [RCE] VI GOS[#0] set to VM GOS[4] base 0xe4904000
[ 814.241595] tegra194-vi5 15c10000.vi: no reply from camera processor
[ 814.241802] tegra194-vi5 15c10000.vi: uncorr_err: request timed out after 2500 ms
[ 814.241958] tegra194-vi5 15c10000.vi: err_rec: attempting to reset the capture channel
[ 814.245648] tegra194-vi5 15c10000.vi: err_rec: successfully reset the capture channel
[ 814.285684] [RCE] Configuring VI GoS.
[ 814.285701] [RCE] VM GOS[#0] addr=0xe4900000
[ 814.285712] [RCE] VM GOS[#1] addr=0xe4901000
[ 814.285723] [RCE] VM GOS[#2] addr=0xe4902000
[ 814.285732] [RCE] VM GOS[#3] addr=0xe4903000
[ 814.285742] [RCE] VM GOS[#4] addr=0xe4904000
[ 814.285752] [RCE] VM GOS[#5] addr=0xe4905000
[ 817.057469] tegra194-vi5 15c10000.vi: no reply from camera processor
[ 817.057639] tegra194-vi5 15c10000.vi: uncorr_err: request timed out after 2500 ms
[ 817.057800] tegra194-vi5 15c10000.vi: err_rec: attempting to reset the capture channel
[ 817.061087] tegra194-vi5 15c10000.vi: err_rec: successfully reset the capture channel

root@agx:/home/nva# cat /sys/kernel/debug/tracing/trace

tracer: nop

entries-in-buffer/entries-written: 832/832 #P:4

_-----=> irqs-off

/ _----=> need-resched

| / _—=> hardirq/softirq

|| / _–=> preempt-depth

||| / delay

TASK-PID CPU# |||| TIMESTAMP FUNCTION

| | | |||| | |

gst-launch-1.0-9727 [000] … 1098.224911: tegra_channel_open: vi-output, ov5693 2-0048
gst-launch-1.0-9727 [001] … 1098.227494: tegra_channel_set_power: ov5693 2-0048 : 0x1
gst-launch-1.0-9727 [001] … 1098.227517: camera_common_s_power: status : 0x1
gst-launch-1.0-9727 [001] … 1098.266983: tegra_channel_set_power: 15a00000.nvcsi–6 : 0x1
gst-launch-1.0-9727 [001] … 1098.266993: csi_s_power: enable : 0x1
gst-launch-1.0-9727 [000] … 1098.270278: tegra_channel_close: vi-output, ov5693 2-0048
gst-launch-1.0-9727 [000] … 1098.270291: tegra_channel_set_power: ov5693 2-0048 : 0x0
gst-launch-1.0-9727 [000] … 1098.270305: camera_common_s_power: status : 0x0
gst-launch-1.0-9727 [000] … 1098.292669: tegra_channel_set_power: 15a00000.nvcsi–6 : 0x0
gst-launch-1.0-9727 [000] … 1098.292678: csi_s_power: enable : 0x0
gst-launch-1.0-9727 [000] … 1098.294044: tegra_channel_open: vi-output, ov5693 2-004a
gst-launch-1.0-9727 [000] … 1098.294068: tegra_channel_set_power: ov5693 2-004a : 0x1
gst-launch-1.0-9727 [000] … 1098.294088: camera_common_s_power: status : 0x1
gst-launch-1.0-9727 [000] … 1098.332897: tegra_channel_set_power: 15a00000.nvcsi–5 : 0x1
gst-launch-1.0-9727 [000] … 1098.332903: csi_s_power: enable : 0x1
gst-launch-1.0-9727 [000] … 1098.333527: tegra_channel_close: vi-output, ov5693 2-004a
gst-launch-1.0-9727 [000] … 1098.333535: tegra_channel_set_power: ov5693 2-004a : 0x0
gst-launch-1.0-9727 [000] … 1098.333546: camera_common_s_power: status : 0x0
gst-launch-1.0-9727 [000] … 1098.355841: tegra_channel_set_power: 15a00000.nvcsi–5 : 0x0
gst-launch-1.0-9727 [000] … 1098.355880: csi_s_power: enable : 0x0
gst-launch-1.0-9727 [000] … 1098.357109: tegra_channel_open: vi-output, ov5693 2-004c
gst-launch-1.0-9727 [000] … 1098.357124: tegra_channel_set_power: ov5693 2-004c : 0x1
gst-launch-1.0-9727 [000] … 1098.357172: camera_common_s_power: status : 0x1
gst-launch-1.0-9727 [000] … 1098.396025: tegra_channel_set_power: 15a00000.nvcsi–4 : 0x1
gst-launch-1.0-9727 [000] … 1098.396034: csi_s_power: enable : 0x1
gst-launch-1.0-9727 [000] … 1098.396758: tegra_channel_close: vi-output, ov5693 2-004c
gst-launch-1.0-9727 [000] … 1098.396768: tegra_channel_set_power: ov5693 2-004c : 0x0
gst-launch-1.0-9727 [000] … 1098.396783: camera_common_s_power: status : 0x0
gst-launch-1.0-9727 [001] … 1098.419185: tegra_channel_set_power: 15a00000.nvcsi–4 : 0x0
gst-launch-1.0-9727 [001] … 1098.419198: csi_s_power: enable : 0x0
gst-launch-1.0-9727 [001] … 1098.420510: tegra_channel_open: vi-output, ov5693 2-0068
gst-launch-1.0-9727 [001] … 1098.420525: tegra_channel_set_power: ov5693 2-0068 : 0x1
gst-launch-1.0-9727 [001] … 1098.420544: camera_common_s_power: status : 0x1
gst-launch-1.0-9727 [001] … 1098.459474: tegra_channel_set_power: 15a00000.nvcsi–3 : 0x1
gst-launch-1.0-9727 [001] … 1098.459482: csi_s_power: enable : 0x1
gst-launch-1.0-9727 [001] … 1098.460439: tegra_channel_close: vi-output, ov5693 2-0068
gst-launch-1.0-9727 [001] … 1098.460449: tegra_channel_set_power: ov5693 2-0068 : 0x0
gst-launch-1.0-9727 [001] … 1098.460463: camera_common_s_power: status : 0x0
gst-launch-1.0-9727 [000] … 1098.482803: tegra_channel_set_power: 15a00000.nvcsi–3 : 0x0
gst-launch-1.0-9727 [000] … 1098.482810: csi_s_power: enable : 0x0
gst-launch-1.0-9727 [000] … 1098.484041: tegra_channel_open: vi-output, ov5693 2-006c
gst-launch-1.0-9727 [000] … 1098.484056: tegra_channel_set_power: ov5693 2-006c : 0x1
gst-launch-1.0-9727 [000] … 1098.484074: camera_common_s_power: status : 0x1
gst-launch-1.0-9727 [000] … 1098.522909: tegra_channel_set_power: 15a00000.nvcsi–2 : 0x1
gst-launch-1.0-9727 [000] … 1098.522915: csi_s_power: enable : 0x1
gst-launch-1.0-9727 [000] … 1098.523528: tegra_channel_close: vi-output, ov5693 2-006c
gst-launch-1.0-9727 [000] … 1098.523572: tegra_channel_set_power: ov5693 2-006c : 0x0
gst-launch-1.0-9727 [000] … 1098.523603: camera_common_s_power: status : 0x0
gst-launch-1.0-9727 [000] … 1098.545957: tegra_channel_set_power: 15a00000.nvcsi–2 : 0x0
gst-launch-1.0-9727 [000] … 1098.545962: csi_s_power: enable : 0x0
gst-launch-1.0-9727 [000] … 1098.547189: tegra_channel_open: vi-output, ov5693 2-002a
gst-launch-1.0-9727 [000] … 1098.547200: tegra_channel_set_power: ov5693 2-002a : 0x1
gst-launch-1.0-9727 [000] … 1098.547219: camera_common_s_power: status : 0x1
gst-launch-1.0-9727 [000] … 1098.585963: tegra_channel_set_power: 15a00000.nvcsi–1 : 0x1
gst-launch-1.0-9727 [000] … 1098.585966: csi_s_power: enable : 0x1
gst-launch-1.0-9727 [000] … 1098.586073: tegra_channel_close: vi-output, ov5693 2-002a
gst-launch-1.0-9727 [000] … 1098.586078: tegra_channel_set_power: ov5693 2-002a : 0x0
gst-launch-1.0-9727 [000] … 1098.586092: camera_common_s_power: status : 0x0
gst-launch-1.0-9727 [000] … 1098.608472: tegra_channel_set_power: 15a00000.nvcsi–1 : 0x0
gst-launch-1.0-9727 [000] … 1098.608480: csi_s_power: enable : 0x0
gst-launch-1.0-9727 [003] … 1098.678279: tegra_channel_open: vi-output, ov5693 2-0048
gst-launch-1.0-9727 [003] … 1098.678307: tegra_channel_set_power: ov5693 2-0048 : 0x1
gst-launch-1.0-9727 [003] … 1098.678325: camera_common_s_power: status : 0x1
gst-launch-1.0-9727 [001] … 1098.717343: tegra_channel_set_power: 15a00000.nvcsi–6 : 0x1
gst-launch-1.0-9727 [001] … 1098.717356: csi_s_power: enable : 0x1
v4l2src0:src-9729 [001] … 1098.735041: tegra_channel_set_stream: enable : 0x1
v4l2src0:src-9729 [003] … 1098.745983: tegra_channel_set_stream: 15a00000.nvcsi–6 : 0x1
v4l2src0:src-9729 [003] … 1098.745991: csi_s_stream: enable : 0x1
v4l2src0:src-9729 [003] … 1098.746011: tegra_channel_set_stream: ov5693 2-0048 : 0x1
v4l2src0:src-9729 [003] … 1098.746145: tegra_channel_capture_setup: vnc_id 0 W 1280 H 720 fmt 13
kworker/0:1-8626 [000] … 1098.753992: rtos_queue_send_from_isr_failed: tstamp:34540085230 queue:0x0bcb41f8
kworker/0:1-8626 [000] … 1098.753998: rtos_queue_send_from_isr_failed: tstamp:34540087730 queue:0x0bcb8a60
kworker/0:1-8626 [000] … 1098.754000: rtos_queue_send_from_isr_failed: tstamp:34540090224 queue:0x0bcba5e0
kworker/0:1-8626 [000] … 1098.754002: rtos_queue_send_from_isr_failed: tstamp:34540092678 queue:0x0bcbb3a0
kworker/0:1-8626 [000] … 1098.754003: rtos_queue_send_from_isr_failed: tstamp:34540095132 queue:0x0bcbc160
kworker/0:1-8626 [000] … 1098.754005: rtos_queue_peek_from_isr_failed: tstamp:34540207041 queue:0x0bcbcf78
kworker/0:1-8626 [000] … 1098.754009: rtcpu_start: tstamp:34540209191
kworker/0:1-8626 [000] … 1098.754010: rtos_queue_send_from_isr_failed: tstamp:34540222589 queue:0x0bcb41f8
kworker/0:1-8626 [000] … 1098.754012: rtos_queue_send_from_isr_failed: tstamp:34540222749 queue:0x0bcb8a60
kworker/0:1-8626 [000] … 1098.754045: rtos_queue_send_from_isr_failed: tstamp:34540222909 queue:0x0bcba5e0
kworker/0:1-8626 [000] … 1098.754047: rtos_queue_send_from_isr_failed: tstamp:34540223066 queue:0x0bcbb3a0
kworker/0:1-8626 [000] … 1098.754048: rtos_queue_send_from_isr_failed: tstamp:34540223222 queue:0x0bcbc160
kworker/0:1-8626 [000] … 1098.754051: rtcpu_string: tstamp:34540223677 id:0x04010000 str:"Configuring VI GoS.
"
kworker/0:1-8626 [000] … 1098.754078: rtcpu_string: tstamp:34540223868 id:0x04010000 str:"VM GOS[#0] addr=0xe4900000
"
kworker/0:1-8626 [000] … 1098.754087: rtcpu_string: tstamp:34540224132 id:0x04010000 str:"VM GOS[#1] addr=0xe4901000
"
kworker/0:1-8626 [000] … 1098.754123: rtcpu_string: tstamp:34540224415 id:0x04010000 str:"VM GOS[#2] addr=0xe4902000
"
kworker/0:1-8626 [000] … 1098.754131: rtcpu_string: tstamp:34540224657 id:0x04010000 str:"VM GOS[#3] addr=0xe4903000
"
kworker/0:1-8626 [000] … 1098.754138: rtcpu_string: tstamp:34540224901 id:0x04010000 str:"VM GOS[#4] addr=0xe4904000
"
kworker/0:1-8626 [000] … 1098.754146: rtcpu_string: tstamp:34540225144 id:0x04010000 str:"VM GOS[#5] addr=0xe4905000
"
kworker/0:1-8626 [000] … 1098.754153: rtcpu_string: tstamp:34540232763 id:0x04010000 str:“vi5_hwinit: firmware CL2018101701 protocol versi”
kworker/0:1-8626 [000] … 1098.754155: rtcpu_string: tstamp:34540232891 id:0x04010000 str:"on 2.2
"
kworker/0:1-8626 [000] … 1098.754162: rtos_queue_send_from_isr_failed: tstamp:34540251277 queue:0x0bcb41f8
kworker/0:1-8626 [000] … 1098.754164: rtos_queue_send_from_isr_failed: tstamp:34540251461 queue:0x0bcb8a60
kworker/0:1-8626 [000] … 1098.754165: rtos_queue_send_from_isr_failed: tstamp:34540251624 queue:0x0bcba5e0
kworker/0:1-8626 [000] … 1098.754189: rtos_queue_send_from_isr_failed: tstamp:34540251783 queue:0x0bcbb3a0
kworker/0:1-8626 [000] … 1098.754190: rtos_queue_send_from_isr_failed: tstamp:34540251938 queue:0x0bcbc160
kworker/0:1-8626 [000] … 1098.754192: rtcpu_string: tstamp:34540252846 id:0x04010000 str:"VI GOS[#0] set to VM GOS[4] base 0xe4904000
"
kworker/0:1-8626 [000] … 1098.809976: rtcpu_vinotify_event: tstamp:34540545500 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:35841264832 data:0x10000000
kworker/0:1-8626 [000] … 1098.809982: rtcpu_vinotify_event: tstamp:34540545657 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:35841268672 data:0x31000001
kworker/0:1-8626 [000] … 1098.809984: rtcpu_vinotify_event: tstamp:34540545831 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:35841269664 data:0x07020001
kworker/0:1-8626 [000] … 1098.809985: rtcpu_vinotify_event: tstamp:34540545977 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:35841309120 data:0x10000000
kworker/0:1-8626 [000] … 1098.809986: rtcpu_vinotify_event: tstamp:34540546147 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:35841312992 data:0x31000002
kworker/0:1-8626 [000] … 1098.922001: rtos_queue_peek_from_isr_failed: tstamp:34545207413 queue:0x0bcbcf78
kworker/0:1-8626 [000] … 1099.089975: rtos_queue_peek_from_isr_failed: tstamp:34550207410 queue:0x0bcbcf78
kworker/0:1-8626 [000] … 1099.257948: rtos_queue_peek_from_isr_failed: tstamp:34555207410 queue:0x0bcbcf78
kworker/0:1-8626 [000] … 1099.425914: rtos_queue_peek_from_isr_failed: tstamp:34560207410 queue:0x0bcbcf78
kworker/0:1-8626 [000] … 1099.593908: rtos_queue_peek_from_isr_failed: tstamp:34565207413 queue:0x0bcbcf78
kworker/0:1-8626 [000] … 1099.761886: rtos_queue_peek_from_isr_failed: tstamp:34570207410 queue:0x0bcbcf78
kworker/0:1-8626 [000] … 1099.873876: rtos_queue_peek_from_isr_failed: tstamp:34575207414 queue:0x0bcbcf78
kworker/0:1-8626 [000] … 1100.041880: rtos_queue_peek_from_isr_failed: tstamp:34580207410 queue:0x0bcbcf78
kworker/0:1-8626 [000] … 1100.209866: rtos_queue_peek_from_isr_failed: tstamp:34585207410 queue:0x0bcbcf78
kworker/0:1-8626 [000] … 1100.377878: rtos_queue_peek_from_isr_failed: tstamp:34590207414 queue:0x0bcbcf78
kworker/0:1-8626 [000] … 1100.545878: rtos_queue_peek_from_isr_failed: tstamp:34595207431 queue:0x0bcbcf78
kworker/0:1-8626 [000] … 1100.713851: rtos_queue_peek_from_isr_failed: tstamp:34600207410 queue:0x0bcbcf78
kworker/0:1-8626 [000] … 1100.881852: rtos_queue_peek_from_isr_failed: tstamp:34605207414 queue:0x0bcbcf78
kworker/0:1-8626 [000] … 1100.993868: rtos_queue_peek_from_isr_failed: tstamp:34610207414 queue:0x0bcbcf78
kworker/0:1-8626 [000] … 1101.161852: rtos_queue_peek_from_isr_failed: tstamp:34615207410 queue:0x0bcbcf78
kworker/0:1-8626 [000] … 1101.329822: rtos_queue_peek_from_isr_failed: tstamp:34620207410 queue:0x0bcbcf78
vi-output, ov56-9732 [000] … 1101.464292: tegra_channel_capture_setup: vnc_id 0 W 1280 H 720 fmt 13
kworker/0:1-8626 [000] … 1101.497819: rtos_queue_send_from_isr_failed: tstamp:34624967891 queue:0x0bcb41f8
kworker/0:1-8626 [000] … 1101.497823: rtos_queue_send_from_isr_failed: tstamp:34624968055 queue:0x0bcb8a60
kworker/0:1-8626 [000] … 1101.497825: rtos_queue_send_from_isr_failed: tstamp:34624968218 queue:0x0bcba5e0
kworker/0:1-8626 [000] … 1101.497827: rtos_queue_send_from_isr_failed: tstamp:34624968374 queue:0x0bcbb3a0
kworker/0:1-8626 [000] … 1101.497828: rtos_queue_send_from_isr_failed: tstamp:34624968531 queue:0x0bcbc160
kworker/0:1-8626 [000] … 1101.497829: rtos_queue_send_from_isr_failed: tstamp:34625023818 queue:0x0bcb41f8
kworker/0:1-8626 [000] … 1101.497837: rtos_queue_send_from_isr_failed: tstamp:34625023979 queue:0x0bcb8a60
kworker/0:1-8626 [000] … 1101.497838: rtos_queue_send_from_isr_failed: tstamp:34625024141 queue:0x0bcba5e0
kworker/0:1-8626 [000] … 1101.497839: rtos_queue_send_from_isr_failed: tstamp:34625024298 queue:0x0bcbb3a0
kworker/0:1-8626 [000] … 1101.497841: rtos_queue_send_from_isr_failed: tstamp:34625024455 queue:0x0bcbc160
kworker/0:1-8626 [000] … 1101.497842: rtos_queue_send_from_isr_failed: tstamp:34625041503 queue:0x0bcb41f8
kworker/0:1-8626 [000] … 1101.497843: rtos_queue_send_from_isr_failed: tstamp:34625041663 queue:0x0bcb8a60
kworker/0:1-8626 [000] … 1101.497845: rtos_queue_send_from_isr_failed: tstamp:34625041824 queue:0x0bcba5e0
kworker/0:1-8626 [000] … 1101.497846: rtos_queue_send_from_isr_failed: tstamp:34625041980 queue:0x0bcbb3a0
kworker/0:1-8626 [000] … 1101.497848: rtos_queue_send_from_isr_failed: tstamp:34625042135 queue:0x0bcbc160
kworker/0:1-8626 [000] … 1101.497852: rtcpu_string: tstamp:34625042607 id:0x04010000 str:"Configuring VI GoS.
"
kworker/0:1-8626 [000] … 1101.497874: rtcpu_string: tstamp:34625042799 id:0x04010000 str:"VM GOS[#0] addr=0xe4900000
"
kworker/0:1-8626 [000] … 1101.497882: rtcpu_string: tstamp:34625043062 id:0x04010000 str:"VM GOS[#1] addr=0xe4901000
"
kworker/0:1-8626 [000] … 1101.497890: rtcpu_string: tstamp:34625043341 id:0x04010000 str:"VM GOS[#2] addr=0xe4902000
"
kworker/0:1-8626 [000] … 1101.497928: rtcpu_string: tstamp:34625043582 id:0x04010000 str:"VM GOS[#3] addr=0xe4903000
"
kworker/0:1-8626 [000] … 1101.497935: rtcpu_string: tstamp:34625043826 id:0x04010000 str:"VM GOS[#4] addr=0xe4904000
"
kworker/0:1-8626 [000] … 1101.497942: rtcpu_string: tstamp:34625044069 id:0x04010000 str:"VM GOS[#5] addr=0xe4905000
"
kworker/0:1-8626 [000] … 1101.497951: rtos_queue_peek_from_isr_failed: tstamp:34625207414 queue:0x0bcbcf78
kworker/0:1-8626 [000] … 1101.609812: rtos_queue_send_from_isr_failed: tstamp:34627959338 queue:0x0bcb41f8
kworker/0:1-8626 [000] … 1101.609818: rtos_queue_send_from_isr_failed: tstamp:34627959499 queue:0x0bcb8a60
kworker/0:1-8626 [000] … 1101.609820: rtos_queue_send_from_isr_failed: tstamp:34627959660 queue:0x0bcba5e0
kworker/0:1-8626 [000] … 1101.609821: rtos_queue_send_from_isr_failed: tstamp:34627959816 queue:0x0bcbb3a0
kworker/0:1-8626 [000] … 1101.609823: rtos_queue_send_from_isr_failed: tstamp:34627959974 queue:0x0bcbc160
kworker/0:1-8626 [000] … 1101.609826: rtcpu_vinotify_event: tstamp:34628259111 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:34352944448 data:0x10000000
kworker/0:1-8626 [000] … 1101.609827: rtcpu_vinotify_event: tstamp:34628259290 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:34352948352 data:0x31000001
kworker/0:1-8626 [000] … 1101.609855: rtcpu_vinotify_event: tstamp:34628259439 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:34352949344 data:0x07020001
kworker/0:1-8626 [000] … 1101.665876: rtos_queue_peek_from_isr_failed: tstamp:34630207414 queue:0x0bcbcf78
kworker/0:1-8626 [000] … 1101.665883: rtos_queue_send_from_isr_failed: tstamp:34631195063 queue:0x0bcb41f8
kworker/0:1-8626 [000] … 1101.665885: rtos_queue_send_from_isr_failed: tstamp:34631195225 queue:0x0bcb8a60
kworker/0:1-8626 [000] … 1101.665886: rtos_queue_send_from_isr_failed: tstamp:34631195389 queue:0x0bcba5e0
kworker/0:1-8626 [000] … 1101.665888: rtos_queue_send_from_isr_failed: tstamp:34631195547 queue:0x0bcbb3a0
kworker/0:1-8626 [000] … 1101.665889: rtos_queue_send_from_isr_failed: tstamp:34631195702 queue:0x0bcbc160
kworker/0:1-8626 [000] … 1101.721889: rtcpu_vinotify_event: tstamp:34631389101 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:34456484352 data:0x100000

Thank you for any advice,

From the trace CSI/VI didn’t get any validate data from MIPI bus.
You may need to check if the sensor is initial well.

Hi ShaneCCC,

Thank you for your support.
After modified some setting, our cameras previewed ok.
However we got a preview failed, as running multi cameras.
And the error only happened as launching camera 1 & camera 2 sequencesly.(the other 4 cameras worked well.)
The thing is the cameras worked well with deepstream.
Thank you for any advice.

Here are error message.
nva@nva-desktop:~$ ./2.sh
Setting pipeline to PAUSED …
Pipeline is live and does not need PREROLL …
Setting pipeline to PLAYING …
New clock: GstSystemClock
/GstPipeline:pipeline0/GstV4l2Src:v4l2src0.GstPad:src: caps = video/x-raw, width=(int)1280, height=(int)720, format=(string)UYVY, framerate=(fraction)30/1, colorimetry=(string)2:4:7:1, interlace-mode=(string)progressive
/GstPipeline:pipeline0/GstCapsFilter:capsfilter0.GstPad:src: caps = video/x-raw, width=(int)1280, height=(int)720, format=(string)UYVY, framerate=(fraction)30/1, colorimetry=(string)2:4:7:1, interlace-mode=(string)progressive
/GstPipeline:pipeline0/Gstnvvconv:nvvconv0.GstPad:src: caps = video/x-raw(memory:NVMM), width=(int)640, height=(int)360, framerate=(fraction)30/1, interlace-mode=(string)progressive, format=(string)I420
/GstPipeline:pipeline0/GstCapsFilter:capsfilter1.GstPad:src: caps = video/x-raw(memory:NVMM), width=(int)640, height=(int)360, framerate=(fraction)30/1, interlace-mode=(string)progressive, format=(string)I420
/GstPipeline:pipeline0/Gstnvvconv:nvvconv1.GstPad:src: caps = video/x-raw, width=(int)640, height=(int)360, framerate=(fraction)30/1, interlace-mode=(string)progressive, format=(string)YUY2
/GstPipeline:pipeline0/GstXvImageSink:xvimagesink0.GstPad:sink: caps = video/x-raw, width=(int)640, height=(int)360, framerate=(fraction)30/1, interlace-mode=(string)progressive, format=(string)YUY2
/GstPipeline:pipeline0/Gstnvvconv:nvvconv1.GstPad:sink: caps = video/x-raw(memory:NVMM), width=(int)640, height=(int)360, framerate=(fraction)30/1, interlace-mode=(string)progressive, format=(string)I420
/GstPipeline:pipeline0/GstCapsFilter:capsfilter1.GstPad:sink: caps = video/x-raw(memory:NVMM), width=(int)640, height=(int)360, framerate=(fraction)30/1, interlace-mode=(string)progressive, format=(string)I420
/GstPipeline:pipeline0/Gstnvvconv:nvvconv0.GstPad:sink: caps = video/x-raw, width=(int)1280, height=(int)720, format=(string)UYVY, framerate=(fraction)30/1, colorimetry=(string)2:4:7:1, interlace-mode=(string)progressive
/GstPipeline:pipeline0/GstCapsFilter:capsfilter0.GstPad:sink: caps = video/x-raw, width=(int)1280, height=(int)720, format=(string)UYVY, framerate=(fraction)30/1, colorimetry=(string)2:4:7:1, interlace-mode=(string)progressive
ERROR: from element /GstPipeline:pipeline0/GstV4l2Src:v4l2src0: Failed to allocate required memory.
Additional debug info:
gstv4l2src.c(658): gst_v4l2src_decide_allocation (): /GstPipeline:pipeline0/GstV4l2Src:v4l2src0:
Buffer pool activation failed
Execution ended after 0:00:09.108489147
Setting pipeline to PAUSED …
Setting pipeline to READY …
Setting pipeline to NULL …
Freeing pipeline …

Attached the log.

Thank you,

cam0_cam1_fail_p.txt (4.71 KB)

Could you boost the clock to try.

sudo su
echo 1 > /sys/kernel/debug/bpmp/debug/clk/vi/mrq_rate_locked
echo 1 > /sys/kernel/debug/bpmp/debug/clk/isp/mrq_rate_locked
echo 1 > /sys/kernel/debug/bpmp/debug/clk/nvcsi/mrq_rate_locked
cat /sys/kernel/debug/bpmp/debug/clk/vi/max_rate
cat /sys/kernel/debug/bpmp/debug/clk/isp/max_rate
cat /sys/kernel/debug/bpmp/debug/clk/nvcsi/max_rate
echo ${max_rate} > /sys/kernel/debug/bpmp/debug/clk/vi/rate
echo ${max_rate} > /sys/kernel/debug/bpmp/debug/clk/isp/rate
echo ${max_rate} > /sys/kernel/debug/bpmp/debug/clk/nvcsi/rate

Hi ShaneCCC,

After boosted the clock, cam2 did launch ok but caused cam1 hung up.
And sometimes the boosted clock did not work.
By the way, our multi cameras use the same I2c bus, do I need to do some adjust for this?

May I double check the command.
Here are what I did.

sudo su
echo 1 > /sys/kernel/debug/bpmp/debug/clk/vi/mrq_rate_locked
echo 1 > /sys/kernel/debug/bpmp/debug/clk/isp/mrq_rate_locked
echo 1 > /sys/kernel/debug/bpmp/debug/clk/nvcsi/mrq_rate_locked
cat /sys/kernel/debug/bpmp/debug/clk/vi/max_rate
cat /sys/kernel/debug/bpmp/debug/clk/isp/max_rate
cat /sys/kernel/debug/bpmp/debug/clk/nvcsi/max_rate
echo 998400000 > /sys/kernel/debug/bpmp/debug/clk/vi/rate
echo 1190400000 > /sys/kernel/debug/bpmp/debug/clk/isp/rate
echo 400000000 > /sys/kernel/debug/bpmp/debug/clk/nvcsi/rate

attached the log.

Thank you for any advice.

cam0_1_hung0_p.txt (1.34 KB)

Could you verify by v4l2-ctl instead of v4l2src?

v4l2-ctl -d /dev/video0 --set-fmt-video=width=1280,height=720, --set-ctrl bypass_mode=0 --stream-mmap --stream-count=5000

Hi ShaneCCC,

Sorry. I still got the same error as I tested it by using v4l2-ctl cmd.

  1. Cam0 launch ok
  2. cam1 launch ok, but camo hung up and got the error message below.

[ 829.871030] tegra194-vi5 15c10000.vi: no reply from camera processor
[ 829.871180] tegra194-vi5 15c10000.vi: uncorr_err: request timed out after 2500 ms
[ 829.871361] tegra194-vi5 15c10000.vi: err_rec: attempting to reset the capture channel
[ 829.873724] tegra194-vi5 15c10000.vi: err_rec: successfully reset the capture channel
[ 829.877533] tegra194-vi5 15c10000.vi: corr_err: discarding frame 0, flags: 96, err_data 4194401
[ 832.430935] tegra194-vi5 15c10000.vi: no reply from camera processor
[ 832.431075] tegra194-vi5 15c10000.vi: uncorr_err: request timed out after 2500 ms
[ 832.431280] tegra194-vi5 15c10000.vi: err_rec: attempting to reset the capture channel
[ 832.435620] tegra194-vi5 15c10000.vi: corr_err: discarding frame 0, flags: 0, err_data 512
[ 832.435832] tegra194-vi5 15c10000.vi: err_rec: successfully reset the capture channel
[ 832.443946] tegra194-vi5 15c10000.vi: corr_err: discarding frame 0, flags: 96, err_data 8388705
[ 834.990858] tegra194-vi5 15c10000.vi: no reply from camera processor
[ 834.990991] tegra194-vi5 15c10000.vi: uncorr_err: request timed out after 2500 ms
[ 834.991127] tegra194-vi5 15c10000.vi: err_rec: attempting to reset the capture channel
[ 834.994348] tegra194-vi5 15c10000.vi: corr_err: discarding frame 0, flags: 0, err_data 512
[ 834.994531] tegra194-vi5 15c10000.vi: err_rec: successfully reset the capture channel
[ 835.010482] tegra194-vi5 15c10000.vi: corr_err: discarding frame 0, flags: 96, err_data 8388705
[ 837.550788] tegra194-vi5 15c10000.vi: no reply from camera processor
[ 837.550982] tegra194-vi5 15c10000.vi: uncorr_err: request timed out after 2500 ms
[ 837.551150] tegra194-vi5 15c10000.vi: err_rec: attempting to reset the capture channel
[ 837.553097] tegra194-vi5 15c10000.vi: err_rec: successfully reset the capture channel

Thank you for any advice,

Please clarify to run the cam 0 only for a long time to confirm cam 0 can run stable.

Hi ShaneCCC,

Yes. Cam 0 can run overnight.

Here are the steps to run the long time test.

  1. launch cam 0 ok
  2. launch cam 1 ok, but cam 0 hung up.
  3. close cam 0 streaming.
  4. launch cam 0 again and both cam0 & cam1 work well.
  5. both cam0 & cam1 work well overnight

Thank you for any advice,

What’s the discontinuous_clk in the DT? Could you try modify it to try.

The discontinuous_clk is “no”, and we did test “yes”.
Sorry. The result was the same.

Thank you,

As you said only the launch cam0 and cam1 have issue. It could be this two cameras may have power/reset or something affect each others.

Does launch cam1 the launch cam0 without problem?

Yes. launch cam1 and then launch cam0 got problem too. (cam1 hung up)

We will double check the power and reset.

Thank you,

Could you apply the patch from below.

https://devtalk.nvidia.com/default/topic/1066392/jetson-agx-xavier/vi-stops-capturing-on-multistream-configuration/post/5400803/#5400803

Thank you for your information. We will re-tested the patch again.
Honestly, we did add the patch before and the result did not make difference.
However, we will re-test it again.
And update the results.

Thanks,