Acquisition crashes with ga10 error

Robotics & Edge Computing Jetson & Embedded Systems Jetson Orin Nano
1

Hi,

We have two cameras connected which are running in a synchronized mode. Following error appears after streaming for some time:

[  703.540966] tegra-camrtc-capture-vi tegra-capture-vi: corr_err: discarding frame 0, flags: 0, err_data 40000h
[  703.597861] bwmgr API not supported
[  703.873509] tegra-camrtc-capture-vi tegra-capture-vi: corr_err: discarding frame 0, flags: 0, err_data 40000h
[  703.967378] bwmgr API not supported
[  706.772641] host1x 13e40000.host1x: ViCsiHw frameCo: syncpoint id 43 (progress) stuck waiting 40439, timeout=36000
[  706.773070] ---- syncpts ----
[  706.773093] id 20 (ga10b_511) min 28 max 0 refs 1 (previous client : )
[  706.773096] id 21 (ga10b_510) min 9 max 0 refs 1 (previous client : )
[  706.773099] id 22 (ga10b_509) min 16 max 12 refs 1 (previous client : ga10b_509)
[  706.773102] id 23 (progress) min 70290 max 69774 refs 1 (previous client : progress)
[  706.773106] id 24 (stats_progress) min 140580 max 139548 refs 1 (previous client : stats_progress)
[  706.773109] id 25 (ga10b_475_user) min 131072 max 131072 refs 1 (previous client : nvargus-daemon)
[  706.773114] id 28 (ga10b_443_user) min 131074 max 131073 refs 1 (previous client : ga10b_507_user)
[  706.773117] id 29 (ga10b_508_user) min 131074 max 131073 refs 1 (previous client : ga10b_506_user)
[  706.773120] id 30 (ga10b_507_user) min 131074 max 131073 refs 1 (previous client : ga10b_505_user)
[  706.773123] id 31 (ga10b_506_user) min 131072 max 131072 refs 1 (previous client : ga10b_504_user)
[  706.773126] id 32 (ga10b_505_user) min 131072 max 131072 refs 1 (previous client : ga10b_503_user)
[  706.773129] id 33 (ga10b_504_user) min 131072 max 131072 refs 1 (previous client : ga10b_502_user)
[  706.773132] id 34 (ga10b_503_user) min 131072 max 131072 refs 1 (previous client : ga10b_501_user)
[  706.773135] id 35 (ga10b_502_user) min 131072 max 131072 refs 1 (previous client : ga10b_500_user)
[  706.773138] id 36 (ga10b_501_user) min 131072 max 131072 refs 1 (previous client : ga10b_499_user)
[  706.773140] id 37 (ga10b_500_user) min 131072 max 131072 refs 1 (previous client : ga10b_498_user)
[  706.773143] id 38 (ga10b_499_user) min 131072 max 131072 refs 1 (previous client : ga10b_497_user)
[  706.773146] id 39 (ga10b_498_user) min 131072 max 131072 refs 1 (previous client : ga10b_496_user)
[  706.773149] id 40 (ga10b_497_user) min 131072 max 131072 refs 1 (previous client : ga10b_495_user)
[  706.773152] id 41 (ga10b_496_user) min 131072 max 131072 refs 1 (previous client : ga10b_494_user)
[  706.773155] id 42 (ga10b_495_user) min 131072 max 131072 refs 1 (previous client : ga10b_493_user)
[  706.773158] id 43 (progress) min 40432 max 40432 refs 1 (previous client : progress)
[  706.773162] id 46 (ga10b_494) min 12 max 9 refs 1 (previous client : ga10b_475)

Can this be an issue with libargus? We currently are using JetPack 5.1.2 with a patched Argus version taken from a previous issue: Argus image acquisition crashes after a few days - #3 by ShaneCCC

Do you have any idea where this problem might come from?

2

try this and tell me what happened?

v4l2-ctl --set-ctrl bypass_mode=0
4

This message tell didn’t receive frame data and timeout.

5

bypass_mode=0 for both sensors does not seem to impact the error.

Also it seems to be different errors from time to time. I also sometimes get a
[RCE] ERROR: camera-ip/vi5/vi5.c:745 [vi5_handle_eof] "General error queue is out of sync with frame queue. ts=253262971968 sof_ts=253290046176 gerror_code=2 gerror_data=400060 notify_bits=20000"

Which I learned indicates missing MIPI Data, correct? But whats in common is that it always ends with the ViCsiHw error:

host1x 13e40000.host1x: ViCsiHw frameSt: syncpoint id 43 (progress) progressing slowly 4047, timeout=36000
[  234.462922] host1x 13e40000.host1x: ViCsiHw frameCo: syncpoint id 43 (progress) stuck waiting 4053, timeout=36000
[  234.462927] ---- syncpts ----
[  234.463257] id 20 (ga10b_511) min 28 max 0 refs 1 (previous client : )
[  234.463260] id 21 (ga10b_510) min 9 max 0 refs 1 (previous client : )
[  234.463263] id 22 (ga10b_509) min 16 max 12 refs 1 (previous client : ga10b_509)
[  234.463267] id 23 (progress) min 9602 max 3948 refs 1 (previous client : progress)
[  234.463270] id 24 (stats_progress) min 19202 max 7896 refs 1 (previous client : stats_progress)
[  234.463275] id 28 (ga10b_507_user) min 1 max 0 refs 1 (previous client : )
[  234.463278] id 29 (ga10b_506_user) min 1 max 0 refs 1 (previous client : )
[  234.463280] id 30 (ga10b_505_user) min 1 max 0 refs 1 (previous client : )
[  234.463293] id 43 (progress) min 4046 max 1981 refs 1 (previous client : progress)
[  234.463298] id 46 (ga10b_475) min 9 max 6 refs 1 (previous client : ga10b_492)
[  234.463302] id 48 (ga10b_490_user) min 1 max 0 refs 1 (previous client : )
[  234.463304] id 49 (ga10b_489_user) min 1 max 0 refs 1 (previous client : )
[  234.463307] id 50 (ga10b_488_user) min 1 max 0 refs 1 (previous client : )
[  234.463320] id 63 (ga10b_492_user) min 2681 max 2681 refs 1 (previous client : progress)
[  234.463323] id 64 (ga10b_458_user) min 1 max 0 refs 1 (previous client : nvargus-daemon)
[  234.463326] id 65 (ga10b_457_user) min 1 max 0 refs 1 (previous client : nvargus-daemon)
[  234.463329] id 66 (ga10b_456_user) min 6 max 5 refs 1 (previous client : ga10b_475)
[  234.463332] id 67 (ga10b_474_user) min 11 max 0 refs 1 (previous client : )
[  234.463334] id 68 (ga10b_473_user) min 5 max 0 refs 1 (previous client : )
[  234.463337] id 69 (ga10b_472_user) min 4 max 0 refs 1 (previous client : )
[  234.463339] id 70 (ga10b_471_user) min 4 max 0 refs 1 (previous client : )
[  234.463343] id 72 (ga10b_469_user) min 4 max 0 refs 1 (previous client : )
[  234.463346] id 73 (ga10b_468_user) min 4 max 0 refs 1 (previous client : )
[  234.463348] id 74 (ga10b_467_user) min 4 max 0 refs 1 (previous client : )

Which only stops printing after i restart nvargus-daemon - so could this have something to do with libargus?!

6

Apply below files to verify the problem.

camera-rtcpu-t234-rce.img.r35.5.asynchronous (519.3 KB)
libnvfusacap.so.r35.5.txt (193.6 KB)
libnvscf.so.r35.5.inifite.txt (8.4 MB)

7

Hi Shane,

sorry for the late answer. For using the rce patch we have to install the device new, correct? The other two librarys can be changed.

Can you explain what the goal of changing those files is ?

8

Reference to below topic to apply the rce firmware.

How to update camer_rtc_debug image - Jetson & Embedded Systems / Jetson Orin Nano - NVIDIA Developer Forums

10

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.