Camera won't start for the firs time

Joko · June 27, 2018, 6:06am

Hi All,

we have two cameras connected to the TX2 (port A and port C).

we have a problem that the camera won’t start from the first time, like there is a MIPI synchronization problem.

the camera 0 always starts from the first but the cameras 1 starts from the third attempt, the first two attempts end with green screen or an error.

This one starts ok:
gst-launch-1.0 nvcamerasrc sensor-id=0 ! nvvidconv ! ximagesink

This one don’t starts ok:
gst-launch-1.0 nvcamerasrc sensor-id=1 ! nvvidconv ! ximagesink

The strange thing is, when it once starts the camera 1 ok then also both cameras can work simultaneously.

We get the same behivore also with discontinuous_clk = “yes”;

Device tree
camera0

mclk_khz = "26000";
num_lanes = "2";
tegra_sinterface = "serial_c";
//discontinuous_clk = "yes";
discontinuous_clk = "no";
dpcm_enable = "false";
cil_settletime = "0";

active_w = "1936";
active_h = "1096";
pixel_t = "bayer_bggr";
readout_orientation = "90";
line_length = "2016";
inherent_gain = "1";
mclk_multiplier = "6.4";
//pix_clk_hz = "166400000";
pix_clk_hz = "332800000";

min_gain_val = "1.0";
max_gain_val = "16";
min_hdr_ratio = "1";
max_hdr_ratio = "64";
min_framerate = "1.816577";
max_framerate = "30";
min_exp_time = "34";
max_exp_time = "550385";

camera1

mclk_khz = "26000";
//mclk_khz = "24000";
num_lanes = "2";
tegra_sinterface = "serial_a";
//discontinuous_clk = "yes";
discontinuous_clk = "no";
dpcm_enable = "false";
cil_settletime = "0";

active_w = "1936";
active_h = "1096";
pixel_t = "bayer_bggr";
readout_orientation = "90";
line_length = "2016";
inherent_gain = "1";
mclk_multiplier = "6.4";
//pix_clk_hz = "160000000";
//pix_clk_hz = "166400000";
pix_clk_hz = "332800000";

min_gain_val = "1.0";
max_gain_val = "16";
min_hdr_ratio = "1";
max_hdr_ratio = "64";
min_framerate = "1.816577";
max_framerate = "30";
min_exp_time = "34";
max_exp_time = "550385";

Observation from your example of OV5693. You have in device tree the discontinuous_clk set to discontinuous_clk = “no”; , which means that the ov5693 camera is having continuous clk is that right ?

But then in the register set up of ov5693 is {0x4800, 0x20}, /* dis-continuous */, 0x20 which means per datasheet of the ov5693 that the camera is having “Gate clock lane when there is no packed to transmit” which means by our opinion that this is a discontinuous clk from camera. Please explain this?

BR.

JerryChang · June 28, 2018, 6:00am

hello Joko_,

you always have dual camera works with launching serial_a first then serial_c, right?
could you please have an experiment to replace the CSI port of cam0 and cam1? to see if your observation reversed.
according to your commands, your camera preview image would be overlapped.
suggest you to test dual camera as below.

cmd1: nvgstcapture-1.0 --prev-res=4 --image-res=4 --video-res=4 --sensor-id=0 --overlayConfig="1, 100, 100, 1280, 720" -m 2
cmd2: nvgstcapture-1.0 --prev-res=4 --image-res=4 --video-res=4 --sensor-id=1 --overlayConfig="2, 500, 500, 1280, 720" -m 2

thanks for finding the erroneous, ov5693 is running with discontinuous clk, thanks

Joko · July 6, 2018, 1:09pm

Dear Jerry,

one strange thing.

we set the #define DEBUG 1 in the csi4_fops.c file and recompile.

if we reboot the system

when we turn on the camera (sensor-id=0) the camera is working, but we don’t get the print from

int csi4_start_streaming(struct tegra_csi_channel *chan,
				enum tegra_csi_port_num port_num)
{
	struct tegra_csi_device *csi = chan->csi;
	int csi_port, csi_lanes, ret = 0;

	csi_port = chan->ports[port_num].num;
	csi_lanes = chan->ports[port_num].lanes;
	
	dev_info(csi->dev, "%s dev_info: ports index=%d, lanes=%d\n",
			__func__, csi_port, csi_lanes);
	dev_dbg(csi->dev, "%s dev_dbg: ports index=%d, lanes=%d\n",
			__func__, csi_port, csi_lanes);

	if (chan->pg_mode)
		ret = csi4_tpg_start_streaming(chan, port_num);
	else {
		csi4_stream_init(chan, csi_port);
		csi4_stream_config(chan, csi_port);
		/* enable DPHY */
		csi4_phy_config(chan, csi_port, csi_lanes, true);
		csi4_stream_write(chan, csi_port, PP_EN_CTRL, CFG_PP_EN);
	}
	return ret;
}

if we first start the camera (sensor-id=1) then the camera won’t start.

Br

JerryChang · July 9, 2018, 6:28am

hello Joko_,

FYI,
there’s control flag to enable the debug prints without recompile the kernel image,
please execute below command with superuser permission.

#enable debug prints in channel.c 
#enable it by below command
echo 'file channel.c +p' > /sys/kernel/debug/dynamic_debug/control

I’m wondering there’s something missing in your sensor init sequence,
suggest you to co-work with hardware engineers to measure the regulators and mipi clock for camera-0 and camera-1 to find the difference,
thanks

Joko · July 27, 2018, 12:03pm

Dear Jerry,

when we turn-on both cameras at some point the nvcamera-daemon crashes, but we don’t get any error message in dmesg.

and if we start the cameras again with gst then it won’t start, but if we then start the nvcamera-daemon from terminal with:

/usr/sbin/nvcamera-daemon&

and and start the cameras again then the cameras starts and are working but we get error prints from nvcamera-daemon in the terminal where started the nvcamera-daemon

/usr/sbin/nvcamera-deamon&

Error prints:

(NvOdmDevice) Error InvalidState: Invalid active Mode Size (in dvs/git/dirty-master_linux/camera-partner/imager/src/V4L2Device.cpp, function streamControl(), line 1636)

(NvOdmDevice) Error InvalidState: Invalid active Mode Size (in dvs/git/dirty-master_linux/camera-partner/imager/src/devices/V4L2SensorViCsi.cpp, function apply(), line 202)

What are those two errors?

Br.

JerryChang · July 31, 2018, 9:32am

hello Joko_,

it seems you’re using invalid sensor mode. (for example, 0x0)
could you please check the resolution of the sensor mode,
thanks

Joko · July 31, 2018, 9:46am

Dear Jerry,

where should we check that?

we implemented a new sensor module based on OV5693.

we only have one mode:

mode0 { // OV5693_MODE_1936X1086
				mclk_khz = "26000";
				//mclk_khz = "24000";
				num_lanes = "2";
				tegra_sinterface = "serial_a";
				//discontinuous_clk = "yes";
				discontinuous_clk = "no";
				dpcm_enable = "false";
				cil_settletime = "0";
				//dynamic_pixel_bit_depth = "12";
				csi_pixel_bit_depth = "10";
				mode_type = "bayer";
				pixel_phase = "bggr";

				active_w = "1936";
				active_h = "1096";
				//pixel_t = "bayer_bggr";
				//readout_orientation = "90";
				readout_orientation = "0";
				line_length = "2640";
				//line_length = "2016";
				inherent_gain = "1";
				mclk_multiplier = "6.4";
				//pix_clk_hz = "160000000";
				//pix_clk_hz = "166400000";
				pix_clk_hz = "332800000";

				min_gain_val = "1.0";
				max_gain_val = "16";
				min_hdr_ratio = "1";
				max_hdr_ratio = "64";
				min_framerate = "1.816577";
				max_framerate = "30";
				min_exp_time = "34";
				max_exp_time = "550385";
			};

has this mode configuration some error?

Br.

Joko · August 3, 2018, 9:07am

Dear Jerry,

here another error log please can you look at it?

root@tegra-ubuntu:/home/nvidia# /usr/sbin/nvcamera-daemon
NvPclHwGetModuleList: No module data found
NvPclHwGetModuleList: No module data found
NvPclHwGetModuleList: No module data found
OFParserGetVirtualDevice: NVIDIA Camera virtual enumerator not found in proc device-tree
LoadOverridesFile: looking for override file [/Calib/camera_override.isp] 1/16LoadOverridesFile: looking for override file [/data/nvcam/settings/camera_overrides.isp] 2/16LoadOverridesFile: looking for override file [/opt/nvidia/nvcam/settings/camera_overrides.isp] 3/16LoadOverridesFile: looking for override file [/var/nvidia/nvcam/settings/camera_overrides.isp] 4/16LoadOverridesFile: looking for override file [/data/nvcam/camera_overrides.isp] 5/16LoadOverridesFile: looking for override file [/data/nvcam/settings/h3tx2_centerleft_P5V27C.isp] 6/16LoadOverridesFile: looking for override file [/opt/nvidia/nvcam/settings/h3tx2_centerleft_P5V27C.isp] 7/16LoadOverridesFile: looking for override file [/var/nvidia/nvcam/settings/h3tx2_centerleft_P5V27C.isp] 8/16---- imager: No override file found. ----
LSC: LSC surface is not based on full res!
LoadOverridesFile: looking for override file [/Calib/camera_override.isp] 1/16LoadOverridesFile: looking for override file [/data/nvcam/settings/camera_overrides.isp] 2/16LoadOverridesFile: looking for override file [/opt/nvidia/nvcam/settings/camera_overrides.isp] 3/16LoadOverridesFile: looking for override file [/var/nvidia/nvcam/settings/camera_overrides.isp] 4/16LoadOverridesFile: looking for override file [/data/nvcam/camera_overrides.isp] 5/16LoadOverridesFile: looking for override file [/data/nvcam/settings/h3tx2_topleft_P5V27C.isp] 6/16LoadOverridesFile: looking for override file [/opt/nvidia/nvcam/settings/h3tx2_topleft_P5V27C.isp] 7/16LoadOverridesFile: looking for override file [/var/nvidia/nvcam/settings/h3tx2_topleft_P5V27C.isp] 8/16---- imager: No override file found. ----
LSC: LSC surface is not based on full res!
LoadOverridesFile: looking for override file [/Calib/camera_override.isp] 1/16LoadOverridesFile: looking for override file [/data/nvcam/settings/camera_overrides.isp] 2/16LoadOverridesFile: looking for override file [/opt/nvidia/nvcam/settings/camera_overrides.isp] 3/16LoadOverridesFile: looking for override file [/var/nvidia/nvcam/settings/camera_overrides.isp] 4/16LoadOverridesFile: looking for override file [/data/nvcam/camera_overrides.isp] 5/16LoadOverridesFile: looking for override file [/data/nvcam/settings/h3tx2_bottomleft_P5V27C.isp] 6/16LoadOverridesFile: looking for override file [/opt/nvidia/nvcam/settings/h3tx2_bottomleft_P5V27C.isp] 7/16LoadOverridesFile: looking for override file [/var/nvidia/nvcam/settings/h3tx2_bottomleft_P5V27C.isp] 8/16---- imager: No override file found. ----
LSC: LSC surface is not based on full res!
LSC: LSC surface is not based on full res!
LSC: LSC surface is not based on full res!
SCF: Error InvalidState:  NonFatal ISO BW requested not set. Requested = 2147483647 Set = 2250000 (in src/services/power/PowerServiceCore.cpp, function setCameraBw(), line 653)
LSC: LSC surface is not based on full res!
SCF: Error InvalidState:  NonFatal ISO BW requested not set. Requested = 4294967294 Set = 2250000 (in src/services/power/PowerServiceCore.cpp, function setCameraBw(), line 653)
SCF: Error InvalidState:  NonFatal ISO BW requested not set. Requested = 6442450941 Set = 2250000 (in src/services/power/PowerServiceCore.cpp, function setCameraBw(), line 653)
PowerServiceCore:handleRequests: timePassed = 904
SCF: Error InvalidState:  NonFatal ISO BW requested not set. Requested = 2148783647 Set = 2250000 (in src/services/power/PowerServiceCore.cpp, function setCameraBw(), line 653)
NvViErrorDecode Stream 2.0 failed: ts 729200856416 frame 654 error 2 data 0x000000a2
NvViErrorDecode CaptureError: CsimuxFrameError (2)
NvViErrorDecode See https://wiki.nvidia.com/wmpwiki/index.php/Camera_Debugging/CaptureError_debugging for more information and links to documents.
CsimuxFrameError_Regular : 0x000000a2
    Stream ID                [ 2: 0]: 2
        
    VPR state from fuse block    [ 3]: 0
        
    Frame end (FE)              [ 5]: 1
        A frame end has been found on a regular mode stream.
    FS_FAULT                    [ 7]: 1
        A FS packet was found for a virtual channel that was already in frame. An errored FE packet was injected before FS was allowed through.
captureErrorCallback Stream 2.0 capture 4128 failed: ts 729200856416 frame 654 error 2 data 0x000000a2

SCF: Error InvalidState:  (propagating from src/services/capture/CaptureServiceDeviceViCsi.cpp, function startCapture(), line 708)
SCF: Error InvalidState:  (propagating from src/services/capture/CaptureServiceCore.cpp, function doCSItoMemCapture(), line 418)
SCF: Error InvalidState:  (propagating from src/services/capture/CaptureServiceCore.cpp, function issueCapture(), line 356)
SCF: Error InvalidState:  (propagating from src/services/capture/CaptureServiceDevice.cpp, function issueCaptures(), line 1213)
SCF: Error InvalidState:  (propagating from src/services/capture/CaptureServiceDevice.cpp, function issueBubbleFillCapturesIfNeeded(), line 678)
SCF: Error InvalidState:  (propagating from src/services/capture/CaptureServiceDevice.cpp, function issueCaptures(), line 1054)
SCF: Error InvalidState:  (propagating from src/common/Utils.cpp, function workerThread(), line 114)
SCF: Error InvalidState: Worker thread CaptureScheduler frameStart failed (in src/common/Utils.cpp, function workerThread(), line 131)
SCF: Error InvalidState: Capture Scheduler not running (in src/services/capture/CaptureServiceDevice.cpp, function addNewItemToSchedule(), line 841)
SCF: Error InvalidState:  (propagating from src/services/capture/CaptureService.cpp, function addRequest(), line 739)
SCF: Error InvalidState:  (propagating from src/components/stages/SensorCaptureStage.cpp, function doHandleRequest(), line 87)
SCF: Error InvalidState:  (propagating from src/components/stages/OrderedStage.cpp, function doExecute(), line 158)
SCF: Error Timeout:  (propagating from src/api/Buffer.cpp, function waitForUnlock(), line 591)
SCF: Error Timeout:  (propagating from src/components/CaptureContainerImpl.cpp, function returnBuffer(), line 358)
SCF: Error InvalidState: Capture Scheduler not running (in src/services/capture/CaptureServiceDevice.cpp, function addNewItemToSchedule(), line 841)
SCF: Error InvalidState:  (propagating from src/services/capture/CaptureService.cpp, function addRequest(), line 739)
SCF: Error InvalidState:  (propagating from src/components/stages/MemoryToISPCaptureStage.cpp, function doHandleRequest(), line 129)
SCF: Error InvalidState:  (propagating from src/components/stages/OrderedStage.cpp, function doExecute(), line 158)
SCF: Error InvalidState: Sending critical error event (in src/api/Session.cpp, function sendErrorEvent(), line 992)
SCF: Error InvalidState: Capture Scheduler not running (in src/services/capture/CaptureServiceDevice.cpp, function addNewItemToSchedule(), line 841)
SCF: Error InvalidState:  (propagating from src/services/capture/CaptureService.cpp, function addRequest(), line 739)
SCF: Error InvalidState:  (propagating from src/components/stages/MemoryToISPCaptureStage.cpp, function doHandleRequest(), line 129)
SCF: Error InvalidState:  (propagating from src/components/stages/OrderedStage.cpp, function doExecute(), line 158)
SCF: Error InvalidState: Sending critical error event (in src/api/Session.cpp, function sendErrorEvent(), line 992)
SCF: Error InvalidState: Capture Scheduler not running (in src/services/capture/CaptureServiceDevice.cpp, function addNewItemToSchedule(), line 841)
SCF: Error InvalidState:  (propagating from src/services/capture/CaptureService.cpp, function addRequest(), line 739)
SCF: Error InvalidState:  (propagating from src/components/stages/SensorCaptureStage.cpp, function doHandleRequest(), line 87)
SCF: Error InvalidState:  (propagating from src/components/stages/OrderedStage.cpp, function doExecute(), line 158)
SCF: Error InvalidState: Sending critical error event (in src/api/Session.cpp, function sendErrorEvent(), line 992)
SCF: Error Timeout:  (propagating from src/components/amr/Snapshot.cpp, function waitForNewerSample(), line 92)
SCF_AutocontrolACSync failed to wait for an earlier frame to complete.

SCF: Error Timeout:  (propagating from src/components/ac_stages/ACSynchronizeStage.cpp, function doHandleRequest(), line 126)
SCF: Error Timeout:  (propagating from src/components/stages/OrderedStage.cpp, function doExecute(), line 137)
SCF: Error Timeout:  (propagating from src/components/amr/Snapshot.cpp, function waitForNewerSample(), line 92)
SCF_AutocontrolACSync failed to wait for an earlier frame to complete.

SCF: Error Timeout:  (propagating from src/components/ac_stages/ACSynchronizeStage.cpp, function doHandleRequest(), line 126)
SCF: Error Timeout:  (propagating from src/components/stages/OrderedStage.cpp, function doExecute(), line 137)
SCF: Error Timeout:  (propagating from src/services/capture/CaptureServiceEvent.cpp, function wait(), line 59)
Error: Camera HwEvents wait, this may indicate a hardware timeout occured,abort current/incoming cc
SCF: Error Timeout:  (propagating from src/services/capture/CaptureServiceEvent.cpp, function wait(), line 59)
Error: Camera HwEvents wait, this may indicate a hardware timeout occured,abort current/incoming cc
SCF: Error Timeout:  (propagating from src/components/amr/Snapshot.cpp, function waitForNewerSample(), line 92)
SCF_AutocontrolACSync failed to wait for an earlier frame to complete.

SCF: Error Timeout:  (propagating from src/components/ac_stages/ACSynchronizeStage.cpp, function doHandleRequest(), line 126)
SCF: Error Timeout:  (propagating from src/components/stages/OrderedStage.cpp, function doExecute(), line 137)
SCF: Error Timeout:  (propagating from src/services/capture/CaptureServiceEvent.cpp, function wait(), line 59)
Error: Camera HwEvents wait, this may indicate a hardware timeout occured,abort current/incoming cc

Br.

JerryChang · August 6, 2018, 7:16am

hello Joko_,

may I know your latest status, are you still met the issue with only 1 camera works?
also, had you confirm the regulator difference as I mentioned in comment #4.
thanks

Joko · August 7, 2018, 10:05am

Dear Jerry,

We have checked the regulator and this seams to be ok.

When we have only 1 camera then is everything ok, it worked over a day and we didn’t see a crash.
We connected 3 cameras on port A,C and E and at some point the vi_v4l2_update_isobw is updated to 281250

[ 6012.578805] misc tegra_camera_ctrl: vi_v4l2_update_isobw:Set iso bw 281250 kbyteps at 35157 KHz

then the crash happens. We think this is the main reason. Please can you check this?

From three cameras we have approx 750Mbyteps and the 281250kbyteps is to low.

Please find the dmesg_log, nvcameradaemon_log and gstreamer_log attached

thanks,
Br.

dmesg_csi_A_C_E.txt (224 KB)
gst_log_CSI_A_C_E.txt (3.15 KB)
nvdaemon_log_CSI_A_C_E.txt (18.2 KB)

Joko · August 7, 2018, 10:36am

Dear Jerry,

there is also an other error that crashes only the nvcameradaemon:

simuxFrameError_Regular : 0x000000a2
    Stream ID                [ 2: 0]: 2
        
    VPR state from fuse block    [ 3]: 0
        
    Frame end (FE)              [ 5]: 1
        A frame end has been found on a regular mode stream.
    FS_FAULT                    [ 7]: 1
        A FS packet was found for a virtual channel that was already in frame. An errored FE packet was injected before FS was allowed through.
captureErrorCallback Stream 2.0 capture 93200 failed: ts 1662424731232 frame 27673 error 2 data 0x000000a2

also i attached the “dmesg_A_C_E_FS_Error” and “nvdaemon_A_C_E_FS_Error”

thanks,
Br.
nvdaemon_A_C_E_FS_Error.txt (7.21 KB)
dmesg_A_C_E_FS_Error.txt (90.1 KB)

JerryChang · August 8, 2018, 3:23am

hello Joko_,

could you please try to access multiple cameras with the other application instead,
please check the [L4T Multimedia API Reference]-> [Multimedia API Sample Applications]-> [13_multi_camera]
thanks

Joko · August 8, 2018, 7:59pm

Dear Jerry,

we will try this.

Please can you tell me is the nvcameradaemon deprecated for multi camera or are there known issues with nvcameradaemon when having multiple cameras?

Br.

JerryChang · August 9, 2018, 8:02am

hello Joko_,

FYI,
we had also verify multiple cameras use-case with JetPack-3.2.1/TX2.
confirmed that all 6-camera works simultaneously.
thanks

Joko · August 10, 2018, 12:59pm

Dear Jerry,

we tried the [13_multi_camera] application and we also enabled the jetson_clocks.sh

I attached all the log files.

when we run one camera

./multi_camera -n 1 -c 100

It is working but it does’t show frames at around after frame 75.
If we set 10000 frames then it is working.

multi_camera_x1.log

we also tried with one camera:

gst-launch-1.0 nvarguscamerasrc ! ‘video/x-raw(memory:NVMM), width=1920, height=1080, format=NV12, framerate=60/1' ! nvoverlaysink -e

this is also working.

when we run two camera

./multi_camera -n 2 -c 100

It is sometimes working but it crashes at around frame 75. Or it crashes at the beginning.

multi_camera_x2.log

when we run three camera

./multi_camera -n 3 -c 100

It crashes at the beginning.

multi_camera_x3.log

thanks.
BR.
multi_camera_x2.log (6.22 KB)
multi_camera_x1.log (5.81 KB)
multi_camera_x3.log (41.8 KB)

Joko · August 16, 2018, 12:12pm

Dear Jerry,

do you have nay update on this?

We also changed from 28.2 to 28.2.1 (jetpack 3.3) but the errors are the same.

nvidia@tegra-ubuntu:~$ sudo su
[sudo] password for nvidia: 
root@tegra-ubuntu:/home/nvidia# systemctl stop nvcamera-daemon
root@tegra-ubuntu:/home/nvidia# export enableCamScfLog=1
root@tegra-ubuntu:/home/nvidia# export enableCamPclLog=1
root@tegra-ubuntu:/home/nvidia# /usr/sbin/nvcamera-daemon
NvPclHwGetModuleList: No module data found
NvPclHwGetModuleList: No module data found
NvPclHwGetModuleList: No module data found
OFParserGetVirtualDevice: NVIDIA Camera virtual enumerator not found in proc device-tree
LoadOverridesFile: looking for override file [/Calib/camera_override.isp] 1/16LoadOverridesFile: looking for override file [/data/nvcam/settings/camera_overrides.isp] 2/16LoadOverridesFile: looking for override file [/opt/nvidia/nvcam/settings/camera_overrides.isp] 3/16LoadOverridesFile: looking for override file [/var/nvidia/nvcam/settings/camera_overrides.isp] 4/16LoadOverridesFile: looking for override file [/data/nvcam/camera_overrides.isp] 5/16LoadOverridesFile: looking for override file [/data/nvcam/settings/h3tx2_centerleft_P5V27C.isp] 6/16LoadOverridesFile: looking for override file [/opt/nvidia/nvcam/settings/h3tx2_centerleft_P5V27C.isp] 7/16LoadOverridesFile: looking for override file [/var/nvidia/nvcam/settings/h3tx2_centerleft_P5V27C.isp] 8/16---- imager: No override file found. ----
LSC: LSC surface is not based on full res!
LoadOverridesFile: looking for override file [/Calib/camera_override.isp] 1/16LoadOverridesFile: looking for override file [/data/nvcam/settings/camera_overrides.isp] 2/16LoadOverridesFile: looking for override file [/opt/nvidia/nvcam/settings/camera_overrides.isp] 3/16LoadOverridesFile: looking for override file [/var/nvidia/nvcam/settings/camera_overrides.isp] 4/16LoadOverridesFile: looking for override file [/data/nvcam/camera_overrides.isp] 5/16LoadOverridesFile: looking for override file [/data/nvcam/settings/h3tx2_topleft_P5V27C.isp] 6/16LoadOverridesFile: looking for override file [/opt/nvidia/nvcam/settings/h3tx2_topleft_P5V27C.isp] 7/16LoadOverridesFile: looking for override file [/var/nvidia/nvcam/settings/h3tx2_topleft_P5V27C.isp] 8/16---- imager: No override file found. ----
LSC: LSC surface is not based on full res!
LoadOverridesFile: looking for override file [/Calib/camera_override.isp] 1/16LoadOverridesFile: looking for override file [/data/nvcam/settings/camera_overrides.isp] 2/16LoadOverridesFile: looking for override file [/opt/nvidia/nvcam/settings/camera_overrides.isp] 3/16LoadOverridesFile: looking for override file [/var/nvidia/nvcam/settings/camera_overrides.isp] 4/16LoadOverridesFile: looking for override file [/data/nvcam/camera_overrides.isp] 5/16LoadOverridesFile: looking for override file [/data/nvcam/settings/h3tx2_bottomleft_P5V27C.isp] 6/16LoadOverridesFile: looking for override file [/opt/nvidia/nvcam/settings/h3tx2_bottomleft_P5V27C.isp] 7/16LoadOverridesFile: looking for override file [/var/nvidia/nvcam/settings/h3tx2_bottomleft_P5V27C.isp] 8/16---- imager: No override file found. ----
LSC: LSC surface is not based on full res!
LSC: LSC surface is not based on full res!
LSC: LSC surface is not based on full res!
LSC: LSC surface is not based on full res!
SCF: Error InvalidState:  NonFatal ISO BW requested not set. Requested = 2147483647 Set = 2250000 (in src/services/power/PowerServiceCore.cpp, function setCameraBw(), line 653)
SCF: Error InvalidState:  NonFatal ISO BW requested not set. Requested = 4294967294 Set = 2250000 (in src/services/power/PowerServiceCore.cpp, function setCameraBw(), line 653)
SCF: Error InvalidState:  NonFatal ISO BW requested not set. Requested = 6442450941 Set = 2250000 (in src/services/power/PowerServiceCore.cpp, function setCameraBw(), line 653)
SCF: Error InvalidState:  NonFatal ISO BW requested not set. Requested = 2148046147 Set = 2250000 (in src/services/power/PowerServiceCore.cpp, function setCameraBw(), line 653)
NvViErrorDecode Stream 2.0 failed: ts 1662424731232 frame 27673 error 2 data 0x000000a2
NvViErrorDecode CaptureError: CsimuxFrameError (2)
NvViErrorDecode See https://wiki.nvidia.com/wmpwiki/index.php/Camera_Debugging/CaptureError_debugging for more information and links to documents.
CsimuxFrameError_Regular : 0x000000a2
    Stream ID                [ 2: 0]: 2
        
    VPR state from fuse block    [ 3]: 0
        
    Frame end (FE)              [ 5]: 1
        A frame end has been found on a regular mode stream.
    FS_FAULT                    [ 7]: 1
        A FS packet was found for a virtual channel that was already in frame. An errored FE packet was injected before FS was allowed through.
captureErrorCallback Stream 2.0 capture 93200 failed: ts 1662424731232 frame 27673 error 2 data 0x000000a2

SCF: Error Timeout:  (propagating from src/services/capture/CaptureServiceDevice.cpp, function issueCaptures(), line 1066)
SCF: Error Timeout:  (propagating from src/common/Utils.cpp, function workerThread(), line 114)
SCF: Error Timeout: Worker thread CaptureScheduler frameStart failed (in src/common/Utils.cpp, function workerThread(), line 131)
SCF: Error InvalidState: Capture Scheduler not running (in src/services/capture/CaptureServiceDevice.cpp, function addNewItemToSchedule(), line 841)
SCF: Error InvalidState:  (propagating from src/services/capture/CaptureService.cpp, function addRequest(), line 739)
SCF: Error InvalidState:  (propagating from src/components/stages/SensorCaptureStage.cpp, function doHandleRequest(), line 87)
SCF: Error InvalidState:  (propagating from src/components/stages/OrderedStage.cpp, function doExecute(), line 158)
SCF: Error InvalidState: Sending critical error event (in src/api/Session.cpp, function sendErrorEvent(), line 992)
SCF: Error InvalidState: Session has suffered a critical failure (in src/api/Session.cpp, function registerBuffer(), line 543)
SCF: Error InvalidState: Session has suffered a critical failure (in src/api/Session.cpp, function capture(), line 689)
SCF: Error InvalidState: Capture Scheduler not running (in src/services/capture/CaptureServiceDevice.cpp, function addNewItemToSchedule(), line 841)
SCF: Error InvalidState:  (propagating from src/services/capture/CaptureService.cpp, function addRequest(), line 739)
SCF: Error InvalidState:  (propagating from src/components/stages/MemoryToISPCaptureStage.cpp, function doHandleRequest(), line 129)
SCF: Error InvalidState:  (propagating from src/components/stages/OrderedStage.cpp, function doExecute(), line 158)
SCF: Error InvalidState: Sending critical error event (in src/api/Session.cpp, function sendErrorEvent(), line 992)
SCF: Error InvalidState: Session has suffered a critical failure (in src/api/Session.cpp, function registerBuffer(), line 543)
SCF: Error InvalidState: Session has suffered a critical failure (in src/api/Session.cpp, function capture(), line 689)
SCF: Error InvalidState: Capture Scheduler not running (in src/services/capture/CaptureServiceDevice.cpp, function addNewItemToSchedule(), line 841)
SCF: Error InvalidState:  (propagating from src/services/capture/CaptureService.cpp, function addRequest(), line 739)
SCF: Error InvalidState:  (propagating from src/components/stages/SensorCaptureStage.cpp, function doHandleRequest(), line 87)
SCF: Error InvalidState:  (propagating from src/components/stages/OrderedStage.cpp, function doExecute(), line 158)
Segmentation fault (core dumped)
root@tegra-ubuntu:/home/nvidia#

Thanks.
Br.

JerryChang · August 17, 2018, 2:47am

hello Joko_,

please check the [L4T Documentation]-> [NVIDIA Tegra Linux Driver Package]-> [Camera Development]
please access each of your camera sensor individually by referring to [Camera Software Development Solution] chapter.

according to your description,
it seems power/signal stability issue due to you got crash sometimes, you may also check from the hardware side to confirm this.

besides increase the system performance by jetson_clock.sh, please also have a try to set VI clock and ISP clock to maximum as below.
thanks

echo 1 > /sys/kernel/debug/bpmp/debug/clk/vi/mrq_rate_locked
echo 1 > /sys/kernel/debug/bpmp/debug/clk/isp/mrq_rate_locked
cat /sys/kernel/debug/bpmp/debug/clk/vi/max_rate
cat /sys/kernel/debug/bpmp/debug/clk/isp/max_rate
echo "max_rate" > /sys/kernel/debug/bpmp/debug/clk/vi/rate
echo "max_rate" > /sys/kernel/debug/bpmp/debug/clk/isp/rate