Video stream crashes in jetpack 5.1.1 xavier nx

I got an issue that when I ran my app for a while, the nvagus-daemon would get errors and from then on all the frames I got from my app Stayed the same as the moment the issue happened.

The issue I got from nvargus-daemon is shown below:

Dec 08 19:47:06 cp-copy17-0094 nvargus-daemon[3664]: Module_id 30 Severity 2 : (fusa) Error: InvalidState propagating from:/capture/src/fusaViHandler.cpp 759
Dec 08 19:47:06 cp-copy17-0094 nvargus-daemon[3664]: SCF: Error InvalidState: (propagating from src/services/capture/FusaCaptureViCsiHw.cpp, function waitCsiFrameEnd(), line 600)
Dec 08 19:47:06 cp-copy17-0094 nvargus-daemon[3664]: SCF: Error InvalidState: (propagating from src/common/Utils.cpp, function workerThread(), line 114)
Dec 08 19:47:06 cp-copy17-0094 nvargus-daemon[3664]: SCF: Error InvalidState: Worker thread ViCsiHw frameComplete failed (in src/common/Utils.cpp, function workerThread(), line 133)
Dec 08 19:47:08 cp-copy17-0094 nvargus-daemon[3664]: Module_id 30 Severity 2 : (fusa) Error: Timeout propagating from:/capture/src/fusaIspHandler.cpp 811
Dec 08 19:47:08 cp-copy17-0094 nvargus-daemon[3664]: Module_id 30 Severity 2 : (fusa) Error: Timeout propagating from:/capture/src/fusaIspHandler.cpp 778
Dec 08 19:47:08 cp-copy17-0094 nvargus-daemon[3664]: SCF: Error Timeout: FuSa Capture Status failed! (in src/services/capture/FusaCaptureIspHw.cpp, function waitIspFrameEnd(), line 365)
Dec 08 19:47:08 cp-copy17-0094 nvargus-daemon[3664]: SCF: Error InvalidState: ISP request error with status code 0 (in src/services/capture/FusaCaptureIspHw.cpp, function waitIspFrameEnd(), line 381)
Dec 08 19:47:09 cp-copy17-0094 nvargus-daemon[3664]: Module_id 30 Severity 2 : (fusa) Error: Timeout propagating from:/capture/src/fusaIspHandler.cpp 811
Dec 08 19:47:09 cp-copy17-0094 nvargus-daemon[3664]: Module_id 30 Severity 2 : (fusa) Error: Timeout propagating from:/capture/src/fusaIspHandler.cpp 778
Dec 08 19:47:09 cp-copy17-0094 nvargus-daemon[3664]: SCF: Error Timeout: FuSa Capture Status failed! (in src/services/capture/FusaCaptureIspHw.cpp, function waitIspFrameEnd(), line 365)
Dec 08 19:47:09 cp-copy17-0094 nvargus-daemon[3664]: SCF: Error InvalidState: ISP request error with status code 0 (in src/services/capture/FusaCaptureIspHw.cpp, function waitIspFrameEnd(), line 381)
Dec 08 19:47:11 cp-copy17-0094 nvargus-daemon[3664]: SCF: Error InvalidState: Timeout waiting on frame start sensor guid 0, capture sequence ID = 78379 (in src/services/capture/FusaCaptureViCsiHw.cpp, function waitCsiFrameStart(), line 514)
Dec 08 19:47:11 cp-copy17-0094 nvargus-daemon[3664]: SCF: Error InvalidState: (propagating from src/common/Utils.cpp, function workerThread(), line 114)
Dec 08 19:47:11 cp-copy17-0094 nvargus-daemon[3664]: SCF: Error InvalidState: Worker thread ViCsiHw frameStart failed (in src/common/Utils.cpp, function workerThread(), line 133)
Dec 08 19:47:11 cp-copy17-0094 nvargus-daemon[3664]: SCF: Error InvalidState: Timeout waiting on frame start sensor guid 1, capture sequence ID = 234895 (in src/services/capture/FusaCaptureViCsiHw.cpp, function waitCsiFrameStart(), line 514)
Dec 08 19:47:11 cp-copy17-0094 nvargus-daemon[3664]: SCF: Error InvalidState: (propagating from src/common/Utils.cpp, function workerThread(), line 114)
Dec 08 19:47:11 cp-copy17-0094 nvargus-daemon[3664]: SCF: Error InvalidState: Worker thread ViCsiHw frameStart failed (in src/common/Utils.cpp, function workerThread(), line 133)
Dec 08 19:47:11 cp-copy17-0094 nvargus-daemon[3664]: SCF: Error Timeout: (propagating from src/services/capture/FusaCaptureViCsiHw.cpp, function waitCsiFrameEnd(), line 600)
Dec 08 19:47:11 cp-copy17-0094 nvargus-daemon[3664]: SCF: Error Timeout: (propagating from src/common/Utils.cpp, function workerThread(), line 114)
Dec 08 19:47:11 cp-copy17-0094 nvargus-daemon[3664]: SCF: Error Timeout: Worker thread ViCsiHw frameComplete failed (in src/common/Utils.cpp, function workerThread(), line 133)
Dec 08 19:47:11 cp-copy17-0094 nvargus-daemon[3664]: Module_id 30 Severity 2 : (fusa) Error: Timeout propagating from:/capture/src/fusaViHandler.cpp 776
Dec 08 19:47:12 cp-copy17-0094 nvargus-daemon[3664]: SCF: Error Timeout: (propagating from src/services/capture/CaptureServiceDeviceViCsi.cpp, function waitCompletion(), line 368)
Dec 08 19:47:12 cp-copy17-0094 nvargus-daemon[3664]: SCF: Error Timeout: (propagating from src/services/capture/CaptureServiceDevice.cpp, function pause(), line 936)
Dec 08 19:47:12 cp-copy17-0094 nvargus-daemon[3664]: SCF: Error Timeout: During capture abort, syncpoint wait timeout waiting for current frame to finish (in src/services/capture/CaptureServiceDevice.cpp, function handleCancelSourceRequests(), line 1029)
Dec 08 19:47:12 cp-copy17-0094 nvargus-daemon[3664]: SCF: Error Timeout: NvRmSyncWait failed (in src/api/Buffer.cpp, function cpuWaitFences(), line 622)
Dec 08 19:47:12 cp-copy17-0094 nvargus-daemon[3664]: SCF: Error Timeout: (propagating from src/api/Buffer.cpp, function cpuWaitInputFences(), line 543)
Dec 08 19:47:12 cp-copy17-0094 nvargus-daemon[3664]: SCF: Error Timeout: (propagating from src/api/Buffer.cpp, function acquire(), line 680)
Dec 08 19:47:12 cp-copy17-0094 nvargus-daemon[3664]: SCF: Error Timeout: (propagating from src/api/Buffer.cpp, function ScopedBufferLock(), line 657)
Dec 08 19:47:14 cp-copy17-0094 nvargus-daemon[3664]: SCF: Error Timeout: NvRmSyncWait failed (in src/api/Buffer.cpp, function cpuWaitFences(), line 622)
Dec 08 19:47:14 cp-copy17-0094 nvargus-daemon[3664]: SCF: Error Timeout: (propagating from src/api/Buffer.cpp, function cpuWaitInputFences(), line 543)
Dec 08 19:47:14 cp-copy17-0094 nvargus-daemon[3664]: SCF: Error Timeout: (propagating from src/api/Buffer.cpp, function acquire(), line 680)
Dec 08 19:47:14 cp-copy17-0094 nvargus-daemon[3664]: SCF: Error Timeout: (propagating from src/api/Buffer.cpp, function ScopedBufferLock(), line 657)
Dec 08 19:47:15 cp-copy17-0094 nvargus-daemon[3664]: waitForIdleLocked remaining request 78352
Dec 08 19:47:15 cp-copy17-0094 nvargus-daemon[3664]: waitForIdleLocked remaining request 78351
Dec 08 19:47:15 cp-copy17-0094 nvargus-daemon[3664]: waitForIdleLocked remaining request 78353
Dec 08 19:47:15 cp-copy17-0094 nvargus-daemon[3664]: SCF: Error Timeout: waitForIdle() timed out (in src/api/Session.cpp, function waitForIdleLocked(), line 922)
Dec 08 19:47:15 cp-copy17-0094 nvargus-daemon[3664]: SCF: Error Timeout: (propagating from src/api/Session.cpp, function abortCaptures(), line 888)
Dec 08 19:47:15 cp-copy17-0094 nvargus-daemon[3664]: SCF: Error Timeout: (propagating from src/services/capture/CaptureServiceEvent.cpp, function wait(), line 59)
Dec 08 19:47:15 cp-copy17-0094 nvargus-daemon[3664]: Error: Camera HwEvents wait, this may indicate a hardware timeout occured,abort current/incoming cc
Dec 08 19:47:17 cp-copy17-0094 nvargus-daemon[3664]: SCF: Error Timeout: NvRmSyncWait failed (in src/api/Buffer.cpp, function cpuWaitFences(), line 622)
Dec 08 19:47:17 cp-copy17-0094 nvargus-daemon[3664]: SCF: Error Timeout: (propagating from src/api/Buffer.cpp, function unassignFromCapture(), line 387)
Dec 08 19:47:17 cp-copy17-0094 nvargus-daemon[3664]: SCF: Error Timeout: (propagating from src/components/CaptureContainerImpl.cpp, function releaseBuffer(), line 579)
Dec 08 19:47:17 cp-copy17-0094 nvargus-daemon[3664]: SCF: Error Timeout: (propagating from src/components/ac_stages/AfAnalysisStage.cpp, function pushStatsToAmr(), line 166)
Dec 08 19:47:17 cp-copy17-0094 nvargus-daemon[3664]: SCF: Error Timeout: (propagating from src/components/ac_stages/AfAnalysisStage.cpp, function pushResultsToAmr(), line 193)
Dec 08 19:47:17 cp-copy17-0094 nvargus-daemon[3664]: SCF: Error Timeout: (propagating from src/components/ac_stages/AfAnalysisStage.cpp, function doHandleRequest(), line 268)
Dec 08 19:47:17 cp-copy17-0094 nvargus-daemon[3664]: SCF: Error Timeout: (propagating from src/components/stages/OrderedStage.cpp, function doExecute(), line 137)
Dec 08 19:47:17 cp-copy17-0094 nvargus-daemon[3664]: SCF: Error Timeout: Sending critical error event (in src/api/Session.cpp, function sendErrorEvent(), line 992)
Dec 08 19:47:18 cp-copy17-0094 nvargus-daemon[3664]: SCF: Error Timeout: NvRmSyncWait failed (in src/api/Buffer.cpp, function cpuWaitFences(), line 622)
Dec 08 19:47:18 cp-copy17-0094 nvargus-daemon[3664]: SCF: Error Timeout: (propagating from src/api/Buffer.cpp, function unassignFromCapture(), line 387)
Dec 08 19:47:18 cp-copy17-0094 nvargus-daemon[3664]: SCF: Error Timeout: (propagating from src/components/CaptureContainerImpl.cpp, function releaseBuffer(), line 579)
Dec 08 19:47:18 cp-copy17-0094 nvargus-daemon[3664]: SCF: Error Timeout: (propagating from src/components/ac_stages/AfAnalysisStage.cpp, function pushStatsToAmr(), line 166)
Dec 08 19:47:18 cp-copy17-0094 nvargus-daemon[3664]: SCF: Error Timeout: (propagating from src/components/ac_stages/AfAnalysisStage.cpp, function pushResultsToAmr(), line 193)
Dec 08 19:47:18 cp-copy17-0094 nvargus-daemon[3664]: SCF: Error Timeout: (propagating from src/components/ac_stages/AfAnalysisStage.cpp, function doHandleRequest(), line 268)
Dec 08 19:47:18 cp-copy17-0094 nvargus-daemon[3664]: SCF: Error Timeout: (propagating from src/components/stages/OrderedStage.cpp, function doExecute(), line 137)
Dec 08 19:47:18 cp-copy17-0094 nvargus-daemon[3664]: SCF: Error Timeout: Sending critical error event (in src/api/Session.cpp, function sendErrorEvent(), line 992)
Dec 08 19:48:10 cp-copy17-0094 nvargus-daemon[3664]: SCF: Error InvalidState: 4 buffers still pending during EGLStreamProducer destruction (propagating from src/services/gl/EGLStreamProducer.cpp, function freeBuffers(), line 300)
Dec 08 19:48:10 cp-copy17-0094 nvargus-daemon[3664]: SCF: Error InvalidState: 2 buffers still pending during EGLStreamProducer destruction (propagating from src/services/gl/EGLStreamProducer.cpp, function freeBuffers(), line 300)
Dec 08 19:48:10 cp-copy17-0094 nvargus-daemon[3664]: SCF: Error InvalidState: (propagating from src/services/gl/EGLStreamProducer.cpp, function ~EGLStreamProducer(), line 49)
Dec 08 19:48:14 cp-copy17-0094 nvargus-daemon[3664]: SCF: Error Timeout: NvRmSyncWait failed (in src/api/Buffer.cpp, function cpuWaitFences(), line 622)
Dec 08 19:48:14 cp-copy17-0094 nvargus-daemon[3664]: SCF: Error Timeout: (propagating from src/api/Buffer.cpp, function cpuWaitInputFences(), line 543)
Dec 08 19:48:14 cp-copy17-0094 nvargus-daemon[3664]: SCF: Error Timeout: (propagating from src/api/Buffer.cpp, function acquire(), line 680)
Dec 08 19:48:14 cp-copy17-0094 nvargus-daemon[3664]: SCF: Error Timeout: (propagating from src/api/Buffer.cpp, function ScopedBufferLock(), line 657)
Dec 08 19:48:14 cp-copy17-0094 nvargus-daemon[3664]: SCF: Error InvalidState: (propagating from src/services/gl/EGLStreamProducer.cpp, function ~EGLStreamProducer(), line 49)
Dec 08 19:48:15 cp-copy17-0094 nvargus-daemon[3664]: waitForIdleLocked remaining request 78352
Dec 08 19:48:15 cp-copy17-0094 nvargus-daemon[3664]: waitForIdleLocked remaining request 78353
Dec 08 19:48:15 cp-copy17-0094 nvargus-daemon[3664]: SCF: Error Timeout: waitForIdle() timed out (in src/api/Session.cpp, function waitForIdleLocked(), line 922)
Dec 08 19:48:15 cp-copy17-0094 nvargus-daemon[3664]: (Argus) Error Timeout: (propagating from src/api/CaptureSessionImpl.cpp, function destroy(), line 216)
Dec 08 19:48:17 cp-copy17-0094 nvargus-daemon[3664]: SCF: Error Timeout: (propagating from src/services/capture/CaptureServiceDeviceViCsi.cpp, function waitCompletion(), line 368)
Dec 08 19:48:17 cp-copy17-0094 nvargus-daemon[3664]: SCF: Error Timeout: (propagating from src/services/capture/CaptureServiceDevice.cpp, function pause(), line 936)
Dec 08 19:48:17 cp-copy17-0094 nvargus-daemon[3664]: SCF: Error Timeout: During capture abort, syncpoint wait timeout waiting for current frame to finish (in src/services/capture/CaptureServiceDevice.cpp, function handleCancelSourceRequests(), line 1029)
Dec 08 19:48:19 cp-copy17-0094 nvargus-daemon[3664]: waitForIdleLocked remaining request 230411
Dec 08 19:48:19 cp-copy17-0094 nvargus-daemon[3664]: waitForIdleLocked remaining request 230412
Dec 08 19:48:19 cp-copy17-0094 nvargus-daemon[3664]: waitForIdleLocked remaining request 230410
Dec 08 19:48:19 cp-copy17-0094 nvargus-daemon[3664]: waitForIdleLocked remaining request 230413
Dec 08 19:48:19 cp-copy17-0094 nvargus-daemon[3664]: SCF: Error Timeout: waitForIdle() timed out (in src/api/Session.cpp, function waitForIdleLocked(), line 922)
Dec 08 19:48:19 cp-copy17-0094 nvargus-daemon[3664]: (Argus) Error Timeout: (propagating from src/api/CaptureSessionImpl.cpp, function destroy(), line 216)
Dec 08 19:48:20 cp-copy17-0094 nvargus-daemon[3664]: waitForIdleLocked remaining request 78352
Dec 08 19:48:20 cp-copy17-0094 nvargus-daemon[3664]: waitForIdleLocked remaining request 78353
Dec 08 19:48:20 cp-copy17-0094 nvargus-daemon[3664]: SCF: Error Timeout: waitForIdle() timed out (in src/api/Session.cpp, function waitForIdleLocked(), line 922)
Dec 08 19:48:20 cp-copy17-0094 nvargus-daemon[3664]: SCF: Error Timeout: (propagating from src/api/Session.cpp, function abortCaptures(), line 888)
Dec 08 19:48:20 cp-copy17-0094 nvargus-daemon[3664]: SCF: Error Timeout: (propagating from src/api/Session.cpp, function shutdown(), line 407)
Dec 08 19:48:22 cp-copy17-0094 nvargus-daemon[3664]: SCF: Error Timeout: (propagating from src/services/capture/CaptureServiceDeviceViCsi.cpp, function waitCompletion(), line 368)
Dec 08 19:48:22 cp-copy17-0094 nvargus-daemon[3664]: SCF: Error Timeout: (propagating from src/services/capture/CaptureServiceDevice.cpp, function pause(), line 936)
Dec 08 19:48:22 cp-copy17-0094 nvargus-daemon[3664]: SCF: Error Timeout: During capture abort, syncpoint wait timeout waiting for current frame to finish (in src/services/capture/CaptureServiceDevice.cpp, function handleCancelSourceRequests(), line 1029)

I have boost the clock with:

sudo su
echo 1 > /sys/kernel/debug/bpmp/debug/clk/vi/mrq_rate_locked
echo 1 > /sys/kernel/debug/bpmp/debug/clk/isp/mrq_rate_locked
echo 1 > /sys/kernel/debug/bpmp/debug/clk/nvcsi/mrq_rate_locked
echo 1 > /sys/kernel/debug/bpmp/debug/clk/emc/mrq_rate_locked
cat /sys/kernel/debug/bpmp/debug/clk/vi/max_rate |tee /sys/kernel/debug/bpmp/debug/clk/vi/rate
cat /sys/kernel/debug/bpmp/debug/clk/isp/max_rate | tee /sys/kernel/debug/bpmp/debug/clk/isp/rate
cat /sys/kernel/debug/bpmp/debug/clk/nvcsi/max_rate | tee /sys/kernel/debug/bpmp/debug/clk/nvcsi/rate
cat /sys/kernel/debug/bpmp/debug/clk/emc/max_rate | tee /sys/kernel/debug/bpmp/debug/clk/emc/rate

But it doesn’t make any difference

Anything I can do for further debugging and to get more information about this issue?

hello EmondCai,

may I know what’s the background running services? for instance, do you have CPU/GPU stressed for running camera streams?

furthermore, is this a single camera or multi-cam use-case?
according to those error logs, it looks like camera sensor did not output frames to capture engine, whereas SCF report timeout error and trying to abort the pipeline.

Thanks for your reply JerryChang!

Yeah I have to say that for most use-case both GPU and CPU stress is high and the usage shown in jtop here:

And we are using dual imx283 camera.

But one thing I need to mention, we do have an use-case which have low recource usage and single imx577 meet the same issue.

Jetpack version is 35.3.1, and we also got kernel logs like this when issue happen:

hello EmondCai,

please refer to Release Notes (r35.4.1), there’s stability update for the latest Jetpack release version.
furthermore, we’ve recently address some camera bugs for JP-5.1.2/l4t-r35.4.1
please see-also below threads to apply the bug fixes for verification.
for example,
Topic 268833, for camera firmware to update deskew algorithm, and also stability fixes,
Topic 268519, to fix memory corruption within libnvargus

Hello JerryChang

Is your advice also useful for JP-5.1.1 which I’m using

hello EmondCai,

is it possible for moving to the latest release version?
or…
you may try with below fixes.

Thanks JerryChang, seems change the firmware does help. One more thing, do you also have a solution or .so binaries for jetpack 5.0.2?

hello EmondCai,

may I have more details for doing so? it’s a bad practice to keep rolling back to previous version.

We have some Jetpack 5.0.2 on the production environment which is hard to flash to 5.1.2
Also as I know there doesn’t exist a way to upgrade 5.0.2 to 5.1.2 and keep files and data, is it?

it could be done by Updating Jetson Linux with Image-Based Over-the-Air Update.

We have created a jetpack 5.1.2 instance, but still meet the same issue.
Here is the nvargus log:

12月 19 19:58:54 ubuntu nvargus-daemon[6600]: CAM: serial no file already exists, skips storing againLSC: LSC surface is not based on full res!
12月 19 19:58:54 ubuntu nvargus-daemon[6600]: E/ libnvphs:socket: Error[2]: socket connection /var/lib/nvphs/nvphsd.ctl to PHS failed: No such file or directory
12月 19 19:58:54 ubuntu nvargus-daemon[6600]: D/ libnvphs:socket: Warning: connecting to Power Hinting Service failed. Is PHS running?
12月 19 19:58:54 ubuntu nvargus-daemon[6600]: === python[6870]: CameraProvider initialized (0xffff986ce130)=== python[6872]: CameraProvider initialized (0xffff90000c20)SCF: Error BadValue: NvPHSSendThroughputHints (in src/common/CameraPowerHint.cpp, function sendCameraPowerHint(), line 56)
12月 19 19:58:54 ubuntu nvargus-daemon[6600]: E/ libnvphs:socket: Error[2]: socket connection /var/lib/nvphs/nvphsd.ctl to PHS failed: No such file or directory
12月 19 19:58:54 ubuntu nvargus-daemon[6600]: D/ libnvphs:socket: Warning: connecting to Power Hinting Service failed. Is PHS running?
12月 19 19:58:54 ubuntu nvargus-daemon[6600]: E/ libnvphs: Error: NvPHSSendThroughputHints[usecase=camera, hint=MinCPU, value=4294967295, timeout_ms=1000]: queue_or_send() failed
12月 19 19:58:54 ubuntu nvargus-daemon[6600]: NvCameraIspConfigFileLoad: type = 0xf5 Config file “camera_overrides.isp” Line 51: Error: Invalid isp config attribute element: “ae.FlickerCorrectionRangeMultiplier=1.0”
12月 19 19:58:54 ubuntu nvargus-daemon[6600]: CAM: serial no file already exists, skips storing againLSC: LSC surface is not based on full res!
12月 19 19:58:55 ubuntu nvargus-daemon[6600]: NvCameraIspConfigFileLoad: type = 0xf5 Config file “camera_overrides.isp” Line 51: Error: Invalid isp config attribute element: “ae.FlickerCorrectionRangeMultiplier=1.0”
12月 19 19:58:55 ubuntu nvargus-daemon[6600]: CAM: serial no file already exists, skips storing againLSC: LSC surface is not based on full res!
12月 19 20:36:44 ubuntu nvargus-daemon[6600]: Module_id 30 Severity 2 : (fusa) Error: InvalidState Status syncpoint signaled but status value not updated in:/capture/src/fusaViHandler.cpp 817
12月 19 20:36:44 ubuntu nvargus-daemon[6600]: Module_id 30 Severity 2 : (fusa) Error: InvalidState propagating from:/capture/src/fusaViHandler.cpp 759
12月 19 20:36:44 ubuntu nvargus-daemon[6600]: SCF: Error InvalidState: Corr Error Received for sensor 1 … Continuing!
12月 19 20:36:44 ubuntu nvargus-daemon[6600]: (in src/services/capture/FusaCaptureViCsiHw.cpp, function waitCsiFrameEnd(), line 643)
12月 19 20:36:44 ubuntu nvargus-daemon[6600]: Module_id 30 Severity 2 : (fusa) Error: InvalidState Status syncpoint signaled but status value not updated in:/capture/src/fusaIspHandler.cpp 848
12月 19 20:36:44 ubuntu nvargus-daemon[6600]: Module_id 30 Severity 2 : (fusa) Error: InvalidState propagating from:/capture/src/fusaIspHandler.cpp 770
12月 19 20:36:44 ubuntu nvargus-daemon[6600]: SCF: Error Timeout: FuSa Capture Status failed! (in src/services/capture/FusaCaptureIspHw.cpp, function waitIspFrameEnd(), line 365)
12月 19 20:36:47 ubuntu nvargus-daemon[6600]: Module_id 30 Severity 2 : (fusa) Error: Timeout propagating from:/capture/src/fusaViHandler.cpp 776
12月 19 20:36:47 ubuntu nvargus-daemon[6600]: SCF: Error InvalidState: Sensor 1 already in same state
12月 19 20:36:47 ubuntu nvargus-daemon[6600]: (in src/services/capture/CaptureServiceDeviceSensor.cpp, function setErrorState(), line 100)
12月 19 20:36:47 ubuntu nvargus-daemon[6600]: SCF: Error InvalidState: Timeout!! Skipping requests on sensor GUID 1, capture sequence ID = 135814 draining session frameEnd events 2
12月 19 20:36:47 ubuntu nvargus-daemon[6600]: (in src/services/capture/FusaCaptureViCsiHw.cpp, function waitCsiFrameEnd(), line 635)
12月 19 20:36:47 ubuntu nvargus-daemon[6600]: SCF: Error InvalidState: Sensor 0 already in same state
12月 19 20:36:47 ubuntu nvargus-daemon[6600]: (in src/services/capture/CaptureServiceDeviceSensor.cpp, function setErrorState(), line 100)
12月 19 20:36:47 ubuntu nvargus-daemon[6600]: SCF: Error InvalidState: Timeout!! Skipping requests on sensor GUID 0, capture sequence ID = 45313 draining session frameEnd events 2
12月 19 20:36:47 ubuntu nvargus-daemon[6600]: (in src/services/capture/FusaCaptureViCsiHw.cpp, function waitCsiFrameEnd(), line 635)
12月 19 20:36:47 ubuntu nvargus-daemon[6600]: SCF: Error Timeout: Sending critical error event for Session 1
12月 19 20:36:47 ubuntu nvargus-daemon[6600]: (in src/api/Session.cpp, function sendErrorEvent(), line 1039)
12月 19 20:36:47 ubuntu nvargus-daemon[6600]: SCF: Error InvalidState: Sensor 1 already in same state
12月 19 20:36:47 ubuntu nvargus-daemon[6600]: (in src/services/capture/CaptureServiceDeviceSensor.cpp, function setErrorState(), line 100)
12月 19 20:36:47 ubuntu nvargus-daemon[6600]: SCF: Error InvalidState: Timeout!! Skipping requests on sensor GUID 1, capture sequence ID = 135815 draining session frameEnd events 2
12月 19 20:36:47 ubuntu nvargus-daemon[6600]: (in src/services/capture/FusaCaptureViCsiHw.cpp, function waitCsiFrameEnd(), line 635)
12月 19 20:36:47 ubuntu nvargus-daemon[6600]: SCF: Error InvalidState: Sensor 1 already in same state
12月 19 20:36:47 ubuntu nvargus-daemon[6600]: (in src/services/capture/CaptureServiceDeviceSensor.cpp, function setErrorState(), line 100)
12月 19 20:36:47 ubuntu nvargus-daemon[6600]: SCF: Error InvalidState: Timeout!! Skipping requests on sensor GUID 1, capture sequence ID = 135816 draining session frameEnd events 1
12月 19 20:36:47 ubuntu nvargus-daemon[6600]: (in src/services/capture/FusaCaptureViCsiHw.cpp, function waitCsiFrameEnd(), line 635)
12月 19 20:36:47 ubuntu nvargus-daemon[6600]: Module_id 30 Severity 2 : (fusa) Error: Timeout propagating from:/capture/src/fusaViHandler.cpp 776
12月 19 20:36:47 ubuntu nvargus-daemon[6600]: SCF: Error Timeout: Sending critical error event for Session 0
12月 19 20:36:47 ubuntu nvargus-daemon[6600]: (in src/api/Session.cpp, function sendErrorEvent(), line 1039)
12月 19 20:36:47 ubuntu nvargus-daemon[6600]: SCF: Error InvalidState: Sensor 0 already in same state
12月 19 20:36:47 ubuntu nvargus-daemon[6600]: (in src/services/capture/CaptureServiceDeviceSensor.cpp, function setErrorState(), line 100)
12月 19 20:36:47 ubuntu nvargus-daemon[6600]: SCF: Error InvalidState: Timeout!! Skipping requests on sensor GUID 0, capture sequence ID = 45314 draining session frameEnd events 2
12月 19 20:36:47 ubuntu nvargus-daemon[6600]: (in src/services/capture/FusaCaptureViCsiHw.cpp, function waitCsiFrameEnd(), line 635)
12月 19 20:36:47 ubuntu nvargus-daemon[6600]: SCF: Error InvalidState: Sensor 0 already in same state
12月 19 20:36:47 ubuntu nvargus-daemon[6600]: (in src/services/capture/CaptureServiceDeviceSensor.cpp, function setErrorState(), line 100)
12月 19 20:36:47 ubuntu nvargus-daemon[6600]: SCF: Error InvalidState: Timeout!! Skipping requests on sensor GUID 0, capture sequence ID = 45315 draining session frameEnd events 1
12月 19 20:36:47 ubuntu nvargus-daemon[6600]: (in src/services/capture/FusaCaptureViCsiHw.cpp, function waitCsiFrameEnd(), line 635)
12月 19 20:36:47 ubuntu nvargus-daemon[6600]: SCF: Error Timeout: Sending critical error event for Session 1
12月 19 20:36:47 ubuntu nvargus-daemon[6600]: (in src/api/Session.cpp, function sendErrorEvent(), line 1039)
12月 19 20:36:47 ubuntu nvargus-daemon[6600]: SCF: Error InvalidState: Timeout!! Skipping requests on sensor GUID 1, capture sequence ID = 135815 draining session frameStart events 2
12月 19 20:36:47 ubuntu nvargus-daemon[6600]: (in src/services/capture/FusaCaptureViCsiHw.cpp, function waitCsiFrameStart(), line 532)
12月 19 20:36:47 ubuntu nvargus-daemon[6600]: SCF: Error InvalidState: Timeout!! Skipping requests on sensor GUID 1, capture sequence ID = 135816 draining session frameStart events 1
12月 19 20:36:47 ubuntu nvargus-daemon[6600]: (in src/services/capture/FusaCaptureViCsiHw.cpp, function waitCsiFrameStart(), line 532)
12月 19 20:36:47 ubuntu nvargus-daemon[6600]: SCF: Error Timeout: Sending critical error event for Session 0
12月 19 20:36:47 ubuntu nvargus-daemon[6600]: (in src/api/Session.cpp, function sendErrorEvent(), line 1039)
12月 19 20:36:47 ubuntu nvargus-daemon[6600]: SCF: Error InvalidState: Timeout!! Skipping requests on sensor GUID 0, capture sequence ID = 45314 draining session frameStart events 2
12月 19 20:36:47 ubuntu nvargus-daemon[6600]: (in src/services/capture/FusaCaptureViCsiHw.cpp, function waitCsiFrameStart(), line 532)
12月 19 20:36:47 ubuntu nvargus-daemon[6600]: SCF: Error InvalidState: Timeout!! Skipping requests on sensor GUID 1, capture sequence ID = 135817 draining session frameStart events 1
12月 19 20:36:47 ubuntu nvargus-daemon[6600]: (in src/services/capture/FusaCaptureViCsiHw.cpp, function waitCsiFrameStart(), line 532)
12月 19 20:36:47 ubuntu nvargus-daemon[6600]: SCF: Error InvalidState: Sensor 1 already in same state
12月 19 20:36:47 ubuntu nvargus-daemon[6600]: (in src/services/capture/CaptureServiceDeviceSensor.cpp, function setErrorState(), line 100)
12月 19 20:36:47 ubuntu nvargus-daemon[6600]: SCF: Error InvalidState: Timeout!! Skipping requests on sensor GUID 1, capture sequence ID = 135817 draining session frameEnd events 1
12月 19 20:36:47 ubuntu nvargus-daemon[6600]: (in src/services/capture/FusaCaptureViCsiHw.cpp, function waitCsiFrameEnd(), line 635)
12月 19 20:36:47 ubuntu nvargus-daemon[6600]: PowerServiceCore:handleRequests: timePassed = 2629
12月 19 20:36:47 ubuntu nvargus-daemon[6600]: SCF: Error BadParameter: CC has already been disposed (in src/components/CaptureContainerManager.cpp, function dispose(), line 161)
12月 19 20:36:47 ubuntu nvargus-daemon[6600]: SCF: Error BadParameter: CC has already been disposed (in src/components/CaptureContainerManager.cpp, function dispose(), line 161)
12月 19 20:36:47 ubuntu nvargus-daemon[6600]: Module_id 30 Severity 2 : capture reset ioctl failed: 22
12月 19 20:36:47 ubuntu nvargus-daemon[6600]: SCF: Error IoctlFailed: (propagating from src/services/capture/FusaCaptureViCsiHw.cpp, function abort(), line 704)
12月 19 20:36:47 ubuntu nvargus-daemon[6600]: Module_id 30 Severity 2 : (fusa) Error: IoctlFailed ioctl failed in:/capture/src/fusaViChannelLinux.cpp 221
12月 19 20:36:47 ubuntu nvargus-daemon[6600]: Module_id 30 Severity 2 : (fusa) Error: IoctlFailed propagating from:/capture/src/fusaViHandler.cpp 922
12月 19 20:36:47 ubuntu nvargus-daemon[6600]: Module_id 30 Severity 2 : (fusa) Error: BadParameter propagating from:/capture/src/fusaCsiStreamHandler.cpp 287
12月 19 20:36:47 ubuntu nvargus-daemon[6600]: Module_id 30 Severity 2 : (fusa) Error: BadParameter propagating from:/capture/src/fusaViHandler.cpp 148
12月 19 20:36:47 ubuntu nvargus-daemon[6600]: Module_id 30 Severity 2 : (fusa) Error: BadParameter propagating from:/capture/src/fusaCsiStreamHandler.cpp 287
12月 19 20:36:47 ubuntu nvargus-daemon[6600]: Module_id 30 Severity 2 : (fusa) Error: BadParameter propagating from:/capture/src/fusaPhyStreamHandler.h 178
12月 19 20:36:47 ubuntu nvargus-daemon[6600]: Module_id 30 Severity 2 : capture reset ioctl failed: 22
12月 19 20:36:47 ubuntu nvargus-daemon[6600]: Module_id 30 Severity 2 : (fusa) Error: IoctlFailed ioctl failed in:/capture/src/fusaViChannelLinux.cpp 221
12月 19 20:36:47 ubuntu nvargus-daemon[6600]: Module_id 30 Severity 2 : (fusa) Error: IoctlFailed propagating from:/capture/src/fusaViChannelLinux.cpp 200
12月 19 20:36:47 ubuntu nvargus-daemon[6600]: Module_id 30 Severity 2 : (fusa) Error: IoctlFailed propagating from:/capture/src/fusaViHandler.cpp 155
12月 19 20:36:47 ubuntu nvargus-daemon[6600]: Module_id 30 Severity 2 : capture reset ioctl failed: 22
12月 19 20:36:47 ubuntu nvargus-daemon[6600]: Module_id 30 Severity 2 : (fusa) Error: IoctlFailed ioctl failed in:/capture/src/fusaViChannelLinux.cpp 221
12月 19 20:36:47 ubuntu nvargus-daemon[6600]: Module_id 30 Severity 2 : (fusa) Error: IoctlFailed propagating from:/capture/src/fusaViChannelLinux.cpp 200
12月 19 20:36:50 ubuntu nvargus-daemon[6600]: === python[6872]: Connection closed (FFFF9F699900)=== python[6872]: WARNING: CameraProvider was not destroyed before client connection terminated.=== python[6872]: The client may have abnormally terminated. Destroying CameraProvider…=== python[6872]: CameraProvider destroyed (0xffff90000c20)=== python[6872]: Connection cleaned up (FFFF9F699900)SCF: Error BadParameter: CC has already been disposed (in src/components/CaptureContainerManager.cpp, function dispose(), line 161)
12月 19 20:36:50 ubuntu nvargus-daemon[6600]: SCF: Error BadParameter: CC has already been disposed (in src/components/CaptureContainerManager.cpp, function dispose(), line 161)
12月 19 20:36:53 ubuntu nvargus-daemon[6600]: Module_id 30 Severity 2 : capture reset ioctl failed: 22
12月 19 20:36:53 ubuntu nvargus-daemon[6600]: Module_id 30 Severity 2 : (fusa) Error: IoctlFailed ioctl failed in:/capture/src/fusaViChannelLinux.cpp 221
12月 19 20:36:53 ubuntu nvargus-daemon[6600]: SCF: Error IoctlFailed: (propagating from src/services/capture/FusaCaptureViCsiHw.cpp, function abort(), line 704)
12月 19 20:36:53 ubuntu nvargus-daemon[6600]: Module_id 30 Severity 2 : (fusa) Error: IoctlFailed propagating from:/capture/src/fusaViHandler.cpp 922
12月 19 20:36:53 ubuntu nvargus-daemon[6600]: Module_id 30 Severity 2 : (fusa) Error: BadParameter propagating from:/capture/src/fusaCsiStreamHandler.cpp 287
12月 19 20:36:53 ubuntu nvargus-daemon[6600]: Module_id 30 Severity 2 : (fusa) Error: BadParameter propagating from:/capture/src/fusaViHandler.cpp 148
12月 19 20:36:53 ubuntu nvargus-daemon[6600]: Module_id 30 Severity 2 : (fusa) Error: BadParameter propagating from:/capture/src/fusaCsiStreamHandler.cpp 287
12月 19 20:36:53 ubuntu nvargus-daemon[6600]: Module_id 30 Severity 2 : (fusa) Error: BadParameter propagating from:/capture/src/fusaPhyStreamHandler.h 178
12月 19 20:36:53 ubuntu nvargus-daemon[6600]: Module_id 30 Severity 2 : capture reset ioctl failed: 22
12月 19 20:36:53 ubuntu nvargus-daemon[6600]: Module_id 30 Severity 2 : (fusa) Error: IoctlFailed ioctl failed in:/capture/src/fusaViChannelLinux.cpp 221
12月 19 20:36:53 ubuntu nvargus-daemon[6600]: Module_id 30 Severity 2 : (fusa) Error: IoctlFailed propagating from:/capture/src/fusaViChannelLinux.cpp 200
12月 19 20:36:53 ubuntu nvargus-daemon[6600]: Module_id 30 Severity 2 : (fusa) Error: IoctlFailed propagating from:/capture/src/fusaViHandler.cpp 155
12月 19 20:36:53 ubuntu nvargus-daemon[6600]: Module_id 30 Severity 2 : capture reset ioctl failed: 22
12月 19 20:36:53 ubuntu nvargus-daemon[6600]: Module_id 30 Severity 2 : (fusa) Error: IoctlFailed ioctl failed in:/capture/src/fusaViChannelLinux.cpp 221
12月 19 20:36:53 ubuntu nvargus-daemon[6600]: PowerServiceCore:handleRequests: timePassed = 5685
12月 19 20:36:53 ubuntu nvargus-daemon[6600]: Module_id 30 Severity 2 : (fusa) Error: IoctlFailed propagating from:/capture/src/fusaViChannelLinux.cpp 200
12月 19 20:36:58 ubuntu nvargus-daemon[6600]: === python[6870]: Connection closed (FFFF9FE9A900)=== python[6870]: WARNING: CameraProvider was not destroyed before client connection terminated.=== python[6870]: The client may have abnormally terminated. Destroying CameraProvider…=== python[6870]: CameraProvider destroyed (0xffff986ce130)SCF: Error Timeout: NvRmSyncWait failed (in src/api/Buffer.cpp, function cpuWaitFences(), line 622)
12月 19 20:36:58 ubuntu nvargus-daemon[6600]: SCF: Error Timeout: (propagating from src/api/Buffer.cpp, function cpuWaitInputFences(), line 543)
12月 19 20:36:58 ubuntu nvargus-daemon[6600]: SCF: Error Timeout: (propagating from src/api/Buffer.cpp, function acquire(), line 680)
12月 19 20:36:58 ubuntu nvargus-daemon[6600]: SCF: Error Timeout: (propagating from src/api/Buffer.cpp, function ScopedBufferLock(), line 657)
12月 19 20:37:02 ubuntu nvargus-daemon[6600]: SCF: Error Timeout: NvRmSyncWait failed (in src/api/Buffer.cpp, function cpuWaitFences(), line 622)
12月 19 20:37:02 ubuntu nvargus-daemon[6600]: SCF: Error Timeout: (propagating from src/api/Buffer.cpp, function cpuWaitInputFences(), line 543)
12月 19 20:37:02 ubuntu nvargus-daemon[6600]: SCF: Error Timeout: (propagating from src/api/Buffer.cpp, function acquire(), line 680)
12月 19 20:37:02 ubuntu nvargus-daemon[6600]: SCF: Error Timeout: (propagating from src/api/Buffer.cpp, function ScopedBufferLock(), line 657)
12月 19 20:37:07 ubuntu nvargus-daemon[6600]: SCF: Error Timeout: NvRmSyncWait failed (in src/api/Buffer.cpp, function cpuWaitFences(), line 622)
12月 19 20:37:07 ubuntu nvargus-daemon[6600]: SCF: Error Timeout: (propagating from src/api/Buffer.cpp, function cpuWaitInputFences(), line 543)
12月 19 20:37:07 ubuntu nvargus-daemon[6600]: SCF: Error Timeout: (propagating from src/api/Buffer.cpp, function acquire(), line 680)
12月 19 20:37:07 ubuntu nvargus-daemon[6600]: SCF: Error Timeout: (propagating from src/api/Buffer.cpp, function ScopedBufferLock(), line 657)
12月 19 20:37:11 ubuntu nvargus-daemon[6600]: SCF: Error Timeout: NvRmSyncWait failed (in src/api/Buffer.cpp, function cpuWaitFences(), line 622)
12月 19 20:37:11 ubuntu nvargus-daemon[6600]: SCF: Error Timeout: (propagating from src/api/Buffer.cpp, function cpuWaitInputFences(), line 543)
12月 19 20:37:11 ubuntu nvargus-daemon[6600]: SCF: Error Timeout: (propagating from src/api/Buffer.cpp, function acquire(), line 680)
12月 19 20:37:11 ubuntu nvargus-daemon[6600]: SCF: Error Timeout: (propagating from src/api/Buffer.cpp, function ScopedBufferLock(), line 657)
12月 19 20:37:16 ubuntu nvargus-daemon[6600]: SCF: Error Timeout: NvRmSyncWait failed (in src/api/Buffer.cpp, function cpuWaitFences(), line 622)
12月 19 20:37:16 ubuntu nvargus-daemon[6600]: SCF: Error Timeout: (propagating from src/api/Buffer.cpp, function cpuWaitInputFences(), line 543)
12月 19 20:37:16 ubuntu nvargus-daemon[6600]: SCF: Error Timeout: (propagating from src/api/Buffer.cpp, function acquire(), line 680)
12月 19 20:37:16 ubuntu nvargus-daemon[6600]: SCF: Error Timeout: (propagating from src/api/Buffer.cpp, function ScopedBufferLock(), line 657)
12月 19 20:37:20 ubuntu nvargus-daemon[6600]: SCF: Error Timeout: NvRmSyncWait failed (in src/api/Buffer.cpp, function cpuWaitFences(), line 622)
12月 19 20:37:20 ubuntu nvargus-daemon[6600]: SCF: Error Timeout: (propagating from src/api/Buffer.cpp, function cpuWaitInputFences(), line 543)
12月 19 20:37:20 ubuntu nvargus-daemon[6600]: SCF: Error Timeout: (propagating from src/api/Buffer.cpp, function acquire(), line 680)
12月 19 20:37:20 ubuntu nvargus-daemon[6600]: SCF: Error Timeout: (propagating from src/api/Buffer.cpp, function ScopedBufferLock(), line 657)
12月 19 20:37:20 ubuntu nvargus-daemon[6600]: Module_id 30 Severity 2 : isp capture release ioctl failed: 22
12月 19 20:37:20 ubuntu nvargus-daemon[6600]: Module_id 30 Severity 2 : (fusa) Error: IoctlFailed ioctl failed. in:/capture/src/fusaIspChannelLinux.cpp 216
12月 19 20:37:20 ubuntu nvargus-daemon[6600]: Module_id 30 Severity 2 : (fusa) Error: IoctlFailed propagating from:/capture/src/fusaIspHandler.cpp 130
12月 19 20:37:20 ubuntu nvargus-daemon[6600]: Module_id 30 Severity 2 : (fusa) Error: IoctlFailed Failure during close in:/capture/src/fusaIspHandler.cpp 29

We also try to follow Topic 268833 to update fw but got value -8 and “Failed to flash/read t186ref” issue

I’m using xavier NX 8G, when flashing with:
sudo ./flash.sh -r -k rce-fw jetson-xavier-nx-devkit nvme0n1p1
The flash stack here:

if flash with sudo ./flash.sh -r -k rce-fw jetson-xavier nvme0n1p1 I get the “Return value 8”, anything I did wrong?

Hey Jerry

Any idea on why the flash of img failed?

hello EmondCai,

according to JetPack 5.1.2 release note, which has include some camera update as below.
• Enhanced error resiliency for improved stability in Argus
• Deskew calibration support for high data rate sensors (data-rate > 1.5 Gbps)
…etc

may I double confirm what did you meant… “a JP-5.1.2 instance”?
for instance, you may share steps to demonstrate how you install this image to Xavier NX.

BTW,
since it’s now moving to JP-5.1.2, it’s suggest to have new topic thread for following-up.

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.