Hello, Nvidia
We are now experiencing a nvargus-ademon crash issue, which causes our camera image to freeze. Please help us analyze it! Here is the background:
Hardware model: orinNX P3767
L4T version: 35.6.0
Number of cameras: 6
Camera interface: mipi-csi
Camera software solution: camera driver->nvargus-daemon->gstreamer
Description of the phenomenon:
We took the camera stream when the product was in a static state, and took 6 streams to display on the screen at the same time.
10 devices were running together. After 12 hours, 3 of them had image stuck. After obtaining the log, it was found that the nvargus-daemon of the faulty device was abnormal. The system automatically restarted nvargus-daemon,
but our gstreamer did not restart, so the image was stuck.
Since we don’t have the source code of nvargus-daemon, we can’t investigate further. Please tell me the following:
- What is the reason for the crash of nvargus-daemon?
- Is this a software problem or a hardware problem?
- How to solve this problem?
The logs when crashing is as follows:
192.168.1.230
Jan 11 11:50:10 cart-ai nvargus-daemon[1493]: Module_id 30 Severity 2 : capture reset ioctl failed: 11
Jan 11 11:50:10 cart-ai nvargus-daemon[1493]: Module_id 30 Severity 2 : (fusa) Error: IoctlFailed ioctl failed in:/capture/src/fusaViChannelLinux.cpp 221
Jan 11 11:50:10 cart-ai nvargus-daemon[1493]: CAM: serial no file already exists, skips storing againSCF: Error IoctlFailed: (propagating from src/services/capture/FusaCaptureViCsiHw.cpp, function abort(), line 717)
Jan 11 11:50:10 cart-ai nvargus-daemon[1493]: Module_id 30 Severity 2 : (fusa) Error: IoctlFailed propagating from:/capture/src/fusaViHandler.cpp 917
Jan 11 11:51:57 cart-ai systemd[1]: nvargus-daemon.service: Main process exited, code=killed, status=11/SEGV
Jan 11 11:51:57 cart-ai systemd[1]: nvargus-daemon.service: Failed with result ‘signal’.
Jan 11 11:51:57 cart-ai systemd[1]: nvargus-daemon.service: Scheduled restart job, restart counter is at 1.
Jan 11 11:51:57 cart-ai systemd[1]: Stopped Argus daemon.
Jan 11 11:51:57 cart-ai systemd[1]: Started Argus daemon.
192.168.1.173
Jan 12 02:03:07 cart-ai nvargus-daemon[25522]: CAM: serial no file already exists, skips storing againfree(): invalid pointer
Jan 12 02:03:09 cart-ai systemd[1]: nvargus-daemon.service: Main process exited, code=killed, status=6/ABRT
Jan 12 02:03:09 cart-ai systemd[1]: nvargus-daemon.service: Failed with result ‘signal’.
Jan 12 02:03:09 cart-ai systemd[1]: nvargus-daemon.service: Scheduled restart job, restart counter is at 2.
192.168.1.220
Jan 11 11:57:15 cart-ai nvargus-daemon[26800]: NvCameraIspConfigFileLoad: type = 0xf5 Config file “camera_overrides.isp” Line 426: Error: Invalid isp config attribute: “badPixelCorrection.v5[0].Or2NoiseFunction[16].Slope=0.0113056”
Jan 11 11:57:15 cart-ai nvargus-daemon[26800]: NvCameraIspConfigFileLoad: type = 0xf5 Config file “camera_overrides.isp” Line 427: Error: Invalid isp config attribute: “badPixelCorrection.v5[0].Or2NoiseFunction[17].X=1”
Jan 11 11:57:15 cart-ai nvargus-daemon[26800]: NvCameraIspConfigFileLoad: type = 0xf5 Config file “camera_overrides.isp” Line 428: Error: Invalid isp config attribute: “badPixelCorrection.v5[0].Or2NoiseFunction[17].Y=0.0619091”
Jan 11 11:57:15 cart-ai nvargus-daemon[26800]: NvCameraIspConfigFileLoad: type = 0xf5 Config file “camera_overrides.isp” Line 429: Error: Invalid isp config attribute: “badPixelCorrection.v5[0].Or2NoiseFunction[17].Slope=0.0109644”
Jan 12 02:33:54 cart-ai nvargus-daemon[26800]: CAM: serial no file already exists, skips storing again
Jan 12 02:33:56 cart-ai systemd[1]: nvargus-daemon.service: Main process exited, code=killed, status=11/SEGV
Jan 12 02:33:56 cart-ai systemd[1]: nvargus-daemon.service: Failed with result ‘signal’.
Jan 12 02:33:56 cart-ai systemd[1]: nvargus-daemon.service: Scheduled restart job, restart counter is at 2.
Jan 12 02:33:56 cart-ai systemd[1]: Stopped Argus daemon.
Jan 12 02:33:56 cart-ai systemd[1]: Started Argus daemon.
192.168.1.135
Jan 11 11:57:17 cart-ai nvargus-daemon[25991]: NvCameraIspConfigFileLoad: type = 0xf5 Config file “camera_overrides.isp” Line 426: Error: Invalid isp config attribute: “badPixelCorrection.v5[0].Or2NoiseFunction[16].Slope=0.0113056”
Jan 11 11:57:17 cart-ai nvargus-daemon[25991]: NvCameraIspConfigFileLoad: type = 0xf5 Config file “camera_overrides.isp” Line 427: Error: Invalid isp config attribute: “badPixelCorrection.v5[0].Or2NoiseFunction[17].X=1”
Jan 11 11:57:17 cart-ai nvargus-daemon[25991]: NvCameraIspConfigFileLoad: type = 0xf5 Config file “camera_overrides.isp” Line 428: Error: Invalid isp config attribute: “badPixelCorrection.v5[0].Or2NoiseFunction[17].Y=0.0619091”
Jan 11 11:57:17 cart-ai nvargus-daemon[25991]: NvCameraIspConfigFileLoad: type = 0xf5 Config file “camera_overrides.isp” Line 429: Error: Invalid isp config attribute: “badPixelCorrection.v5[0].Or2NoiseFunction[17].Slope=0.0109644”
Jan 11 12:43:45 cart-ai nvargus-daemon[25991]: CAM: serial no file already exists, skips storing again
Jan 11 12:43:46 cart-ai systemd[1]: nvargus-daemon.service: Main process exited, code=killed, status=11/SEGV
Jan 11 12:43:46 cart-ai systemd[1]: nvargus-daemon.service: Failed with result ‘signal’.
Jan 11 12:43:46 cart-ai systemd[1]: nvargus-daemon.service: Scheduled restart job, restart counter is at 2.
Jan 11 12:43:46 cart-ai systemd[1]: Stopped Argus daemon.
Jan 11 12:43:46 cart-ai systemd[1]: Started Argus daemon.