/var/log/system grows very fast. Starts as soon as bootup

Autonomous Vehicles DRIVE AGX Orin DRIVE AGX Orin General
1

Please provide the following info (tick the boxes after creating this topic):
Software Version
DRIVE OS 6.0.6
DRIVE OS 6.0.5
DRIVE OS 6.0.4 (rev. 1)
DRIVE OS 6.0.4 SDK
other

Target Operating System
Linux
QNX
other

Hardware Platform
DRIVE AGX Orin Developer Kit (940-63710-0010-300)
DRIVE AGX Orin Developer Kit (940-63710-0010-200)
DRIVE AGX Orin Developer Kit (940-63710-0010-100)
DRIVE AGX Orin Developer Kit (940-63710-0010-D00)
DRIVE AGX Orin Developer Kit (940-63710-0010-C00)
DRIVE AGX Orin Developer Kit (not sure its number)
other

SDK Manager Version
1.9.2.10884
other

Host Machine Version
native Ubuntu Linux 20.04 Host installed with SDK Manager
native Ubuntu Linux 20.04 Host installed with DRIVE OS Docker Containers
native Ubuntu Linux 18.04 Host installed with DRIVE OS Docker Containers
other

/var/log/syslog keeps growing (15 GB/hr) with the following error logs as soon as Orin is booted up. It can take up the whole disk space on Orin in about 1-2 hours.

Jun 27 22:40:35 tegra-ubuntu sh[1087]: Failed to get event
Jun 27 22:40:35 tegra-ubuntu sh[1087]: NvFsiIpc_ReadFromIndex: error in reading: 256
Jun 27 22:40:35 tegra-ubuntu sh[1087]: NvFsiIpc_ReadFromIndex: error in reading: 256
Jun 27 22:40:35 tegra-ubuntu sh[1087]: Failed to get event
Jun 27 22:40:35 tegra-ubuntu sh[1087]: Nv!ERR![L:1186]error: NvSciIpcGetEventSafe: Invalid handle or parameter
Jun 27 22:40:35 tegra-ubuntu sh[1087]: !ERR![L:1186]error: NvSciIpcGetEventSafe: Invalid handle or parameter
Jun 27 22:40:35 tegra-ubuntu sh[1087]: message repeated 2 times: [ !ERR![L:1186]error: NvSciIpcGetEventSafe: Invalid handle or parameter]
Jun 27 22:40:35 tegra-ubuntu sh[1087]: !ERR![L:719]error: NvSciIpcReadSafe
4

I haven’t encountered this issue on my devkit running DRIVE OS 6.0.6. To assist you further, could you please provide more details on how to reproduce this error?

5

@VickNV this is happening right after boot up. Any specific logs that we should take or test we should do to help figure this out?

6

Please help check what’s the 1087 task. Also, please try if power cycling the devkit helps with this issue. Thanks.

7

logs from lsof, this is the task that is filling up the syslog

NvFsiCom  1072                  user cwd   unknown                                        /proc/1072/cwd (readlink: Permission denied)
NvFsiCom  1072                   -  rtd   unknown                                        /proc/1072/root (readlink: Permission denied)
NvFsiCom  1072                   -  txt   unknown                                        /proc/1072/exe (readlink: Permission denied)
NvFsiCom  1072                   - NOFD                                                  /proc/1072/fd (opendir: Permission denied)
NvFsiCom  1072 1175 NvFsiCom     -  cwd   unknown                                        /proc/1072/task/1175/cwd (readlink: Permission denied)
NvFsiCom  1072 1175 NvFsiCom     -  rtd   unknown                                        /proc/1072/task/1175/root (readlink: Permission denied)
NvFsiCom  1072 1175 NvFsiCom     -  txt   unknown                                        /proc/1072/task/1175/exe (readlink: Permission denied)
NvFsiCom  1072 1175 NvFsiCom     - NOFD                                                  /proc/1072/task/1175/fd (opendir: Permission denied)
8

Have you tried reflashing DRIVE OS 6.0.6?

9

Is this still an issue?

10

@VickNV
Thanks for the suggestion but reflashing the Dev Kit is out of scope currently for us. Is there anything else that we can try? is there a way to stop the NvFsiCom process from being executed? we are not using it anyway. Thanks.

11

Could you please provide some background information about the steps taken before encountering this issue?