Driveworks Entron camera queue timeout

Autonomous Vehicles DRIVE AGX Orin DRIVE AGX Orin General
1

Please provide the following info (tick the boxes after creating this topic):
Software Version
DRIVE OS 6.0.10.0
DRIVE OS 6.0.8.1
DRIVE OS 6.0.6
DRIVE OS 6.0.5
DRIVE OS 6.0.4 (rev. 1)
DRIVE OS 6.0.4 SDK
other

Target Operating System
Linux
QNX
other

Hardware Platform
DRIVE AGX Orin Developer Kit (940-63710-0010-300)
DRIVE AGX Orin Developer Kit (940-63710-0010-200)
DRIVE AGX Orin Developer Kit (940-63710-0010-100)
DRIVE AGX Orin Developer Kit (940-63710-0010-D00)
DRIVE AGX Orin Developer Kit (940-63710-0010-C00)
DRIVE AGX Orin Developer Kit (not sure its number)
other

SDK Manager Version
2.1.0
other

Host Machine Version
native Ubuntu Linux 20.04 Host installed with SDK Manager
native Ubuntu Linux 20.04 Host installed with DRIVE OS Docker Containers
native Ubuntu Linux 18.04 Host installed with DRIVE OS Docker Containers
other

Issue Description
sample_camera fails to capture image from Entron camera, doesn’t write to mp4 file.

Error String

[22-11-2023 06:43:00] SIPLDeviceBlockNotificationHandler: Queue timeout
[22-11-2023 06:43:00] CameraClient: Notification received from pipeline index:0 of type: NOTIF_WARN_ICP_CAPTURE_TIMEOUT
[22-11-2023 06:43:00] SIPLClient: ImageQueue timeout

Logs

$ ./sample_camera --offscreen 1 --rig /home/nvidia/rig.json --write-file /home/nvidia/test.mp4
Warning: SamplesDataPath::getBasePathFor(): 'DATA_ROOT' not found in search paths [/home/nvidia/test_nvsipl/driveworks-5.8_samples/bin/data | /home/nvidia/test_nvsipl/driveworks-5.8_samples/bin.runfiles/av/data | /home/nvidia/test_nvsipl/driveworks-5.8_samples/bin/sample_camera.runfiles/av/data | /home/nvidia/test_nvsipl/driveworks-5.8_samples/bin/data | /home/nvidia/test_nvsipl/driveworks-5.8_samples/data | /home/nvidia/test_nvsipl/data | /home/nvidia/data | /home/data]
ProgramArguments: Missing argument 'dwTracePath' requested
WindowEGL: find EGL devices
WindowEGL: found 1 EGL devices
WindowEGL: init EGL with GLES3 context
WindowEGL: bind OpenGLES3 API
WindowEGL: offscreen mode -> use EGL PBuffer surface 1280x800
WindowEGL: create EGL context
WindowEGL: assign EGL context to current thread
[22-11-2023 06:42:51] Platform: Orin platform detected: model - p3663-a01-f0100-a
[22-11-2023 06:42:51] TimeSource: monotonic epoch time offset is 1700601015917473
[22-11-2023 06:42:51] TimeSourceVibranteLinux: detect valid PTP interface mgbe2_0
[22-11-2023 06:42:51] TimeSource: Could not detect valid PTP time source at nvpps. Fallback to mgbe2_0
[22-11-2023 06:42:51] TimeSource Eth: PTP ioctl returned error. Synchronized time will not be available from this timesource.
[22-11-2023 06:42:51] TimeSource: Could not detect valid PTP time source at 'mgbe2_0'. Fallback to CLOCK_MONOTONIC.
[22-11-2023 06:42:51] Adding variable DW_Base:DW_Version
[22-11-2023 06:42:51] Addded variable DW_Base:DW_Version
[22-11-2023 06:42:51] Platform: number of GPU devices detected 1
[22-11-2023 06:42:51] Platform: currently selected GPU device 0, Resource Data Dir: trt_08_04_12_05, Arch: ga10b
[22-11-2023 06:42:51] Platform: currently selected GPU device integrated ID 0
[22-11-2023 06:42:51] CUDLAEngine:getDLACountandCheck: CUDLA version is = 1002001
[22-11-2023 06:42:51] CUDLAEngine:getDLACountandCheck: Number of DLA devices = 2
[22-11-2023 06:42:51] ========== DLA Device 0 Attributes ==========
[22-11-2023 06:42:51]            UVA supported = 0
[22-11-2023 06:42:51]            Device version = 1
[22-11-2023 06:42:51]            Device 0 Check PASSED
[22-11-2023 06:42:51] ========== DLA Device 1 Attributes ==========
[22-11-2023 06:42:51]            UVA supported = 0
[22-11-2023 06:42:51]            Device version = 1
[22-11-2023 06:42:51]            Device 1 Check PASSED
[22-11-2023 06:42:51] Context::mountResourceCandidateDataPath resource FAILED to mount from './resources': VirtualFileSystem: Failed to mount './resources/resources.pak'
[22-11-2023 06:42:51] Context::mountResourceCandidateDataPath resource FAILED to mount from '/home/nvidia/test_nvsipl/driveworks-5.8_samples/bin/data': VirtualFileSystem: Failed to mount '/home/nvidia/test_nvsipl/driveworks-5.8_samples/bin/data/resources.pak'
[22-11-2023 06:42:51] Context::findDataRootInPathWalk data/DATA_ROOT found at: /usr/local/driveworks/data
[22-11-2023 06:42:51] Context::mountResourceCandidateDataPath resource FAILED to mount from '/usr/local/driveworks/data': VirtualFileSystem: Failed to mount '/usr/local/driveworks/data/resources.pak'
[22-11-2023 06:42:51] Context::findDataRootInPathWalk data/DATA_ROOT found at: /usr/local/driveworks-5.8/data
[22-11-2023 06:42:51] Context::mountResourceCandidateDataPath resource FAILED to mount from '/usr/local/driveworks-5.8/data': VirtualFileSystem: Failed to mount '/usr/local/driveworks-5.8/data/resources.pak'
[22-11-2023 06:42:51] Context::findResourcesPackageInPathWalk: Could not find ./resources/resources.pak in upto 7 parent directories from /usr/local/driveworks/lib/libdw_base.so.5.8
[22-11-2023 06:42:51] Context::findResourcesPackageInPathWalk: Could not find ./resources/resources.pak in upto 7 parent directories from /usr/local/driveworks-5.8/targets/aarch64-Linux/lib/libdw_base.so.5.8
[22-11-2023 06:42:51] SDK: No resources(.pak) mounted, some modules will not function properly
[22-11-2023 06:42:51] SDK: Create NvMediaDevice
[22-11-2023 06:42:51] SDK: use EGL display as provided
[22-11-2023 06:42:51] TimeSource: monotonic epoch time offset is 1700601015917473
[22-11-2023 06:42:51] TimeSourceVibranteLinux: detect valid PTP interface mgbe2_0
[22-11-2023 06:42:51] TimeSource: Could not detect valid PTP time source at nvpps. Fallback to mgbe2_0
[22-11-2023 06:42:51] TimeSource Eth: PTP ioctl returned error. Synchronized time will not be available from this timesource.
[22-11-2023 06:42:51] TimeSource: Could not detect valid PTP time source at 'mgbe2_0'. Fallback to CLOCK_MONOTONIC.
[22-11-2023 06:42:51] Initialize DriveWorks SDK v5.8.82
[22-11-2023 06:42:51] Release build with GNU 9.3.0 from buildbrain-branch-0-g33d6f4a1440 against Drive PDK v6.0.5.0
[22-11-2023 06:42:51] SensorFactory::createSensor() -> time.nvpps, nvpps-device=/dev/nvpps0
[22-11-2023 06:42:51] Can not create time sensor: DW_HAL_CANNOT_OPEN_CHANNEL: EndpointNVPPS: cannot open NVPPS device with name: /dev/nvpps0
 Error: No such file or directory
[22-11-2023 06:42:51] Rig::fromFile: Loading rig file: /home/nvidia/dolphin_rig/datvt_rig.json
[22-11-2023 06:42:51] rig::DatabaseOverlayer: Failed to open a file '/tmp/car_vin' - file likely does not exist - skipping overlay
[22-11-2023 06:42:51] RigConfiguration: loading dwGenericVehicle from a rig that does not contain the drive-by-wire second order dynamics. Ignoring the second-order dynamic values.
[22-11-2023 06:42:51] No valid data file found for camera:front:center:30 in parameter string: camera-name=F008A120RM0A,interface=csi-ab,link=0,output-format=processed (using configuration folder /home/nvidia/dolphin_rig/)
[22-11-2023 06:42:51] No valid data file found for radar:front:left in parameter string: TODO (using configuration folder /home/nvidia/dolphin_rig/)
[22-11-2023 06:42:51] No valid data file found for radar:front:right in parameter string: TODO (using configuration folder /home/nvidia/dolphin_rig/)
[22-11-2023 06:42:51] No valid data file found for radar:rear:center in parameter string: TODO (using configuration folder /home/nvidia/dolphin_rig/)
[22-11-2023 06:42:51] No valid data file found for lidar in parameter string: device=VELO_VLP16,ip=192.168.1.201,port=2368,scan-frequency=10 (using configuration folder /home/nvidia/dolphin_rig/)
[22-11-2023 06:42:51] No valid data file found for imu in parameter string: device=/dev/ttyACM0 (using configuration folder /home/nvidia/dolphin_rig/)
[22-11-2023 06:42:51] No valid data file found for gps in parameter string: device=/dev/ttyACM0 (using configuration folder /home/nvidia/dolphin_rig/)
[22-11-2023 06:42:51] No valid data file found for can:vehicle in parameter string: device=can0 (using configuration folder /home/nvidia/dolphin_rig/)
[22-11-2023 06:42:51] rig::DatabaseOverlayer: Failed to open a file '/tmp/car_vin' - file likely does not exist - skipping overlay
[22-11-2023 06:42:51] RigConfiguration: loading dwGenericVehicle from a rig that does not contain the drive-by-wire second order dynamics. Ignoring the second-order dynamic values.
onInitialize: creating camera.gmsl with params: camera-name=F008A120RM0A,interface=csi-ab,link=0,output-format=processed
[22-11-2023 06:42:51] SensorFactory::createSensor() -> camera.gmsl, camera-name=F008A120RM0A,interface=csi-ab,link=0,output-format=processed
[22-11-2023 06:42:51] CameraBase: pool size set to 8
[22-11-2023 06:42:51] SensorFactory::createSensor() -> camera.gmsl.master, 
[22-11-2023 06:42:51] CameraMaster::parseDevBlock Getting device info list.
[22-11-2023 06:42:51] devBlock: 0 Slave = 0 Interface = csi-ab Camera_name = F008A120RM0A Link = 0
[22-11-2023 06:42:51] Camera Match Name: F008A120RM0A Description: Entron F008A120RM0A module - 120-deg FOV, 24-bit capture, MIPI-AR0820, MAX9295 linkIndex: 4294967295 serInfo.Name: MAX9295
[22-11-2023 06:42:51] Client, Setting up information for camera ID 0
[22-11-2023 06:42:51] Client, successfully found info for camera ID 0 bound to id 0
[22-11-2023 06:42:51]  ImageStreamer(NvMedia -> CUDA) 
[22-11-2023 06:42:51]  ImageStreamer(NvMedia -> CUDA) 
[22-11-2023 06:42:51]  ImageStreamer(NvMedia -> CUDA) 
[22-11-2023 06:42:51]  ImageStreamer(NvMedia -> CUDA) 
[22-11-2023 06:42:51]  ImageStreamer(NvMedia -> CUDA) 
[22-11-2023 06:42:51]  ImageStreamer(NvMedia -> CUDA) 
[22-11-2023 06:42:51]  ImageStreamer(NvMedia -> CUDA) 
[22-11-2023 06:42:51]  ImageStreamer(NvMedia -> CUDA) 
[22-11-2023 06:42:51] CameraClient: using NITO found at /opt/nvidia/nvmedia/nit/F008A120RM0A.nito
[22-11-2023 06:42:51] SIPLMaster::SIPLMaster: Setting up master camera
[22-11-2023 06:42:51] Platform: 
[22-11-2023 06:42:51] Platform Config: 
[22-11-2023 06:42:51] Description: 
[22-11-2023 06:42:51] Number of device blocks: 1
[22-11-2023 06:42:51] Device Block : 0
[22-11-2023 06:42:51]   csiPort: 2
[22-11-2023 06:42:51]   i2cDevice: 0
[22-11-2023 06:42:51]   Deserializer Name: MAX96712
[22-11-2023 06:42:51]   Deserializer Description: Maxim 96712 Aggregator
[22-11-2023 06:42:51]   Deserializer i2cAddress: 41
[22-11-2023 06:42:51]   Simulator Mode: 0
[22-11-2023 06:42:51]   Passive Mode: 0
[22-11-2023 06:42:51]   Phy Mode: 0
[22-11-2023 06:42:51]   Number of camera modules: 1
[22-11-2023 06:42:51]   CameraModule index: 0
[22-11-2023 06:42:51]           Name :F008A120RM0A
[22-11-2023 06:42:51]           Description: Entron F008A120RM0A module - 120-deg FOV, 24-bit capture, MIPI-AR0820, MAX9295
[22-11-2023 06:42:51]           Serializer name: MAX9295
[22-11-2023 06:42:51]           Serializer description: Maxim 9295 Serializer
[22-11-2023 06:42:51]           Serializer i2cAdress: 98
[22-11-2023 06:42:51]                   EEPROM name: N24C64
[22-11-2023 06:42:51]                   EEPROM i2cAddress: 84
[22-11-2023 06:42:51]                   EEPROM description: N24C64 EEPROM
[22-11-2023 06:42:51]                   Sensor ID: 0
[22-11-2023 06:42:51]                   Sensor name: AR0820
[22-11-2023 06:42:51]                   Sensor description: OnSemi AR0820 Sensor
[22-11-2023 06:42:51]                   Sensor i2cAddress: 16
[22-11-2023 06:42:51]                   Sensor isTPGEnabled: 0
[22-11-2023 06:42:51]                   Sensor isTriggerMode: 1
[22-11-2023 06:42:51]                            cfa: 35
[22-11-2023 06:42:51]                            embeddedTopLines: 6
[22-11-2023 06:42:51]                            embeddedBottomLines: 0
[22-11-2023 06:42:51]                            inputFormat: 8
[22-11-2023 06:42:51]                            height: 2168
[22-11-2023 06:42:51]                            width: 3848
[22-11-2023 06:42:51]                            fps: 30.000000
[22-11-2023 06:42:51]                            Embedded Data: 1
[22-11-2023 06:42:51] CameraMaster available outputs: 1
[22-11-2023 06:42:51] CameraClient: setting pipeline config for camera ID 0
[22-11-2023 06:42:51] CameraMaster: master initiation
MAX96712: Revision 5 detected
MAX96712 Link 0: PHY optimization was enabled
MAX9295: Revision 8 detected!
Sensor AR0820 GRBG Rev 2.1 detected!
[22-11-2023 06:42:52] CameraMaster: Bootstrap NvSIPL and ClientPipelines complete
[22-11-2023 06:42:52] CameraClient::readEEPROMInfo:  
[22-11-2023 06:42:52]            mmIntrinsicModelID:  27
[22-11-2023 06:42:52]            mmIntrinsicCoeff[0]: -0.000000
[22-11-2023 06:42:52]            mmIntrinsicCoeff[1]: 0.000000
[22-11-2023 06:42:52]            mmIntrinsicCoeff[2]: 0.000000
[22-11-2023 06:42:52]            mmIntrinsicCoeff[3]: 0.000000
[22-11-2023 06:42:52]            mmIntrinsicCoeff[4]: 0.000000
[22-11-2023 06:42:52]            mmIntrinsicCoeff[5]: 0.000000
[22-11-2023 06:42:52]            mmIntrinsicCoeff[6]: 0.000000
[22-11-2023 06:42:52]            mmIntrinsicCoeff[7]: 0.000000
[22-11-2023 06:42:52]            mmIntrinsicCoeff[8]: 0.000000
[22-11-2023 06:42:52]            mmIntrinsicCoeff[9]: 1.892143e+11
[22-11-2023 06:42:52]            mmIntrinsicCoeff[10]: 0.000000
[22-11-2023 06:42:52]            mmIntrinsicCoeff[11]: 0.000000
[22-11-2023 06:42:52]            mmIntrinsicCoeff[12]: 0.000000
[22-11-2023 06:42:52]            mmIntrinsicCoeff[13]: 0.000000
[22-11-2023 06:42:52]            mmIntrinsicCoeff[14]: 0.000170
[22-11-2023 06:42:52]            mmIntrinsicCoeff[15]: 8.000000
[22-11-2023 06:42:52]            mmIntrinsicMeasuredFlagID: 237
[22-11-2023 06:42:52]            fwVersionMajor:  0
[22-11-2023 06:42:52]            fwVersionMinor:  0
[22-11-2023 06:42:52]            fwVersionPatch:  0
[22-11-2023 06:42:52] SAL: bootstrap complete
[22-11-2023 06:42:52] Initialize DriveWorks VisualizationSDK v5.8.82
[22-11-2023 06:42:52] Initialize DriveWorksGL SDK v5.8.82
onInitialize: Total cameras 1
onInitialize: getting image props 0
onInitialize: initilizing stream: 0
[22-11-2023 06:42:52] CameraClient: camera params: format=mp4,type=disk,file=/home/nvidia/test3.mp4
[22-11-2023 06:42:52] CameraClient: serializer bitrate not specified. Using 8000000.
[22-11-2023 06:42:52] EncoderNvMedia: Setting encode on instance 0
Main: Starting master.
[22-11-2023 06:42:52] CameraMaster: starting...
[22-11-2023 06:42:52] CameraClient: allocating image pool for ICP
[22-11-2023 06:42:52] Allocating NvSci group
[22-11-2023 06:42:52] CameraClient: allocate image pool for 0
[22-11-2023 06:42:52] Allocating NvSci ISP0 images
[22-11-2023 06:42:52] CameraClient: format not specified. Using h264 in Codec Header.
[22-11-2023 06:42:52] CameraClient: Notification received from pipeline index:0 of type: NOTIF_WARN_ICP_CAPTURE_TIMEOUT
[22-11-2023 06:42:52] SIPLClient: ImageQueue timeout
[22-11-2023 06:42:53] CameraClient: Notification received from pipeline index:0 of type: NOTIF_WARN_ICP_CAPTURE_TIMEOUT
[22-11-2023 06:42:53] SIPLDeviceBlockNotificationHandler: Queue timeout
[22-11-2023 06:42:53] CameraClient: Notification received from pipeline index:0 of type: NOTIF_WARN_ICP_CAPTURE_TIMEOUT
[22-11-2023 06:42:53] SIPLClient: ImageQueue timeout
[22-11-2023 06:42:54] CameraClient: Notification received from pipeline index:0 of type: NOTIF_WARN_ICP_CAPTURE_TIMEOUT
[22-11-2023 06:42:54] CameraClient: Notification received from pipeline index:0 of type: NOTIF_WARN_ICP_CAPTURE_TIMEOUT
[22-11-2023 06:42:54] SIPLDeviceBlockNotificationHandler: Queue timeout
[22-11-2023 06:42:54] CameraClient: Notification received from pipeline index:0 of type: NOTIF_WARN_ICP_CAPTURE_TIMEOUT
[22-11-2023 06:42:54] SIPLClient: ImageQueue timeout

Here is the relevant rig.json section

{
    "rig": {
        "sensors": [
            {
                "name": "camera:front:center:30",
                "parameter": "camera-name=F008A120RM0A,interface=csi-ab,link=0,output-format=processed",
                "properties": {
                    "Model": "ftheta",
                    "bw-poly": "0.000000000000000 5.35356812179089e-4 4.99266072928606e-10 4.27370422037554e-12 -6.68245573791717e-16",
                    "cx": "1927.764404",
                    "cy": "1096.686646",
                    "height": "2168",
                    "width": "3848"
                },                
		"protocol": "camera.gmsl",
		"nominalSensor2Rig": {
                    "roll-pitch-yaw": [
                        0.0,
                        0.0,
                        0.0
                    ],
                    "t": [
                        1.509,
                        0.0,
                        1.85
                    ]
                }
            }
        ],
        "vehicle": {
            "json-merge": "components/vehicle.json"
        },
        "vehicleio": [
            { "json-merge": "components/vehicleio.json" }
	    ]
    },
    "version": 7
}
3

Dear @ninh.phamngoc ,
Any reason for using DRIVE OS 6.0.5? We recommend to upgrade to latest release if possible.
Do you see display with sample_camera if not recorded?
Do you have issue only with mp4 format recording or raw/h264 as well?

4

Any reason for using DRIVE OS 6.0.5? We recommend to upgrade to latest release if possible.

Unfortunately, I’m using a custom Orin that could only be flashed with Drive OS 6.0.5 (for now).

Do you see display with sample_camera if not recorded?

I have some problems with HDMI display due to the custom hardware, so I can only try with saved output.

Do you have issue only with mp4 format recording or raw/h264 as well?

Edit rig file from output-format=processed to output-format=raw then try to --write-file raw:

$ ./sample_camera --offscreen 1 --rig rig.json --write-file /home/nvidia/test.raw
......same init as above........
[22-11-2023 04:56:48] SAL: bootstrap complete
[22-11-2023 04:56:48] Initialize DriveWorks VisualizationSDK v5.8.82
[22-11-2023 04:56:48] Initialize DriveWorksGL SDK v5.8.82
onInitialize: Total cameras 1
[22-11-2023 04:56:48] CameraClient: camera params: format=raw,type=disk,file=/home/nvidia/test.raw
[22-11-2023 04:56:48] EncoderRAW: Reading header information
[22-11-2023 04:56:48] EncoderRAW: encoding SIPL info
[22-11-2023 04:56:49] Streamer NVM/CPU using NvSciBuffer
Main: Starting master.
[22-11-2023 04:56:49] CameraMaster: starting...
[22-11-2023 04:56:49] CameraClient: allocating image pool for ICP
[22-11-2023 04:56:49] Allocating NvSci group
[22-11-2023 04:56:49] CameraClient: Failed to register plugin!6
[22-11-2023 04:56:49] Driveworks exception thrown: DW_NVMEDIA_ERROR: CameraClient: Failed to register plugin!

terminate called after throwing an instance of 'std::runtime_error'
  what():  [2023-11-22 04:56:49] DW Error DW_NVMEDIA_ERROR executing DW function:
 dwSensor_start(m_camera[i])
 at samples/sensors/camera/camera/main.cpp:449
Aborted (core dumped)
5

Are you not using DRIVE AGX Orin Devkit? May I know the platform?

6

It’s mostly just custom hardware (different ports, in/out interfaces) based on the Orin Devkit. I don’t know the full detail of firmware/software changes. Please give me some commands to probe about system information if you need to.

7

Dear @ninh.phamngoc,
Forum is intended to support the issues on DRIVE AGX Orin Devkit i.e p3710 and not other custom HW based on Orin. May I know the platform vendor?

8

@SivaRamaKrishnaNV I believe it’s DRIVE AGX Orin Developer Kit (940-63710-0010-200), our hardware team made some modification to the casing and modified the usb/serial ports to suit our needs. It can still run nvsipl_camera and any other driveworks sample but just not camera related, so I don’t think it’s changed too much. We did not make any modifications to the gmsl ports.

9

Dear @ninh.phamngoc,
Firstly , verify the camera with nvsipl_camera(AR0820 Using 1 Lane CPHY | NVIDIA Docs) with -f <prefix> --enableRawOutput flags. Please see Command Line Switches | NVIDIA Docs

10 
$ nvsipl_camera -c "F008A120RM0A_CPHY_x4" -m "0x0001" --showfps --disableISP0Output --disableISP1Output --disableISP2Output --enableRawOutput
MAX96712: Revision 5 detected
MAX96712 Link 0: PHY optimization was enabled
MAX9295: Revision 8 detected!
Sensor AR0820 GRBG Rev 2.1 detected!
Enter 'les' followed by sensor ID to enable LED
Enter 'lds' followed by sensor ID to disable LED
Enter 'dl' followed by sensor ID to disable the link
Enter 'el' followed by sensor ID to enable the link without module reset
Enter 'elr' followed by sensor ID to enable the link with module reset
Enter 'cm' to check the module availabilty
Enter 'q' to quit the application
-
Output
Sensor0_Out0    Frame rate (fps):               26.499

Output
Sensor0_Out0    Frame rate (fps):               29.9989

q
Output
Sensor0_Out0    Frame rate (fps):               29.9989

Sensor0         Frame drops: 0          Frame discontinuities: 0
file descriptor: 18 closed
SUCCESS
file descriptor: 28 closed
file descriptor: 27 closed
file descriptor: 25 closed
file descriptor: 24 closed

It’s working fine with nvsipl_camera.

11

Dear @ninh.phamngoc ,
Could you please check the rig file used at Unable to run recorder-qtgui on Drive AGX Orin - #34 by SivaRamaKrishnaNV for mp4 recording using recorder tool. Please make changes in rig file accordingly and test with recorder tool to confirm?

12 
/usr/local/driveworks/tools/capture$ sudo ./recorder ~/only_cam.json
[sudo] password for nvidia: 
[22-11-2023 13:35:21] Platform: Orin platform detected: model - p3663-a01-f0100-a
[22-11-2023 13:35:21] TimeSource: monotonic epoch time offset is 1700601015709510
[22-11-2023 13:35:21] TimeSourceVibranteLinux: detect valid PTP interface mgbe2_0
[22-11-2023 13:35:21] TimeSource: Could not detect valid PTP time source at nvpps. Fallback to mgbe2_0
[22-11-2023 13:35:21] TimeSource Eth: PTP ioctl returned error. Synchronized time will not be available from this timesource.
[22-11-2023 13:35:21] TimeSource: Could not detect valid PTP time source at 'mgbe2_0'. Fallback to CLOCK_MONOTONIC.
[22-11-2023 13:35:21] Platform: currently selected GPU device integrated ID 0
[22-11-2023 13:35:21] Context::mountResourceCandidateDataPath resource FAILED to mount from './resources': VirtualFileSystem: Failed to mount './resources/resources.pak'
[22-11-2023 13:35:21] Context::mountResourceCandidateDataPath resource FAILED to mount from '/usr/local/driveworks-5.8/tools/capture/data': VirtualFileSystem: Failed to mount '/usr/local/driveworks-5.8/tools/capture/data/resources.pak'
[22-11-2023 13:35:21] Context::mountResourceCandidateDataPath resource FAILED to mount from '/usr/local/driveworks-5.8/tools/capture/../../data': VirtualFileSystem: Failed to mount '/usr/local/driveworks-5.8/tools/capture/../../data/resources.pak'
[22-11-2023 13:35:21] Context::mountResourceCandidateDataPath resource FAILED to mount from '/usr/local/driveworks-5.8/data': VirtualFileSystem: Failed to mount '/usr/local/driveworks-5.8/data/resources.pak'
[22-11-2023 13:35:21] Context::findResourcesPackageInPathWalk: Could not find ./resources/resources.pak in upto 7 parent directories from /usr/local/driveworks-5.8/tools/capture/../../targets/aarch64-Linux/lib/libdw_base.so.5.8
[22-11-2023 13:35:21] Context::findResourcesPackageInPathWalk: Could not find ./resources/resources.pak in upto 7 parent directories from /usr/local/driveworks-5.8/targets/aarch64-Linux/lib/libdw_base.so.5.8
[22-11-2023 13:35:21] SDK: No resources(.pak) mounted, some modules will not function properly
[22-11-2023 13:35:21] SDK: Create NvMediaDevice
[22-11-2023 13:35:21] egl::Display: found 1 EGL devices
[22-11-2023 13:35:21] egl::Display: use drm device: drm-nvdc
[22-11-2023 13:35:21] TimeSource: monotonic epoch time offset is 1700601015709510
[22-11-2023 13:35:21] TimeSourceVibranteLinux: detect valid PTP interface mgbe2_0
[22-11-2023 13:35:21] TimeSource: Could not detect valid PTP time source at nvpps. Fallback to mgbe2_0
[22-11-2023 13:35:21] TimeSource Eth: PTP ioctl returned error. Synchronized time will not be available from this timesource.
[22-11-2023 13:35:21] TimeSource: Could not detect valid PTP time source at 'mgbe2_0'. Fallback to CLOCK_MONOTONIC.
[22-11-2023 13:35:21] Initialize DriveWorks SDK v5.8.82
[22-11-2023 13:35:21] Release build with GNU 9.3.0 from buildbrain-branch-0-g33d6f4a1440 against Drive PDK v6.0.5.0
[22-11-2023 13:35:21] Rig overlay directory does not exist: /storage/driveworks/data/vehicle_cfg
[22-11-2023 13:35:21] Platform: currently selected GPU device integrated ID 0
[22-11-2023 13:35:21] rig::DatabaseOverlayer: Failed to open a file '/tmp/car_vin' - file likely does not exist - skipping overlay
[22-11-2023 13:35:21] RigConfiguration: loading dwGenericVehicle from a rig that does not contain the drive-by-wire second order dynamics. Ignoring the second-order dynamic values.
[22-11-2023 13:35:21] No valid data file found for camera:front:center:120 in parameter string: camera-name=F008A120RM0A,interface=csi-ab,link=0,output-format=processed (using configuration folder /home/nvidia/)
[22-11-2023 13:35:21] rig::DatabaseOverlayer: Failed to open a file '/tmp/car_vin' - file likely does not exist - skipping overlay
[22-11-2023 13:35:21] RigConfiguration: loading dwGenericVehicle from a rig that does not contain the drive-by-wire second order dynamics. Ignoring the second-order dynamic values.
[22-11-2023 13:35:21] SensorFactory::createSensor() -> time.nvpps, nvpps-device=/dev/nvpps0
[22-11-2023 13:35:21] Can not create time sensor: DW_HAL_CANNOT_OPEN_CHANNEL: EndpointNVPPS: cannot open NVPPS device with name: /dev/nvpps0
 Error: No such file or directory
[22-11-2023 13:35:21] SensorFactory::createSensor() -> camera.gmsl, camera-name=F008A120RM0A,interface=csi-ab,link=0,output-format=processed
[22-11-2023 13:35:21] SensorFactory::createSensor() -> camera.gmsl.master, 
[22-11-2023 13:35:21] CameraMaster::parseDevBlock Getting device info list.
[22-11-2023 13:35:21] devBlock: 0 Slave = 0 Interface = csi-ab Camera_name = F008A120RM0A Link = 0
[22-11-2023 13:35:21] Camera Match Name: F008A120RM0A Description: Entron F008A120RM0A module - 120-deg FOV, 24-bit capture, MIPI-AR0820, MAX9295 linkIndex: 4294967295 serInfo.Name: MAX9295
[22-11-2023 13:35:21] Client, Setting up information for camera ID 0
[22-11-2023 13:35:21] Client, successfully found info for camera ID 0 bound to id 0
[22-11-2023 13:35:21] CameraClient: using NITO found at /opt/nvidia/nvmedia/nit/F008A120RM0A.nito
[22-11-2023 13:35:21] SIPLMaster::SIPLMaster: Setting up master camera
Could not create NVCCP shared memory nvccpmutex
[22-11-2023 13:35:21] CameraMaster available outputs: 1
[22-11-2023 13:35:21] CameraClient: setting pipeline config for camera ID 0
[22-11-2023 13:35:21] CameraMaster: master initiation
MAX96712: Revision 5 detected
MAX96712 Link 0: PHY optimization was enabled
MAX9295: Revision 8 detected!
Sensor AR0820 GRBG Rev 2.1 detected!
[22-11-2023 13:35:22] CameraMaster: Bootstrap NvSIPL and ClientPipelines complete
[22-11-2023 13:35:22] CameraClient::readEEPROMInfo:  
[22-11-2023 13:35:22]            mmIntrinsicModelID:  27
[22-11-2023 13:35:22]            mmIntrinsicCoeff[0]: -0.000000
[22-11-2023 13:35:22]            mmIntrinsicCoeff[1]: 0.000000
[22-11-2023 13:35:22]            mmIntrinsicCoeff[2]: 0.000000
[22-11-2023 13:35:22]            mmIntrinsicCoeff[3]: 0.000000
[22-11-2023 13:35:22]            mmIntrinsicCoeff[4]: 0.000000
[22-11-2023 13:35:22]            mmIntrinsicCoeff[5]: 0.000000
[22-11-2023 13:35:22]            mmIntrinsicCoeff[6]: 0.000000
[22-11-2023 13:35:22]            mmIntrinsicCoeff[7]: 0.000000
[22-11-2023 13:35:22]            mmIntrinsicCoeff[8]: 0.000000
[22-11-2023 13:35:22]            mmIntrinsicCoeff[9]: 1.892143e+11
[22-11-2023 13:35:22]            mmIntrinsicCoeff[10]: 0.000000
[22-11-2023 13:35:22]            mmIntrinsicCoeff[11]: 0.000000
[22-11-2023 13:35:22]            mmIntrinsicCoeff[12]: 0.000000
[22-11-2023 13:35:22]            mmIntrinsicCoeff[13]: 0.000000
[22-11-2023 13:35:22]            mmIntrinsicCoeff[14]: 0.000170
[22-11-2023 13:35:22]            mmIntrinsicCoeff[15]: 8.000000
[22-11-2023 13:35:22]            mmIntrinsicMeasuredFlagID: 237
[22-11-2023 13:35:22]            fwVersionMajor:  0
[22-11-2023 13:35:22]            fwVersionMinor:  0
[22-11-2023 13:35:22]            fwVersionPatch:  0
[22-11-2023 13:35:22] SAL: bootstrap complete
[22-11-2023 13:35:22] CameraClient: format not specified. Using h264.
[22-11-2023 13:35:22] CameraClient: serializer bitrate not specified. Using 8000000.
[22-11-2023 13:35:22] EncoderNvMedia: Setting encode on instance 0
[22-11-2023 13:35:22] EncoderNvMedia: Header Information not available for h264/h265 , Default Header Data
Rig: only_cam.json NewSink: /dev/null
[22-11-2023 13:35:22] CameraClient: allocating image pool for ICP
[22-11-2023 13:35:22] Allocating NvSci group
[22-11-2023 13:35:22] CameraClient: allocate image pool for 0
[22-11-2023 13:35:22] Allocating NvSci ISP0 images
[22-11-2023 13:35:22] CameraClient: format not specified. Using h264 in Codec Header.
[22-11-2023 13:35:22] SensorManager::start() started
Press s<Enter> to start, just <Enter> to see progress, q<Enter> to quit.
[22-11-2023 13:35:22] SIPLClient: Acquisition started
[22-11-2023 13:35:23] SIPLDeviceBlockNotificationHandler: Queue timeout
[22-11-2023 13:35:24] SIPLDeviceBlockNotificationHandler: Queue timeout
[22-11-2023 13:35:25] SIPLDeviceBlockNotificationHandler: Queue timeout
[22-11-2023 13:35:26] SIPLDeviceBlockNotificationHandler: Queue timeout
[22-11-2023 13:35:27] SIPLDeviceBlockNotificationHandler: Queue timeout

Rig: only_cam.json Sensor: camera:front:center:120 Bytes: 5800014
Rig: only_cam.json EndOfSensorsInfo
[22-11-2023 13:35:28] SIPLDeviceBlockNotificationHandler: Queue timeout
[22-11-2023 13:35:29] SIPLDeviceBlockNotificationHandler: Queue timeout

Rig: only_cam.json Sensor: camera:front:center:120 Bytes: 7304921
Rig: only_cam.json EndOfSensorsInfo
[22-11-2023 13:35:30] SIPLDeviceBlockNotificationHandler: Queue timeout
s
Rig: only_cam.json NewSink: .
Rig: only_cam.json Sensor: camera:front:center:120 Bytes: 152489
Rig: only_cam.json EndOfSensorsInfo
[22-11-2023 13:35:31] SIPLDeviceBlockNotificationHandler: Queue timeout
[22-11-2023 13:35:32] SIPLDeviceBlockNotificationHandler: Queue timeout
[22-11-2023 13:35:33] SIPLDeviceBlockNotificationHandler: Queue timeout
[22-11-2023 13:35:34] SIPLDeviceBlockNotificationHandler: Queue timeout
[22-11-2023 13:35:35] SIPLDeviceBlockNotificationHandler: Queue timeout
[22-11-2023 13:35:36] SIPLDeviceBlockNotificationHandler: Queue timeout
[22-11-2023 13:35:37] SIPLDeviceBlockNotificationHandler: Queue timeout
s[22-11-2023 13:35:38] SIPLDeviceBlockNotificationHandler: Queue timeout
 [22-11-2023 13:35:39] SIPLDeviceBlockNotificationHandler: Queue timeout
/dev/[22-11-2023 13:35:40] SIPLDeviceBlockNotificationHandler: Queue timeout
null[22-11-2023 13:35:41] SIPLDeviceBlockNotificationHandler: Queue timeout

Rig: only_cam.json NewSink: /dev/null
Rig: only_cam.json Sensor: camera:front:center:120 Bytes: 244801
Rig: only_cam.json EndOfSensorsInfo
[22-11-2023 13:35:42] SIPLDeviceBlockNotificationHandler: Queue timeout
[22-11-2023 13:35:43] SIPLDeviceBlockNotificationHandler: Queue timeout
[22-11-2023 13:35:44] SIPLDeviceBlockNotificationHandler: Queue timeout
q
[22-11-2023 13:35:44] SensorManager::stop() stopped
[22-11-2023 13:35:44]  Buffers(Processed) should be          released before calling DeInit() on sipl camera 
[22-11-2023 13:35:44] Deinit master camera
[22-11-2023 13:35:44] SIPLNotifier: Event notification queue shutdown
Closing of TACP shared memory handle failed nvccpmutex
[22-11-2023 13:35:45] SIPLDeviceBlockNotificationHandler: Queue timeout
[22-11-2023 13:35:46] SIPLDeviceBlockNotificationHandler: Queue timeout
[22-11-2023 13:35:47] CameraClient: Stopping client
[22-11-2023 13:35:47] Releasing camera master
[22-11-2023 13:35:47] SIPLDeviceBlockNotificationHandler: Queue timeout
[22-11-2023 13:35:47] Releasing Driveworks SDK Context

/usr/local/driveworks/tools/capture$ ll
total 13904
drwxr-xr-x. 4 root root     4096 Nov 22 13:35 ./
drwxr-xr-x. 9 root root     4096 Oct 21  2022 ../
-r-xr-xr-x. 1 root root     1475 Jan  1  2000 README-Virtual-CAN-File-Updater.md*
-r-xr-xr-x. 1 root root     5315 Jan  1  2000 README-chop.md*
-r-xr-xr-x. 1 root root     1802 Jan  1  2000 README-extractLRawPreview.md*
-r-xr-xr-x. 1 root root      779 Jan  1  2000 README-header-dump.md*
-r-xr-xr-x. 1 root root     2240 Jan  1  2000 README-lraw2raw.md*
-r-xr-xr-x. 1 root root     3097 Jan  1  2000 README-postrecord-checker.md*
-r-xr-xr-x. 1 root root     4818 Jan  1  2000 README-recorder-qt.md*
-r-xr-xr-x. 1 root root     7074 Jan  1  2000 README-recorder-tui.md*
-r-xr-xr-x. 1 root root     1436 Jan  1  2000 README-recorder.md*
-r-xr-xr-x. 1 root root     1835 Jan  1  2000 README-video_exporter.md*
-rw-rw-rw-. 1 root root 10204246 Nov 22 13:35 camera_front_center_120.bin
-rw-rw-rw-. 1 root root     4802 Nov 22 13:35 camera_front_center_120.bin.timestamps

Recorder works too I think.

14

There is no update from you for a period, assuming this is not an issue anymore.
Hence, we are closing this topic. If need further support, please open a new one.
Thanks

Recorder able to generate mp4 format? Is it still an issue to be supported?