Encounter ERROR: nvsipl_camera: ERROR: Pipeline: 0, NOTIF_ERROR_ISP_PROCESSING_FAILURE when run the SIPL on Orin

Robotics & Edge Computing Jetson Systems Jetson AGX Orin
1

IMX728 (3840x2160, raw10, 4 lanes DPHY) → MAX96717 (GMSL2 serializer) → MAX96712 (deserializer)

My log:

nv@nv:~$ sudo nvsipl_camera -c R0SIM728S3RU2120NB2 -t transport_settings_orin.json -m “0x0001” -s -v 4 -H
Platform configuration name: R0SIM728S3RU2120NB2
Platform configuration file: transport_settings_orin.json
Verbosity level: 4
Raw output: disabled
ISP0 output: enabled
ISP1 output: enabled
ISP2 output: enabled
Enabled FPS logging
Disabled Metadata logging
Disabled automatic recovery
Disabled profiling
Disabled ISP Statistics settings override
Subframe : enabled
Disabled Passive mode
Camera HAL path: enabled
Disabled retrieving/displaying NITO Metadata
nvsipl_camera: Setting up signal handler
libnvsipl_query.so: CNvMCameraQuery.cpp : 1414: ParseJsonFile: CNvMCameraQuery::ParseJsonFile reading file transport_settings_orin.json
libnvsipl_query.so: CNvMCameraQuery.cpp : 453: ParseCameraConfigs: ParseCameraConfigs: Processing module: R0SIM728S3RU2120NB2
libnvsipl_query.so: CNvMCameraConfigInfo.cpp : 79: ParseJson: Parsing camera config: name=R0SIM728S3RU2120NB2 type=GMSL
libnvsipl_query.so: CNvMCameraConfigInfo.cpp : 197: ParseJson: R0SIM728S3RU2120NB2: mipiSettings parsed: phyMode=0 dphyRate=1500000 cphyRate=0 lanes=4
libnvsipl_query.so: CNvMCameraConfigInfo.cpp : 694: ParseGMSLConfig: No linkIndex specified, defaulting to 0
libnvsipl_query.so: CNvMCameraConfigInfo.cpp : 712: ParseGMSLConfig: Parsed linkMode: LINK_MODE_GMSL2_6GBPS
libnvsipl_query.so: CNvMCameraConfigInfo.cpp : 725: ParseGMSLConfig: Parsed fsyncMode: osc_manual
libnvsipl_query.so: CNvMCameraConfigInfo.cpp : 742: ParseGMSLConfig: R0SIM728S3RU2120NB2: serializer name=MAX96717
libnvsipl_query.so: CNvMSerInfo.cpp : 71: ParseJson: Parsed MAX96717
libnvsipl_query.so: CNvMCameraConfigInfo.cpp : 814: ParseGMSLConfig: Parsing 1 GMSL sensors from ‘sensorInfo’ array
libnvsipl_query.so: CNvMCameraConfigInfo.cpp : 833: ParseGMSLConfig: Parsed GMSL sensor[0]: R0SIM728S3RU2120NB2 with 1 virtual channels
libnvsipl_query.so: CNvMCameraConfigInfo.cpp : 842: ParseGMSLConfig: Parsed GMSL module with 1 sensors
libnvsipl_query.so: CNvMCameraConfigInfo.cpp : 855: ParseGMSLConfig: R0SIM728S3RU2120NB2: GMSL config complete: phyMode=0 dphyRate=1500000 cphyRate=0 mipiClockRate=1500000
libnvsipl_query.so: CNvMCameraQuery.cpp : 1498: ParseJsonFile: Parsing unified platformTransportSettings format
libnvsipl_query.so: CNvMCameraQuery.cpp : 967: ParsePlatformTransportSettings: ParsePlatformTransportSettings: Parsing 1 platform entries
libnvsipl_query.so: CNvMCameraQuery.cpp : 1006: ParsePlatformTransportSettings: ParsePlatformTransportSettings: Platform ‘jetson-orin’ using driver suffix ‘NativeGpio’
libnvsipl_query.so: CNvMCameraQuery.cpp : 670: ParseTransportSettings: Parsing deserializer info for ‘Max96712GmslDeserializer’ in GMSL transport ‘transportSettings_jetson-orin_A’
libnvsipl_query.so: CNvMDeserInfo.cpp : 111: ParseJson: Parsed Max96712GmslDeserializer
libnvsipl_query.so: CNvMCameraQuery.cpp : 1020: ParsePlatformTransportSettings: ParsePlatformTransportSettings: Platform ‘jetson-orin’ has 1 transports, 1 enable masks
libnvsipl_query.so: CNvMCameraQuery.cpp : 1032: ParsePlatformTransportSettings: ParsePlatformTransportSettings: Total platforms parsed: 1
libnvsipl_query.so: CNvMCameraQuery.cpp : 876: GetPlatformIndex: Platform detected: ‘jetson-orin’ (board prefix ‘NVIDIA Jetson AGX Orin’)
libnvsipl_query.so: CNvMCameraQuery.cpp : 1509: ParseJsonFile: Selected platform: jetson-orin (index=0)
libnvsipl_query.so: CNvMCameraQuery.cpp : 1554: ParseJsonFile: ParseJsonFile: Associated 1 transports with 1 GMSL camera configs
libnvsipl_query.so: CNvMCameraQuery.cpp : 1558: ParseJsonFile: ParseJsonFile: Complete - cameras=1, transports=1
libnvsipl_query.so: CNvMCameraQuery.cpp : 1609: GetSensorSystemConfig: GetCameraSystemConfig: Looking up ‘R0SIM728S3RU2120NB2’
libnvsipl_query.so: CNvMCameraQuery.cpp : 1631: GetSensorSystemConfig: GetCameraSystemConfig: R0SIM728S3RU2120NB2 mipiSettings: phyMode=0 dphyRate=1500000 cphyRate=0 mipiClockRate=1500000
libnvsipl_query.so: CNvMCameraQuery.cpp : 1794: GetSensorSystemConfig: GetCameraSystemConfig: Using module-specific transports for ‘R0SIM728S3RU2120NB2’ (1 transports)
libnvsipl_query.so: CNvMCameraQuery.cpp : 1811: GetSensorSystemConfig: Processing transport: transportSettings_jetson-orin_A, transportIndex=0, csiPort=2
libnvsipl_query.so: CNvMCameraQuery.cpp : 1828: GetSensorSystemConfig: Sensor: id=0, deviceIndex=0
libnvsipl_query.so: CNvMCameraQuery.cpp : 1844: GetSensorSystemConfig: Created module instance: linkIndex=0, csiPort=2
libnvsipl_query.so: CNvMCameraQuery.cpp : 1828: GetSensorSystemConfig: Sensor: id=1, deviceIndex=0
libnvsipl_query.so: CNvMCameraQuery.cpp : 1844: GetSensorSystemConfig: Created module instance: linkIndex=1, csiPort=2
libnvsipl_query.so: CNvMCameraQuery.cpp : 1828: GetSensorSystemConfig: Sensor: id=2, deviceIndex=0
libnvsipl_query.so: CNvMCameraQuery.cpp : 1844: GetSensorSystemConfig: Created module instance: linkIndex=2, csiPort=2
libnvsipl_query.so: CNvMCameraQuery.cpp : 1828: GetSensorSystemConfig: Sensor: id=3, deviceIndex=0
libnvsipl_query.so: CNvMCameraQuery.cpp : 1844: GetSensorSystemConfig: Created module instance: linkIndex=3, csiPort=2
libnvsipl_query.so: CNvMCameraQuery.cpp : 1855: GetSensorSystemConfig: Built sensor system config: 4 modules, 1 transports
nvsipl_camera: Setting link masks
libnvsipl_query.so: CNvMCameraQuery.cpp : 1866: ApplyMask: ApplyMask: Starting with 4 modules, 1 transports
libnvsipl_query.so: CNvMCameraQuery.cpp : 1881: ApplyMask: ApplyMask: Using user-provided masks (1 masks)
libnvsipl_query.so: CNvMCameraQuery.cpp : 1899: ApplyMask: Transport[0]: csiPort=2
libnvsipl_query.so: CNvMCameraQuery.cpp : 1940: ApplyMask: Mask check: module=R0SIM728S3RU2120NB2, linkIndex=0, transportIdx=0, linkMask=0x1, enabled=1
libnvsipl_query.so: CNvMCameraQuery.cpp : 1945: ApplyMask: Enabled module: R0SIM728S3RU2120NB2, csiPort=2, transportIdx=0, linkIndex=0
libnvsipl_query.so: CNvMCameraQuery.cpp : 1940: ApplyMask: Mask check: module=R0SIM728S3RU2120NB2, linkIndex=1, transportIdx=0, linkMask=0x1, enabled=0
libnvsipl_query.so: CNvMCameraQuery.cpp : 1940: ApplyMask: Mask check: module=R0SIM728S3RU2120NB2, linkIndex=2, transportIdx=0, linkMask=0x1, enabled=0
libnvsipl_query.so: CNvMCameraQuery.cpp : 1940: ApplyMask: Mask check: module=R0SIM728S3RU2120NB2, linkIndex=3, transportIdx=0, linkMask=0x1, enabled=0
libnvsipl_query.so: CNvMCameraQuery.cpp : 2003: ApplyMask: ApplyMask: Filtered to 1 modules based on mask
nvsipl_camera: Creating camera master
nvsipl_camera: Setting up master
Main: /dvs/git/dirty/git-master_linux/camera/fusa/sipl/src/core/pipelineMgr/CNvMCamera.cpp: 159: GetInstance: Entering
Main: /dvs/git/dirty/git-master_linux/camera/fusa/sipl/src/core/pipelineMgr/CNvMCamera.cpp: 174: GetInstance: Exiting
nvsipl_camera: Creating consumers
/home/nv/usr/src/jetson_sipl_api/sipl/uddf/drivers/deserializers/MAX967XX/MAX967XX.cpp, ConfigureDriver(), ConfigureDriver called
/home/nv/usr/src/jetson_sipl_api/sipl/uddf/drivers/deserializers/MAX967XX/MAX967XX.cpp, SetMipiOutputMode(), MIPI output mode set to 2x4 (4-lane)
Main: /dvs/git/dirty/git-master_linux/camera/fusa/sipl/src/core/pipelineMgr/CNvMCamera.cpp: 1083: SetPipelineCfg: Entering for pipeline[0][0]
Main: /dvs/git/dirty/git-master_linux/camera/fusa/sipl/src/core/pipelineMgr/CNvMCamera.cpp: 1300: SetPipelineCfg: Exiting for pipeline[0][0]
nvsipl_camera: Creating consumer for output:1 of sensor:0
nvsipl_camera: Profiler initialization for output:1 of sensor:0
nvsipl_camera: Consumer initialization for output:1 of sensor:0
nvsipl_camera: Creating consumer for output:2 of sensor:0
nvsipl_camera: Profiler initialization for output:2 of sensor:0
nvsipl_camera: Consumer initialization for output:2 of sensor:0
nvsipl_camera: Creating consumer for output:3 of sensor:0
nvsipl_camera: Profiler initialization for output:3 of sensor:0
nvsipl_camera: Consumer initialization for output:3 of sensor:0
Main: /dvs/git/dirty/git-master_linux/camera/fusa/sipl/src/core/pipelineMgr/CNvMCamera.cpp: 1831: GetImageAttributes: Entering for pipeline[0][0] and output type: 0
Main: /dvs/git/dirty/git-master_linux/camera/fusa/sipl/src/core/pipelineMgr/CNvMCamera.cpp: 1890: GetImageAttributes: Exiting for pipeline: 0 and output type: 0
Main: /dvs/git/dirty/git-master_linux/camera/fusa/sipl/src/core/pipelineMgr/CNvMCamera.cpp: 1831: GetImageAttributes: Entering for pipeline[0][0] and output type: 3441973505
Main: /dvs/git/dirty/git-master_linux/camera/fusa/sipl/src/core/pipelineMgr/CNvMCamera.cpp: 1890: GetImageAttributes: Exiting for pipeline: 0 and output type: 1
Pipeline: 0 ISP Output: 0 is using YUV 420 SEMI-PLANAR UINT8 BL REC_709ER
Main: /dvs/git/dirty/git-master_linux/camera/fusa/sipl/src/core/pipelineMgr/CNvMCamera.cpp: 1831: GetImageAttributes: Entering for pipeline[0][0] and output type: 2905249282
Main: /dvs/git/dirty/git-master_linux/camera/fusa/sipl/src/core/pipelineMgr/CNvMCamera.cpp: 1890: GetImageAttributes: Exiting for pipeline: 0 and output type: 2
Pipeline: 0 ISP Output: 1 is using YUV 420 SEMI-PLANAR UINT8 BL REC_709ER
Main: /dvs/git/dirty/git-master_linux/camera/fusa/sipl/src/core/pipelineMgr/CNvMCamera.cpp: 1831: GetImageAttributes: Entering for pipeline[0][0] and output type: 2905249283
Main: /dvs/git/dirty/git-master_linux/camera/fusa/sipl/src/core/pipelineMgr/CNvMCamera.cpp: 1890: GetImageAttributes: Exiting for pipeline: 0 and output type: 3
Pipeline: 0 ISP Output: 2 is using RGBA PACKED FLOAT16 PL SENSOR_RGBA
Main: /dvs/git/dirty/git-master_linux/camera/fusa/sipl/src/core/pipelineMgr/CNvMCamera.cpp: 4646: FillNvSciSyncAttrList: Entering for pipeline[0][0] output type: 3441975041, and client type: 0
Main: /dvs/git/dirty/git-master_linux/camera/fusa/sipl/src/core/pipelineMgr/CNvMCamera.cpp: 4708: FillNvSciSyncAttrList: Exiting for pipeline[0][0], output type: 3441975041, and client type: 0

nvsipl_camera: Initializing master interface
Main: /dvs/git/dirty/git-master_linux/camera/fusa/sipl/src/core/pipelineMgr/CNvMCamera.cpp: 1712: Init: Entering
/home/nv/usr/src/jetson_sipl_api/sipl/uddf/drivers/deserializers/MAX967XX/MAX967XX.cpp, ProbeHardware(), ProbeHardware called
/home/nv/usr/src/jetson_sipl_api/sipl/uddf/drivers/deserializers/MAX967XX/MAX967XX.cpp, Init(), Init called
/home/nv/usr/src/jetson_sipl_api/sipl/uddf/drivers/deserializers/MAX967XX/MAX967XX.cpp, SetDefault(), SetDefault called
/home/nv/usr/src/jetson_sipl_api/sipl/uddf/drivers/deserializers/MAX967XX/MAX967XX.cpp, SetI2cPort(), Configuring deserializer I2C port: 0 (SoC I2C bus: 9)
/home/nv/usr/src/jetson_sipl_api/sipl/uddf/drivers/deserializers/MAX967XX/MAX967XX.cpp, prepareMipiPhyConfig(), Setting DPHY: rate=1500000 kHz, mipiSpeed=15 (0x0F)
/home/nv/usr/src/jetson_sipl_api/sipl/uddf/drivers/deserializers/MAX967XX/MAX967XX.cpp, ControlLink(), ControlLink called
/home/nv/usr/src/jetson_sipl_api/sipl/uddf/drivers/serializers/MAX96717/MAX96717.cpp, SerInit(), SerInit called
/home/nv/usr/src/jetson_sipl_api/sipl/uddf/drivers/serializers/MAX96717/MAX96717.cpp, SerInit(), Setting translator: physical=0x1a, virtual=0x08
/home/nv/usr/src/jetson_sipl_api/sipl/uddf/drivers/serializers/MAX96717/MAX96717.cpp, SerInit(), Setting translator: physical=0x54, virtual=0x09
/home/nv/usr/src/jetson_sipl_api/sipl/uddf/drivers/deserializers/MAX967XX/MAX967XX.cpp, InitWithSerializer(), InitWithSerializer called
/home/nv/usr/src/jetson_sipl_api/sipl/uddf/drivers/deserializers/MAX967XX/MAX967XX.cpp, CheckLinkLock(), CheckLinkLock called
/home/nv/usr/src/jetson_sipl_api/sipl/uddf/drivers/deserializers/MAX967XX/MAX967XX.cpp, InitWithSerializer(), Enable raw10 double pixel mode
/home/nv/usr/src/jetson_sipl_api/sipl/uddf/drivers/deserializers/MAX967XX/MAX967XX.cpp, ConfigureVideoPipelineMappingForLink(), Setting video pipeline mapping for link 0: txPort PHY=1, isEmbDataType=0, pipelineMapping=0x15, outputController=0x10
/home/nv/usr/src/jetson_sipl_api/sipl/uddf/drivers/serializers/MAX96717/MAX96717.cpp, SerPrepareForModuleInit(), SerPrepareForModuleInit called
/home/nv/usr/src/jetson_sipl_api/sipl/uddf/drivers/sensors/IMX728/IMX728.cpp, ProbeHardware(), ProbeHardware called
/home/nv/usr/src/jetson_sipl_api/sipl/uddf/drivers/sensors/IMX728/IMX728.cpp, ProbeHardware(), CFA is RGGB
/home/nv/usr/src/jetson_sipl_api/sipl/uddf/drivers/sensors/IMX728/IMX728.cpp, ProbeHardware(), Revision ID: 0x33
/home/nv/usr/src/jetson_sipl_api/sipl/uddf/drivers/sensors/IMX728/IMX728.cpp, ProbeHardware(), Detected IMX728 revision: 7
/home/nv/usr/src/jetson_sipl_api/sipl/uddf/drivers/sensors/IMX728/IMX728.cpp, Init(), Init called
nvsipl_camera: Queue timeout
/home/nv/usr/src/jetson_sipl_api/sipl/uddf/drivers/sensors/IMX728/IMX728.cpp, GetSensorAttributes(), GetSensorAttributes called
/home/nv/usr/src/jetson_sipl_api/sipl/uddf/drivers/deserializers/MAX967XX/MAX967XX.cpp, FinalizeInitWithSerializer(), FinalizeInitWithSerializer called
/home/nv/usr/src/jetson_sipl_api/sipl/uddf/drivers/serializers/MAX96717/MAX96717.cpp, SerFinalizeInit(), SerFinalizeInit called
Main: /dvs/git/dirty/git-master_linux/camera/fusa/sipl/src/core/pipelineMgr/CNvMCamera.cpp: 1743: Init: Exiting
Main: /dvs/git/dirty/git-master_linux/camera/fusa/sipl/src/core/pipelineMgr/CNvMCamera.cpp: 4497: RegisterImages: Entering for pipeline[0][0] and output type: 2906830848
Main: /dvs/git/dirty/git-master_linux/camera/fusa/sipl/src/core/pipelineMgr/CNvMCamera.cpp: 4545: RegisterImages: Exiting for pipeline: 0 and output type: 0
Main: /dvs/git/dirty/git-master_linux/camera/fusa/sipl/src/core/pipelineMgr/CNvMCamera.cpp: 4497: RegisterImages: Entering for pipeline[0][0] and output type: 2906830849
Main: /dvs/git/dirty/git-master_linux/camera/fusa/sipl/src/core/pipelineMgr/CNvMCamera.cpp: 4545: RegisterImages: Exiting for pipeline: 0 and output type: 1
Main: /dvs/git/dirty/git-master_linux/camera/fusa/sipl/src/core/pipelineMgr/CNvMCamera.cpp: 4497: RegisterImages: Entering for pipeline[0][0] and output type: 2906830850
Main: /dvs/git/dirty/git-master_linux/camera/fusa/sipl/src/core/pipelineMgr/CNvMCamera.cpp: 4545: RegisterImages: Exiting for pipeline: 0 and output type: 2
Main: /dvs/git/dirty/git-master_linux/camera/fusa/sipl/src/core/pipelineMgr/CNvMCamera.cpp: 4497: RegisterImages: Entering for pipeline[0][0] and output type: 2906830851
Main: /dvs/git/dirty/git-master_linux/camera/fusa/sipl/src/core/pipelineMgr/CNvMCamera.cpp: 4545: RegisterImages: Exiting for pipeline: 0 and output type: 3
Main: /dvs/git/dirty/git-master_linux/camera/fusa/sipl/src/core/pipelineMgr/CNvMCamera.cpp: 4824: RegisterNvSciSyncObj: Entering for pipeline[0][0] output type: 2906797313, and sync object type: 1
Main: /dvs/git/dirty/git-master_linux/camera/fusa/sipl/src/core/pipelineMgr/CNvMCamera.cpp: 4870: RegisterNvSciSyncObj: Exiting for pipeline[0][0], output type: 2906797313, and sync object type: 1
nvsipl_camera: Opened NITO file for module “R0SIM728S3RU2120NB2”, file name: “/var/nvidia/nvcam/settings/sipl/R0SIM728S3RU2120NB2.nito”
nvsipl_camera: data from NITO file loaded for module “R0SIM728S3RU2120NB2”
Main: /dvs/git/dirty/git-master_linux/camera/fusa/sipl/src/core/pipelineMgr/CNvMCamera.cpp: 1514: RegisterAutoControlPlugin: Entering for pipeline[0][0] of type: 0
/home/nv/usr/src/jetson_sipl_api/sipl/uddf/drivers/sensors/IMX728/IMX728.cpp, SetSensorControls(), SetSensorControls called
/home/nv/usr/src/jetson_sipl_api/sipl/uddf/drivers/sensors/IMX728/IMX728.cpp, SetExposure(), SetExposure called
/home/nv/usr/src/jetson_sipl_api/sipl/uddf/drivers/sensors/IMX728/IMX728.cpp, GetdBGain(), GetdBGain called
/home/nv/usr/src/jetson_sipl_api/sipl/uddf/drivers/sensors/IMX728/IMX728.cpp, GetdBGain(), GetdBGain called
/home/nv/usr/src/jetson_sipl_api/sipl/uddf/drivers/sensors/IMX728/IMX728.cpp, SetWBGain(), SetWBGain called
/home/nv/usr/src/jetson_sipl_api/sipl/uddf/drivers/sensors/IMX728/IMX728.cpp, WriteHoldValueToRegister(), WriteHoldValueToRegister called
Main: /dvs/git/dirty/git-master_linux/camera/fusa/sipl/src/core/pipelineMgr/CNvMCamera.cpp: 1569: RegisterAutoControlPlugin: Exiting for pipeline[0][0] of type: 0

nvsipl_camera: Starting master

Main: /dvs/git/dirty/git-master_linux/camera/fusa/sipl/src/core/pipelineMgr/CNvMCamera.cpp: 4989: Start: Entering
nvsipl_camera: Pipeline: 0, NOTIF_INFO_CDI_PROCESSING_DONE
/home/nv/usr/src/jetson_sipl_api/sipl/uddf/drivers/deserializers/MAX967XX/MAX967XX.cpp, StartStreaming(), StartStreaming called
/home/nv/usr/src/jetson_sipl_api/sipl/uddf/drivers/deserializers/MAX967XX/MAX967XX.cpp, CheckLinkLock(), CheckLinkLock called
/home/nv/usr/src/jetson_sipl_api/sipl/uddf/drivers/sensors/IMX728/IMX728.cpp, StartStreaming(), StartStreaming called
Main: /dvs/git/dirty/git-master_linux/camera/fusa/sipl/src/core/pipelineMgr/CNvMCamera.cpp: 5014: Start: Exiting
Enter ‘q’ to quit the application

nvsipl_camera: ERROR: Pipeline: 0, NOTIF_ERROR_ISP_PROCESSING_FAILURE
nvsipl_camera: Queue timeout
nvsipl_camera: Queue timeout
Output
Sensor0_Out1 Frame rate (fps): 0
Sensor0_Out2 Frame rate (fps): 0
Sensor0_Out3 Frame rate (fps): 0

Sensor 0 Frame captured: 0 Frame drops: 0 Frame discontinuities: 0 Frames authenticated: 0 Frames failed to authenticate: 0 Frames authenticated as Out Of Order: 0
nvsipl_camera: [TEARDOWN_PROBE] phase_begin: 0 ms
nvsipl_camera: Stopping master
Main: /dvs/git/dirty/git-master_linux/camera/fusa/sipl/src/core/pipelineMgr/CNvMCamera.cpp: 5066: Stop: Entering
/home/nv/usr/src/jetson_sipl_api/sipl/uddf/drivers/sensors/IMX728/IMX728.cpp, StopStreaming(), StopStreaming called
/home/nv/usr/src/jetson_sipl_api/sipl/uddf/drivers/deserializers/MAX967XX/MAX967XX.cpp, StopStreaming(), StopStreaming called
Main: /dvs/git/dirty/git-master_linux/camera/fusa/sipl/src/core/pipelineMgr/CNvMCamera.cpp: 5077: Stop: Exiting
nvsipl_camera: [TEARDOWN_PROBE] upMaster->Stop: 52 ms
nvsipl_camera: [TEARDOWN_PROBE] devblkNotify->Stop: 0 ms
nvsipl_camera: [TEARDOWN_PROBE] pipelineNotify->Stop: 0 ms
nvsipl_camera: [TEARDOWN_PROBE] frameCompletionQueue->Stop: 0 ms
nvsipl_camera: [TEARDOWN_PROBE] readers->Deinit: 0 ms
nvsipl_camera: [TEARDOWN_PROBE] composite->Deinit: 0 ms
nvsipl_camera: [TEARDOWN_PROBE] devblkNotify->Deinit: 0 ms
nvsipl_camera: Deinitializing pipeline notificationHandler: 0
nvsipl_camera: Queue timeout
nvsipl_camera: [TEARDOWN_PROBE] pipelineNotify->Deinit: 986 ms
nvsipl_camera: Deinitializing frameCompletionQueueHandler: 0
nvsipl_camera: Queue timeout
nvsipl_camera: Queue timeout
nvsipl_camera: [TEARDOWN_PROBE] frameCompletionQueue->Deinit: 1730 ms
nvsipl_camera: [TEARDOWN_PROBE] eglRenderers->delete: 0 ms
nvsipl_camera: Deinitializing consumer Sensor0_Out1
nvsipl_camera: Deinitializing consumer Sensor0_Out2
nvsipl_camera: Deinitializing consumer Sensor0_Out3
nvsipl_camera: [TEARDOWN_PROBE] consumers->Deinit: 0 ms
nvsipl_camera: Deinitializing profiler Sensor0_Out1
nvsipl_camera: Deinitializing profiler Sensor0_Out2
nvsipl_camera: Deinitializing profiler Sensor0_Out3
nvsipl_camera: [TEARDOWN_PROBE] profilers->Deinit: 0 ms
nvsipl_camera: [TEARDOWN_PROBE] frameFeeder->Deinit: 0 ms
nvsipl_camera: Deinitializing master
Main: /dvs/git/dirty/git-master_linux/camera/fusa/sipl/src/core/pipelineMgr/CNvMCamera.cpp: 5177: Deinit: Entering
/home/nv/usr/src/jetson_sipl_api/sipl/uddf/drivers/deserializers/MAX967XX/MAX967XX.cpp, Deinit(), Deinit called
Main: /dvs/git/dirty/git-master_linux/camera/fusa/sipl/src/core/pipelineMgr/CNvMCamera.cpp: 5206: Deinit: Exiting
nvsipl_camera: [TEARDOWN_PROBE] upMaster->Deinit: 90 ms
nvsipl_camera: ERROR: Pipeline failure

And here is the kernel log:

[ 7097.454654] tegra194-vi5 13e00000.host1x:vi0@15c00000: [PIPELINE 0] VI capture setup complete (channel_id=0, csi_stream=0, vc=0)
[ 7097.457638] tegra194-isp5 14800000.isp: [PIPELINE 0] ISP capture setup complete (channel_id=1)
[ 7097.542512] [RCE] VM0 deactivatingVM0 activating===== NVCSI Stream Configuration =====
[ 7097.542542] [RCE] stream_id: PP 0, csi_port: PORT A
[ 7097.542547] [RCE] Brick: PHY 0, Mode: D-PHY
[ 7097.542551] [RCE] Partition: CIL A, LP bypass: Enabled, Lanes: 4
[ 7097.542555] [RCE] Clock information:
[ 7097.542559] [RCE] CIL rate: 408000000 Hz
[ 7097.542563] [RCE] MIPI clock rate: 750000 kHz
[ 7097.542567] [RCE] Physical rate: 1500000 Kbps
[ 7097.542571] [RCE] T_HS settle: autoconfigured, T_CLK settle: autoconfigured

[ 7097.542576] [RCE] NVCSI prod write phy: 0 cil: 0 reg=0x00011c18 mask=0x06070000 value=0x04020000 (was 0x04020100)
[ 7097.542581] [RCE] NVCSI prod write phy: 0 cil: 0 reg=0x00011c84 mask=0x00000fff value=0x00000555 (was 0x00000777)
[ 7097.542585] [RCE] NVCSI prod write phy: 0 cil: 0 reg=0x00011c00 mask=0x00000001 value=0x00000000 (was 0x00000001)
[ 7097.542590] [RCE] NVCSI prod write phy: 0 cil: 0 reg=0x00011c88 mask=0x0000003c value=0x00000000 (was 0x00000555)
[ 7097.542594] [RCE] NVCSI prod write phy: 0 cil: 0 reg=0x00011ce4 mask=0x000000ff value=0x00000027 (was 0x00007411)
[ 7097.542598] [RCE] NVCSI prod write phy: 0 cil: 0 reg=0x00011c84 mask=0x00000fff value=0x00000666 (was 0x00000555)
[ 7097.542603] [RCE] CSI port AB IDAC calibration result with freqband=0:
[ 7097.542607] [RCE] Trio A0 rxab=21 rxbc=24 rxca=15
[ 7097.542611] [RCE] Trio A1 rxab=19 rxbc=19 rxca=19
[ 7097.542615] [RCE] CSI port AB IDAC calibration result with freqband=0:
[ 7097.542619] [RCE] Trio B0 rxab=23 rxbc=18 rxca=16
[ 7097.542631] [RCE] Trio B1 rxab=20 rxbc=16 rxca=16
[ 7097.542635] [RCE] CSI port AB
[ 7097.542639] [RCE] AFE_HFGAIN_IO0_A=6
[ 7097.542643] [RCE] AFE_HFGAIN_IO1_A=6
[ 7097.542646] [RCE] AFE_HFGAIN_CLK_A=6
[ 7097.542650] [RCE] AFE_HFGAIN_IO0_B=6
[ 7097.542654] [RCE] AFE_HFGAIN_IO1_B=6
[ 7097.542657] [RCE] AFE_HFGAIN_CLK_B=6
[ 7097.542661] [RCE] VI ch[35] frame configuration: 3840x2160
[ 7097.542665] [RCE] left skip pixels=0 top skip lines=0
[ 7097.542669] [RCE] right crop pixels=0 bottom crop lines=0
[ 7097.542673] [RCE] pixel format=VI_PIXFMT_FORMAT_T_R16 fmt=196
[ 7099.558479] [RCE] NVCSI prod write phy: 0 cil: 0 reg=0x00011c18 mask=0x06070000 value=0x04020000 (was 0x04020000)
[ 7099.558509] [RCE] NVCSI prod write phy: 0 cil: 0 reg=0x00011c84 mask=0x00000fff value=0x00000555 (was 0x00000666)
[ 7099.558516] [RCE] NVCSI prod write phy: 0 cil: 0 reg=0x00011c00 mask=0x00000001 value=0x00000000 (was 0x00000000)
[ 7099.558522] [RCE] NVCSI prod write phy: 0 cil: 0 reg=0x00011c88 mask=0x0000003c value=0x00000000 (was 0x00000541)
[ 7099.558560] [RCE] NVCSI prod write phy: 0 cil: 0 reg=0x00011ce4 mask=0x000000ff value=0x00000027 (was 0x00007427)
[ 7099.558565] [RCE] NVCSI prod write phy: 0 cil: 0 reg=0x00011c84 mask=0x00000fff value=0x00000666 (was 0x00000555)

Any help is appreciated.

3

Init and GMSL lock succeeded; ISP never saw a good frame. Split RAW vs ISP, then align format / resolution / emb / DPHY rate / serdes / NITO with the real IMX728 mode. The name R0SIM728S3RU2120NB2 plus that NITO implies RAW12 3840×2160, not RAW10 1.5G.

What the log already shows

Stage Result
HAL JSON / -H Parse OK, mask 0x0001, CSI programmed
MAX96712 / MAX96717 / IMX728 probe OK (IMX728 rev 7, RGGB)
NITO Loaded /var/nvidia/nvcam/settings/sipl/R0SIM728S3RU2120NB2.nito
Start NOTIF_INFO_CDI_PROCESSING_DONE, StartStreaming
Frames 0 fps, 0 captured, queue timeouts
RCE VI/ISP setup, CSI-A D-PHY 4-lane @ 1.5 Gbps, VI 3840×2160 T_R16, no SOF/FE, no corr_err

RCE never reports a completed frame. About 2 s later CSI is reprogrammed (typical of stream teardown). ISP is failing on an empty/invalid capture path.

In this tree the stock HAL module is not RAW10 @ 1.5G:

smart_imx728s_camera.jsonLines 7-32

“serInfo”: { “name”: “MAX96717F”, … },

“mipiSettings”: { “dphyRate”: 1300000, “phyMode”: “dphy” },

“inputFormat”: “raw12”,

“width”: 3840, “height”: 2160,

“embeddedTopLines”: 1, “embeddedBottomLines”: 20,

Your setup: RAW10, MAX96717, dphyRate 1500000, fsyncMode: osc_manual.
Loading the NITO for that module name. That NITO is built for RAW12 + 1/20 emb lines. Feeding RAW10 (or a different active window) into it is a common ISP_PROCESSING_FAILURE.

Deser log Enable raw10 double pixel mode matches RAW10 GMSL packing. If the sensor is actually RAW12, that packing is wrong.

Suggested isolation (do this first)

  1. RAW-only (no ISP):

    sudo nvsipl_camera -c R0SIM728S3RU2120NB2 -t transport_settings_orin.json \

    -m ‘0x0001’ -r -s -v 4 -H

    • RAW fps > 0 → VI/CSI OK; fix NITO / inputFormat / emb lines / width×height.
    • RAW still 0 → GMSL/CSI/sensor stream, not ISP.

  2. dmesg while streaming for corr_err, uncorr_err, CHANSEL, timed out, short frame. The posted klog has none of those, which usually means no FS/FE at all.

  3. Confirm JSON vs silicon:

    • inputFormat: raw10 vs raw12 / raw12rj
    • width/height vs IMX728 active + crop (stock sensor DB is often 3868×2176, not 3840×2160)
    • embeddedTopLines / embeddedBottomLines must match the sensor mode
    • dphyRate vs MAX96712 CSI output (stock 1.3G vs their 1.5G)
    • serializer MAX96717 vs MAX96717F
    • fsyncMode: stock is external; osc_manual with no FSYNC can yield a sensor that inits but never sends frames

  4. If RAW works: use a NITO built for this bit depth and geometry, or retune. Do not reuse R0SIM728S3RU2120NB2.nito for RAW10.

4

Hi Shane

Thank you for your reply, I can capture raw images now.

According to your reply, I have some questions want to confirm with you:

My format setting is raw10, if I want to get video streaming with ISP, I need to have a new ISP file to replace the R0SIM728S3RU2120NB2, and the sensor name in module codes should be correspond to this ISP name?

We can not get images with ISP working as the Jetson Linux driver?

Looking forward to your reply.

Jory

5

The NITO is built for RAW12 + 1/20 emb lines.

You need new NITO for RAW10 for your case.

7

Hi Shane

One more question: I can capture the image when set to 1/20 emb lines, but when embeddedTopLines and embeddedBottomLines are set to 0, the capture was failed even the EMB lines are disabled in the pyHSL, is the emb lines also should be set in NITO or shoud I change any other settings to set emb lines to 0?

8

Current release don’t support emb lines set to 0.

Thanks

9

Thank you.

Is it that both embeddedTopLines and embeddedBottomLines cannot be set to 0, or is it enough that at least one of them is non-zero?

11

hello jory,

FYI, we’re not support zero embedded metadata (especially embeddedTopLines) lines at the moment.