New custom camera bring-up - v4l2-ctl working but gstreamer fail

We’re busy on a new project with a custom camera connected to TX2 DevKit with L4T R32.2.2.

Characteristics of the Camera:

  • 400x400 resultion, 30fps
  • 10 bit Raw Bayer output
  • MIPI-CSI2 1 Lane @ 125Mbps

The driver has been written based on an existing one.

  1. When using v4l2-ctl, everything is running as expected, excepted for the data format
v4l2-ctl -d /dev/video0 --set-fmt-video=width=400,height=400,pixelformat=RG10 --set-ctrl bypass_mode=0 --stream-mmap --stream-count=1 --stream-to=image.raw --verbose

The output is generated and we get a 320Kbytes file with 16bits per pixel.

First question: the format of each pixels seems to be the one described in “Parker TRM” Figure 198 page 2794 (2X 0 on MSBs and duplicated bits on 4 LSBs) instead of having only 6X zero on the MBs as described in other posts on this forum. Could someone confirm how the raw data is output from v4l2-ctl ?

  1. When using gstreamer with v4l2src it always fail. But we stopped using this configuration since we saw on the forums that gstreamer doesn’t support natively RAW10 so it won’t work. There is a post on this link https://developer.ridgerun.com/wiki/index.php?title=Compile_gstreamer_on_Jetson_TX1_and_TX2#Steps_to_patch_gstreamer_to_support_RAW10 which explain how to patch gstreamer but it seems to be only a temporary solution for us since we need nvarguscamerasrc if we want the ISP to de-bayer our images. Is it correct?

  2. When using gstreamer with nvarguscamerasource it fails.

The command is

gst-launch-1.0 -v nvarguscamerasrc num-buffers=200 ! 'video/x-raw(memory:NVMM),width=400, height=400, framerate=30/1, format=NV12' ! omxh264enc ! qtmux ! filesink location=test.mp4 -e

When the commande is started, we can see that our driver is started as expected and the MIPI stream start also (such as for v4l2-ctl). But immediatly after the MIPI stream starts we get errors in the gstreamer logs. See the log below.

Can anyone help us on these errors “SCF: Error InvalidSize” ?

Remark: we can’t see any error in dmesg when executing this command. Only normal messages from our driver telling it’s powered on, started, stopped, powered off.

=== NVIDIA Libargus Camera Service (0.97.3)=== Listening for connections...=== gst-launch-1.0[7978]: 
Connection established (7F970621D0)Thread 1 getting next capture
Thread 2 getting next capture
Thread 3 getting next capture
Thread 4 getting next capture
Thread 5 getting next captureThread 2 is waiting
Thread 1 is waiting

Thread 5 is waiting
Thread 4 is waiting
Thread 3 is waiting
Thread 6 getting next capture
Thread 6 is waiting
Thread 8 getting next capture
Thread 8 is waiting
Thread 7 getting next capture
Thread 7 is waiting
Thread 9 getting next capture
Thread 9 is waiting
Thread 10 getting next capture
Thread 10 is waiting
Thread 12 getting next captureThread 11 getting next capture
Thread 11 is waiting

Thread 12 is waiting
Starting services...
Worker thread IspHw statsComplete start
Worker thread IspHw frameComplete start
Worker thread CaptureScheduler checkFramePending start
Worker thread CaptureScheduler frameStart start
Worker thread V4L2CaptureScheduler checkCaptureComplete start
Worker thread V4L2CaptureScheduler issueCaptures start
Worker thread PS handleRequests start
getInstance: s_instance(0x7f9067f730)
getInstance: s_instance(0x7f9067f730)
subscribe: SensorType(gyroscope)
subscribe: create SensorType(gyroscope) sensor(0x7f90681d30)
subscribe: SensorType(accelerometer)
subscribe: create SensorType(accelerometer) sensor(0x7f90687290)
AC plugin not present: dlopen "acplugin.so", acplugin.so: cannot open shared object file: No such file or directory
Services are started
NvPclSetHotplugCallback: ++++++++++++++++++++++
---- Imager: Calibration blob file handling supported in this build ----
NvPclHwGetModuleList: OFParserListModules Succeeded
OFParserListModules: module list: /proc/device-tree/tegra-camera-platform/modules/module0
NvPclHwGetModuleList: WARNING: Could not map module to ISP config string
NvPclHwGetModuleList: No module data found
NvPclHwPrintModuleDefinition -- Name: e0000_rear_OV6946
NvPclHwPrintModuleDefinition -- Position: 0
NvPclHwPrintModuleDefinition -- CalibrationData Found: 1
NvPclHwPrintCameraSubModule -- HwCamSubModule[0].Name: v4l2_sensor
NvPclHwPrintCameraSubModule -- HwCamSubModule[0].DevName: lys_cam 2-0036
NvPclHwGetModuleList: OFParserListModules Succeeded
NvPclModuleListInitialize: NvPclModule list[0]: e0000_rear_OV6946 position0
NvPclHwScanExternalCameras -- adding video0 to discover list
NvPclHwScanExternalCameras -- adding video0 to discover list
NvPclHwScanExternalCameras -- adding video0 to discover list
getHotplugMonitor: Getting hotplug monitor instance
 initializeHotplug++
 hotPlugfunc ++
 addWatch: Watch added wd='1'
CheckProcDTExists: INFO: accessing /proc/device-tree/tegra-virtual-camera-platform/modules/module0/drivernode1; No such file or directory
OFParserGetVirtualDevice: virtual device driver node not found in proc device-tree: /proc/device-tree/tegra-virtual-camera-platform/modules/module0/drivernode1
CheckProcDTExists: INFO: accessing /proc/device-tree/tegra-virtual-camera-platform/modules/module1/drivernode0; No such file or directory
OFParserGetVirtualDevice: virtual device driver node not found in proc device-tree: /proc/device-tree/tegra-virtual-camera-platform/modules/module1/drivernode0
setHotplugCallback: Registered new callback client
NvPclSetHotplugCallback: ----------------------
 hotPlugfunc: reading from inotify FD, Thread waiting
NvPclOpen: ++++++++++++++++++++++
NvPclStateControllerOpen: Found GUID 0 match at index[0]
NvPclHwInitializeModule: allocate overrides pathname @ 0x7f905c6940
NvPclHwInitializeModule: allocate overrides pathname @ 0x7f90614400
NvPclHwInitializeModule: allocate overrides pathname @ 0x7f9034af00
NvPclHwInitializeModule: allocate overrides pathname @ 0x7f905cff20
NvPclHwInitializeModule: allocate overrides pathname @ 0x7f906d1650
NvPclHwInitializeModule: allocate overrides pathname @ 0x7f906d2c90
LoadOverridesFile: looking for override file [/Calib/camera_override.isp] 1/16
CheckOverridesPermissions: stat(/Calib/camera_override.isp) call failed
LoadOverridesFile: looking for override file [/data/vendor/nvcam/settings/camera_overrides.isp] 2/16
CheckOverridesPermissions: stat(/data/vendor/nvcam/settings/camera_overrides.isp) call failed
LoadOverridesFile: looking for override file [/opt/nvidia/nvcam/settings/camera_overrides.isp] 3/16
CheckOverridesPermissions: stat(/opt/nvidia/nvcam/settings/camera_overrides.isp) call failed
LoadOverridesFile: looking for override file [/var/nvidia/nvcam/settings/camera_overrides.isp] 4/16
CheckOverridesPermissions: stat(/var/nvidia/nvcam/settings/camera_overrides.isp) call failed
LoadOverridesFile: looking for override file [/data/vendor/nvcam/camera_overrides.isp] 5/16
CheckOverridesPermissions: stat(/data/vendor/nvcam/camera_overrides.isp) call failed
LoadOverridesFile: looking for override file [/data/vendor/nvcam/settings/e0000_rear_OV6946.isp] 6/16
CheckOverridesPermissions: stat(/data/vendor/nvcam/settings/e0000_rear_OV6946.isp) call failed
LoadOverridesFile: looking for override file [/opt/nvidia/nvcam/settings/e0000_rear_OV6946.isp] 7/16
CheckOverridesPermissions: stat(/opt/nvidia/nvcam/settings/e0000_rear_OV6946.isp) call failed
LoadOverridesFile: looking for override file [/var/nvidia/nvcam/settings/e0000_rear_OV6946.isp] 8/16
CheckOverridesPermissions: stat(/var/nvidia/nvcam/settings/e0000_rear_OV6946.isp) call failed
---- imager: No override file found. ----
Imager: looking for override file [/mnt/factory/camera/factory.bin] 1/16
Imager: looking for override file [/Calib/factory.bin] 2/16
Imager: looking for override file [/Calib/calibration.bin] 3/16
Imager: looking for override file [(null)] 4/16
Imager: looking for override file [(null)] 5/16
Imager: looking for override file [(null)] 6/16
Imager: looking for override file [(null)] 7/16
Imager: looking for override file [(null)] 8/16
Imager: looking for override file [(null)] 9/16
Imager: looking for override file [(null)] 10/16
Imager: looking for override file [(null)] 11/16
Imager: looking for override file [(null)] 12/16
Imager: looking for override file [(null)] 13/16
Imager: looking for override file [(null)] 14/16
Imager: looking for override file [(null)] 15/16
Imager: looking for override file [(null)] 16/16
Imager: looking for override file [/data/vendor/nvcam/settings/factory.bin] 1/16
Imager: looking for override file [/data/vendor/nvcam/settings/e0000_rear_OV6946.bin] 2/16
Imager: looking for override file [/opt/nvidia/nvcam/settings/e0000_rear_OV6946.bin] 3/16
Imager: looking for override file [/var/nvidia/nvcam/settings/e0000_rear_OV6946.bin] 4/16
Imager: looking for override file [(null)] 5/16
Imager: looking for override file [(null)] 6/16
Imager: looking for override file [(null)] 7/16
Imager: looking for override file [(null)] 8/16
Imager: looking for override file [(null)] 9/16
Imager: looking for override file [(null)] 10/16
Imager: looking for override file [(null)] 11/16
Imager: looking for override file [(null)] 12/16
Imager: looking for override file [(null)] 13/16
Imager: looking for override file [(null)] 14/16
Imager: looking for override file [(null)] 15/16
Imager: looking for override file [(null)] 16/16
NvPclCreateDriver: Found NvPcl Driver Hal dev_name match (v4l2_sensor)
NvPclCreateDriver: Found a Driver name match (v4l2_sensor)
NvPclConnectDrivers: hImager was NULL, creating new imager
NvPclInitializeDrivers: v4l2_sensor ++++++++++++++++++
OFDPropertyGetString: could not read property [devnode-bus]
OFDPropertyGetString: could not read property [use_decibel_gain]
OFDPropertyGetString: could not read property [use_sensor_mode_id]
OFDPropertyGetString: could not read property [delayed_gain]
OFDPropertyCopyToLong: could not read property [has-eeprom]
OFDPropertyGetString: could not read property [type]
loadSubType: Sensor type missing in DT, 206
OFDPropertyCopyToLong: could not read property [set_mode_delay_ms]
OFDPropertyCopyToLong: could not read property [mode0.vc_id]
OFDPropertyCopyToLongLong: could not read property [mode0.serdes_pix_clk_hz]
OFDPropertyCopyToLongLong: could not read property [mode0.exp_time_1h]
OFDPropertyCopyToFloat: could not read property [mode0.gain_step_pitch]
OFDPropertyCopyToLong: could not read property [mode0.embedded_metadata_width]
OFDPropertyGetString: could not read property [mode0.x_start]
OFDPropertyGetString: could not read property [mode0.y_start]
OFDPropertyGetString: could not read property [mode0.x_end]
OFDPropertyGetString: could not read property [mode0.y_end]
OFDPropertyGetString: could not read property [mode0.h_scaling]
OFDPropertyGetString: could not read property [mode0.v_scaling]
OFDPropertyGetString: could not read property [sensor_model]
initialize: Loaded Driver: 1 Modes Available--------------
NvPclInitializeDrivers: v4l2_sensor ------------------
NvPclOpen: ----------------------
LSC: LSC surface is not based on full res!
=== gst-launch-1.0[7978]: CameraProvider initialized (0x7f906d0610)sourceRegistry[0] assigned

ispRegistry[0] assigned

Using Source GUID 0
Worker thread ViCsiHw frameComplete start
Worker thread ViCsiHw frameStart start
NvPclPowerOn: +++++++++++
NvPclPowerOn: -----------
Using ISP A
NvPHSSendThroughputHints: sensorId=0, m_usecase=4, m_type=2, m_value=4294967295, m_timeout_ms=1000

LSC: LSC surface is not based on full res!
AC plugin not present: dlopen "acplugin.so", acplugin.so: cannot open shared object file: No such file or directory
No library found, disabling AC plugin.
Worker thread CaptureDispatcher start
Session::updatePerfHints()
updatePerfHints(): guid=0ll, CaptureIntent=1
updatePerfHints(): NvCameraCoreUseCase_Preview
NvPHSSendThroughputHints: sensorId=0, m_usecase=4, m_type=1, m_value=30, m_timeout_ms=1000

NvPHSSendThroughputHints: sensorId=0, m_usecase=4, m_type=15, m_value=0, m_timeout_ms=1000

No output buffers for 2
No output buffers for 1
InstructionList:
  + GraphSettings
      | SensorMode: 400x400 BayerS16BGGR 33.0fps
      | output 0: 400x400 BL U8_V8_ER 420SP
      | inputClipRect 0: (0.00,0.00, 1.00,1.00)

  + Instruction List
      | id: 0
      +  0: CCDataSetupStage
          | EstimatedIspOutLatencyFrames: 5
          | NumConcurrentCaptures: 1
          | UnprocessedYuvBufferMask: 0
      +  1: ACSynchronizeStage
      +  2: AeAfApplyStage
      +  3: AcPluginStage
          | operation: opApply
      +  4: AcMergeStage
          | IspIn: [400, 400]
          | IspOut0: [400, 400]
          | IspOut1: [0, 0]
          | IspOut2: [640, 640]
      +  5: StatsBufferAcquireStage
          | Buffer Index: 1
          | BufferRequirements: 640x640 Pitch Y8_ER 420
      +  6: TempBufferAcquireStage
          | Buffer Index: 2
          | BufferRequirements: 400x1 Pitch NonColor8
      +  7: TempBufferAcquireStage
          | Buffer Index: 3
          | BufferRequirements: 524288x1 Pitch NonColor8
      +  8: SensorISPCaptureStage
          | Source GUID: 0
          | Output A Buffer: 0
          | Output Thumb Buffer: 1
          | SensorMetadata Buffer: 2
          | Output IspStats Buffer: 3
      +  9: StatsUpdateStage
          | Output Meta Buffer: 2
          | Output IspStats Buffer: 3
      + 10: BufferReturnStage
          | Output A Buffer: 2
      + 11: BufferReturnStage
          | Output A Buffer: 3
      + 12: AcPluginStage
          | operation: opAnalyze
      + 13: AfAnalysisStage
      + 14: MonitorStage
      + 15: ExifStage
      + 16: MakerNoteStage
      + 17: BufferReturnStage
          | Output A Buffer: 0
      + 18: MetadataReturnStage
      + 19: PerfStatsStage

Session::updatePerfHints()
updatePerfHints(): guid=0ll, CaptureIntent=1
updatePerfHints(): NvCameraCoreUseCase_Preview
NvPHSSendThroughputHints: sensorId=0, m_usecase=4, m_type=1, m_value=30, m_timeout_ms=1000

NvPHSSendThroughputHints: sensorId=0, m_usecase=4, m_type=15, m_value=0, m_timeout_ms=1000

Created fiber 0x7f34000b20 for CC 101 globalID 101 session 0
Thread 2 is working on CC 101 session 0 globalID 101 step 0
Created fiber 0x7f34000dd0 for CC 102 globalID 102 session 0
Thread 1 is working on CC 102 session 0 globalID 102 step 0
CC 101 session 0 completed step 0 in fiber 0x7f34000b20
CC 102 session 0 completed step 0 in fiber 0x7f34000dd0
CC 102 session 0 stalled step 1 in fiber 0x7f34000dd0
FiberScheduler: cc 102, session 0 fiber 0x7f34000dd0 not ready to execute stalled on 0x7f9068c860 stage...

Thread 1 getting next capture
Thread 1 is waitingcc 101(1) session 0 runCount=0 runIspOut=0, latest ccId=0

CC 101 session 0 completed step 1 in fiber 0x7f34000b20
Thread 4 is working on CC 102 session 0 globalID 102 step 1
Thread 5 is waiting
Session::updatePerfHints()
NV AE and AfApply algorithms are active.
cc 102(2) session 0 runCount=1 runIspOut=0, latest ccId=0
CC 102 session 0 completed step 1 in fiber 0x7f34000dd0
updatePerfHints(): guid=0ll, CaptureIntent=1
updatePerfHints(): NvCameraCoreUseCase_Preview
CC 102 session 0 stalled step 2 in fiber 0x7f34000dd0
FiberScheduler: cc 102, session 0 fiber 0x7f34000dd0 not ready to execute stalled on 0x7f906d4230 stage...

NvPHSSendThroughputHints: sensorId=0, m_usecase=4, m_type=1, m_value=30, m_timeout_ms=1000

CC 101 session 0 completed step 2 in fiber 0x7f34000b20
Thread 6 is working on CC 102 session 0 globalID 102 step 2
NV AE and AfApply algorithms are active.
Thread 3 is waiting
CC 101 session 0 completed step 3 in fiber 0x7f34000b20
CC 102 session 0 completed step 2 in fiber 0x7f34000dd0
CC 102 session 0 completed step 3 in fiber 0x7f34000dd0
CC 102 session 0 stalled step 4 in fiber 0x7f34000dd0
FiberScheduler: cc 102, session 0 fiber 0x7f34000dd0 not ready to execute stalled on 0x7f906ca970 stage...

Thread 6 getting next capture
Thread 6 is waiting
Thread 4 getting next capture
Thread 8 is waiting
Thread 4 is waiting
CC 101 session 0 completed step 4 in fiber 0x7f34000b20
Thread 7 is working on CC 102 session 0 globalID 102 step 4
NvPHSSendThroughputHints: sensorId=0, m_usecase=4, m_type=15, m_value=0, m_timeout_ms=1000

CC 102 session 0 completed step 4 in fiber 0x7f34000dd0
CC 101 session 0 completed step 5 in fiber 0x7f34000b20
CC 101 session 0 completed step 6 in fiber 0x7f34000b20
CC 102 session 0 completed step 5 in fiber 0x7f34000dd0
CC 102 session 0 completed step 6 in fiber 0x7f34000dd0
CC 101 session 0 completed step 7 in fiber 0x7f34000b20
CC 101 session 0 processing step 8 in fiber 0x7f34000b20
FiberScheduler: cc 101, session 0, fiber 0x7f34000b20 in progress...

Thread 2 getting next capture
Thread 9 is waiting
Thread 2 is waiting
CC 102 session 0 completed step 7 in fiber 0x7f34000dd0
CC 102 session 0 processing step 8 in fiber 0x7f34000dd0
FiberScheduler: cc 102, session 0, fiber 0x7f34000dd0 in progress...

Thread 7 getting next capture
Thread 10 is waiting
Thread 7 is waiting
NvPclSettingsUpdate: Sending Updated Settings through PCL
NvPclSettingsApply: Applying last settings through PCL
apply:+++++++++++++++++++++++
writeMode: Target mode Id(0): Resolution 400x400
writeFrameRate: INPUT frameRate:33.000000
writeGain:      INPUT gainCtrl:a analogGain:1.000000
updateOutputSettings:   OUTPUT frameRate:33.000000
updateOutputSettings:   OUTPUT analogGain:1.000000
apply:-----------------------
NvPclSettingsApply: Reading PCL settings
NvPclSettingsUpdate: Sending Updated Settings through PCL
NvPclSettingsApply: Applying last settings through PCL
apply:+++++++++++++++++++++++
writeFrameRate: INPUT frameRate:30.000002
writeExposure:  INPUT expTime:0.033330
updateOutputSettings:   OUTPUT frameRate:30.000002
updateOutputSettings:   OUTPUT expTime:0.033330
apply:-----------------------
NvPclSettingsApply: Reading PCL settings
PowerServiceHw:addRequest: table size: before: 0, after:1
        request table for ISP 0:
        req[0]: output1 width=320, output1 height=200, output1 Bpp=16
        req[0]: output2 width=320, output2 height=200, output2 Bpp=16
        req[0]: input width=400, input height=400, input Bpp=10
        req[0]: output width=28, output height=28, output Bpp=16
        req[0]: input fps=33
        req[0]: guID=0, stage type=SensorIspCapture
        req[0]: clock=0 Hz, iso bw=42989 KB/s, non-iso bw=0 KB/s
        req[450]: timeout=0
PowerServiceHwIsp:setLaBw: m_bwVal_Iso=42989 and m_bwVal_NonIso=0 KBpS

PowerServiceCore:setCameraBw: totalIsoBw=42989
NvPclSettingsUpdate: Sending Updated Settings through PCL
NvPclSettingsApply: Applying last settings through PCL
apply:+++++++++++++++++++++++
writeFrameRate: INPUT frameRate:33.000000
updateOutputSettings:   OUTPUT frameRate:33.000000
apply:-----------------------
NvPclSettingsApply: Reading PCL settings
NvPclSettingsUpdate: Sending Updated Settings through PCL
NvPclSettingsApply: Applying last settings through PCL
apply:+++++++++++++++++++++++
apply:-----------------------
NvPclSettingsApply: Reading PCL settings
NvPclSettingsUpdate: Sending Updated Settings through PCL
NvPclSettingsApply: Applying last settings through PCL
apply:+++++++++++++++++++++++
writeFrameRate: INPUT frameRate:30.000002
updateOutputSettings:   OUTPUT frameRate:30.000002
apply:-----------------------
NvPclSettingsApply: Reading PCL settings
NvPclSettingsUpdate: Sending Updated Settings through PCL
NvPclSettingsApply: Applying last settings through PCL
apply:+++++++++++++++++++++++
apply:-----------------------
NvPclSettingsApply: Reading PCL settings
PowerServiceHw:addRequest: table size: before: 1, after:2
        request table for ISP 0:
        req[0]: output1 width=320, output1 height=200, output1 Bpp=16
        req[0]: output2 width=320, output2 height=200, output2 Bpp=16
        req[0]: input width=400, input height=400, input Bpp=10
        req[0]: output width=28, output height=28, output Bpp=16
        req[0]: input fps=33
        req[0]: guID=0, stage type=SensorIspCapture
        req[0]: clock=0 Hz, iso bw=42989 KB/s, non-iso bw=0 KB/s
        req[414]: timeout=0
        req[1]: output1 width=320, output1 height=200, output1 Bpp=16
        req[1]: output2 width=640, output2 height=640, output2 Bpp=13
        req[1]: input width=400, input height=400, input Bpp=10
        req[1]: output width=400, output height=400, output Bpp=12
        req[1]: input fps=33
        req[1]: guID=0, stage type=SensorIspCapture
        req[1]: clock=0 Hz, iso bw=70021 KB/s, non-iso bw=0 KB/s
        req[450]: timeout=0
PowerServiceHw:updateRequests: table size: before: 2, after:2
        request table for ISP 0:
        req[0]: output1 width=320, output1 height=200, output1 Bpp=16
        req[0]: output2 width=320, output2 height=200, output2 Bpp=16
        req[0]: input width=400, input height=400, input Bpp=10
        req[0]: output width=28, output height=28, output Bpp=16
        req[0]: input fps=33
        req[0]: guID=0, stage type=SensorIspCapture
        req[0]: clock=0 Hz, iso bw=42989 KB/s, non-iso bw=0 KB/s
        req[413]: timeout=0
        req[1]: output1 width=320, output1 height=200, output1 Bpp=16
        req[1]: output2 width=640, output2 height=640, output2 Bpp=13
        req[1]: input width=400, input height=400, input Bpp=10
        req[1]: output width=400, output height=400, output Bpp=12
        req[1]: input fps=33
        req[1]: guID=0, stage type=SensorIspCapture
        req[1]: clock=0 Hz, iso bw=70021 KB/s, non-iso bw=0 KB/s
        req[449]: timeout=0
PowerServiceHwIsp:setLaBw: m_bwVal_Iso=70021 and m_bwVal_NonIso=0 KBpS

PowerServiceCore:setCameraBw: totalIsoBw=70021
Created fiber 0x7f34000f70 for CC 103 globalID 103 session 0
Thread 11 is working on CC 103 session 0 globalID 103 step 0
Session::updatePerfHints()
updatePerfHints(): guid=0ll, CaptureIntent=1
updatePerfHints(): NvCameraCoreUseCase_Preview
NvPHSSendThroughputHints: sensorId=0, m_usecase=4, m_type=1, m_value=30, m_timeout_ms=1000

NvPHSSendThroughputHints: sensorId=0, m_usecase=4, m_type=15, m_value=0, m_timeout_ms=1000

CC 103 session 0 completed step 0 in fiber 0x7f34000f70
cc 103(3) session 0 runCount=2 runIspOut=0, latest ccId=0
CC 103 session 0 completed step 1 in fiber 0x7f34000f70
NV AE and AfApply algorithms are active.
CC 103 session 0 completed step 2 in fiber 0x7f34000f70
CC 103 session 0 completed step 3 in fiber 0x7f34000f70
CC 103 session 0 completed step 4 in fiber 0x7f34000f70
CC 103 session 0 completed step 5 in fiber 0x7f34000f70
CC 103 session 0 completed step 6 in fiber 0x7f34000f70
CC 103 session 0 completed step 7 in fiber 0x7f34000f70
CC 103 session 0 processing step 8 in fiber 0x7f34000f70
FiberScheduler: cc 103, session 0, fiber 0x7f34000f70 in progress...

Thread 11 getting next capture
Thread 12 is waiting
Thread 11 is waiting
SCF: Error InvalidSize:  (propagating from src/services/capture/NvIspHw.cpp, function startCapture(), line 323)
SCF: Error InvalidSize:  (propagating from src/services/capture/DeviceRecordNv.cpp, function doCSItoISPCapture(), line 97)
SCF: Error InvalidSize:  (propagating from src/services/capture/CaptureRecord.cpp, function doCSItoISPCapture(), line 547)
SCF: Error InvalidSize:  (propagating from src/services/capture/CaptureRecord.cpp, function issueCapture(), line 460)
SCF: Error InvalidSize:  (propagating from src/services/capture/CaptureServiceDevice.cpp, function issueCaptures(), line 1276)
SCF: Error InvalidSize:  (propagating from src/services/capture/CaptureServiceDevice.cpp, function issueCaptures(), line 1107)
SCF: Error OverFlow:  (propagating from src/services/capture/CaptureServiceDevice.cpp, function returnRequestPoolCaptures(), line 1226)
FiberScheduler: cc 101, session 0, fiber 0x7f34000b20 aborted in async operation

Created fiber 0x7f34001110 for CC 104 globalID 104 session 0
Thread 1 is working on CC 104 session 0 globalID 104 step 0
CC 104 session 0 completed step 0 in fiber 0x7f34001110
cc 104(4) session 0 runCount=3 runIspOut=0, latest ccId=0
CC 104 session 0 completed step 1 in fiber 0x7f34001110
NV AE and AfApply algorithms are active.
CC 104 session 0 completed step 2 in fiber 0x7f34001110
CC 104 session 0 completed step 3 in fiber 0x7f34001110
CC 104 session 0 completed step 4 in fiber 0x7f34001110
CC 104 session 0 completed step 5 in fiber 0x7f34001110
CC 104 session 0 completed step 6 in fiber 0x7f34001110
CC 104 session 0 completed step 7 in fiber 0x7f34001110
CC 104 session 0 processing step 8 in fiber 0x7f34001110
FiberScheduler: cc 104, session 0, fiber 0x7f34001110 in progress...

Thread 1 getting next capture
Thread 5 is waiting
Thread 1 is waiting
SCF: Error OverFlow:  (propagating from src/services/capture/CaptureServiceDevice.cpp, function checkCaptureComplete(), line 1198)
SCF: Error OverFlow:  (propagating from src/common/Utils.cpp, function workerThread(), line 116)
SCF: Error OverFlow: Worker thread CaptureScheduler checkFramePending failed (in src/common/Utils.cpp, function workerThread(), line 133)
SCF: Error Timeout:  (propagating from src/api/Buffer.cpp, function waitForUnlock(), line 637)
SCF: Error Timeout:  (propagating from src/components/CaptureContainerImpl.cpp, function returnBuffer(), line 358)
FiberScheduler: fiber 0x7f34000b20 exiting
Thread 3 is waiting
Session::updatePerfHints()
disposing CC 101 Session 0
updatePerfHints(): guid=0ll, CaptureIntent=1
updatePerfHints(): NvCameraCoreUseCase_Preview
NvPHSSendThroughputHints: sensorId=0, m_usecase=4, m_type=1, m_value=30, m_timeout_ms=1000

NvPHSSendThroughputHints: sensorId=0, m_usecase=4, m_type=15, m_value=0, m_timeout_ms=1000

SCF: Error Timeout:  (propagating from src/api/Buffer.cpp, function waitForUnlock(), line 637)
SCF: Error Timeout:  (propagating from src/components/CaptureContainerImpl.cpp, function returnBuffer(), line 358)
SCF: Error Timeout:  (propagating from src/api/Buffer.cpp, function waitForUnlock(), line 637)
SCF: Error Timeout:  (propagating from src/components/CaptureContainerImpl.cpp, function returnBuffer(), line 358)
SCF: Error InvalidSize:  (propagating from src/common/Utils.cpp, function workerThread(), line 116)
SCF: Error InvalidSize: Worker thread CaptureScheduler frameStart failed (in src/common/Utils.cpp, function workerThread(), line 133)
SCF: Error Timeout:  (propagating from src/services/capture/CaptureServiceEvent.cpp, function wait(), line 59)
Error: Camera HwEvents wait, this may indicate a hardware timeout occured,abort current/incoming cc
Created fiber 0x7f340012b0 for CC 105 globalID 105 session 0
Thread 6 is working on CC 105 session 0 globalID 105 step 0
Fiber 0x7f340012b0 is aborting in CC 105 Session 0
FiberScheduler: cc 105 session 0, fiber 0x7f340012b0 aborted

FiberScheduler: fiber 0x7f340012b0 exiting
Thread 6 getting next capture
Thread 8 is waiting
Thread 4 is waiting
Thread 6 is waiting

Could you check the trace log for the gst command.

echo 1 > /sys/kernel/debug/tracing/tracing_on
echo 30720 > /sys/kernel/debug/tracing/buffer_size_kb
echo 1 > /sys/kernel/debug/tracing/events/tegra_rtcpu/enable
echo 1 > /sys/kernel/debug/tracing/events/freertos/enable
echo 2 > /sys/kernel/debug/camrtc/log-level
echo 1 > /sys/kernel/debug/tracing/events/camera_common/enable
echo > /sys/kernel/debug/tracing/trace

gst-launch-1.0 -v nvarguscamerasrc num-buffers=200 ! ‘video/x-raw(memory:NVMM),width=400, height=400, framerate=30/1, format=NV12’ ! fakesink

cat /sys/kernel/debug/tracing/trace

Here it is:

# tracer: nop
#
# entries-in-buffer/entries-written: 423/423   #P:4
#
#                              _-----=> irqs-off
#                             / _----=> need-resched
#                            | / _---=> hardirq/softirq
#                            || / _--=> preempt-depth
#                            ||| /     delay
#           TASK-PID   CPU#  ||||    TIMESTAMP  FUNCTION
#              | |       |   ||||       |         |
     kworker/0:3-5356  [000] ....   150.026005: rtos_queue_peek_from_isr_failed: tstamp:5056308458 queue:0x0b4b4500
     kworker/0:3-5356  [000] ....   150.137977: rtos_queue_peek_from_isr_failed: tstamp:5061308463 queue:0x0b4b4500
     kworker/0:3-5356  [000] ....   150.305876: rtos_queue_peek_from_isr_failed: tstamp:5066308470 queue:0x0b4b4500
     kworker/0:3-5356  [000] ....   150.473912: rtos_queue_peek_from_isr_failed: tstamp:5071308477 queue:0x0b4b4500
     kworker/0:3-5356  [000] ....   150.641905: rtos_queue_peek_from_isr_failed: tstamp:5076308483 queue:0x0b4b4500
     kworker/0:3-5356  [000] ....   150.809892: rtos_queue_peek_from_isr_failed: tstamp:5081308493 queue:0x0b4b4500
     kworker/0:3-5356  [000] ....   150.977870: rtos_queue_peek_from_isr_failed: tstamp:5086308500 queue:0x0b4b4500
     kworker/0:3-5356  [000] ....   151.145949: rtos_queue_peek_from_isr_failed: tstamp:5091308504 queue:0x0b4b4500
     kworker/0:3-5356  [000] ....   151.257914: rtos_queue_peek_from_isr_failed: tstamp:5096308585 queue:0x0b4b4500
     kworker/0:3-5356  [000] ....   151.426042: rtos_queue_peek_from_isr_failed: tstamp:5101308496 queue:0x0b4b4500
     kworker/0:3-5356  [000] ....   151.593984: rtos_queue_peek_from_isr_failed: tstamp:5106308531 queue:0x0b4b4500
     kworker/0:3-5356  [000] ....   151.761953: rtos_queue_peek_from_isr_failed: tstamp:5111308539 queue:0x0b4b4500
     kworker/0:3-5356  [000] ....   151.929945: rtos_queue_peek_from_isr_failed: tstamp:5116308547 queue:0x0b4b4500
     kworker/0:3-5356  [000] ....   152.098054: rtos_queue_peek_from_isr_failed: tstamp:5121308554 queue:0x0b4b4500
     kworker/0:3-5356  [000] ....   152.266013: rtos_queue_peek_from_isr_failed: tstamp:5126308557 queue:0x0b4b4500
     kworker/0:3-5356  [000] ....   152.377977: rtos_queue_peek_from_isr_failed: tstamp:5131308567 queue:0x0b4b4500
     kworker/0:3-5356  [000] ....   152.545950: rtos_queue_peek_from_isr_failed: tstamp:5136308573 queue:0x0b4b4500
     kworker/0:3-5356  [000] ....   152.713999: rtos_queue_peek_from_isr_failed: tstamp:5141308580 queue:0x0b4b4500
     kworker/0:3-5356  [000] ....   152.881958: rtos_queue_peek_from_isr_failed: tstamp:5146308588 queue:0x0b4b4500
     kworker/0:3-5356  [000] ....   152.938049: rtos_queue_peek_from_isr_failed: tstamp:5147904165 queue:0x0b4b4500
 gst-plugin-scan-7858  [005] ....   166.965528: tegra_channel_open: vi-output, lys_cam 2-0036
 gst-plugin-scan-7858  [005] ....   166.966526: tegra_channel_set_power: lys_cam 2-0036 : 0x1
 gst-plugin-scan-7858  [005] ....   166.966532: camera_common_s_power: status : 0x1
 gst-plugin-scan-7858  [005] ....   166.980528: tegra_channel_set_power: 150c0000.nvcsi--1 : 0x1
 gst-plugin-scan-7858  [005] ....   166.980532: csi_s_power: enable : 0x1
 gst-plugin-scan-7858  [000] ....   166.984217: tegra_channel_close: vi-output, lys_cam 2-0036
 gst-plugin-scan-7858  [000] ....   166.984223: tegra_channel_set_power: lys_cam 2-0036 : 0x0
 gst-plugin-scan-7858  [000] ....   166.984229: camera_common_s_power: status : 0x0
 gst-plugin-scan-7858  [000] ....   166.989698: tegra_channel_set_power: 150c0000.nvcsi--1 : 0x0
 gst-plugin-scan-7858  [000] ....   166.989700: csi_s_power: enable : 0x0
  nvargus-daemon-7865  [005] ....   167.366536: tegra_channel_open: vi-output, lys_cam 2-0036
  nvargus-daemon-7865  [005] ....   167.366554: tegra_channel_set_power: lys_cam 2-0036 : 0x1
  nvargus-daemon-7865  [005] ....   167.366567: camera_common_s_power: status : 0x1
  nvargus-daemon-7865  [003] ....   167.384927: tegra_channel_set_power: 150c0000.nvcsi--1 : 0x1
  nvargus-daemon-7865  [003] ....   167.384938: csi_s_power: enable : 0x1
  nvargus-daemon-7865  [003] ....   167.385176: tegra_channel_close: vi-output, lys_cam 2-0036
  nvargus-daemon-7865  [003] ....   167.385184: tegra_channel_set_power: lys_cam 2-0036 : 0x0
  nvargus-daemon-7865  [003] ....   167.385194: camera_common_s_power: status : 0x0
  nvargus-daemon-7865  [004] ....   167.390972: tegra_channel_set_power: 150c0000.nvcsi--1 : 0x0
  nvargus-daemon-7865  [004] ....   167.390974: csi_s_power: enable : 0x0
  nvargus-daemon-7865  [004] ....   167.397191: tegra_channel_open: vi-output, lys_cam 2-0036
  nvargus-daemon-7865  [004] ....   167.397198: tegra_channel_set_power: lys_cam 2-0036 : 0x1
  nvargus-daemon-7865  [004] ....   167.397203: camera_common_s_power: status : 0x1
  nvargus-daemon-7865  [003] ....   167.414010: tegra_channel_set_power: 150c0000.nvcsi--1 : 0x1
  nvargus-daemon-7865  [003] ....   167.414015: csi_s_power: enable : 0x1
  nvargus-daemon-7865  [003] ....   167.414180: tegra_channel_close: vi-output, lys_cam 2-0036
  nvargus-daemon-7865  [003] ....   167.414186: tegra_channel_set_power: lys_cam 2-0036 : 0x0
  nvargus-daemon-7865  [003] ....   167.414194: camera_common_s_power: status : 0x0
  nvargus-daemon-7865  [003] ....   167.419938: tegra_channel_set_power: 150c0000.nvcsi--1 : 0x0
  nvargus-daemon-7865  [003] ....   167.419942: csi_s_power: enable : 0x0
  nvargus-daemon-7865  [003] ....   167.435920: tegra_channel_open: vi-output, lys_cam 2-0036
  nvargus-daemon-7865  [003] ....   167.435928: tegra_channel_set_power: lys_cam 2-0036 : 0x1
  nvargus-daemon-7865  [003] ....   167.435934: camera_common_s_power: status : 0x1
  nvargus-daemon-7865  [003] ....   167.449928: tegra_channel_set_power: 150c0000.nvcsi--1 : 0x1
  nvargus-daemon-7865  [003] ....   167.449933: csi_s_power: enable : 0x1
  nvargus-daemon-7865  [003] ....   167.449969: tegra_channel_close: vi-output, lys_cam 2-0036
  nvargus-daemon-7865  [003] ....   167.449972: tegra_channel_set_power: lys_cam 2-0036 : 0x0
  nvargus-daemon-7865  [003] ....   167.449979: camera_common_s_power: status : 0x0
  nvargus-daemon-7865  [003] ....   167.455645: tegra_channel_set_power: 150c0000.nvcsi--1 : 0x0
  nvargus-daemon-7865  [003] ....   167.455648: csi_s_power: enable : 0x0
  nvargus-daemon-7865  [003] ....   167.456104: tegra_channel_open: vi-output, lys_cam 2-0036
  nvargus-daemon-7865  [003] ....   167.456154: tegra_channel_set_power: lys_cam 2-0036 : 0x1
  nvargus-daemon-7865  [003] ....   167.456165: camera_common_s_power: status : 0x1
  nvargus-daemon-7865  [003] ....   167.474158: tegra_channel_set_power: 150c0000.nvcsi--1 : 0x1
  nvargus-daemon-7865  [003] ....   167.474161: csi_s_power: enable : 0x1
  nvargus-daemon-7865  [003] ....   167.474423: tegra_channel_close: vi-output, lys_cam 2-0036
  nvargus-daemon-7865  [003] ....   167.474430: tegra_channel_set_power: lys_cam 2-0036 : 0x0
  nvargus-daemon-7865  [003] ....   167.474438: camera_common_s_power: status : 0x0
  nvargus-daemon-7865  [000] ....   167.480136: tegra_channel_set_power: 150c0000.nvcsi--1 : 0x0
  nvargus-daemon-7865  [000] ....   167.480141: csi_s_power: enable : 0x0
  nvargus-daemon-7865  [000] ....   167.480652: tegra_channel_open: vi-output, lys_cam 2-0036
  nvargus-daemon-7865  [000] ....   167.480661: tegra_channel_set_power: lys_cam 2-0036 : 0x1
  nvargus-daemon-7865  [000] ....   167.480669: camera_common_s_power: status : 0x1
  nvargus-daemon-7865  [003] ....   167.495059: tegra_channel_set_power: 150c0000.nvcsi--1 : 0x1
  nvargus-daemon-7865  [003] ....   167.495063: csi_s_power: enable : 0x1
  nvargus-daemon-7865  [003] ....   167.495339: tegra_channel_close: vi-output, lys_cam 2-0036
  nvargus-daemon-7865  [003] ....   167.495346: tegra_channel_set_power: lys_cam 2-0036 : 0x0
  nvargus-daemon-7865  [003] ....   167.495354: camera_common_s_power: status : 0x0
  nvargus-daemon-7865  [003] ....   167.501171: tegra_channel_set_power: 150c0000.nvcsi--1 : 0x0
  nvargus-daemon-7865  [003] ....   167.501176: csi_s_power: enable : 0x0
     kworker/0:3-5356  [000] ....   167.558295: rtos_queue_peek_from_isr_failed: tstamp:5605229270 queue:0x0b4b4500
     kworker/0:3-5356  [000] ....   167.558299: rtcpu_start: tstamp:5605230411
     kworker/0:3-5356  [000] ....   167.558301: rtos_queue_send_from_isr_failed: tstamp:5605239713 queue:0x0b4a7258
     kworker/0:3-5356  [000] ....   167.558301: rtos_queue_send_from_isr_failed: tstamp:5605239821 queue:0x0b4aad68
     kworker/0:3-5356  [000] ....   167.558302: rtos_queue_send_from_isr_failed: tstamp:5605239931 queue:0x0b4ac998
     kworker/0:3-5356  [000] ....   167.558302: rtos_queue_send_from_isr_failed: tstamp:5605240044 queue:0x0b4ae518
     kworker/0:3-5356  [000] ....   167.558303: rtos_queue_send_from_isr_failed: tstamp:5605240148 queue:0x0b4af2d8
     kworker/0:3-5356  [000] ....   167.558304: rtos_queue_send_from_isr_failed: tstamp:5605240251 queue:0x0b4b0098
     kworker/0:3-5356  [000] ....   167.558305: rtos_queue_send_from_isr_failed: tstamp:5605240355 queue:0x0b4b0e58
     kworker/0:3-5356  [000] ....   167.558305: rtos_queue_send_from_isr_failed: tstamp:5605240468 queue:0x0b4b1c18
     kworker/0:3-5356  [000] ....   167.558307: rtos_queue_send_failed: tstamp:5605240924 queue:0x0b4a7258
     kworker/0:3-5356  [000] ....   167.726324: rtos_queue_peek_from_isr_failed: tstamp:5610229621 queue:0x0b4b4500
 CaptureSchedule-7884  [000] ....   167.728640: tegra_channel_open: vi-output, lys_cam 2-0036
 CaptureSchedule-7884  [000] ....   167.728649: tegra_channel_set_power: lys_cam 2-0036 : 0x1
 CaptureSchedule-7884  [000] ....   167.728655: camera_common_s_power: status : 0x1
 CaptureSchedule-7884  [000] ....   167.742657: tegra_channel_set_power: 150c0000.nvcsi--1 : 0x1
 CaptureSchedule-7884  [000] ....   167.742661: csi_s_power: enable : 0x1
 CaptureSchedule-7884  [005] ....   167.743970: tegra_channel_set_stream: enable : 0x1
 CaptureSchedule-7884  [005] ....   167.745363: tegra_channel_set_stream: 150c0000.nvcsi--1 : 0x1
 CaptureSchedule-7884  [005] ....   167.745366: csi_s_stream: enable : 0x1
 CaptureSchedule-7884  [005] ....   167.745367: tegra_channel_set_stream: lys_cam 2-0036 : 0x1
     kworker/0:3-5356  [000] ....   167.783719: rtos_queue_send_from_isr_failed: tstamp:5611189694 queue:0x0b4a7258
     kworker/0:3-5356  [000] ....   167.783722: rtos_queue_send_from_isr_failed: tstamp:5611189801 queue:0x0b4aad68
     kworker/0:3-5356  [000] ....   167.783723: rtos_queue_send_from_isr_failed: tstamp:5611189908 queue:0x0b4ac998
     kworker/0:3-5356  [000] ....   167.783724: rtos_queue_send_from_isr_failed: tstamp:5611190014 queue:0x0b4ae518
     kworker/0:3-5356  [000] ....   167.783724: rtos_queue_send_from_isr_failed: tstamp:5611190119 queue:0x0b4af2d8
     kworker/0:3-5356  [000] ....   167.783725: rtos_queue_send_from_isr_failed: tstamp:5611190224 queue:0x0b4b0098
     kworker/0:3-5356  [000] ....   167.783726: rtos_queue_send_from_isr_failed: tstamp:5611190329 queue:0x0b4b0e58
     kworker/0:3-5356  [000] ....   167.783726: rtos_queue_send_from_isr_failed: tstamp:5611190434 queue:0x0b4b1c18
     kworker/0:3-5356  [000] ....   167.783728: rtos_queue_send_failed: tstamp:5611190874 queue:0x0b4a7258
     kworker/0:3-5356  [000] ....   167.783728: rtos_queue_send_from_isr_failed: tstamp:5611688703 queue:0x0b4a7258
     kworker/0:3-5356  [000] ....   167.783729: rtos_queue_send_from_isr_failed: tstamp:5611688810 queue:0x0b4aad68
     kworker/0:3-5356  [000] ....   167.783730: rtos_queue_send_from_isr_failed: tstamp:5611688915 queue:0x0b4ac998
     kworker/0:3-5356  [000] ....   167.783730: rtos_queue_send_from_isr_failed: tstamp:5611689021 queue:0x0b4ae518
     kworker/0:3-5356  [000] ....   167.783731: rtos_queue_send_from_isr_failed: tstamp:5611689126 queue:0x0b4af2d8
     kworker/0:3-5356  [000] ....   167.783731: rtos_queue_send_from_isr_failed: tstamp:5611689231 queue:0x0b4b0098
     kworker/0:3-5356  [000] ....   167.783732: rtos_queue_send_from_isr_failed: tstamp:5611689336 queue:0x0b4b0e58
     kworker/0:3-5356  [000] ....   167.783732: rtos_queue_send_from_isr_failed: tstamp:5611689441 queue:0x0b4b1c18
     kworker/0:3-5356  [000] ....   167.783733: rtos_queue_send_failed: tstamp:5611689886 queue:0x0b4a7258
     kworker/0:3-5356  [000] ....   167.895560: rtos_queue_peek_from_isr_failed: tstamp:5615229636 queue:0x0b4b4500
     kworker/0:3-5356  [000] ....   168.065242: rtos_queue_peek_from_isr_failed: tstamp:5620229675 queue:0x0b4b4500
     kworker/0:2-3039  [000] ....   168.233947: rtos_queue_peek_from_isr_failed: tstamp:5625229645 queue:0x0b4b4500
     kworker/0:3-5356  [000] ....   168.342523: rtos_queue_send_from_isr_failed: tstamp:5630156882 queue:0x0b4a7258
     kworker/0:3-5356  [000] ....   168.342557: rtos_queue_send_from_isr_failed: tstamp:5630157044 queue:0x0b4aad68
     kworker/0:3-5356  [000] ....   168.342562: rtos_queue_send_from_isr_failed: tstamp:5630157184 queue:0x0b4ac998
     kworker/0:3-5356  [000] ....   168.342568: rtos_queue_send_from_isr_failed: tstamp:5630157326 queue:0x0b4ae518
     kworker/0:3-5356  [000] ....   168.342571: rtos_queue_send_from_isr_failed: tstamp:5630157464 queue:0x0b4af2d8
     kworker/0:3-5356  [000] ....   168.342576: rtos_queue_send_from_isr_failed: tstamp:5630157601 queue:0x0b4b0098
     kworker/0:3-5356  [000] ....   168.342579: rtos_queue_send_from_isr_failed: tstamp:5630157739 queue:0x0b4b0e58
     kworker/0:3-5356  [000] ....   168.342584: rtos_queue_send_from_isr_failed: tstamp:5630157876 queue:0x0b4b1c18
     kworker/0:3-5356  [000] ....   168.342600: rtos_queue_send_failed: tstamp:5630159328 queue:0x0b4a7258
     kworker/0:3-5356  [000] ....   168.342610: rtos_queue_peek_from_isr_failed: tstamp:5630229672 queue:0x0b4b4500
     kworker/0:3-5356  [000] ....   168.398578: rtcpu_vinotify_event: tstamp:5631057842 tag:ISPBUF_FS channel:0x00 frame:0 vi_tstamp:5631057429 data:0x00000000
     kworker/0:3-5356  [000] ....   168.398621: rtcpu_vinotify_event: tstamp:5631129154 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:5631128477 data:0x00000001
     kworker/0:3-5356  [000] ....   168.398627: rtcpu_vinotify_event: tstamp:5632027932 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:5632027216 data:0x018f0002
     kworker/0:3-5356  [000] ....   168.398632: rtcpu_vinotify_event: tstamp:5632028081 tag:ISPBUF_FE channel:0x00 frame:0 vi_tstamp:5632027510 data:0x00000000
     kworker/0:3-5356  [000] ....   168.398638: rtcpu_vinotify_event: tstamp:5632097594 tag:ISPBUF_FS channel:0x00 frame:0 vi_tstamp:5632096942 data:0x00000000
     kworker/0:3-5356  [000] ....   168.454669: rtcpu_vinotify_event: tstamp:5632168634 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:5632167990 data:0x00000001
     kworker/0:3-5356  [000] ....   168.454708: rtcpu_vinotify_event: tstamp:5633067472 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:5633066729 data:0x018f0002
     kworker/0:3-5356  [000] ....   168.454713: rtcpu_vinotify_event: tstamp:5633067662 tag:ISPBUF_FE channel:0x00 frame:0 vi_tstamp:5633067023 data:0x00000000
     kworker/0:3-5356  [000] ....   168.510436: rtos_queue_peek_from_isr_failed: tstamp:5635229950 queue:0x0b4b4500
     kworker/0:3-5356  [000] ....   168.678443: rtos_queue_peek_from_isr_failed: tstamp:5640230000 queue:0x0b4b4500
     kworker/0:3-5356  [000] ....   168.846425: rtos_queue_peek_from_isr_failed: tstamp:5645229965 queue:0x0b4b4500
     kworker/0:3-5356  [000] ....   169.014400: rtos_queue_peek_from_isr_failed: tstamp:5650229972 queue:0x0b4b4500
     kworker/0:3-5356  [000] ....   169.182411: rtos_queue_peek_from_isr_failed: tstamp:5655229978 queue:0x0b4b4500
     kworker/0:3-5356  [000] ....   169.350431: rtos_queue_peek_from_isr_failed: tstamp:5660229987 queue:0x0b4b4500
     kworker/0:3-5356  [000] ....   169.462394: rtos_queue_peek_from_isr_failed: tstamp:5665229994 queue:0x0b4b4500
     kworker/0:3-5356  [000] ....   169.630438: rtos_queue_peek_from_isr_failed: tstamp:5670230000 queue:0x0b4b4500
     kworker/0:3-5356  [000] ....   169.798446: rtos_queue_peek_from_isr_failed: tstamp:5675230006 queue:0x0b4b4500

Looks like your sensor need much to initialize.
Have a try to add set_mode_delay_ms=“5000” to the device tree in the sensor mode table to try.

Hello,

We test it right now.

I checked our logs and the startup sequence for our sensor last about 510ms (total duration of the function that intiialize the sensor and start streaming).

Here is the result (Behavior seems the same):

Gstreamer log:

=== NVIDIA Libargus Camera Service (0.97.3)=== Listening for connections...=== gst-launch-1.0[7725]: Connection established (7FB222D1D0)Thread 1 getting next capture
Thread 1 is waiting
Thread 2 getting next capture
Thread 2 is waiting
Thread 3 getting next capture
Thread 3 is waiting
Thread 4 getting next capture
Thread 4 is waiting
Thread 5 getting next capture
Thread 5 is waiting
Thread 7 getting next capture
Thread 6 getting next capture
Thread 6 is waiting
Thread 7 is waiting
Thread 8 getting next capture
Thread 8 is waiting
Thread 9 getting next capture
Thread 9 is waiting
Thread 10 getting next capture
Thread 10 is waiting
Thread 11 getting next capture
Thread 11 is waiting
Thread 12 getting next capture
Thread 12 is waiting
Starting services...
Worker thread IspHw statsComplete start
Worker thread IspHw frameComplete start
Worker thread CaptureScheduler checkFramePending start
Worker thread CaptureScheduler frameStart start
Worker thread V4L2CaptureScheduler checkCaptureComplete start
Worker thread V4L2CaptureScheduler issueCaptures start
Worker thread PS handleRequests start
getInstance: s_instance(0x7fac67f840)
getInstance: s_instance(0x7fac67f840)
subscribe: SensorType(gyroscope)
subscribe: create SensorType(gyroscope) sensor(0x7fac681e40)
subscribe: SensorType(accelerometer)
subscribe: create SensorType(accelerometer) sensor(0x7fac6873a0)
AC plugin not present: dlopen "acplugin.so", acplugin.so: cannot open shared object file: No such file or directory
Services are started
NvPclSetHotplugCallback: ++++++++++++++++++++++
---- Imager: Calibration blob file handling supported in this build ----
NvPclHwGetModuleList: OFParserListModules Succeeded
OFParserListModules: module list: /proc/device-tree/tegra-camera-platform/modules/module0
NvPclHwGetModuleList: WARNING: Could not map module to ISP config string
NvPclHwGetModuleList: No module data found
NvPclHwPrintModuleDefinition -- Name: e0000_rear_OV6946
NvPclHwPrintModuleDefinition -- Position: 0
NvPclHwPrintModuleDefinition -- CalibrationData Found: 1
NvPclHwPrintCameraSubModule -- HwCamSubModule[0].Name: v4l2_sensor
NvPclHwPrintCameraSubModule -- HwCamSubModule[0].DevName: lys_cam 2-0036
NvPclHwGetModuleList: OFParserListModules Succeeded
NvPclModuleListInitialize: NvPclModule list[0]: e0000_rear_OV6946 position0
NvPclHwScanExternalCameras -- adding video0 to discover list
NvPclHwScanExternalCameras -- adding video0 to discover list
NvPclHwScanExternalCameras -- adding video0 to discover list
getHotplugMonitor: Getting hotplug monitor instance
 initializeHotplug++
 hotPlugfunc ++
 addWatch: Watch added wd='1'
CheckProcDTExists: INFO: accessing /proc/device-tree/tegra-virtual-camera-platform/modules/module0/drivernode1; No such file or directory
OFParserGetVirtualDevice: virtual device driver node not found in proc device-tree: /proc/device-tree/tegra-virtual-camera-platform/modules/module0/drivernode1
CheckProcDTExists: INFO: accessing /proc/device-tree/tegra-virtual-camera-platform/modules/module1/drivernode0; No such file or directory
OFParserGetVirtualDevice: virtual device driver node not found in proc device-tree: /proc/device-tree/tegra-virtual-camera-platform/modules/module1/drivernode0
setHotplugCallback: Registered new callback client
NvPclSetHotplugCallback: ----------------------
 hotPlugfunc: reading from inotify FD, Thread waiting
NvPclOpen: ++++++++++++++++++++++
NvPclStateControllerOpen: Found GUID 0 match at index[0]
NvPclHwInitializeModule: allocate overrides pathname @ 0x7fac5c6940
NvPclHwInitializeModule: allocate overrides pathname @ 0x7fac5fbb20
NvPclHwInitializeModule: allocate overrides pathname @ 0x7fac34af00
NvPclHwInitializeModule: allocate overrides pathname @ 0x7fac5cdd00
NvPclHwInitializeModule: allocate overrides pathname @ 0x7fac6d0300
NvPclHwInitializeModule: allocate overrides pathname @ 0x7fac6d40e0
LoadOverridesFile: looking for override file [/Calib/camera_override.isp] 1/16
CheckOverridesPermissions: stat(/Calib/camera_override.isp) call failed
LoadOverridesFile: looking for override file [/data/vendor/nvcam/settings/camera_overrides.isp] 2/16
CheckOverridesPermissions: stat(/data/vendor/nvcam/settings/camera_overrides.isp) call failed
LoadOverridesFile: looking for override file [/opt/nvidia/nvcam/settings/camera_overrides.isp] 3/16
CheckOverridesPermissions: stat(/opt/nvidia/nvcam/settings/camera_overrides.isp) call failed
LoadOverridesFile: looking for override file [/var/nvidia/nvcam/settings/camera_overrides.isp] 4/16
CheckOverridesPermissions: stat(/var/nvidia/nvcam/settings/camera_overrides.isp) call failed
LoadOverridesFile: looking for override file [/data/vendor/nvcam/camera_overrides.isp] 5/16
CheckOverridesPermissions: stat(/data/vendor/nvcam/camera_overrides.isp) call failed
LoadOverridesFile: looking for override file [/data/vendor/nvcam/settings/e0000_rear_OV6946.isp] 6/16
CheckOverridesPermissions: stat(/data/vendor/nvcam/settings/e0000_rear_OV6946.isp) call failed
LoadOverridesFile: looking for override file [/opt/nvidia/nvcam/settings/e0000_rear_OV6946.isp] 7/16
CheckOverridesPermissions: stat(/opt/nvidia/nvcam/settings/e0000_rear_OV6946.isp) call failed
LoadOverridesFile: looking for override file [/var/nvidia/nvcam/settings/e0000_rear_OV6946.isp] 8/16
CheckOverridesPermissions: stat(/var/nvidia/nvcam/settings/e0000_rear_OV6946.isp) call failed
---- imager: No override file found. ----
Imager: looking for override file [/mnt/factory/camera/factory.bin] 1/16
Imager: looking for override file [/Calib/factory.bin] 2/16
Imager: looking for override file [/Calib/calibration.bin] 3/16
Imager: looking for override file [(null)] 4/16
Imager: looking for override file [(null)] 5/16
Imager: looking for override file [(null)] 6/16
Imager: looking for override file [(null)] 7/16
Imager: looking for override file [(null)] 8/16
Imager: looking for override file [(null)] 9/16
Imager: looking for override file [(null)] 10/16
Imager: looking for override file [(null)] 11/16
Imager: looking for override file [(null)] 12/16
Imager: looking for override file [(null)] 13/16
Imager: looking for override file [(null)] 14/16
Imager: looking for override file [(null)] 15/16
Imager: looking for override file [(null)] 16/16
Imager: looking for override file [/data/vendor/nvcam/settings/factory.bin] 1/16
Imager: looking for override file [/data/vendor/nvcam/settings/e0000_rear_OV6946.bin] 2/16
Imager: looking for override file [/opt/nvidia/nvcam/settings/e0000_rear_OV6946.bin] 3/16
Imager: looking for override file [/var/nvidia/nvcam/settings/e0000_rear_OV6946.bin] 4/16
Imager: looking for override file [(null)] 5/16
Imager: looking for override file [(null)] 6/16
Imager: looking for override file [(null)] 7/16
Imager: looking for override file [(null)] 8/16
Imager: looking for override file [(null)] 9/16
Imager: looking for override file [(null)] 10/16
Imager: looking for override file [(null)] 11/16
Imager: looking for override file [(null)] 12/16
Imager: looking for override file [(null)] 13/16
Imager: looking for override file [(null)] 14/16
Imager: looking for override file [(null)] 15/16
Imager: looking for override file [(null)] 16/16
NvPclCreateDriver: Found NvPcl Driver Hal dev_name match (v4l2_sensor)
NvPclCreateDriver: Found a Driver name match (v4l2_sensor)
NvPclConnectDrivers: hImager was NULL, creating new imager
NvPclInitializeDrivers: v4l2_sensor ++++++++++++++++++
OFDPropertyGetString: could not read property [devnode-bus]
OFDPropertyGetString: could not read property [use_decibel_gain]
OFDPropertyGetString: could not read property [use_sensor_mode_id]
OFDPropertyGetString: could not read property [delayed_gain]
OFDPropertyCopyToLong: could not read property [has-eeprom]
OFDPropertyGetString: could not read property [type]
loadSubType: Sensor type missing in DT, 206
OFDPropertyCopyToLong: could not read property [set_mode_delay_ms]
OFDPropertyCopyToLong: could not read property [mode0.vc_id]
OFDPropertyCopyToLongLong: could not read property [mode0.serdes_pix_clk_hz]
OFDPropertyCopyToLongLong: could not read property [mode0.exp_time_1h]
OFDPropertyCopyToFloat: could not read property [mode0.gain_step_pitch]
OFDPropertyCopyToLong: could not read property [mode0.embedded_metadata_width]
OFDPropertyGetString: could not read property [mode0.x_start]
OFDPropertyGetString: could not read property [mode0.y_start]
OFDPropertyGetString: could not read property [mode0.x_end]
OFDPropertyGetString: could not read property [mode0.y_end]
OFDPropertyGetString: could not read property [mode0.h_scaling]
OFDPropertyGetString: could not read property [mode0.v_scaling]
OFDPropertyGetString: could not read property [sensor_model]
initialize: Loaded Driver: 1 Modes Available--------------
NvPclInitializeDrivers: v4l2_sensor ------------------
NvPclOpen: ----------------------
LSC: LSC surface is not based on full res!
=== gst-launch-1.0[7725]: CameraProvider initialized (0x7fac6d2d50)sourceRegistry[0] assigned

ispRegistry[0] assigned

Using Source GUID 0
Worker thread ViCsiHw frameComplete start
Worker thread ViCsiHw frameStart start
NvPclPowerOn: +++++++++++
NvPclPowerOn: -----------
Using ISP A
NvPHSSendThroughputHints: sensorId=0, m_usecase=4, m_type=2, m_value=4294967295, m_timeout_ms=1000

LSC: LSC surface is not based on full res!
AC plugin not present: dlopen "acplugin.so", acplugin.so: cannot open shared object file: No such file or directory
No library found, disabling AC plugin.
Worker thread CaptureDispatcher start
Session::updatePerfHints()
updatePerfHints(): guid=0ll, CaptureIntent=1
updatePerfHints(): NvCameraCoreUseCase_Preview
NvPHSSendThroughputHints: sensorId=0, m_usecase=4, m_type=1, m_value=30, m_timeout_ms=1000

NvPHSSendThroughputHints: sensorId=0, m_usecase=4, m_type=15, m_value=0, m_timeout_ms=1000

No output buffers for 2
No output buffers for 1
InstructionList:
  + GraphSettings
      | SensorMode: 400x400 BayerS16BGGR 33.0fps
      | output 0: 400x400 BL U8_V8_ER 420SP
      | inputClipRect 0: (0.00,0.00, 1.00,1.00)

  + Instruction List
      | id: 0
      +  0: CCDataSetupStage
          | EstimatedIspOutLatencyFrames: 5
          | NumConcurrentCaptures: 1
          | UnprocessedYuvBufferMask: 0
      +  1: ACSynchronizeStage
      +  2: AeAfApplyStage
      +  3: AcPluginStage
          | operation: opApply
      +  4: AcMergeStage
          | IspIn: [400, 400]
          | IspOut0: [400, 400]
          | IspOut1: [0, 0]
          | IspOut2: [640, 640]
      +  5: StatsBufferAcquireStage
          | Buffer Index: 1
          | BufferRequirements: 640x640 Pitch Y8_ER 420
      +  6: TempBufferAcquireStage
          | Buffer Index: 2
          | BufferRequirements: 400x1 Pitch NonColor8
      +  7: TempBufferAcquireStage
          | Buffer Index: 3
          | BufferRequirements: 524288x1 Pitch NonColor8
      +  8: SensorISPCaptureStage
          | Source GUID: 0
          | Output A Buffer: 0
          | Output Thumb Buffer: 1
          | SensorMetadata Buffer: 2
          | Output IspStats Buffer: 3
      +  9: StatsUpdateStage
          | Output Meta Buffer: 2
          | Output IspStats Buffer: 3
      + 10: BufferReturnStage
          | Output A Buffer: 2
      + 11: BufferReturnStage
          | Output A Buffer: 3
      + 12: AcPluginStage
          | operation: opAnalyze
      + 13: AfAnalysisStage
      + 14: MonitorStage
      + 15: ExifStage
      + 16: MakerNoteStage
      + 17: BufferReturnStage
          | Output A Buffer: 0
      + 18: MetadataReturnStage
      + 19: PerfStatsStage

Session::updatePerfHints()
updatePerfHints(): guid=0ll, CaptureIntent=1
updatePerfHints(): NvCameraCoreUseCase_Preview
Created fiber 0x7f54000b20 for CC 101 globalID 101 session 0
NvPHSSendThroughputHints: sensorId=0, m_usecase=4, m_type=1, m_value=30, m_timeout_ms=1000

NvPHSSendThroughputHints: sensorId=0, m_usecase=4, m_type=15, m_value=0, m_timeout_ms=1000

Thread 1 is working on CC 101 session 0 globalID 101 step 0
Created fiber 0x7f54000dd0 for CC 102 globalID 102 session 0
Thread 2 is working on CC 102 session 0 globalID 102 step 0
CC 102 session 0 stalled step 0 in fiber 0x7f54000dd0
FiberScheduler: cc 102, session 0 fiber 0x7f54000dd0 not ready to execute stalled on 0x7fac7ea250 stage...

Thread 2 getting next capture
Thread 3 is waiting
CC 101 session 0 completed step 0 in fiber 0x7f54000b20
Thread 2 is working on CC 102 session 0 globalID 102 step 0
Session::updatePerfHints()
updatePerfHints(): guid=0ll, CaptureIntent=1
updatePerfHints(): NvCameraCoreUseCase_Preview
NvPHSSendThroughputHints: sensorId=0, m_usecase=4, m_type=1, m_value=30, m_timeout_ms=1000

NvPHSSendThroughputHints: sensorId=0, m_usecase=4, m_type=15, m_value=0, m_timeout_ms=1000

Thread 4 is waiting
cc 101(1) session 0 runCount=0 runIspOut=0, latest ccId=0CC 102 session 0 completed step 0 in fiber 0x7f54000dd0

CC 102 session 0 stalled step 1 in fiber 0x7f54000dd0
CC 101 session 0 completed step 1 in fiber 0x7f54000b20
FiberScheduler: cc 102, session 0 fiber 0x7f54000dd0 not ready to execute stalled on 0x7fac68c970 stage...

Thread 2 getting next capture
Thread 6 is working on CC 102 session 0 globalID 102 step 1
cc 102(2) session 0 runCount=1 runIspOut=0, latest ccId=0
Thread 5 is waiting
NV AE and AfApply algorithms are active.
Thread 2 is waiting
CC 102 session 0 completed step 1 in fiber 0x7f54000dd0
CC 102 session 0 stalled step 2 in fiber 0x7f54000dd0
FiberScheduler: cc 102, session 0 fiber 0x7f54000dd0 not ready to execute stalled on 0x7fac6d42e0 stage...

Thread 6 getting next capture
Thread 6 is waiting
CC 101 session 0 completed step 2 in fiber 0x7f54000b20
Thread 8 is working on CC 102 session 0 globalID 102 step 2
NV AE and AfApply algorithms are active.
Thread 7 is waitingCC 101 session 0 completed step 3 in fiber 0x7f54000b20

CC 102 session 0 completed step 2 in fiber 0x7f54000dd0
CC 102 session 0 completed step 3 in fiber 0x7f54000dd0
CC 102 session 0 stalled step 4 in fiber 0x7f54000dd0
FiberScheduler: cc 102, session 0 fiber 0x7f54000dd0 not ready to execute stalled on 0x7fac6caa80 stage...

Thread 8 getting next captureThread 9 is waiting

Thread 8 is waiting
CC 101 session 0 completed step 4 in fiber 0x7f54000b20
Thread 10 is working on CC 102 session 0 globalID 102 step 4
CC 101 session 0 completed step 5 in fiber 0x7f54000b20
CC 102 session 0 completed step 4 in fiber 0x7f54000dd0
CC 101 session 0 completed step 6 in fiber 0x7f54000b20
CC 102 session 0 completed step 5 in fiber 0x7f54000dd0
CC 102 session 0 completed step 6 in fiber 0x7f54000dd0
CC 101 session 0 completed step 7 in fiber 0x7f54000b20
CC 101 session 0 processing step 8 in fiber 0x7f54000b20
FiberScheduler: cc 101, session 0, fiber 0x7f54000b20 in progress...

Thread 1 getting next capture
Thread 1 is waiting
Thread 11 is waiting
CC 102 session 0 completed step 7 in fiber 0x7f54000dd0
CC 102 session 0 processing step 8 in fiber 0x7f54000dd0
FiberScheduler: cc 102, session 0, fiber 0x7f54000dd0 in progress...

Thread 10 getting next capture
Thread 12 is waiting
Thread 10 is waiting
NvPclSettingsUpdate: Sending Updated Settings through PCL
NvPclSettingsApply: Applying last settings through PCL
apply:+++++++++++++++++++++++
writeMode: Target mode Id(0): Resolution 400x400
writeFrameRate: INPUT frameRate:33.000000
writeGain:      INPUT gainCtrl:a analogGain:1.000000
updateOutputSettings:   OUTPUT frameRate:33.000000
updateOutputSettings:   OUTPUT analogGain:1.000000
apply:-----------------------
NvPclSettingsApply: Reading PCL settings
NvPclSettingsUpdate: Sending Updated Settings through PCL
NvPclSettingsApply: Applying last settings through PCL
apply:+++++++++++++++++++++++
writeFrameRate: INPUT frameRate:30.000002
writeExposure:  INPUT expTime:0.033330
updateOutputSettings:   OUTPUT frameRate:30.000002
updateOutputSettings:   OUTPUT expTime:0.033330
apply:-----------------------
NvPclSettingsApply: Reading PCL settings
PowerServiceHw:addRequest: table size: before: 0, after:1
        request table for ISP 0:
        req[0]: output1 width=320, output1 height=200, output1 Bpp=16
        req[0]: output2 width=320, output2 height=200, output2 Bpp=16
        req[0]: input width=400, input height=400, input Bpp=10
        req[0]: output width=28, output height=28, output Bpp=16
        req[0]: input fps=33
        req[0]: guID=0, stage type=SensorIspCapture
        req[0]: clock=0 Hz, iso bw=42989 KB/s, non-iso bw=0 KB/s
        req[450]: timeout=0
PowerServiceHwIsp:setLaBw: m_bwVal_Iso=42989 and m_bwVal_NonIso=0 KBpS

PowerServiceCore:setCameraBw: totalIsoBw=42989
NvPclSettingsUpdate: Sending Updated Settings through PCL
NvPclSettingsApply: Applying last settings through PCL
apply:+++++++++++++++++++++++
writeFrameRate: INPUT frameRate:33.000000
updateOutputSettings:   OUTPUT frameRate:33.000000
apply:-----------------------
NvPclSettingsApply: Reading PCL settings
NvPclSettingsUpdate: Sending Updated Settings through PCL
NvPclSettingsApply: Applying last settings through PCL
apply:+++++++++++++++++++++++
apply:-----------------------
NvPclSettingsApply: Reading PCL settings
NvPclSettingsUpdate: Sending Updated Settings through PCL
NvPclSettingsApply: Applying last settings through PCL
apply:+++++++++++++++++++++++
writeFrameRate: INPUT frameRate:30.000002
updateOutputSettings:   OUTPUT frameRate:30.000002
apply:-----------------------
NvPclSettingsApply: Reading PCL settings
NvPclSettingsUpdate: Sending Updated Settings through PCL
NvPclSettingsApply: Applying last settings through PCL
apply:+++++++++++++++++++++++
apply:-----------------------
NvPclSettingsApply: Reading PCL settings
PowerServiceHw:addRequest: table size: before: 1, after:2
        request table for ISP 0:
        req[0]: output1 width=320, output1 height=200, output1 Bpp=16
        req[0]: output2 width=320, output2 height=200, output2 Bpp=16
        req[0]: input width=400, input height=400, input Bpp=10
        req[0]: output width=28, output height=28, output Bpp=16
        req[0]: input fps=33
        req[0]: guID=0, stage type=SensorIspCapture
        req[0]: clock=0 Hz, iso bw=42989 KB/s, non-iso bw=0 KB/s
        req[392]: timeout=0
        req[1]: output1 width=320, output1 height=200, output1 Bpp=16
        req[1]: output2 width=640, output2 height=640, output2 Bpp=13
        req[1]: input width=400, input height=400, input Bpp=10
        req[1]: output width=400, output height=400, output Bpp=12
        req[1]: input fps=33
        req[1]: guID=0, stage type=SensorIspCapture
        req[1]: clock=0 Hz, iso bw=70021 KB/s, non-iso bw=0 KB/s
        req[450]: timeout=0
PowerServiceHw:updateRequests: table size: before: 2, after:2
        request table for ISP 0:
        req[0]: output1 width=320, output1 height=200, output1 Bpp=16
        req[0]: output2 width=320, output2 height=200, output2 Bpp=16
        req[0]: input width=400, input height=400, input Bpp=10
        req[0]: output width=28, output height=28, output Bpp=16
        req[0]: input fps=33
        req[0]: guID=0, stage type=SensorIspCapture
        req[0]: clock=0 Hz, iso bw=42989 KB/s, non-iso bw=0 KB/s
        req[390]: timeout=0
        req[1]: output1 width=320, output1 height=200, output1 Bpp=16
        req[1]: output2 width=640, output2 height=640, output2 Bpp=13
        req[1]: input width=400, input height=400, input Bpp=10
        req[1]: output width=400, output height=400, output Bpp=12
        req[1]: input fps=33
        req[1]: guID=0, stage type=SensorIspCapture
        req[1]: clock=0 Hz, iso bw=70021 KB/s, non-iso bw=0 KB/s
        req[448]: timeout=0
PowerServiceHwIsp:setLaBw: m_bwVal_Iso=70021 and m_bwVal_NonIso=0 KBpS

PowerServiceCore:setCameraBw: totalIsoBw=70021
Created fiber 0x7f54000f70 for CC 103 globalID 103 session 0
Thread 3 is working on CC 103 session 0 globalID 103 step 0
CC 103 session 0 completed step 0 in fiber 0x7f54000f70
cc 103(3) session 0 runCount=2 runIspOut=0, latest ccId=0
CC 103 session 0 completed step 1 in fiber 0x7f54000f70
NV AE and AfApply algorithms are active.
Session::updatePerfHints()
updatePerfHints(): guid=0ll, CaptureIntent=1
updatePerfHints(): NvCameraCoreUseCase_Preview
NvPHSSendThroughputHints: sensorId=0, m_usecase=4, m_type=1, m_value=30, m_timeout_ms=1000

NvPHSSendThroughputHints: sensorId=0, m_usecase=4, m_type=15, m_value=0, m_timeout_ms=1000

CC 103 session 0 completed step 2 in fiber 0x7f54000f70
CC 103 session 0 completed step 3 in fiber 0x7f54000f70
CC 103 session 0 completed step 4 in fiber 0x7f54000f70
CC 103 session 0 completed step 5 in fiber 0x7f54000f70
CC 103 session 0 completed step 6 in fiber 0x7f54000f70
CC 103 session 0 completed step 7 in fiber 0x7f54000f70
CC 103 session 0 processing step 8 in fiber 0x7f54000f70
FiberScheduler: cc 103, session 0, fiber 0x7f54000f70 in progress...

Thread 3 getting next capture
Thread 4 is waiting
Thread 3 is waiting
SCF: Error InvalidSize:  (propagating from src/services/capture/NvIspHw.cpp, function startCapture(), line 323)
SCF: Error InvalidSize:  (propagating from src/services/capture/DeviceRecordNv.cpp, function doCSItoISPCapture(), line 97)
SCF: Error InvalidSize:  (propagating from src/services/capture/CaptureRecord.cpp, function doCSItoISPCapture(), line 547)
SCF: Error InvalidSize:  (propagating from src/services/capture/CaptureRecord.cpp, function issueCapture(), line 460)
SCF: Error InvalidSize:  (propagating from src/services/capture/CaptureServiceDevice.cpp, function issueCaptures(), line 1276)
SCF: Error InvalidSize:  (propagating from src/services/capture/CaptureServiceDevice.cpp, function issueCaptures(), line 1107)
SCF: Error OverFlow:  (propagating from src/services/capture/CaptureServiceDevice.cpp, function returnRequestPoolCaptures(), line 1226)
FiberScheduler: cc 101, session 0, fiber 0x7f54000b20 aborted in async operation

Created fiber 0x7f54001110 for CC 104 globalID 104 session 0
Thread 5 is working on CC 104 session 0 globalID 104 step 0
CC 104 session 0 completed step 0 in fiber 0x7f54001110
cc 104(4) session 0 runCount=3 runIspOut=0, latest ccId=0
CC 104 session 0 completed step 1 in fiber 0x7f54001110
NV AE and AfApply algorithms are active.
CC 104 session 0 completed step 2 in fiber 0x7f54001110
CC 104 session 0 completed step 3 in fiber 0x7f54001110
CC 104 session 0 completed step 4 in fiber 0x7f54001110
CC 104 session 0 completed step 5 in fiber 0x7f54001110
CC 104 session 0 completed step 6 in fiber 0x7f54001110
CC 104 session 0 completed step 7 in fiber 0x7f54001110
CC 104 session 0 processing step 8 in fiber 0x7f54001110
FiberScheduler: cc 104, session 0, fiber 0x7f54001110 in progress...

Thread 5 getting next capture
Thread 2 is waiting
Thread 5 is waiting
SCF: Error OverFlow:  (propagating from src/services/capture/CaptureServiceDevice.cpp, function checkCaptureComplete(), line 1198)
SCF: Error OverFlow:  (propagating from src/common/Utils.cpp, function workerThread(), line 116)
SCF: Error OverFlow: Worker thread CaptureScheduler checkFramePending failed (in src/common/Utils.cpp, function workerThread(), line 133)
SCF: Error Timeout:  (propagating from src/api/Buffer.cpp, function waitForUnlock(), line 637)
SCF: Error Timeout:  (propagating from src/components/CaptureContainerImpl.cpp, function returnBuffer(), line 358)
FiberScheduler: fiber 0x7f54000b20 exiting
Session::updatePerfHints()
SCF: Error InvalidSize:  (propagating from src/common/Utils.cpp, function workerThread(), line 116)
updatePerfHints(): guid=0ll, CaptureIntent=1SCF: Error InvalidSize: Worker thread CaptureScheduler frameStart failed (in src/common/Utils.cpp, function workerThread(), line 133)

updatePerfHints(): NvCameraCoreUseCase_Preview
NvPHSSendThroughputHints: sensorId=0, m_usecase=4, m_type=1, m_value=30, m_timeout_ms=1000

NvPHSSendThroughputHints: sensorId=0, m_usecase=4, m_type=15, m_value=0, m_timeout_ms=1000

disposing CC 101 Session 0
SCF: Error Timeout:  (propagating from src/api/Buffer.cpp, function waitForUnlock(), line 637)
SCF: Error Timeout:  (propagating from src/components/CaptureContainerImpl.cpp, function returnBuffer(), line 358)
SCF: Error Timeout:  (propagating from src/api/Buffer.cpp, function waitForUnlock(), line 637)
SCF: Error Timeout:  (propagating from src/components/CaptureContainerImpl.cpp, function returnBuffer(), line 358)
Thread 6 is waiting
SCF: Error Timeout:  (propagating from src/services/capture/CaptureServiceEvent.cpp, function wait(), line 59)
Error: Camera HwEvents wait, this may indicate a hardware timeout occured,abort current/incoming cc
Created fiber 0x7f540012b0 for CC 105 globalID 105 session 0
Thread 7 is working on CC 105 session 0 globalID 105 step 0
Fiber 0x7f540012b0 is aborting in CC 105 Session 0
FiberScheduler: cc 105 session 0, fiber 0x7f540012b0 aborted

FiberScheduler: fiber 0x7f540012b0 exiting
Thread 7 getting next capture
Thread 9 is waiting
Thread 7 is waiting
Thread 8 is waiting

Kernel Trace:

# tracer: nop
#
# entries-in-buffer/entries-written: 1066/1066   #P:4
#
#                              _-----=> irqs-off
#                             / _----=> need-resched
#                            | / _---=> hardirq/softirq
#                            || / _--=> preempt-depth
#                            ||| /     delay
#           TASK-PID   CPU#  ||||    TIMESTAMP  FUNCTION
#              | |       |   ||||       |         |
     kworker/0:3-3224  [000] ....   127.469390: rtos_queue_peek_from_isr_failed: tstamp:4352462364 queue:0x0b4b4500
     kworker/0:3-3224  [000] ....   127.637352: rtos_queue_peek_from_isr_failed: tstamp:4357462370 queue:0x0b4b4500
     kworker/0:3-3224  [000] ....   127.805359: rtos_queue_peek_from_isr_failed: tstamp:4362462376 queue:0x0b4b4500
     kworker/0:3-3224  [000] ....   127.973334: rtos_queue_peek_from_isr_failed: tstamp:4367462383 queue:0x0b4b4500
     kworker/0:3-3224  [000] ....   128.141363: rtos_queue_peek_from_isr_failed: tstamp:4372462390 queue:0x0b4b4500
     kworker/0:3-3224  [000] ....   128.253396: rtos_queue_peek_from_isr_failed: tstamp:4377462396 queue:0x0b4b4500
     kworker/0:3-3224  [000] ....   128.421399: rtos_queue_peek_from_isr_failed: tstamp:4382462403 queue:0x0b4b4500
     kworker/0:3-3224  [000] ....   128.589445: rtos_queue_peek_from_isr_failed: tstamp:4387462507 queue:0x0b4b4500
     kworker/0:3-3224  [000] ....   128.757383: rtos_queue_peek_from_isr_failed: tstamp:4392462417 queue:0x0b4b4500
     kworker/0:3-3224  [000] ....   128.925370: rtos_queue_peek_from_isr_failed: tstamp:4397462424 queue:0x0b4b4500
     kworker/0:3-3224  [000] ....   129.093334: rtos_queue_peek_from_isr_failed: tstamp:4402462432 queue:0x0b4b4500
     kworker/0:3-3224  [000] ....   129.261379: rtos_queue_peek_from_isr_failed: tstamp:4407462437 queue:0x0b4b4500
     kworker/0:3-3224  [000] ....   129.373429: rtos_queue_peek_from_isr_failed: tstamp:4412462442 queue:0x0b4b4500
     kworker/0:3-3224  [000] ....   129.541415: rtos_queue_peek_from_isr_failed: tstamp:4417462453 queue:0x0b4b4500
     kworker/0:3-3224  [000] ....   129.709368: rtos_queue_peek_from_isr_failed: tstamp:4422462459 queue:0x0b4b4500
     kworker/0:3-3224  [000] ....   129.877374: rtos_queue_peek_from_isr_failed: tstamp:4427462467 queue:0x0b4b4500
     kworker/0:3-3224  [000] ....   130.045396: rtos_queue_peek_from_isr_failed: tstamp:4432462473 queue:0x0b4b4500
     kworker/0:3-3224  [000] ....   130.213338: rtos_queue_peek_from_isr_failed: tstamp:4437462478 queue:0x0b4b4500
     kworker/0:3-3224  [000] ....   130.381396: rtos_queue_peek_from_isr_failed: tstamp:4442462485 queue:0x0b4b4500
     kworker/0:3-3224  [000] ....   130.493382: rtos_queue_peek_from_isr_failed: tstamp:4447462492 queue:0x0b4b4500
     kworker/0:3-3224  [000] ....   130.661373: rtos_queue_peek_from_isr_failed: tstamp:4452462500 queue:0x0b4b4500
     kworker/0:3-3224  [000] ....   130.829402: rtos_queue_peek_from_isr_failed: tstamp:4457462506 queue:0x0b4b4500
     kworker/0:3-3224  [000] ....   130.997378: rtos_queue_peek_from_isr_failed: tstamp:4462462514 queue:0x0b4b4500
     kworker/0:3-3224  [000] ....   131.165378: rtos_queue_peek_from_isr_failed: tstamp:4467462525 queue:0x0b4b4500
     kworker/0:3-3224  [000] ....   131.333341: rtos_queue_peek_from_isr_failed: tstamp:4472462524 queue:0x0b4b4500
     kworker/0:3-3224  [000] ....   131.501387: rtos_queue_peek_from_isr_failed: tstamp:4477462533 queue:0x0b4b4500
     kworker/0:3-3224  [000] ....   131.613386: rtos_queue_peek_from_isr_failed: tstamp:4482462540 queue:0x0b4b4500
     kworker/0:3-3224  [000] ....   131.781389: rtos_queue_peek_from_isr_failed: tstamp:4487462546 queue:0x0b4b4500
     kworker/0:3-3224  [000] ....   131.949395: rtos_queue_peek_from_isr_failed: tstamp:4492462552 queue:0x0b4b4500
     kworker/0:3-3224  [000] ....   132.117414: rtos_queue_peek_from_isr_failed: tstamp:4497462562 queue:0x0b4b4500
     kworker/0:3-3224  [000] ....   132.285394: rtos_queue_peek_from_isr_failed: tstamp:4502462568 queue:0x0b4b4500
     kworker/0:3-3224  [000] ....   132.397417: rtos_queue_peek_from_isr_failed: tstamp:4506740674 queue:0x0b4b4500
 gst-plugin-scan-7726  [003] ....   203.013096: tegra_channel_open: vi-output, lys_cam 2-0036
 gst-plugin-scan-7726  [003] ....   203.014128: tegra_channel_set_power: lys_cam 2-0036 : 0x1
 gst-plugin-scan-7726  [003] ....   203.014134: camera_common_s_power: status : 0x1
 gst-plugin-scan-7726  [003] ....   203.028123: tegra_channel_set_power: 150c0000.nvcsi--1 : 0x1
 gst-plugin-scan-7726  [003] ....   203.028127: csi_s_power: enable : 0x1
 gst-plugin-scan-7726  [003] ....   203.029566: tegra_channel_close: vi-output, lys_cam 2-0036
 gst-plugin-scan-7726  [003] ....   203.029569: tegra_channel_set_power: lys_cam 2-0036 : 0x0
 gst-plugin-scan-7726  [003] ....   203.029574: camera_common_s_power: status : 0x0
 gst-plugin-scan-7726  [003] ....   203.035167: tegra_channel_set_power: 150c0000.nvcsi--1 : 0x0
 gst-plugin-scan-7726  [003] ....   203.035170: csi_s_power: enable : 0x0
  nvargus-daemon-7733  [005] ....   203.415326: tegra_channel_open: vi-output, lys_cam 2-0036
  nvargus-daemon-7733  [005] ....   203.415336: tegra_channel_set_power: lys_cam 2-0036 : 0x1
  nvargus-daemon-7733  [005] ....   203.415341: camera_common_s_power: status : 0x1
  nvargus-daemon-7733  [000] ....   203.429466: tegra_channel_set_power: 150c0000.nvcsi--1 : 0x1
  nvargus-daemon-7733  [000] ....   203.429473: csi_s_power: enable : 0x1
  nvargus-daemon-7733  [000] ....   203.429607: tegra_channel_close: vi-output, lys_cam 2-0036
  nvargus-daemon-7733  [000] ....   203.429611: tegra_channel_set_power: lys_cam 2-0036 : 0x0
  nvargus-daemon-7733  [000] ....   203.429614: camera_common_s_power: status : 0x0
  nvargus-daemon-7733  [000] ....   203.435093: tegra_channel_set_power: 150c0000.nvcsi--1 : 0x0
  nvargus-daemon-7733  [000] ....   203.435094: csi_s_power: enable : 0x0
  nvargus-daemon-7733  [000] ....   203.438522: tegra_channel_open: vi-output, lys_cam 2-0036
  nvargus-daemon-7733  [000] ....   203.438528: tegra_channel_set_power: lys_cam 2-0036 : 0x1
  nvargus-daemon-7733  [000] ....   203.438532: camera_common_s_power: status : 0x1
  nvargus-daemon-7733  [000] ....   203.452475: tegra_channel_set_power: 150c0000.nvcsi--1 : 0x1
  nvargus-daemon-7733  [000] ....   203.452478: csi_s_power: enable : 0x1
  nvargus-daemon-7733  [000] ....   203.452569: tegra_channel_close: vi-output, lys_cam 2-0036
  nvargus-daemon-7733  [000] ....   203.452571: tegra_channel_set_power: lys_cam 2-0036 : 0x0
  nvargus-daemon-7733  [000] ....   203.452575: camera_common_s_power: status : 0x0
  nvargus-daemon-7733  [000] ....   203.458043: tegra_channel_set_power: 150c0000.nvcsi--1 : 0x0
  nvargus-daemon-7733  [000] ....   203.458045: csi_s_power: enable : 0x0
  nvargus-daemon-7733  [000] ....   203.471940: tegra_channel_open: vi-output, lys_cam 2-0036
  nvargus-daemon-7733  [000] ....   203.471948: tegra_channel_set_power: lys_cam 2-0036 : 0x1
  nvargus-daemon-7733  [000] ....   203.471954: camera_common_s_power: status : 0x1
  nvargus-daemon-7733  [000] ....   203.486014: tegra_channel_set_power: 150c0000.nvcsi--1 : 0x1
  nvargus-daemon-7733  [000] ....   203.486017: csi_s_power: enable : 0x1
  nvargus-daemon-7733  [000] ....   203.486038: tegra_channel_close: vi-output, lys_cam 2-0036
  nvargus-daemon-7733  [000] ....   203.486041: tegra_channel_set_power: lys_cam 2-0036 : 0x0
  nvargus-daemon-7733  [000] ....   203.486045: camera_common_s_power: status : 0x0
  nvargus-daemon-7733  [000] ....   203.491445: tegra_channel_set_power: 150c0000.nvcsi--1 : 0x0
  nvargus-daemon-7733  [000] ....   203.491447: csi_s_power: enable : 0x0
  nvargus-daemon-7733  [000] ....   203.491707: tegra_channel_open: vi-output, lys_cam 2-0036
  nvargus-daemon-7733  [000] ....   203.491711: tegra_channel_set_power: lys_cam 2-0036 : 0x1
  nvargus-daemon-7733  [000] ....   203.491714: camera_common_s_power: status : 0x1
  nvargus-daemon-7733  [000] ....   203.505622: tegra_channel_set_power: 150c0000.nvcsi--1 : 0x1
  nvargus-daemon-7733  [000] ....   203.505624: csi_s_power: enable : 0x1
  nvargus-daemon-7733  [000] ....   203.505725: tegra_channel_close: vi-output, lys_cam 2-0036
  nvargus-daemon-7733  [000] ....   203.505727: tegra_channel_set_power: lys_cam 2-0036 : 0x0
  nvargus-daemon-7733  [000] ....   203.505731: camera_common_s_power: status : 0x0
  nvargus-daemon-7733  [000] ....   203.511188: tegra_channel_set_power: 150c0000.nvcsi--1 : 0x0
  nvargus-daemon-7733  [000] ....   203.511189: csi_s_power: enable : 0x0
  nvargus-daemon-7733  [000] ....   203.511528: tegra_channel_open: vi-output, lys_cam 2-0036
  nvargus-daemon-7733  [000] ....   203.511532: tegra_channel_set_power: lys_cam 2-0036 : 0x1
  nvargus-daemon-7733  [000] ....   203.511536: camera_common_s_power: status : 0x1
  nvargus-daemon-7733  [000] ....   203.525512: tegra_channel_set_power: 150c0000.nvcsi--1 : 0x1
  nvargus-daemon-7733  [000] ....   203.525515: csi_s_power: enable : 0x1
  nvargus-daemon-7733  [000] ....   203.525601: tegra_channel_close: vi-output, lys_cam 2-0036
  nvargus-daemon-7733  [000] ....   203.525604: tegra_channel_set_power: lys_cam 2-0036 : 0x0
  nvargus-daemon-7733  [000] ....   203.525606: camera_common_s_power: status : 0x0
  nvargus-daemon-7733  [000] ....   203.531614: tegra_channel_set_power: 150c0000.nvcsi--1 : 0x0
  nvargus-daemon-7733  [000] ....   203.531616: csi_s_power: enable : 0x0
     kworker/0:3-3224  [000] ....   203.589901: rtos_queue_peek_from_isr_failed: tstamp:6731099460 queue:0x0b4b4500
     kworker/0:3-3224  [000] ....   203.589905: rtcpu_start: tstamp:6731100353
     kworker/0:3-3224  [000] ....   203.589907: rtos_queue_send_from_isr_failed: tstamp:6731108687 queue:0x0b4a7258
     kworker/0:3-3224  [000] ....   203.589908: rtos_queue_send_from_isr_failed: tstamp:6731108793 queue:0x0b4aad68
     kworker/0:3-3224  [000] ....   203.589908: rtos_queue_send_from_isr_failed: tstamp:6731108901 queue:0x0b4ac998
     kworker/0:3-3224  [000] ....   203.589909: rtos_queue_send_from_isr_failed: tstamp:6731109007 queue:0x0b4ae518
     kworker/0:3-3224  [000] ....   203.589910: rtos_queue_send_from_isr_failed: tstamp:6731109112 queue:0x0b4af2d8
     kworker/0:3-3224  [000] ....   203.589910: rtos_queue_send_from_isr_failed: tstamp:6731109230 queue:0x0b4b0098
     kworker/0:3-3224  [000] ....   203.589911: rtos_queue_send_from_isr_failed: tstamp:6731109336 queue:0x0b4b0e58
     kworker/0:3-3224  [000] ....   203.589912: rtos_queue_send_from_isr_failed: tstamp:6731109440 queue:0x0b4b1c18
     kworker/0:3-3224  [000] ....   203.589913: rtos_queue_send_failed: tstamp:6731109915 queue:0x0b4a7258
 CaptureSchedule-7750  [000] ....   203.704072: tegra_channel_open: vi-output, lys_cam 2-0036
 CaptureSchedule-7750  [000] ....   203.704102: tegra_channel_set_power: lys_cam 2-0036 : 0x1
 CaptureSchedule-7750  [000] ....   203.704107: camera_common_s_power: status : 0x1
 CaptureSchedule-7750  [000] ....   203.718111: tegra_channel_set_power: 150c0000.nvcsi--1 : 0x1
 CaptureSchedule-7750  [000] ....   203.718115: csi_s_power: enable : 0x1
 CaptureSchedule-7750  [000] ....   203.720320: tegra_channel_set_stream: enable : 0x1
 CaptureSchedule-7750  [000] ....   203.721926: tegra_channel_set_stream: 150c0000.nvcsi--1 : 0x1
 CaptureSchedule-7750  [000] ....   203.721929: csi_s_stream: enable : 0x1
 CaptureSchedule-7750  [000] ....   203.721929: tegra_channel_set_stream: lys_cam 2-0036 : 0x1
     kworker/0:3-3224  [000] ....   203.759227: rtos_queue_send_from_isr_failed: tstamp:6735391434 queue:0x0b4a7258
     kworker/0:3-3224  [000] ....   203.759231: rtos_queue_send_from_isr_failed: tstamp:6735391564 queue:0x0b4aad68
     kworker/0:3-3224  [000] ....   203.759232: rtos_queue_send_from_isr_failed: tstamp:6735391670 queue:0x0b4ac998
     kworker/0:3-3224  [000] ....   203.759234: rtos_queue_send_from_isr_failed: tstamp:6735391778 queue:0x0b4ae518
     kworker/0:3-3224  [000] ....   203.759235: rtos_queue_send_from_isr_failed: tstamp:6735391883 queue:0x0b4af2d8
     kworker/0:3-3224  [000] ....   203.759236: rtos_queue_send_from_isr_failed: tstamp:6735391988 queue:0x0b4b0098
     kworker/0:3-3224  [000] ....   203.759238: rtos_queue_send_from_isr_failed: tstamp:6735392092 queue:0x0b4b0e58
     kworker/0:3-3224  [000] ....   203.759239: rtos_queue_send_from_isr_failed: tstamp:6735392195 queue:0x0b4b1c18
     kworker/0:3-3224  [000] ....   203.759242: rtos_queue_send_failed: tstamp:6735392660 queue:0x0b4a7258
     kworker/0:3-3224  [000] ....   203.759243: rtos_queue_send_from_isr_failed: tstamp:6735922675 queue:0x0b4a7258
     kworker/0:3-3224  [000] ....   203.759245: rtos_queue_send_from_isr_failed: tstamp:6735922791 queue:0x0b4aad68
     kworker/0:3-3224  [000] ....   203.759246: rtos_queue_send_from_isr_failed: tstamp:6735922897 queue:0x0b4ac998
     kworker/0:3-3224  [000] ....   203.759247: rtos_queue_send_from_isr_failed: tstamp:6735923010 queue:0x0b4ae518
     kworker/0:3-3224  [000] ....   203.759248: rtos_queue_send_from_isr_failed: tstamp:6735923115 queue:0x0b4af2d8
     kworker/0:3-3224  [000] ....   203.759250: rtos_queue_send_from_isr_failed: tstamp:6735923220 queue:0x0b4b0098
     kworker/0:3-3224  [000] ....   203.759251: rtos_queue_send_from_isr_failed: tstamp:6735923325 queue:0x0b4b0e58
     kworker/0:3-3224  [000] ....   203.759252: rtos_queue_send_from_isr_failed: tstamp:6735923429 queue:0x0b4b1c18
     kworker/0:3-3224  [000] ....   203.759254: rtos_queue_send_failed: tstamp:6735923874 queue:0x0b4a7258
     kworker/0:3-3224  [000] ....   203.759257: rtos_queue_peek_from_isr_failed: tstamp:6736099800 queue:0x0b4b4500
     kworker/0:3-3224  [000] ....   203.925899: rtos_queue_peek_from_isr_failed: tstamp:6741099805 queue:0x0b4b4500
     kworker/0:3-3224  [000] ....   204.094747: rtos_queue_peek_from_isr_failed: tstamp:6746099812 queue:0x0b4b4500
     kworker/0:2-3043  [000] ....   204.209998: rtos_queue_peek_from_isr_failed: tstamp:6751099842 queue:0x0b4b4500
     kworker/0:3-3224  [000] ....   204.321891: rtos_queue_send_from_isr_failed: tstamp:6754097016 queue:0x0b4a7258
     kworker/0:3-3224  [000] ....   204.321895: rtos_queue_send_from_isr_failed: tstamp:6754098035 queue:0x0b4aad68
     kworker/0:3-3224  [000] ....   204.321898: rtos_queue_send_from_isr_failed: tstamp:6754099049 queue:0x0b4ac998
     kworker/0:3-3224  [000] ....   204.321899: rtos_queue_send_from_isr_failed: tstamp:6754100092 queue:0x0b4ae518
     kworker/0:3-3224  [000] ....   204.321900: rtos_queue_send_from_isr_failed: tstamp:6754101103 queue:0x0b4af2d8
     kworker/0:3-3224  [000] ....   204.321901: rtos_queue_send_from_isr_failed: tstamp:6754102117 queue:0x0b4b0098
     kworker/0:3-3224  [000] ....   204.321902: rtos_queue_send_from_isr_failed: tstamp:6754103520 queue:0x0b4b0e58
     kworker/0:3-3224  [000] ....   204.321903: rtos_queue_send_from_isr_failed: tstamp:6754104543 queue:0x0b4b1c18
     kworker/0:3-3224  [000] ....   204.321905: rtos_queue_send_failed: tstamp:6754119347 queue:0x0b4a7258
     kworker/0:3-3224  [000] ....   204.321907: rtcpu_vinotify_event: tstamp:6754236165 tag:ISPBUF_FS channel:0x00 frame:0 vi_tstamp:6754235752 data:0x00000000
     kworker/0:3-3224  [000] ....   204.321908: rtcpu_vinotify_event: tstamp:6754307192 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:6754306799 data:0x00000001
     kworker/0:3-3224  [000] ....   204.377940: rtcpu_vinotify_event: tstamp:6755206859 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:6755205538 data:0x018f0002
     kworker/0:3-3224  [000] ....   204.377949: rtcpu_vinotify_event: tstamp:6755207952 tag:ISPBUF_FE channel:0x00 frame:0 vi_tstamp:6755205833 data:0x00000000
     kworker/0:3-3224  [000] ....   204.377950: rtcpu_vinotify_event: tstamp:6755276138 tag:ISPBUF_FS channel:0x00 frame:0 vi_tstamp:6755275264 data:0x00000000
     kworker/0:3-3224  [000] ....   204.377952: rtcpu_vinotify_event: tstamp:6755347156 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:6755346312 data:0x00000001
     kworker/0:3-3224  [000] ....   204.377958: rtos_queue_peek_from_isr_failed: tstamp:6756099880 queue:0x0b4b4500
     kworker/0:3-3224  [000] ....   204.377959: rtcpu_vinotify_event: tstamp:6756246233 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:6756245051 data:0x018f0002
     kworker/0:3-3224  [000] ....   204.377960: rtcpu_vinotify_event: tstamp:6756247263 tag:ISPBUF_FE channel:0x00 frame:0 vi_tstamp:6756245336 data:0x00000000
     kworker/0:3-3224  [000] ....   204.546110: rtos_queue_peek_from_isr_failed: tstamp:6761100336 queue:0x0b4b4500
     kworker/0:3-3224  [000] ....   204.714139: rtos_queue_peek_from_isr_failed: tstamp:6766100339 queue:0x0b4b4500
     kworker/0:3-3224  [000] ....   204.881998: rtos_queue_peek_from_isr_failed: tstamp:6771100347 queue:0x0b4b4500
     kworker/0:3-3224  [000] ....   205.050011: rtos_queue_peek_from_isr_failed: tstamp:6776100354 queue:0x0b4b4500
     kworker/0:3-3224  [000] ....   205.218044: rtos_queue_peek_from_isr_failed: tstamp:6781100422 queue:0x0b4b4500
     kworker/0:3-3224  [000] ....   205.330062: rtos_queue_peek_from_isr_failed: tstamp:6786100362 queue:0x0b4b4500
     kworker/0:3-3224  [000] ....   205.498010: rtos_queue_peek_from_isr_failed: tstamp:6791100368 queue:0x0b4b4500
     kworker/0:3-3224  [000] ....   205.666077: rtos_queue_peek_from_isr_failed: tstamp:6796100375 queue:0x0b4b4500
     kworker/0:3-3224  [000] ....   205.833995: rtos_queue_peek_from_isr_failed: tstamp:6801100382 queue:0x0b4b4500
     kworker/0:3-3224  [000] ....   206.002022: rtos_queue_peek_from_isr_failed: tstamp:6806100388 queue:0x0b4b4500
     kworker/0:3-3224  [000] ....   206.170033: rtos_queue_peek_from_isr_failed: tstamp:6811100394 queue:0x0b4b4500
  1. From the early trace only receive one frame from the bus. Could you check the trace after add the set mode delay property.

    kworker/0:3-5356 [000] … 168.398578: rtcpu_vinotify_event: tstamp:5631057842 tag:ISPBUF_FS channel:0x00 frame:0 vi_tstamp:5631057429 data:0x00000000
    kworker/0:3-5356 [000] … 168.398621: rtcpu_vinotify_event: tstamp:5631129154 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:5631128477 data:0x00000001
    kworker/0:3-5356 [000] … 168.398627: rtcpu_vinotify_event: tstamp:5632027932 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:5632027216 data:0x018f0002
    kworker/0:3-5356 [000] … 168.398632: rtcpu_vinotify_event: tstamp:5632028081 tag:ISPBUF_FE channel:0x00 frame:0 vi_tstamp:5632027510 data:0x00000000
    kworker/0:3-5356 [000] … 168.398638: rtcpu_vinotify_event: tstamp:5632097594 tag:ISPBUF_FS channel:0x00 frame:0 vi_tstamp:5632096942 data:0x00000000
    kworker/0:3-5356 [000] … 168.454669: rtcpu_vinotify_event: tstamp:5632168634 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:5632167990 data:0x00000001
    kworker/0:3-5356 [000] … 168.454708: rtcpu_vinotify_event: tstamp:5633067472 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:5633066729 data:0x018f0002
    kworker/0:3-5356 [000] … 168.454713: rtcpu_vinotify_event: tstamp:5633067662 tag:ISPBUF_FE channel:0x00 frame:0 vi_tstamp:5633067023 data:0x00000000

  2. Try below command then run the gst command.
    sudo service nvargus-daemon stop
    sudo enableCamInfiniteTimeout=1 nvargus-daemon

Hello,

  1. The previous trace I sent to you was with the set mode delay property added.

  2. When executing nvargus-dameon with enableCamInfiniteTimeout here is the result:

Dameon Log:

=== NVIDIA Libargus Camera Service (0.97.3)=== Listening for connections...=== gst-launch-1.0[8822]: Connection established (7F8F08C1D0)OFParserListModules: module list: /proc/device-tree/tegra-camera-platform/modules/module0
NvPclHwGetModuleList: WARNING: Could not map module to ISP config string
NvPclHwGetModuleList: No module data found
OFParserGetVirtualDevice: virtual device driver node not found in proc device-tree: /proc/device-tree/tegra-virtual-camera-platform/modules/module0/drivernode1
OFParserGetVirtualDevice: virtual device driver node not found in proc device-tree: /proc/device-tree/tegra-virtual-camera-platform/modules/module1/drivernode0
---- imager: No override file found. ----
LSC: LSC surface is not based on full res!
=== gst-launch-1.0[8822]: CameraProvider initialized (0x7f886d2da0)LSC: LSC surface is not based on full res!
SCF: Error InvalidSize:  (propagating from src/services/capture/NvIspHw.cpp, function startCapture(), line 323)
SCF: Error InvalidSize:  (propagating from src/services/capture/DeviceRecordNv.cpp, function doCSItoISPCapture(), line 97)
SCF: Error InvalidSize:  (propagating from src/services/capture/CaptureRecord.cpp, function doCSItoISPCapture(), line 547)
SCF: Error InvalidSize:  (propagating from src/services/capture/CaptureRecord.cpp, function issueCapture(), line 460)
SCF: Error InvalidSize:  (propagating from src/services/capture/CaptureServiceDevice.cpp, function issueCaptures(), line 1276)
SCF: Error InvalidSize:  (propagating from src/services/capture/CaptureServiceDevice.cpp, function issueCaptures(), line 1107)
SCF: Error OverFlow:  (propagating from src/services/capture/CaptureServiceDevice.cpp, function returnRequestPoolCaptures(), line 1226)
SCF: Error OverFlow:  (propagating from src/services/capture/CaptureServiceDevice.cpp, function checkCaptureComplete(), line 1198)
SCF: Error OverFlow:  (propagating from src/common/Utils.cpp, function workerThread(), line 116)
SCF: Error OverFlow: Worker thread CaptureScheduler checkFramePending failed (in src/common/Utils.cpp, function workerThread(), line 133)
SCF: Error Timeout:  (propagating from src/api/Buffer.cpp, function waitForUnlock(), line 637)
SCF: Error Timeout:  (propagating from src/components/CaptureContainerImpl.cpp, function returnBuffer(), line 358)
SCF: Error Timeout:  (propagating from src/api/Buffer.cpp, function waitForUnlock(), line 637)
SCF: Error Timeout:  (propagating from src/components/CaptureContainerImpl.cpp, function returnBuffer(), line 358)
SCF: Error Timeout:  (propagating from src/api/Buffer.cpp, function waitForUnlock(), line 637)
SCF: Error Timeout:  (propagating from src/components/CaptureContainerImpl.cpp, function returnBuffer(), line 358)
SCF: Error InvalidSize:  (propagating from src/common/Utils.cpp, function workerThread(), line 116)
SCF: Error InvalidSize: Worker thread CaptureScheduler frameStart failed (in src/common/Utils.cpp, function workerThread(), line 133)

Kernel Trace:

nvargus-daemon-8829  [000] ....  3019.521898: tegra_channel_open: vi-output, lys_cam 2-0036
  nvargus-daemon-8829  [000] ....  3019.522908: tegra_channel_set_power: lys_cam 2-0036 : 0x1
  nvargus-daemon-8829  [000] ....  3019.522914: camera_common_s_power: status : 0x1
  nvargus-daemon-8829  [000] ....  3019.536917: tegra_channel_set_power: 150c0000.nvcsi--1 : 0x1
  nvargus-daemon-8829  [000] ....  3019.536921: csi_s_power: enable : 0x1
  nvargus-daemon-8829  [000] ....  3019.539911: tegra_channel_close: vi-output, lys_cam 2-0036
  nvargus-daemon-8829  [000] ....  3019.539917: tegra_channel_set_power: lys_cam 2-0036 : 0x0
  nvargus-daemon-8829  [000] ....  3019.539924: camera_common_s_power: status : 0x0
  nvargus-daemon-8829  [000] ....  3019.547457: tegra_channel_set_power: 150c0000.nvcsi--1 : 0x0
  nvargus-daemon-8829  [000] ....  3019.547462: csi_s_power: enable : 0x0
  nvargus-daemon-8829  [000] ....  3019.555691: tegra_channel_open: vi-output, lys_cam 2-0036
  nvargus-daemon-8829  [000] ....  3019.555700: tegra_channel_set_power: lys_cam 2-0036 : 0x1
  nvargus-daemon-8829  [000] ....  3019.555706: camera_common_s_power: status : 0x1
  nvargus-daemon-8829  [000] ....  3019.569939: tegra_channel_set_power: 150c0000.nvcsi--1 : 0x1
  nvargus-daemon-8829  [000] ....  3019.569942: csi_s_power: enable : 0x1
  nvargus-daemon-8829  [000] ....  3019.570036: tegra_channel_close: vi-output, lys_cam 2-0036
  nvargus-daemon-8829  [000] ....  3019.570038: tegra_channel_set_power: lys_cam 2-0036 : 0x0
  nvargus-daemon-8829  [000] ....  3019.570043: camera_common_s_power: status : 0x0
  nvargus-daemon-8829  [000] ....  3019.575572: tegra_channel_set_power: 150c0000.nvcsi--1 : 0x0
  nvargus-daemon-8829  [000] ....  3019.575573: csi_s_power: enable : 0x0
  nvargus-daemon-8829  [000] ....  3019.585308: tegra_channel_open: vi-output, lys_cam 2-0036
  nvargus-daemon-8829  [000] ....  3019.585315: tegra_channel_set_power: lys_cam 2-0036 : 0x1
  nvargus-daemon-8829  [000] ....  3019.585319: camera_common_s_power: status : 0x1
  nvargus-daemon-8829  [000] ....  3019.599323: tegra_channel_set_power: 150c0000.nvcsi--1 : 0x1
  nvargus-daemon-8829  [000] ....  3019.599326: csi_s_power: enable : 0x1
  nvargus-daemon-8829  [000] ....  3019.599350: tegra_channel_close: vi-output, lys_cam 2-0036
  nvargus-daemon-8829  [000] ....  3019.599353: tegra_channel_set_power: lys_cam 2-0036 : 0x0
  nvargus-daemon-8829  [000] ....  3019.599358: camera_common_s_power: status : 0x0
  nvargus-daemon-8829  [000] ....  3019.606832: tegra_channel_set_power: 150c0000.nvcsi--1 : 0x0
  nvargus-daemon-8829  [000] ....  3019.606834: csi_s_power: enable : 0x0
  nvargus-daemon-8829  [000] ....  3019.609039: tegra_channel_open: vi-output, lys_cam 2-0036
  nvargus-daemon-8829  [000] ....  3019.609045: tegra_channel_set_power: lys_cam 2-0036 : 0x1
  nvargus-daemon-8829  [000] ....  3019.609051: camera_common_s_power: status : 0x1
  nvargus-daemon-8829  [000] ....  3019.623131: tegra_channel_set_power: 150c0000.nvcsi--1 : 0x1
  nvargus-daemon-8829  [000] ....  3019.623134: csi_s_power: enable : 0x1
  nvargus-daemon-8829  [000] ....  3019.623247: tegra_channel_close: vi-output, lys_cam 2-0036
  nvargus-daemon-8829  [000] ....  3019.623250: tegra_channel_set_power: lys_cam 2-0036 : 0x0
  nvargus-daemon-8829  [000] ....  3019.623256: camera_common_s_power: status : 0x0
  nvargus-daemon-8829  [000] ....  3019.628769: tegra_channel_set_power: 150c0000.nvcsi--1 : 0x0
  nvargus-daemon-8829  [000] ....  3019.628771: csi_s_power: enable : 0x0
  nvargus-daemon-8829  [000] ....  3019.629098: tegra_channel_open: vi-output, lys_cam 2-0036
  nvargus-daemon-8829  [000] ....  3019.629103: tegra_channel_set_power: lys_cam 2-0036 : 0x1
  nvargus-daemon-8829  [000] ....  3019.629109: camera_common_s_power: status : 0x1
  nvargus-daemon-8829  [000] ....  3019.643203: tegra_channel_set_power: 150c0000.nvcsi--1 : 0x1
  nvargus-daemon-8829  [000] ....  3019.643205: csi_s_power: enable : 0x1
  nvargus-daemon-8829  [000] ....  3019.643307: tegra_channel_close: vi-output, lys_cam 2-0036
  nvargus-daemon-8829  [000] ....  3019.643311: tegra_channel_set_power: lys_cam 2-0036 : 0x0
  nvargus-daemon-8829  [000] ....  3019.643315: camera_common_s_power: status : 0x0
  nvargus-daemon-8829  [000] ....  3019.648884: tegra_channel_set_power: 150c0000.nvcsi--1 : 0x0
  nvargus-daemon-8829  [000] ....  3019.648887: csi_s_power: enable : 0x0
     kworker/0:0-8804  [000] ....  3019.708183: rtos_queue_peek_from_isr_failed: tstamp:94734599808 queue:0x0b4b4500
     kworker/0:0-8804  [000] ....  3019.708187: rtcpu_start: tstamp:94734601264
     kworker/0:0-8804  [000] ....  3019.708189: rtos_queue_send_from_isr_failed: tstamp:94734610269 queue:0x0b4a7258
     kworker/0:0-8804  [000] ....  3019.708189: rtos_queue_send_from_isr_failed: tstamp:94734610377 queue:0x0b4aad68
     kworker/0:0-8804  [000] ....  3019.708191: rtos_queue_send_from_isr_failed: tstamp:94734610483 queue:0x0b4ac998
     kworker/0:0-8804  [000] ....  3019.708192: rtos_queue_send_from_isr_failed: tstamp:94734610591 queue:0x0b4ae518
     kworker/0:0-8804  [000] ....  3019.708193: rtos_queue_send_from_isr_failed: tstamp:94734610696 queue:0x0b4af2d8
     kworker/0:0-8804  [000] ....  3019.708193: rtos_queue_send_from_isr_failed: tstamp:94734610801 queue:0x0b4b0098
     kworker/0:0-8804  [000] ....  3019.708194: rtos_queue_send_from_isr_failed: tstamp:94734610906 queue:0x0b4b0e58
     kworker/0:0-8804  [000] ....  3019.708195: rtos_queue_send_from_isr_failed: tstamp:94734611011 queue:0x0b4b1c18
     kworker/0:0-8804  [000] ....  3019.708197: rtos_queue_send_failed: tstamp:94734611492 queue:0x0b4a7258
 CaptureSchedule-8846  [004] ....  3019.783872: tegra_channel_open: vi-output, lys_cam 2-0036
 CaptureSchedule-8846  [004] ....  3019.783880: tegra_channel_set_power: lys_cam 2-0036 : 0x1
 CaptureSchedule-8846  [004] ....  3019.783886: camera_common_s_power: status : 0x1
 CaptureSchedule-8846  [003] ....  3019.797913: tegra_channel_set_power: 150c0000.nvcsi--1 : 0x1
 CaptureSchedule-8846  [003] ....  3019.797917: csi_s_power: enable : 0x1
 CaptureSchedule-8846  [000] ....  3019.799151: tegra_channel_set_stream: enable : 0x1
 CaptureSchedule-8846  [003] ....  3019.800634: tegra_channel_set_stream: 150c0000.nvcsi--1 : 0x1
 CaptureSchedule-8846  [003] ....  3019.800636: csi_s_stream: enable : 0x1
 CaptureSchedule-8846  [003] ....  3019.800637: tegra_channel_set_stream: lys_cam 2-0036 : 0x1
     kworker/0:0-8804  [000] ....  3019.824170: rtos_queue_send_from_isr_failed: tstamp:94737900231 queue:0x0b4a7258
     kworker/0:0-8804  [000] ....  3019.824172: rtos_queue_send_from_isr_failed: tstamp:94737900359 queue:0x0b4aad68
     kworker/0:0-8804  [000] ....  3019.824173: rtos_queue_send_from_isr_failed: tstamp:94737900466 queue:0x0b4ac998
     kworker/0:0-8804  [000] ....  3019.824174: rtos_queue_send_from_isr_failed: tstamp:94737900572 queue:0x0b4ae518
     kworker/0:0-8804  [000] ....  3019.824174: rtos_queue_send_from_isr_failed: tstamp:94737900677 queue:0x0b4af2d8
     kworker/0:0-8804  [000] ....  3019.824175: rtos_queue_send_from_isr_failed: tstamp:94737900781 queue:0x0b4b0098
     kworker/0:0-8804  [000] ....  3019.824176: rtos_queue_send_from_isr_failed: tstamp:94737900884 queue:0x0b4b0e58
     kworker/0:0-8804  [000] ....  3019.824176: rtos_queue_send_from_isr_failed: tstamp:94737900988 queue:0x0b4b1c18
     kworker/0:0-8804  [000] ....  3019.824178: rtos_queue_send_failed: tstamp:94737901468 queue:0x0b4a7258
     kworker/0:0-8804  [000] ....  3019.824178: rtos_queue_send_from_isr_failed: tstamp:94738396602 queue:0x0b4a7258
     kworker/0:0-8804  [000] ....  3019.824179: rtos_queue_send_from_isr_failed: tstamp:94738396722 queue:0x0b4aad68
     kworker/0:0-8804  [000] ....  3019.824179: rtos_queue_send_from_isr_failed: tstamp:94738396830 queue:0x0b4ac998
     kworker/0:0-8804  [000] ....  3019.824180: rtos_queue_send_from_isr_failed: tstamp:94738396936 queue:0x0b4ae518
     kworker/0:0-8804  [000] ....  3019.824181: rtos_queue_send_from_isr_failed: tstamp:94738397041 queue:0x0b4af2d8
     kworker/0:0-8804  [000] ....  3019.824181: rtos_queue_send_from_isr_failed: tstamp:94738397146 queue:0x0b4b0098
     kworker/0:0-8804  [000] ....  3019.824182: rtos_queue_send_from_isr_failed: tstamp:94738397272 queue:0x0b4b0e58
     kworker/0:0-8804  [000] ....  3019.824183: rtos_queue_send_from_isr_failed: tstamp:94738397377 queue:0x0b4b1c18
     kworker/0:0-8804  [000] ....  3019.824183: rtos_queue_send_failed: tstamp:94738397840 queue:0x0b4a7258
     kworker/0:0-8804  [000] ....  3019.876183: rtos_queue_peek_from_isr_failed: tstamp:94739600192 queue:0x0b4b4500
     kworker/0:0-8804  [000] ....  3020.044281: rtos_queue_peek_from_isr_failed: tstamp:94744600218 queue:0x0b4b4500
     kworker/0:0-8804  [000] ....  3020.216080: rtos_queue_peek_from_isr_failed: tstamp:94749600186 queue:0x0b4b4500
     kworker/0:0-8804  [000] ....  3020.324202: rtos_queue_peek_from_isr_failed: tstamp:94754600192 queue:0x0b4b4500
     kworker/0:0-8804  [000] ....  3020.380185: rtos_queue_send_from_isr_failed: tstamp:94755692783 queue:0x0b4a7258
     kworker/0:0-8804  [000] ....  3020.380188: rtos_queue_send_from_isr_failed: tstamp:94755693802 queue:0x0b4aad68
     kworker/0:0-8804  [000] ....  3020.380189: rtos_queue_send_from_isr_failed: tstamp:94755694823 queue:0x0b4ac998
     kworker/0:0-8804  [000] ....  3020.380189: rtos_queue_send_from_isr_failed: tstamp:94755695868 queue:0x0b4ae518
     kworker/0:0-8804  [000] ....  3020.380190: rtos_queue_send_from_isr_failed: tstamp:94755696885 queue:0x0b4af2d8
     kworker/0:0-8804  [000] ....  3020.380191: rtos_queue_send_from_isr_failed: tstamp:94755697903 queue:0x0b4b0098
     kworker/0:0-8804  [000] ....  3020.380192: rtos_queue_send_from_isr_failed: tstamp:94755698919 queue:0x0b4b0e58
     kworker/0:0-8804  [000] ....  3020.380193: rtos_queue_send_from_isr_failed: tstamp:94755699937 queue:0x0b4b1c18
     kworker/0:0-8804  [000] ....  3020.380194: rtos_queue_send_failed: tstamp:94755714130 queue:0x0b4a7258
     kworker/0:0-8804  [000] ....  3020.380196: rtcpu_vinotify_event: tstamp:94755724773 tag:CSIMUX_STREAM channel:0xff frame:0 vi_tstamp:94755723828 data:0x00000001
     kworker/0:0-8804  [000] ....  3020.436216: rtcpu_vinotify_event: tstamp:94756692689 tag:ISPBUF_FS channel:0x00 frame:0 vi_tstamp:94756692283 data:0x00000000
     kworker/0:0-8804  [000] ....  3020.436224: rtcpu_vinotify_event: tstamp:94756764211 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:94756763332 data:0x00000001
     kworker/0:0-8804  [000] ....  3020.436226: rtcpu_vinotify_event: tstamp:94757663383 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:94757662070 data:0x018f0002
     kworker/0:0-8804  [000] ....  3020.436227: rtcpu_vinotify_event: tstamp:94757664442 tag:ISPBUF_FE channel:0x00 frame:0 vi_tstamp:94757662365 data:0x00000000
     kworker/0:0-8804  [000] ....  3020.436229: rtcpu_vinotify_event: tstamp:94757732637 tag:ISPBUF_FS channel:0x00 frame:0 vi_tstamp:94757731796 data:0x00000000
     kworker/0:0-8804  [000] ....  3020.436232: rtcpu_vinotify_event: tstamp:94757803689 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:94757802844 data:0x00000001
     kworker/0:0-8804  [000] ....  3020.492455: rtcpu_vinotify_event: tstamp:94758702914 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:94758701583 data:0x018f0002
     kworker/0:0-8804  [000] ....  3020.492495: rtcpu_vinotify_event: tstamp:94758704059 tag:ISPBUF_FE channel:0x00 frame:0 vi_tstamp:94758701869 data:0x00000000
     kworker/0:0-8804  [000] ....  3020.492542: rtos_queue_peek_from_isr_failed: tstamp:94759600234 queue:0x0b4b4500
     kworker/0:0-8804  [000] ....  3020.660365: rtos_queue_peek_from_isr_failed: tstamp:94764600704 queue:0x0b4b4500
     kworker/0:0-8804  [000] ....  3020.828430: rtos_queue_peek_from_isr_failed: tstamp:94769600714 queue:0x0b4b4500
     kworker/0:0-8804  [000] ....  3020.996356: rtos_queue_peek_from_isr_failed: tstamp:94774600720 queue:0x0b4b4500
     kworker/0:0-8804  [000] ....  3021.164537: rtos_queue_peek_from_isr_failed: tstamp:94779600728 queue:0x0b4b4500
     kworker/0:0-8804  [000] ....  3021.332381: rtos_queue_peek_from_isr_failed: tstamp:94784600734 queue:0x0b4b4500
     kworker/0:0-8804  [000] ....  3021.444370: rtos_queue_peek_from_isr_failed: tstamp:94789600741 queue:0x0b4b4500
     kworker/0:0-8804  [000] ....  3021.612326: rtos_queue_peek_from_isr_failed: tstamp:94794600808 queue:0x0b4b4500
     kworker/0:0-8804  [000] ....  3021.780330: rtos_queue_peek_from_isr_failed: tstamp:94799600748 queue:0x0b4b4500
     kworker/0:0-8804  [000] ....  3021.948381: rtos_queue_peek_from_isr_failed: tstamp:94804600756 queue:0x0b4b4500
  1. Modify the sensor driver to set the set gain/exposure/frame rat function as dummy to align with v4l2-ctl command.
  2. Try the discontinuous_clk to opposite
  1. We have such dummy functions for gain/exposure/frame rate in our driver from the beginning. These functions just return 0 without any log. The functions will always be dummy since we don’t want gstreamer to try to set these parameters as we handle them from our application in userland (gain/exposure) or they are fixed (our camera only support 30fps).

  2. Currently the discontinuous_clk is set on “no”. I just tested with “yes” and no change in the logs or traces.

Have a confirm it can get frame data continuous by below command. Also check the trace.

v4l2-ctl -d /dev/video0 --set-fmt-video=width=400,height=400,pixelformat=RG10 --set-ctrl bypass_mode=0 --stream-mmap --stream-count=100

It works.

Output from v4l2-ctl:

<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 30.09 fps
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 30.19 fps
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 30.13 fps
<<<<<<<<

Kernel Trace:

# tracer: nop
#
# entries-in-buffer/entries-written: 735/735   #P:4
#
#                              _-----=> irqs-off
#                             / _----=> need-resched
#                            | / _---=> hardirq/softirq
#                            || / _--=> preempt-depth
#                            ||| /     delay
#           TASK-PID   CPU#  ||||    TIMESTAMP  FUNCTION
#              | |       |   ||||       |         |
        v4l2-ctl-8189  [005] ....  1151.343291: tegra_channel_open: vi-output, lys_cam 2-0036
        v4l2-ctl-8189  [003] ....  1151.344544: tegra_channel_set_power: lys_cam 2-0036 : 0x1
        v4l2-ctl-8189  [003] ....  1151.344559: camera_common_s_power: status : 0x1
        v4l2-ctl-8189  [000] ....  1151.359019: tegra_channel_set_power: 150c0000.nvcsi--1 : 0x1
        v4l2-ctl-8189  [000] ....  1151.359033: csi_s_power: enable : 0x1
        v4l2-ctl-8189  [004] ....  1151.371633: tegra_channel_capture_setup: vnc_id 0 W 400 H 400 fmt 20
 vi-output, lys_-8190  [003] ....  1151.371966: tegra_channel_set_stream: enable : 0x1
 vi-output, lys_-8190  [004] ....  1151.376019: tegra_channel_set_stream: 150c0000.nvcsi--1 : 0x1
 vi-output, lys_-8190  [004] ....  1151.376022: csi_s_stream: enable : 0x1
 vi-output, lys_-8190  [004] ....  1151.376051: tegra_channel_set_stream: lys_cam 2-0036 : 0x1
     kworker/4:2-4275  [004] ....  1151.408192: rtos_queue_peek_from_isr_failed: tstamp:36350178210 queue:0x0b4b4500
     kworker/4:2-4275  [004] ....  1151.408197: rtcpu_start: tstamp:36350181380
     kworker/4:2-4275  [004] ....  1151.408201: rtos_queue_send_from_isr_failed: tstamp:36350241498 queue:0x0b4a7258
     kworker/4:2-4275  [004] ....  1151.408202: rtos_queue_send_from_isr_failed: tstamp:36350241674 queue:0x0b4aad68
     kworker/4:2-4275  [004] ....  1151.408203: rtos_queue_send_from_isr_failed: tstamp:36350241853 queue:0x0b4ac998
     kworker/4:2-4275  [004] ....  1151.408204: rtos_queue_send_from_isr_failed: tstamp:36350242030 queue:0x0b4ae518
     kworker/4:2-4275  [004] ....  1151.408205: rtos_queue_send_from_isr_failed: tstamp:36350242209 queue:0x0b4af2d8
     kworker/4:2-4275  [004] ....  1151.408206: rtos_queue_send_from_isr_failed: tstamp:36350242382 queue:0x0b4b0098
     kworker/4:2-4275  [004] ....  1151.408207: rtos_queue_send_from_isr_failed: tstamp:36350242563 queue:0x0b4b0e58
     kworker/4:2-4275  [004] ....  1151.408208: rtos_queue_send_from_isr_failed: tstamp:36350242735 queue:0x0b4b1c18
     kworker/4:2-4275  [004] ....  1151.408212: rtos_queue_send_failed: tstamp:36350243650 queue:0x0b4a7258
     kworker/4:2-4275  [004] ....  1151.408213: rtos_queue_send_from_isr_failed: tstamp:36350250358 queue:0x0b4a7258
     kworker/4:2-4275  [004] ....  1151.408214: rtos_queue_send_from_isr_failed: tstamp:36350250567 queue:0x0b4aad68
     kworker/4:2-4275  [004] ....  1151.408215: rtos_queue_send_from_isr_failed: tstamp:36350250746 queue:0x0b4ac998
     kworker/4:2-4275  [004] ....  1151.408216: rtos_queue_send_from_isr_failed: tstamp:36350250922 queue:0x0b4ae518
     kworker/4:2-4275  [004] ....  1151.408217: rtos_queue_send_from_isr_failed: tstamp:36350251100 queue:0x0b4af2d8
     kworker/4:2-4275  [004] ....  1151.408218: rtos_queue_send_from_isr_failed: tstamp:36350251275 queue:0x0b4b0098
     kworker/4:2-4275  [004] ....  1151.408220: rtos_queue_send_from_isr_failed: tstamp:36350251455 queue:0x0b4b0e58
     kworker/4:2-4275  [004] ....  1151.408221: rtos_queue_send_from_isr_failed: tstamp:36350251629 queue:0x0b4b1c18
     kworker/4:2-4275  [004] ....  1151.408222: rtos_queue_send_failed: tstamp:36350253512 queue:0x0b4a7258
     kworker/4:2-4275  [004] ....  1151.576224: rtos_queue_peek_from_isr_failed: tstamp:36355178554 queue:0x0b4b4500
     kworker/4:2-4275  [004] ....  1151.692167: rtos_queue_peek_from_isr_failed: tstamp:36360178560 queue:0x0b4b4500
     kworker/4:2-4275  [004] ....  1151.860177: rtos_queue_peek_from_isr_failed: tstamp:36365178565 queue:0x0b4b4500
 vi-output, lys_-8190  [005] ....  1151.876354: tegra_channel_capture_frame: sof:1151.764128947
 vi-output, lys_-8190  [005] ....  1151.909672: tegra_channel_capture_frame: sof:1151.797393331
     kworker/4:2-4275  [004] ....  1151.916307: rtcpu_vinotify_event: tstamp:36366028726 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:36366028220 data:0x00000001
     kworker/4:2-4275  [004] ....  1151.916313: rtcpu_vinotify_event: tstamp:36366028888 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:36366028275 data:0x00000000
     kworker/4:2-4275  [004] ....  1151.916315: rtcpu_vinotify_event: tstamp:36366031732 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:36366031365 data:0x08000000
     kworker/4:2-4275  [004] ....  1151.916318: rtcpu_vinotify_event: tstamp:36366927710 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:36366926967 data:0x018f0002
     kworker/4:2-4275  [004] ....  1151.916320: rtcpu_vinotify_event: tstamp:36366927901 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:36366927255 data:0x00000000
     kworker/4:2-4275  [004] ....  1151.916323: rtcpu_vinotify_event: tstamp:36367068247 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:36367067732 data:0x00000001
     kworker/4:2-4275  [004] ....  1151.916325: rtcpu_vinotify_event: tstamp:36367068453 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:36367067780 data:0x00000000
     kworker/4:2-4275  [004] ....  1151.916327: rtcpu_vinotify_event: tstamp:36367072871 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:36367072490 data:0x08000000
 vi-output, lys_-8190  [005] ....  1151.942990: tegra_channel_capture_frame: sof:1151.830657459
     kworker/4:2-4275  [004] ....  1151.972290: rtcpu_vinotify_event: tstamp:36367967218 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:36367966471 data:0x018f0002
     kworker/4:2-4275  [004] ....  1151.972297: rtcpu_vinotify_event: tstamp:36367967408 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:36367966759 data:0x00000000
     kworker/4:2-4275  [004] ....  1151.972299: rtcpu_vinotify_event: tstamp:36368107771 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:36368107236 data:0x00000001
     kworker/4:2-4275  [004] ....  1151.972302: rtcpu_vinotify_event: tstamp:36368108015 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:36368107292 data:0x00000000
     kworker/4:2-4275  [004] ....  1151.972304: rtcpu_vinotify_event: tstamp:36368114139 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:36368113740 data:0x08000000
     kworker/4:2-4275  [004] ....  1151.972306: rtcpu_vinotify_event: tstamp:36369006720 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:36369005975 data:0x018f0002
     kworker/4:2-4275  [004] ....  1151.972308: rtcpu_vinotify_event: tstamp:36369006903 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:36369006272 data:0x00000000
 vi-output, lys_-8190  [005] ....  1151.976418: tegra_channel_capture_frame: sof:1151.863921843
 vi-output, lys_-8190  [005] ....  1152.009634: tegra_channel_capture_frame: sof:1151.897185971
     kworker/4:2-4275  [004] ....  1152.028276: rtcpu_vinotify_event: tstamp:36369147298 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:36369146748 data:0x00000001
     kworker/4:2-4275  [004] ....  1152.028282: rtcpu_vinotify_event: tstamp:36369147562 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:36369146795 data:0x00000000
     kworker/4:2-4275  [004] ....  1152.028284: rtcpu_vinotify_event: tstamp:36369158723 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:36369158325 data:0x08000000
     kworker/4:2-4275  [004] ....  1152.028286: rtcpu_vinotify_event: tstamp:36370046233 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:36370045487 data:0x018f0002
     kworker/4:2-4275  [004] ....  1152.028289: rtcpu_vinotify_event: tstamp:36370046422 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:36370045775 data:0x00000000
     kworker/4:2-4275  [004] ....  1152.028294: rtos_queue_peek_from_isr_failed: tstamp:36370178611 queue:0x0b4b4500
     kworker/4:2-4275  [004] ....  1152.028298: rtcpu_vinotify_event: tstamp:36370186794 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:36370186252 data:0x00000001
     kworker/4:2-4275  [004] ....  1152.028300: rtcpu_vinotify_event: tstamp:36370187039 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:36370186308 data:0x00000000
     kworker/4:2-4275  [004] ....  1152.028302: rtcpu_vinotify_event: tstamp:36370196729 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:36370196330 data:0x08000000
 vi-output, lys_-8190  [005] ....  1152.042874: tegra_channel_capture_frame: sof:1151.930450387
 vi-output, lys_-8190  [005] ....  1152.076130: tegra_channel_capture_frame: sof:1151.963714483
     kworker/4:2-4275  [004] ....  1152.084279: rtcpu_vinotify_event: tstamp:36371085733 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:36371084991 data:0x018f0002
     kworker/4:2-4275  [004] ....  1152.084284: rtcpu_vinotify_event: tstamp:36371085916 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:36371085287 data:0x00000000
     kworker/4:2-4275  [004] ....  1152.084286: rtcpu_vinotify_event: tstamp:36371226312 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:36371225765 data:0x00000001
     kworker/4:2-4275  [004] ....  1152.084289: rtcpu_vinotify_event: tstamp:36371226577 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:36371225812 data:0x00000000
     kworker/4:2-4275  [004] ....  1152.084291: rtcpu_vinotify_event: tstamp:36371235489 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:36371235070 data:0x08000000
     kworker/4:2-4275  [004] ....  1152.084293: rtcpu_vinotify_event: tstamp:36372125248 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:36372124504 data:0x018f0002
     kworker/4:2-4275  [004] ....  1152.084295: rtcpu_vinotify_event: tstamp:36372125439 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:36372124791 data:0x00000000
     kworker/4:2-4275  [004] ....  1152.084298: rtcpu_vinotify_event: tstamp:36372265807 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:36372265268 data:0x00000001
     kworker/4:2-4275  [004] ....  1152.084300: rtcpu_vinotify_event: tstamp:36372266052 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:36372265315 data:0x00000000
     kworker/4:2-4275  [004] ....  1152.084302: rtcpu_vinotify_event: tstamp:36372281831 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:36372281419 data:0x08000000
 vi-output, lys_-8190  [005] ....  1152.109421: tegra_channel_capture_frame: sof:1151.996978611
     kworker/4:2-4275  [004] ....  1152.140265: rtcpu_vinotify_event: tstamp:36373164744 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:36373164007 data:0x018f0002
     kworker/4:2-4275  [004] ....  1152.140270: rtcpu_vinotify_event: tstamp:36373164928 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:36373164304 data:0x00000000
     kworker/4:2-4275  [004] ....  1152.140273: rtcpu_vinotify_event: tstamp:36373305366 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:36373304772 data:0x00000001
     kworker/4:2-4275  [004] ....  1152.140276: rtcpu_vinotify_event: tstamp:36373305631 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:36373304828 data:0x00000000
     kworker/4:2-4275  [004] ....  1152.140278: rtcpu_vinotify_event: tstamp:36373315076 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:36373314675 data:0x08000000
     kworker/4:2-4275  [004] ....  1152.140280: rtcpu_vinotify_event: tstamp:36374204258 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:36374203519 data:0x018f0002
     kworker/4:2-4275  [004] ....  1152.140282: rtcpu_vinotify_event: tstamp:36374204448 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:36374203807 data:0x00000000
 vi-output, lys_-8190  [005] ....  1152.142656: tegra_channel_capture_frame: sof:1152.30242995
 vi-output, lys_-8190  [005] ....  1152.175917: tegra_channel_capture_frame: sof:1152.63507123
     kworker/4:2-4275  [004] ....  1152.196264: rtcpu_vinotify_event: tstamp:36374344831 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:36374344284 data:0x00000001
     kworker/4:2-4275  [004] ....  1152.196269: rtcpu_vinotify_event: tstamp:36374345075 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:36374344332 data:0x00000000
     kworker/4:2-4275  [004] ....  1152.196271: rtcpu_vinotify_event: tstamp:36374353677 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:36374353266 data:0x08000000
     kworker/4:2-4275  [004] ....  1152.196276: rtos_queue_peek_from_isr_failed: tstamp:36375178630 queue:0x0b4b4500
     kworker/4:2-4275  [004] ....  1152.196278: rtcpu_vinotify_event: tstamp:36375243767 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:36375243023 data:0x018f0002
     kworker/4:2-4275  [004] ....  1152.196280: rtcpu_vinotify_event: tstamp:36375243951 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:36375243311 data:0x00000000
     kworker/4:2-4275  [004] ....  1152.196282: rtcpu_vinotify_event: tstamp:36375384336 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:36375383788 data:0x00000001
     kworker/4:2-4275  [004] ....  1152.196285: rtcpu_vinotify_event: tstamp:36375384601 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:36375383844 data:0x00000000
     kworker/4:2-4275  [004] ....  1152.196287: rtcpu_vinotify_event: tstamp:36375393100 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:36375392681 data:0x08000000
 vi-output, lys_-8190  [005] ....  1152.209190: tegra_channel_capture_frame: sof:1152.96771507
 vi-output, lys_-8190  [005] ....  1152.242445: tegra_channel_capture_frame: sof:1152.130035635
     kworker/4:2-4275  [004] ....  1152.252261: rtcpu_vinotify_event: tstamp:36376283274 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:36376282536 data:0x018f0002
     kworker/4:2-4275  [004] ....  1152.252267: rtcpu_vinotify_event: tstamp:36376283463 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:36376282824 data:0x00000000
     kworker/4:2-4275  [004] ....  1152.252269: rtcpu_vinotify_event: tstamp:36376423855 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:36376423300 data:0x00000001
     kworker/4:2-4275  [004] ....  1152.252272: rtcpu_vinotify_event: tstamp:36376424099 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:36376423347 data:0x00000000
     kworker/4:2-4275  [004] ....  1152.252274: rtcpu_vinotify_event: tstamp:36376432849 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:36376432451 data:0x08000000
     kworker/4:2-4275  [004] ....  1152.252276: rtcpu_vinotify_event: tstamp:36377322786 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:36377322039 data:0x018f0002
     kworker/4:2-4275  [004] ....  1152.252279: rtcpu_vinotify_event: tstamp:36377322970 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:36377322327 data:0x00000000
     kworker/4:2-4275  [004] ....  1152.252281: rtcpu_vinotify_event: tstamp:36377463351 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:36377462804 data:0x00000001
     kworker/4:2-4275  [004] ....  1152.252283: rtcpu_vinotify_event: tstamp:36377463607 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:36377462860 data:0x00000000
     kworker/4:2-4275  [004] ....  1152.252285: rtcpu_vinotify_event: tstamp:36377472070 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:36377471658 data:0x08000000
 vi-output, lys_-8190  [005] ....  1152.275712: tegra_channel_capture_frame: sof:1152.163300051
     kworker/4:2-4275  [004] ....  1152.308237: rtcpu_vinotify_event: tstamp:36378362287 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:36378361543 data:0x018f0002
     kworker/4:2-4275  [004] ....  1152.308243: rtcpu_vinotify_event: tstamp:36378362477 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:36378361840 data:0x00000000
     kworker/4:2-4275  [004] ....  1152.308245: rtcpu_vinotify_event: tstamp:36378502864 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:36378502317 data:0x00000001
     kworker/4:2-4275  [004] ....  1152.308247: rtcpu_vinotify_event: tstamp:36378503109 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:36378502364 data:0x00000000
     kworker/4:2-4275  [004] ....  1152.308249: rtcpu_vinotify_event: tstamp:36378511667 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:36378511253 data:0x08000000
     kworker/4:2-4275  [004] ....  1152.308251: rtcpu_vinotify_event: tstamp:36379401801 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:36379401056 data:0x018f0002
     kworker/4:2-4275  [004] ....  1152.308254: rtcpu_vinotify_event: tstamp:36379401983 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:36379401343 data:0x00000000
 vi-output, lys_-8190  [005] ....  1152.309033: tegra_channel_capture_frame: sof:1152.196564147
 vi-output, lys_-8190  [005] ....  1152.342257: tegra_channel_capture_frame: sof:1152.229828563
     kworker/4:2-4275  [004] ....  1152.364274: rtcpu_vinotify_event: tstamp:36379542369 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:36379541820 data:0x00000001
     kworker/4:2-4275  [004] ....  1152.364279: rtcpu_vinotify_event: tstamp:36379542632 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:36379541876 data:0x00000000
     kworker/4:2-4275  [004] ....  1152.364282: rtcpu_vinotify_event: tstamp:36379552993 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:36379552574 data:0x08000000
     kworker/4:2-4275  [004] ....  1152.364286: rtos_queue_peek_from_isr_failed: tstamp:36380178625 queue:0x0b4b4500
     kworker/4:2-4275  [004] ....  1152.364288: rtcpu_vinotify_event: tstamp:36380441303 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:36380440560 data:0x018f0002
     kworker/4:2-4275  [004] ....  1152.364290: rtcpu_vinotify_event: tstamp:36380441487 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:36380440856 data:0x00000000
     kworker/4:2-4275  [004] ....  1152.364292: rtcpu_vinotify_event: tstamp:36380581881 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:36380581333 data:0x00000001
     kworker/4:2-4275  [004] ....  1152.364295: rtcpu_vinotify_event: tstamp:36380582124 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:36380581380 data:0x00000000
     kworker/4:2-4275  [004] ....  1152.364301: rtcpu_vinotify_event: tstamp:36380591256 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:36380590842 data:0x08000000
 vi-output, lys_-8190  [005] ....  1152.375508: tegra_channel_capture_frame: sof:1152.263092691
 vi-output, lys_-8190  [005] ....  1152.408775: tegra_channel_capture_frame: sof:1152.296356787
     kworker/4:2-4275  [004] ....  1152.420271: rtcpu_vinotify_event: tstamp:36381480826 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:36381480071 data:0x018f0002
     kworker/4:2-4275  [004] ....  1152.420277: rtcpu_vinotify_event: tstamp:36381481007 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:36381480359 data:0x00000000
     kworker/4:2-4275  [004] ....  1152.420279: rtcpu_vinotify_event: tstamp:36381621384 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:36381620837 data:0x00000001
     kworker/4:2-4275  [004] ....  1152.420281: rtcpu_vinotify_event: tstamp:36381621649 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:36381620893 data:0x00000000
     kworker/4:2-4275  [004] ....  1152.420284: rtcpu_vinotify_event: tstamp:36381630322 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:36381629909 data:0x08000000
     kworker/4:2-4275  [004] ....  1152.420286: rtcpu_vinotify_event: tstamp:36382520315 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:36382519576 data:0x018f0002
     kworker/4:2-4275  [004] ....  1152.420288: rtcpu_vinotify_event: tstamp:36382520505 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:36382519873 data:0x00000000
     kworker/4:2-4275  [004] ....  1152.420291: rtcpu_vinotify_event: tstamp:36382660879 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:36382660340 data:0x00000001
     kworker/4:2-4275  [004] ....  1152.420294: rtcpu_vinotify_event: tstamp:36382661142 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:36382660396 data:0x00000000
     kworker/4:2-4275  [004] ....  1152.420296: rtcpu_vinotify_event: tstamp:36382669864 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:36382669463 data:0x08000000
 vi-output, lys_-8190  [005] ....  1152.442036: tegra_channel_capture_frame: sof:1152.329621203
 vi-output, lys_-8190  [005] ....  1152.475295: tegra_channel_capture_frame: sof:1152.362885299
     kworker/4:2-4275  [004] ....  1152.476272: rtcpu_vinotify_event: tstamp:36383559832 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:36383559088 data:0x018f0002
     kworker/4:2-4275  [004] ....  1152.476277: rtcpu_vinotify_event: tstamp:36383560016 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:36383559376 data:0x00000000
     kworker/4:2-4275  [004] ....  1152.476280: rtcpu_vinotify_event: tstamp:36383700402 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:36383699853 data:0x00000001
     kworker/4:2-4275  [004] ....  1152.476282: rtcpu_vinotify_event: tstamp:36383700700 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:36383699899 data:0x00000000
     kworker/4:2-4275  [004] ....  1152.476284: rtcpu_vinotify_event: tstamp:36383709292 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:36383708881 data:0x08000000
     kworker/4:2-4275  [004] ....  1152.476286: rtcpu_vinotify_event: tstamp:36384599337 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:36384598592 data:0x018f0002
     kworker/4:2-4275  [004] ....  1152.476288: rtcpu_vinotify_event: tstamp:36384599526 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:36384598879 data:0x00000000
     kworker/4:2-4275  [004] ....  1152.476291: rtcpu_vinotify_event: tstamp:36384739894 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:36384739356 data:0x00000001
     kworker/4:2-4275  [004] ....  1152.476293: rtcpu_vinotify_event: tstamp:36384740139 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:36384739413 data:0x00000000
     kworker/4:2-4275  [004] ....  1152.476295: rtcpu_vinotify_event: tstamp:36384748644 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:36384748231 data:0x08000000
 vi-output, lys_-8190  [005] ....  1152.508570: tegra_channel_capture_frame: sof:1152.396149715
     kworker/4:2-4275  [004] ....  1152.532265: rtos_queue_peek_from_isr_failed: tstamp:36385178632 queue:0x0b4b4500
     kworker/4:2-4275  [004] ....  1152.532271: rtcpu_vinotify_event: tstamp:36385638852 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:36385638104 data:0x018f0002
     kworker/4:2-4275  [004] ....  1152.532273: rtcpu_vinotify_event: tstamp:36385639039 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:36385638392 data:0x00000000
     kworker/4:2-4275  [004] ....  1152.532275: rtcpu_vinotify_event: tstamp:36385779408 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:36385778869 data:0x00000001
     kworker/4:2-4275  [004] ....  1152.532277: rtcpu_vinotify_event: tstamp:36385779705 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:36385778916 data:0x00000000
     kworker/4:2-4275  [004] ....  1152.532280: rtcpu_vinotify_event: tstamp:36385788498 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:36385788086 data:0x08000000
 vi-output, lys_-8190  [005] ....  1152.541830: tegra_channel_capture_frame: sof:1152.429413843
 vi-output, lys_-8190  [005] ....  1152.575082: tegra_channel_capture_frame: sof:1152.462678227
     kworker/4:2-4275  [004] ....  1152.588261: rtcpu_vinotify_event: tstamp:36386678348 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:36386677608 data:0x018f0002
     kworker/4:2-4275  [004] ....  1152.588266: rtcpu_vinotify_event: tstamp:36386678539 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:36386677896 data:0x00000000
     kworker/4:2-4275  [004] ....  1152.588268: rtcpu_vinotify_event: tstamp:36386818921 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:36386818373 data:0x00000001
     kworker/4:2-4275  [004] ....  1152.588271: rtcpu_vinotify_event: tstamp:36386819165 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:36386818428 data:0x00000000
     kworker/4:2-4275  [004] ....  1152.588273: rtcpu_vinotify_event: tstamp:36386827855 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:36386827436 data:0x08000000
     kworker/4:2-4275  [004] ....  1152.588275: rtcpu_vinotify_event: tstamp:36387717862 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:36387717111 data:0x018f0002
     kworker/4:2-4275  [004] ....  1152.588277: rtcpu_vinotify_event: tstamp:36387718045 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:36387717408 data:0x00000000
     kworker/4:2-4275  [004] ....  1152.588280: rtcpu_vinotify_event: tstamp:36387858434 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:36387857885 data:0x00000001
     kworker/4:2-4275  [004] ....  1152.588282: rtcpu_vinotify_event: tstamp:36387858698 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:36387857932 data:0x00000000
     kworker/4:2-4275  [004] ....  1152.588284: rtcpu_vinotify_event: tstamp:36387867010 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:36387866596 data:0x08000000
 vi-output, lys_-8190  [005] ....  1152.608422: tegra_channel_capture_frame: sof:1152.495942355
 vi-output, lys_-8190  [005] ....  1152.641629: tegra_channel_capture_frame: sof:1152.529206739
     kworker/4:2-4275  [004] ....  1152.644277: rtcpu_vinotify_event: tstamp:36388757363 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:36388756624 data:0x018f0002
     kworker/4:2-4275  [004] ....  1152.644283: rtcpu_vinotify_event: tstamp:36388757554 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:36388756912 data:0x00000000
     kworker/4:2-4275  [004] ....  1152.644285: rtcpu_vinotify_event: tstamp:36388897927 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:36388897389 data:0x00000001
     kworker/4:2-4275  [004] ....  1152.644287: rtcpu_vinotify_event: tstamp:36388898171 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:36388897445 data:0x00000000
     kworker/4:2-4275  [004] ....  1152.644290: rtcpu_vinotify_event: tstamp:36388908876 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:36388908458 data:0x08000000
     kworker/4:2-4275  [004] ....  1152.644292: rtcpu_vinotify_event: tstamp:36389796874 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:36389796128 data:0x018f0002
     kworker/4:2-4275  [004] ....  1152.644294: rtcpu_vinotify_event: tstamp:36389797056 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:36389796424 data:0x00000000
     kworker/4:2-4275  [004] ....  1152.644296: rtcpu_vinotify_event: tstamp:36389937450 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:36389936901 data:0x00000001
     kworker/4:2-4275  [004] ....  1152.644299: rtcpu_vinotify_event: tstamp:36389937715 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:36389936948 data:0x00000000
     kworker/4:2-4275  [004] ....  1152.644301: rtcpu_vinotify_event: tstamp:36389946584 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:36389946172 data:0x08000000
 vi-output, lys_-8190  [005] ....  1152.674932: tegra_channel_capture_frame: sof:1152.562470867
     kworker/4:2-4275  [004] ....  1152.700280: rtos_queue_peek_from_isr_failed: tstamp:36390178663 queue:0x0b4b4500
     kworker/4:2-4275  [004] ....  1152.700287: rtcpu_vinotify_event: tstamp:36390836389 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:36390835640 data:0x018f0002
     kworker/4:2-4275  [004] ....  1152.700289: rtcpu_vinotify_event: tstamp:36390836581 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:36390835928 data:0x00000000
     kworker/4:2-4275  [004] ....  1152.700291: rtcpu_vinotify_event: tstamp:36390976944 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:36390976405 data:0x00000001
     kworker/4:2-4275  [004] ....  1152.700293: rtcpu_vinotify_event: tstamp:36390977187 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:36390976460 data:0x00000000
     kworker/4:2-4275  [004] ....  1152.700295: rtcpu_vinotify_event: tstamp:36390987325 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:36390986918 data:0x08000000
 vi-output, lys_-8190  [005] ....  1152.708300: tegra_channel_capture_frame: sof:1152.595734963
 vi-output, lys_-8190  [005] ....  1152.741430: tegra_channel_capture_frame: sof:1152.628999379
     kworker/4:2-4275  [004] ....  1152.756271: rtcpu_vinotify_event: tstamp:36391875890 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:36391875143 data:0x018f0002
     kworker/4:2-4275  [004] ....  1152.756276: rtcpu_vinotify_event: tstamp:36391876072 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:36391875440 data:0x00000000
     kworker/4:2-4275  [004] ....  1152.756279: rtcpu_vinotify_event: tstamp:36392016447 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:36392015908 data:0x00000001
     kworker/4:2-4275  [004] ....  1152.756281: rtcpu_vinotify_event: tstamp:36392016712 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:36392015965 data:0x00000000
     kworker/4:2-4275  [004] ....  1152.756283: rtcpu_vinotify_event: tstamp:36392030082 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:36392029670 data:0x08000000
     kworker/4:2-4275  [004] ....  1152.756286: rtcpu_vinotify_event: tstamp:36392915395 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:36392914656 data:0x018f0002
     kworker/4:2-4275  [004] ....  1152.756288: rtcpu_vinotify_event: tstamp:36392915584 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:36392914944 data:0x00000000
     kworker/4:2-4275  [004] ....  1152.756290: rtcpu_vinotify_event: tstamp:36393055969 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:36393055421 data:0x00000001
     kworker/4:2-4275  [004] ....  1152.756293: rtcpu_vinotify_event: tstamp:36393056213 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:36393055468 data:0x00000000
     kworker/4:2-4275  [004] ....  1152.756296: rtcpu_vinotify_event: tstamp:36393065356 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:36393064943 data:0x08000000
 vi-output, lys_-8190  [005] ....  1152.774672: tegra_channel_capture_frame: sof:1152.662263507
 vi-output, lys_-8190  [005] ....  1152.807954: tegra_channel_capture_frame: sof:1152.695527891
     kworker/4:2-4275  [004] ....  1152.812318: rtcpu_vinotify_event: tstamp:36393954913 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:36393954160 data:0x018f0002
     kworker/4:2-4275  [004] ....  1152.812323: rtcpu_vinotify_event: tstamp:36393955096 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:36393954448 data:0x00000000
     kworker/4:2-4275  [004] ....  1152.812326: rtcpu_vinotify_event: tstamp:36394095473 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:36394094925 data:0x00000001
     kworker/4:2-4275  [004] ....  1152.812328: rtcpu_vinotify_event: tstamp:36394095728 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:36394094980 data:0x00000000
     kworker/4:2-4275  [004] ....  1152.812330: rtcpu_vinotify_event: tstamp:36394104190 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:36394103778 data:0x08000000
     kworker/4:2-4275  [004] ....  1152.812332: rtcpu_vinotify_event: tstamp:36394994413 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:36394993672 data:0x018f0002
     kworker/4:2-4275  [004] ....  1152.812334: rtcpu_vinotify_event: tstamp:36394994602 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:36394993960 data:0x00000000
     kworker/4:2-4275  [004] ....  1152.812337: rtcpu_vinotify_event: tstamp:36395134984 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:36395134437 data:0x00000001
     kworker/4:2-4275  [004] ....  1152.812339: rtcpu_vinotify_event: tstamp:36395135228 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:36395134485 data:0x00000000
     kworker/4:2-4275  [004] ....  1152.812341: rtcpu_vinotify_event: tstamp:36395144257 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:36395143850 data:0x08000000
     kworker/4:2-4275  [004] ....  1152.812345: rtos_queue_peek_from_isr_failed: tstamp:36395178689 queue:0x0b4b4500
 vi-output, lys_-8190  [005] ....  1152.841256: tegra_channel_capture_frame: sof:1152.728792019
     kworker/4:2-4275  [004] ....  1152.868281: rtcpu_vinotify_event: tstamp:36396033926 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:36396033176 data:0x018f0002
     kworker/4:2-4275  [004] ....  1152.868287: rtcpu_vinotify_event: tstamp:36396034110 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:36396033464 data:0x00000000
     kworker/4:2-4275  [004] ....  1152.868290: rtcpu_vinotify_event: tstamp:36396174487 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:36396173941 data:0x00000001
     kworker/4:2-4275  [004] ....  1152.868293: rtcpu_vinotify_event: tstamp:36396174751 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:36396173997 data:0x00000000
     kworker/4:2-4275  [004] ....  1152.868295: rtcpu_vinotify_event: tstamp:36396184960 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:36396184560 data:0x08000000
 vi-output, lys_-8190  [005] ....  1152.874478: tegra_channel_capture_frame: sof:1152.762056403
 vi-output, lys_-8190  [005] ....  1152.907728: tegra_channel_capture_frame: sof:1152.795320531
     kworker/4:2-4275  [004] ....  1152.924273: rtcpu_vinotify_event: tstamp:36397073436 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:36397072689 data:0x018f0002
     kworker/4:2-4275  [004] ....  1152.924278: rtcpu_vinotify_event: tstamp:36397073625 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:36397072976 data:0x00000000
     kworker/4:2-4275  [004] ....  1152.924280: rtcpu_vinotify_event: tstamp:36397214001 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:36397213453 data:0x00000001
     kworker/4:2-4275  [004] ....  1152.924282: rtcpu_vinotify_event: tstamp:36397214245 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:36397213500 data:0x00000000
     kworker/4:2-4275  [004] ....  1152.924285: rtcpu_vinotify_event: tstamp:36397223100 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:36397222695 data:0x08000000
     kworker/4:2-4275  [004] ....  1152.924287: rtcpu_vinotify_event: tstamp:36398112938 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:36398112193 data:0x018f0002
     kworker/4:2-4275  [004] ....  1152.924289: rtcpu_vinotify_event: tstamp:36398113121 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:36398112480 data:0x00000000
     kworker/4:2-4275  [004] ....  1152.924291: rtcpu_vinotify_event: tstamp:36398253505 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:36398252957 data:0x00000001
     kworker/4:2-4275  [004] ....  1152.924294: rtcpu_vinotify_event: tstamp:36398253760 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:36398253013 data:0x00000000
     kworker/4:2-4275  [004] ....  1152.924296: rtcpu_vinotify_event: tstamp:36398262182 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:36398261769 data:0x08000000
 vi-output, lys_-8190  [005] ....  1152.940996: tegra_channel_capture_frame: sof:1152.828584947
 vi-output, lys_-8190  [005] ....  1152.974396: tegra_channel_capture_frame: sof:1152.861849043
     kworker/4:2-4275  [004] ....  1152.980266: rtcpu_vinotify_event: tstamp:36399152479 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:36399151696 data:0x018f0002
     kworker/4:2-4275  [004] ....  1152.980270: rtcpu_vinotify_event: tstamp:36399152669 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:36399151992 data:0x00000000
     kworker/4:2-4275  [004] ....  1152.980273: rtcpu_vinotify_event: tstamp:36399293016 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:36399292470 data:0x00000001
     kworker/4:2-4275  [004] ....  1152.980275: rtcpu_vinotify_event: tstamp:36399293260 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:36399292517 data:0x00000000
     kworker/4:2-4275  [004] ....  1152.980281: rtcpu_vinotify_event: tstamp:36399301832 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:36399301412 data:0x08000000
     kworker/4:2-4275  [004] ....  1152.980286: rtos_queue_peek_from_isr_failed: tstamp:36400178652 queue:0x0b4b4500
     kworker/4:2-4275  [004] ....  1152.980288: rtcpu_vinotify_event: tstamp:36400191946 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:36400191209 data:0x018f0002
     kworker/4:2-4275  [004] ....  1152.980290: rtcpu_vinotify_event: tstamp:36400192131 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:36400191497 data:0x00000000
     kworker/4:2-4275  [004] ....  1152.980293: rtcpu_vinotify_event: tstamp:36400332521 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:36400331973 data:0x00000001
     kworker/4:2-4275  [004] ....  1152.980295: rtcpu_vinotify_event: tstamp:36400332776 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:36400332029 data:0x00000000
     kworker/4:2-4275  [004] ....  1152.980298: rtcpu_vinotify_event: tstamp:36400345556 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:36400345154 data:0x08000000
 vi-output, lys_-8190  [005] ....  1153.007530: tegra_channel_capture_frame: sof:1152.895113459
     kworker/4:2-4275  [004] ....  1153.036264: rtcpu_vinotify_event: tstamp:36401231466 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:36401230712 data:0x018f0002
     kworker/4:2-4275  [004] ....  1153.036269: rtcpu_vinotify_event: tstamp:36401231657 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:36401231009 data:0x00000000
     kworker/4:2-4275  [004] ....  1153.036271: rtcpu_vinotify_event: tstamp:36401372030 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:36401371486 data:0x00000001
     kworker/4:2-4275  [004] ....  1153.036274: rtcpu_vinotify_event: tstamp:36401372276 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:36401371532 data:0x00000000
     kworker/4:2-4275  [004] ....  1153.036276: rtcpu_vinotify_event: tstamp:36401381000 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:36401380598 data:0x08000000
     kworker/4:2-4275  [004] ....  1153.036278: rtcpu_vinotify_event: tstamp:36402270970 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:36402270225 data:0x018f0002
     kworker/4:2-4275  [004] ....  1153.036281: rtcpu_vinotify_event: tstamp:36402271153 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:36402270512 data:0x00000000
 vi-output, lys_-8190  [005] ....  1153.040796: tegra_channel_capture_frame: sof:1152.928377555
 vi-output, lys_-8190  [005] ....  1153.074049: tegra_channel_capture_frame: sof:1152.961641683
     kworker/4:2-4275  [004] ....  1153.092269: rtcpu_vinotify_event: tstamp:36402411536 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:36402410989 data:0x00000001
     kworker/4:2-4275  [004] ....  1153.092274: rtcpu_vinotify_event: tstamp:36402411792 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:36402411037 data:0x00000000
     kworker/4:2-4275  [004] ....  1153.092276: rtcpu_vinotify_event: tstamp:36402420562 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:36402420145 data:0x08000000
     kworker/4:2-4275  [004] ....  1153.092279: rtcpu_vinotify_event: tstamp:36403310475 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:36403309728 data:0x018f0002
     kworker/4:2-4275  [004] ....  1153.092281: rtcpu_vinotify_event: tstamp:36403310664 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:36403310025 data:0x00000000
     kworker/4:2-4275  [004] ....  1153.092283: rtcpu_vinotify_event: tstamp:36403451063 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:36403450493 data:0x00000001
     kworker/4:2-4275  [004] ....  1153.092286: rtcpu_vinotify_event: tstamp:36403451307 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:36403450549 data:0x00000000
     kworker/4:2-4275  [004] ....  1153.092288: rtcpu_vinotify_event: tstamp:36403459704 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:36403459299 data:0x08000000
 vi-output, lys_-8190  [005] ....  1153.107365: tegra_channel_capture_frame: sof:1152.994906067
 vi-output, lys_-8190  [005] ....  1153.140634: tegra_channel_capture_frame: sof:1153.28170195
     kworker/4:2-4275  [004] ....  1153.148287: rtcpu_vinotify_event: tstamp:36404349986 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:36404349241 data:0x018f0002
     kworker/4:2-4275  [004] ....  1153.148293: rtcpu_vinotify_event: tstamp:36404350169 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:36404349528 data:0x00000000
     kworker/4:2-4275  [004] ....  1153.148295: rtcpu_vinotify_event: tstamp:36404490545 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:36404490005 data:0x00000001
     kworker/4:2-4275  [004] ....  1153.148298: rtcpu_vinotify_event: tstamp:36404490800 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:36404490052 data:0x00000000
     kworker/4:2-4275  [004] ....  1153.148300: rtcpu_vinotify_event: tstamp:36404500839 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:36404500427 data:0x08000000
     kworker/4:2-4275  [004] ....  1153.148305: rtos_queue_peek_from_isr_failed: tstamp:36405178663 queue:0x0b4b4500
     kworker/4:2-4275  [004] ....  1153.148307: rtcpu_vinotify_event: tstamp:36405389487 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:36405388744 data:0x018f0002
     kworker/4:2-4275  [004] ....  1153.148309: rtcpu_vinotify_event: tstamp:36405389673 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:36405389032 data:0x00000000
     kworker/4:2-4275  [004] ....  1153.148311: rtcpu_vinotify_event: tstamp:36405530056 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:36405529509 data:0x00000001
     kworker/4:2-4275  [004] ....  1153.148314: rtcpu_vinotify_event: tstamp:36405530300 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:36405529565 data:0x00000000
     kworker/4:2-4275  [004] ....  1153.148316: rtcpu_vinotify_event: tstamp:36405540532 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:36405540132 data:0x08000000
 vi-output, lys_-8190  [005] ....  1153.173851: tegra_channel_capture_frame: sof:1153.61434611
     kworker/4:2-4275  [004] ....  1153.204268: rtcpu_vinotify_event: tstamp:36406428998 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:36406428257 data:0x018f0002
     kworker/4:2-4275  [004] ....  1153.204273: rtcpu_vinotify_event: tstamp:36406429179 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:36406428545 data:0x00000000
     kworker/4:2-4275  [004] ....  1153.204275: rtcpu_vinotify_event: tstamp:36406569569 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:36406569022 data:0x00000001
     kworker/4:2-4275  [004] ....  1153.204277: rtcpu_vinotify_event: tstamp:36406569826 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:36406569069 data:0x00000000
     kworker/4:2-4275  [004] ....  1153.204279: rtcpu_vinotify_event: tstamp:36406578534 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:36406578115 data:0x08000000
     kworker/4:2-4275  [004] ....  1153.204282: rtcpu_vinotify_event: tstamp:36407468505 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:36407467761 data:0x018f0002
     kworker/4:2-4275  [004] ....  1153.204284: rtcpu_vinotify_event: tstamp:36407468695 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:36407468049 data:0x00000000
 vi-output, lys_-8190  [005] ....  1153.207110: tegra_channel_capture_frame: sof:1153.94698707
 vi-output, lys_-8190  [005] ....  1153.240434: tegra_channel_capture_frame: sof:1153.127963123
     kworker/4:2-4275  [004] ....  1153.260265: rtcpu_vinotify_event: tstamp:36407609073 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:36407608525 data:0x00000001
     kworker/4:2-4275  [004] ....  1153.260270: rtcpu_vinotify_event: tstamp:36407609317 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:36407608581 data:0x00000000
     kworker/4:2-4275  [004] ....  1153.260272: rtcpu_vinotify_event: tstamp:36407617871 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:36407617460 data:0x08000000
     kworker/4:2-4275  [004] ....  1153.260274: rtcpu_vinotify_event: tstamp:36408508004 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:36408507264 data:0x018f0002
     kworker/4:2-4275  [004] ....  1153.260277: rtcpu_vinotify_event: tstamp:36408508205 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:36408507561 data:0x00000000
     kworker/4:2-4275  [004] ....  1153.260279: rtcpu_vinotify_event: tstamp:36408648586 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:36408648038 data:0x00000001
     kworker/4:2-4275  [004] ....  1153.260282: rtcpu_vinotify_event: tstamp:36408648841 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:36408648085 data:0x00000000
     kworker/4:2-4275  [004] ....  1153.260284: rtcpu_vinotify_event: tstamp:36408659226 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:36408658815 data:0x08000000
 vi-output, lys_-8190  [005] ....  1153.273635: tegra_channel_capture_frame: sof:1153.161227219
 vi-output, lys_-8190  [005] ....  1153.306891: tegra_channel_capture_frame: sof:1153.194491635
     kworker/4:2-4275  [004] ....  1153.316268: rtcpu_vinotify_event: tstamp:36409547523 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:36409546777 data:0x018f0002
     kworker/4:2-4275  [004] ....  1153.316273: rtcpu_vinotify_event: tstamp:36409547712 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:36409547064 data:0x00000000
     kworker/4:2-4275  [004] ....  1153.316276: rtcpu_vinotify_event: tstamp:36409688091 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:36409687541 data:0x00000001
     kworker/4:2-4275  [004] ....  1153.316278: rtcpu_vinotify_event: tstamp:36409688333 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:36409687598 data:0x00000000
     kworker/4:2-4275  [004] ....  1153.316280: rtcpu_vinotify_event: tstamp:36409696780 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:36409696367 data:0x08000000
     kworker/4:2-4275  [004] ....  1153.316284: rtos_queue_peek_from_isr_failed: tstamp:36410178665 queue:0x0b4b4500
     kworker/4:2-4275  [004] ....  1153.316286: rtcpu_vinotify_event: tstamp:36410587032 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:36410586281 data:0x018f0002
     kworker/4:2-4275  [004] ....  1153.316288: rtcpu_vinotify_event: tstamp:36410587216 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:36410586577 data:0x00000000
     kworker/4:2-4275  [004] ....  1153.316290: rtcpu_vinotify_event: tstamp:36410727601 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:36410727054 data:0x00000001
     kworker/4:2-4275  [004] ....  1153.316293: rtcpu_vinotify_event: tstamp:36410727857 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:36410727101 data:0x00000000
     kworker/4:2-4275  [004] ....  1153.316295: rtcpu_vinotify_event: tstamp:36410736032 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:36410735613 data:0x08000000
 vi-output, lys_-8190  [005] ....  1153.340156: tegra_channel_capture_frame: sof:1153.227755731
     kworker/4:2-4275  [004] ....  1153.372300: rtcpu_vinotify_event: tstamp:36411626537 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:36411625793 data:0x018f0002
     kworker/4:2-4275  [004] ....  1153.372306: rtcpu_vinotify_event: tstamp:36411626760 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:36411626081 data:0x00000000
     kworker/4:2-4275  [004] ....  1153.372308: rtcpu_vinotify_event: tstamp:36411767106 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:36411766557 data:0x00000001
     kworker/4:2-4275  [004] ....  1153.372310: rtcpu_vinotify_event: tstamp:36411767348 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:36411766613 data:0x00000000
     kworker/4:2-4275  [004] ....  1153.372312: rtcpu_vinotify_event: tstamp:36411781024 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:36411780625 data:0x08000000
     kworker/4:2-4275  [004] ....  1153.372314: rtcpu_vinotify_event: tstamp:36412666033 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:36412665296 data:0x018f0002
     kworker/4:2-4275  [004] ....  1153.372317: rtcpu_vinotify_event: tstamp:36412666216 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:36412665593 data:0x00000000
 vi-output, lys_-8190  [005] ....  1153.373436: tegra_channel_capture_frame: sof:1153.261019859
 vi-output, lys_-8190  [005] ....  1153.406695: tegra_channel_capture_frame: sof:1153.294284275
     kworker/4:2-4275  [004] ....  1153.428270: rtcpu_vinotify_event: tstamp:36412806607 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:36412806061 data:0x00000001
     kworker/4:2-4275  [004] ....  1153.428275: rtcpu_vinotify_event: tstamp:36412806862 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:36412806118 data:0x00000000
     kworker/4:2-4275  [004] ....  1153.428277: rtcpu_vinotify_event: tstamp:36412815538 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:36412815127 data:0x08000000
     kworker/4:2-4275  [004] ....  1153.428280: rtcpu_vinotify_event: tstamp:36413705559 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:36413704809 data:0x018f0002
     kworker/4:2-4275  [004] ....  1153.428282: rtcpu_vinotify_event: tstamp:36413705747 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:36413705097 data:0x00000000
     kworker/4:2-4275  [004] ....  1153.428284: rtcpu_vinotify_event: tstamp:36413846117 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:36413845574 data:0x00000001
     kworker/4:2-4275  [004] ....  1153.428286: rtcpu_vinotify_event: tstamp:36413846361 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:36413845621 data:0x00000000
     kworker/4:2-4275  [004] ....  1153.428288: rtcpu_vinotify_event: tstamp:36413854911 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:36413854497 data:0x08000000
 vi-output, lys_-8190  [005] ....  1153.439954: tegra_channel_capture_frame: sof:1153.327548371
 vi-output, lys_-8190  [005] ....  1153.473225: tegra_channel_capture_frame: sof:1153.360812787
     kworker/4:2-4275  [004] ....  1153.484268: rtcpu_vinotify_event: tstamp:36414745052 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:36414744313 data:0x018f0002
     kworker/4:2-4275  [004] ....  1153.484273: rtcpu_vinotify_event: tstamp:36414745233 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:36414744601 data:0x00000000
     kworker/4:2-4275  [004] ....  1153.484276: rtcpu_vinotify_event: tstamp:36414885630 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:36414885077 data:0x00000001
     kworker/4:2-4275  [004] ....  1153.484278: rtcpu_vinotify_event: tstamp:36414885885 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:36414885133 data:0x00000000
     kworker/4:2-4275  [004] ....  1153.484280: rtcpu_vinotify_event: tstamp:36414894263 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:36414893843 data:0x08000000
     kworker/4:2-4275  [004] ....  1153.484284: rtos_queue_peek_from_isr_failed: tstamp:36415178699 queue:0x0b4b4500
     kworker/4:2-4275  [004] ....  1153.484287: rtcpu_vinotify_event: tstamp:36415784575 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:36415783825 data:0x018f0002
     kworker/4:2-4275  [004] ....  1153.484289: rtcpu_vinotify_event: tstamp:36415784767 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:36415784113 data:0x00000000
     kworker/4:2-4275  [004] ....  1153.484291: rtcpu_vinotify_event: tstamp:36415925139 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:36415924590 data:0x00000001
     kworker/4:2-4275  [004] ....  1153.484293: rtcpu_vinotify_event: tstamp:36415925384 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:36415924637 data:0x00000000
     kworker/4:2-4275  [004] ....  1153.484296: rtcpu_vinotify_event: tstamp:36415933961 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:36415933549 data:0x08000000
 vi-output, lys_-8190  [005] ....  1153.506537: tegra_channel_capture_frame: sof:1153.394076915
 vi-output, lys_-8190  [005] ....  1153.539757: tegra_channel_capture_frame: sof:1153.427341299
     kworker/4:2-4275  [004] ....  1153.540274: rtcpu_vinotify_event: tstamp:36416824075 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:36416823328 data:0x018f0002
     kworker/4:2-4275  [004] ....  1153.540280: rtcpu_vinotify_event: tstamp:36416824258 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:36416823617 data:0x00000000
     kworker/4:2-4275  [004] ....  1153.540282: rtcpu_vinotify_event: tstamp:36416964641 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:36416964094 data:0x00000001
     kworker/4:2-4275  [004] ....  1153.540285: rtcpu_vinotify_event: tstamp:36416964898 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:36416964150 data:0x00000000
     kworker/4:2-4275  [004] ....  1153.540287: rtcpu_vinotify_event: tstamp:36416974973 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:36416974571 data:0x08000000
     kworker/4:2-4275  [004] ....  1153.540289: rtcpu_vinotify_event: tstamp:36417863579 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:36417862833 data:0x018f0002
     kworker/4:2-4275  [004] ....  1153.540292: rtcpu_vinotify_event: tstamp:36417863768 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:36417863129 data:0x00000000
     kworker/4:2-4275  [004] ....  1153.540294: rtcpu_vinotify_event: tstamp:36418004159 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:36418003606 data:0x00000001
     kworker/4:2-4275  [004] ....  1153.540296: rtcpu_vinotify_event: tstamp:36418004403 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:36418003653 data:0x00000000
     kworker/4:2-4275  [004] ....  1153.540302: rtcpu_vinotify_event: tstamp:36418013096 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:36418012681 data:0x08000000
 vi-output, lys_-8190  [005] ....  1153.573022: tegra_channel_capture_frame: sof:1153.460605427
     kworker/4:2-4275  [004] ....  1153.596270: rtcpu_vinotify_event: tstamp:36418903082 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:36418902345 data:0x018f0002
     kworker/4:2-4275  [004] ....  1153.596276: rtcpu_vinotify_event: tstamp:36418903266 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:36418902633 data:0x00000000
     kworker/4:2-4275  [004] ....  1153.596278: rtcpu_vinotify_event: tstamp:36419043659 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:36419043110 data:0x00000001
     kworker/4:2-4275  [004] ....  1153.596280: rtcpu_vinotify_event: tstamp:36419043914 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:36419043165 data:0x00000000
     kworker/4:2-4275  [004] ....  1153.596282: rtcpu_vinotify_event: tstamp:36419052616 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:36419052197 data:0x08000000
 vi-output, lys_-8190  [005] ....  1153.606278: tegra_channel_capture_frame: sof:1153.493869811
 vi-output, lys_-8190  [005] ....  1153.639535: tegra_channel_capture_frame: sof:1153.527133939
     kworker/4:2-4275  [004] ....  1153.652224: rtcpu_vinotify_event: tstamp:36419942603 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:36419941849 data:0x018f0002
     kworker/4:2-4275  [004] ....  1153.652229: rtcpu_vinotify_event: tstamp:36419942792 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:36419942145 data:0x00000000
     kworker/4:2-4275  [004] ....  1153.652231: rtcpu_vinotify_event: tstamp:36420083157 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:36420082622 data:0x00000001
     kworker/4:2-4275  [004] ....  1153.652233: rtcpu_vinotify_event: tstamp:36420083401 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:36420082670 data:0x00000000
     kworker/4:2-4275  [004] ....  1153.652235: rtcpu_vinotify_event: tstamp:36420091867 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:36420091455 data:0x08000000
     kworker/4:2-4275  [004] ....  1153.652239: rtos_queue_peek_from_isr_failed: tstamp:36420178716 queue:0x0b4b4500
     kworker/4:2-4275  [004] ....  1153.652242: rtcpu_vinotify_event: tstamp:36420982142 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:36420981361 data:0x018f0002
     kworker/4:2-4275  [004] ....  1153.652244: rtcpu_vinotify_event: tstamp:36420982327 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:36420981650 data:0x00000000
     kworker/4:2-4275  [004] ....  1153.652246: rtcpu_vinotify_event: tstamp:36421122682 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:36421122126 data:0x00000001
     kworker/4:2-4275  [004] ....  1153.652248: rtcpu_vinotify_event: tstamp:36421122937 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:36421122182 data:0x00000000
     kworker/4:2-4275  [004] ....  1153.652251: rtcpu_vinotify_event: tstamp:36421131140 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:36421130728 data:0x08000000
 vi-output, lys_-8190  [005] ....  1153.672849: tegra_channel_capture_frame: sof:1153.560398323
 vi-output, lys_-8190  [005] ....  1153.706076: tegra_channel_capture_frame: sof:1153.593662451
     kworker/4:2-4275  [004] ....  1153.708270: rtcpu_vinotify_event: tstamp:36422021612 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:36422020865 data:0x018f0002
     kworker/4:2-4275  [004] ....  1153.708275: rtcpu_vinotify_event: tstamp:36422021801 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:36422021162 data:0x00000000
     kworker/4:2-4275  [004] ....  1153.708278: rtcpu_vinotify_event: tstamp:36422162175 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:36422161638 data:0x00000001
     kworker/4:2-4275  [004] ....  1153.708280: rtcpu_vinotify_event: tstamp:36422162420 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:36422161685 data:0x00000000
     kworker/4:2-4275  [004] ....  1153.708282: rtcpu_vinotify_event: tstamp:36422172252 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:36422171832 data:0x08000000
     kworker/4:2-4275  [004] ....  1153.708284: rtcpu_vinotify_event: tstamp:36423061126 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:36423060378 data:0x018f0002
     kworker/4:2-4275  [004] ....  1153.708286: rtcpu_vinotify_event: tstamp:36423061307 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:36423060665 data:0x00000000
     kworker/4:2-4275  [004] ....  1153.708289: rtcpu_vinotify_event: tstamp:36423201676 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:36423201142 data:0x00000001
     kworker/4:2-4275  [004] ....  1153.708291: rtcpu_vinotify_event: tstamp:36423201932 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:36423201190 data:0x00000000
     kworker/4:2-4275  [004] ....  1153.708293: rtcpu_vinotify_event: tstamp:36423210540 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:36423210127 data:0x08000000
 vi-output, lys_-8190  [005] ....  1153.739342: tegra_channel_capture_frame: sof:1153.626926579
     kworker/4:2-4275  [004] ....  1153.764263: rtcpu_vinotify_event: tstamp:36424100627 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:36424099881 data:0x018f0002
     kworker/4:2-4275  [004] ....  1153.764268: rtcpu_vinotify_event: tstamp:36424100815 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:36424100169 data:0x00000000
     kworker/4:2-4275  [004] ....  1153.764270: rtcpu_vinotify_event: tstamp:36424241193 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:36424240646 data:0x00000001
     kworker/4:2-4275  [004] ....  1153.764273: rtcpu_vinotify_event: tstamp:36424241481 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:36424240702 data:0x00000000
     kworker/4:2-4275  [004] ....  1153.764275: rtcpu_vinotify_event: tstamp:36424250096 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:36424249683 data:0x08000000
 vi-output, lys_-8190  [005] ....  1153.772605: tegra_channel_capture_frame: sof:1153.660190963
 vi-output, lys_-8190  [005] ....  1153.805878: tegra_channel_capture_frame: sof:1153.693455091
     kworker/4:2-4275  [004] ....  1153.820308: rtcpu_vinotify_event: tstamp:36425140124 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:36425139385 data:0x018f0002
     kworker/4:2-4275  [004] ....  1153.820313: rtcpu_vinotify_event: tstamp:36425140305 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:36425139681 data:0x00000000
     kworker/4:2-4275  [004] ....  1153.820317: rtos_queue_peek_from_isr_failed: tstamp:36425178683 queue:0x0b4b4500
     kworker/4:2-4275  [004] ....  1153.820320: rtcpu_vinotify_event: tstamp:36425280707 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:36425280158 data:0x00000001
     kworker/4:2-4275  [004] ....  1153.820322: rtcpu_vinotify_event: tstamp:36425280970 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:36425280205 data:0x00000000
     kworker/4:2-4275  [004] ....  1153.820324: rtcpu_vinotify_event: tstamp:36425289592 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:36425289179 data:0x08000000
     kworker/4:2-4275  [004] ....  1153.820326: rtcpu_vinotify_event: tstamp:36426179648 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:36426178897 data:0x018f0002
     kworker/4:2-4275  [004] ....  1153.820328: rtcpu_vinotify_event: tstamp:36426179838 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:36426179185 data:0x00000000
     kworker/4:2-4275  [004] ....  1153.820331: rtcpu_vinotify_event: tstamp:36426320208 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:36426319662 data:0x00000001
     kworker/4:2-4275  [004] ....  1153.820333: rtcpu_vinotify_event: tstamp:36426320452 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:36426319718 data:0x00000000
     kworker/4:2-4275  [004] ....  1153.820335: rtcpu_vinotify_event: tstamp:36426329371 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:36426328950 data:0x08000000
 vi-output, lys_-8190  [005] ....  1153.839141: tegra_channel_capture_frame: sof:1153.726719507
 vi-output, lys_-8190  [005] ....  1153.872397: tegra_channel_capture_frame: sof:1153.759983603
     kworker/4:2-4275  [004] ....  1153.876268: rtcpu_vinotify_event: tstamp:36427219140 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:36427218401 data:0x018f0002
     kworker/4:2-4275  [004] ....  1153.876273: rtcpu_vinotify_event: tstamp:36427219323 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:36427218697 data:0x00000000
     kworker/4:2-4275  [004] ....  1153.876275: rtcpu_vinotify_event: tstamp:36427359720 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:36427359175 data:0x00000001
     kworker/4:2-4275  [004] ....  1153.876278: rtcpu_vinotify_event: tstamp:36427359987 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:36427359222 data:0x00000000
     kworker/4:2-4275  [004] ....  1153.876280: rtcpu_vinotify_event: tstamp:36427368829 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:36427368416 data:0x08000000
     kworker/4:2-4275  [004] ....  1153.876282: rtcpu_vinotify_event: tstamp:36428258658 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:36428257914 data:0x018f0002
     kworker/4:2-4275  [004] ....  1153.876285: rtcpu_vinotify_event: tstamp:36428258849 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:36428258202 data:0x00000000
     kworker/4:2-4275  [004] ....  1153.876287: rtcpu_vinotify_event: tstamp:36428399226 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:36428398678 data:0x00000001
     kworker/4:2-4275  [004] ....  1153.876289: rtcpu_vinotify_event: tstamp:36428399470 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:36428398725 data:0x00000000
     kworker/4:2-4275  [004] ....  1153.876291: rtcpu_vinotify_event: tstamp:36428408086 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:36428407682 data:0x08000000
 vi-output, lys_-8190  [005] ....  1153.905667: tegra_channel_capture_frame: sof:1153.793247987
     kworker/4:2-4275  [004] ....  1153.932292: rtcpu_vinotify_event: tstamp:36429298154 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:36429297417 data:0x018f0002
     kworker/4:2-4275  [004] ....  1153.932298: rtcpu_vinotify_event: tstamp:36429298337 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:36429297714 data:0x00000000
     kworker/4:2-4275  [004] ....  1153.932300: rtcpu_vinotify_event: tstamp:36429438739 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:36429438190 data:0x00000001
     kworker/4:2-4275  [004] ....  1153.932302: rtcpu_vinotify_event: tstamp:36429438994 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:36429438238 data:0x00000000
     kworker/4:2-4275  [004] ....  1153.932304: rtcpu_vinotify_event: tstamp:36429447749 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:36429447347 data:0x08000000
     kworker/4:2-4275  [004] ....  1153.932308: rtos_queue_peek_from_isr_failed: tstamp:36430178698 queue:0x0b4b4500
 vi-output, lys_-8190  [005] ....  1153.938925: tegra_channel_capture_frame: sof:1153.826512115
 vi-output, lys_-8190  [005] ....  1153.972369: tegra_channel_capture_frame: sof:1153.859776531
     kworker/4:2-4275  [004] ....  1153.988271: rtcpu_vinotify_event: tstamp:36430337674 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:36430336930 data:0x018f0002
     kworker/4:2-4275  [004] ....  1153.988277: rtcpu_vinotify_event: tstamp:36430337859 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:36430337217 data:0x00000000
     kworker/4:2-4275  [004] ....  1153.988279: rtcpu_vinotify_event: tstamp:36430478241 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:36430477694 data:0x00000001
     kworker/4:2-4275  [004] ....  1153.988281: rtcpu_vinotify_event: tstamp:36430478491 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:36430477742 data:0x00000000
     kworker/4:2-4275  [004] ....  1153.988284: rtcpu_vinotify_event: tstamp:36430487092 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:36430486688 data:0x08000000
     kworker/4:2-4275  [004] ....  1153.988286: rtcpu_vinotify_event: tstamp:36431377171 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:36431376433 data:0x018f0002
     kworker/4:2-4275  [004] ....  1153.988288: rtcpu_vinotify_event: tstamp:36431377354 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:36431376730 data:0x00000000
     kworker/4:2-4275  [004] ....  1153.988290: rtcpu_vinotify_event: tstamp:36431517751 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:36431517207 data:0x00000001
     kworker/4:2-4275  [004] ....  1153.988293: rtcpu_vinotify_event: tstamp:36431518007 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:36431517254 data:0x00000000
     kworker/4:2-4275  [004] ....  1153.988295: rtcpu_vinotify_event: tstamp:36431532230 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:0 vi_tstamp:36431531819 data:0x08000000
 vi-output, lys_-8190  [005] ....  1154.005462: tegra_channel_capture_frame: sof:1153.893040627
 vi-output, lys_-8190  [005] ....  1154.038713

Could you consult with sensor vendor if can gen the frame id as MIPI spec. Shouldn’t always be 0

Hello,

You mean that the ID tag in the MIPI frames is 0x00 instead of 0x2B (for RAW10) as specified in MIPI spec?

Where can you see that in the logs/traces?

Hello again,

I checked bit-per-bit the MIPI frame and I confirm they are sent with a 0x2B Data-ID (meaning RAW10) and a 0x01F4 (meaning 500 bytes for 400 pixels @ 10bpp) Word Count.

I’ve another question regarding some timing parameters:

pixel_clk_hz: how do we have to set-it up:

  • based on the actual pixel clock of our sensor = 8 MHz ?
  • based on MIPI: 1 lane 125Mbps 10bpp = 12.5 MHz ?
  • based on frame rate: 400x400x30 = 4.8 MHz ?

serdes_pix_clk_hz: do we need to configure that?

mclk_khz and mclk_mupltiplier: do we need to configure that as we don’t have any mclk in our design?

Hello,

We finally found the reason of our problem: Gstreamer is working only if the image width is at least 640 pixels!

We found a way to change our sensor format from 400x400 to 640x400 and all errors dissappeared! By using croping with nvvidconv later on it works.

But I’ve still a question that could interest also other readers: what are the current hardware or software limitations of the Jetson (TX1, TX2, Xavier and Nano) regarding the MIPI CSI2 input format: min/max width, min/max height, … ?

Is the problem known and do you plan to resolve it?

Best Regards,

Christophe

Hi
20MP image are the ISP max support and there’s a maximum output width, 6144 is the limitation.

1 Like

Hello,

Could you give a a response regarding the pixel_clk_hz setting (see my question below) ?

Regarding our main issue with images with less than 640 pixels per line: even if we solve the issue by adding 240 pixels to our 400 pixels lines, it’s not an elegant way to solve the problem. I would like to give you another information. Even if the streaming was working with v4l2-ctl, we had an issue with the pixels in the images: the odd lines were OK, but for the even lines were shifted by 16 pixels, meaning we lost the first 16 pixels of the lines and get 16 black pixels at the end of the line. So it seams that the issue is maybe not really located in the ISP but more on the VI itself.

Maybe it could help Nvidia to find what’s the actual problem and how to solve it.

Anyway it could be great that Nvidia provide a clear information about acquiring images with low pixel counts.

Thank you for your support,

Christophe

Could you try to modify the TEGRA_STRIDE_ALIGNMENT to 64 to check if v4l2-ctl capture can get correct data.

../kernel/nvidia/include/media/tegra_camera_core.h	
#define TEGRA_STRIDE_ALIGNMENT 1