argus_camera only capture 1 frame.

Hi folks,

I was adding a driver for imx390 on tx2, base on r28.1 NVIDIA kernel source.
There is a issue that I can always use nvgstcapture to get video, but argus_camera is not able to get capture.
The argus_camera only get one frame(maybe a very quick while), after that it will be stuck.

Here I post some debug log:
1. kmesg
[ 255.201202] imx390 30-001a: imx390_set_frame_rate: val: 125829120, , frame_length: 2250
[ 255.210291] imx390 30-001a: imx390_set_exposure: val: 139810
[ 255.238929] imx390 30-001a: imx390_set_group_hold: val: 1
[ 255.244732] imx390 30-001a: imx390_set_exposure: val: 139796
[ 255.250394] imx390 30-001a: imx390_set_group_hold: val: 0
[ 255.257443] imx390 30-001a: imx390_set_group_hold: val: 1
[ 255.263242] imx390 30-001a: imx390_set_gain: gain reg: 0, db: 0
[ 255.269951] imx390 30-001a: imx390_set_group_hold: val: 0
[ 257.998938] imx390 30-001a: imx390_s_stream++ enable 0
[ 258.004756] imx390 30-001a: imx390_power_off: power off
[ 260.492656] argus_camera[4963]: unhandled level 2 translation fault (11) at 0x00000004, esr 0x92000006
[ 260.502163] pgd = ffffffc1a9612000
[ 260.505620] [00000004] *pgd=0000000234dc7003, *pud=0000000234dc7003, *pmd=0000000000000000

[ 260.515688] CPU: 4 PID: 4963 Comm: argus_camera Not tainted 4.4.38-test #12
[ 260.522715] Hardware name: quill (DT)
[ 260.526458] task: ffffffc1c0cd8000 ti: ffffffc1a9664000 task.ti: ffffffc1a9664000
[ 260.534007] PC is at 0x7f9feb63f4
[ 260.537469] LR is at 0x7f9feb63e4
[ 260.540899] pc : [<0000007f9feb63f4>] lr : [<0000007f9feb63e4>] pstate: 60000000
[ 260.548383] sp : 0000007fe77812d0
[ 260.551816] x29: 0000007fe7781350 x28: 0000000000000000
[ 260.557365] x27: 0000000000000000 x26: 0000000000000000
[ 260.562986] x25: 0000000000000000 x24: 0000000000000000
[ 260.568327] x23: 0000000000000000 x22: 0000000000000000
[ 260.573659] x21: 0000000000000000 x20: 000000000072cc80
[ 260.579016] x19: 0000007fe7781328 x18: 0000000003800027
[ 260.584344] x17: 0000007f9efb9d30 x16: 0000007f9ee6e4a0
[ 260.589681] x15: 0000007fa00d1cc0 x14: 6c632f74656b636f
[ 260.595022] x13: 732f6370722f6372 x12: 73206d6f72662067
[ 260.600354] x11: 6e6974616761706f x10: 72702820203a6574
[ 260.605683] x9 : 61745364696c6176 x8 : 0000000000000040
[ 260.611020] x7 : 0000000000000000 x6 : 0000007fe777e44c
[ 260.616349] x5 : 0000000000000000 x4 : 0000000000000000
[ 260.621680] x3 : 0000000000000000 x2 : 0000000000000001
[ 260.627022] x1 : 0000000000000000 x0 : 0000007fe7781328

[ 260.634014] Library at 0x7f9feb63f4: 0x7f9fe5d000 /usr/lib/aarch64-linux-gnu/tegra/libargus_socketclient.so
[ 260.643750] Library at 0x7f9feb63e4: 0x7f9fe5d000 /usr/lib/aarch64-linux-gnu/tegra/libargus_socketclient.so
[ 260.653483] vdso base = 0x7fa00d0000

2. argus_daemon log
PowerServiceUtils:calculateReqClock: entered
PowerServiceHw:addRequest: table size: before: 0, after:1
request table for VI 0:
req[0]: guID=0, stageID=SensorCapture
req[0]: inW=1936, inH=1100, inBpp = 12, fps=30
req[0]: outW=1936, outH=1100, outBpp=12
req[0]: out1W=0, out1H=0, out1Bpp=0
req[0]: out2W=0, out2H=0, out2Bpp=0
req[0]: clock=25987500, pixelRate=148500000, timeout=900
req[0]: isoBw=311844, timeout=900
req[0]: non_isoBw=0, timeout=900
PowerServiceUtils:calculateReqClock: entered
PowerServiceHw:addRequest: table size: before: 0, after:1
request table for CSI 0:
req[0]: guID=0, stageID=SensorCapture
req[0]: inW=1936, inH=1100, inBpp = 12, fps=30
req[0]: outW=1936, outH=1100, outBpp=12
req[0]: out1W=0, out1H=0, out1Bpp=0
req[0]: out2W=0, out2H=0, out2Bpp=0
req[0]: clock=36196872, pixelRate=148500000, timeout=900
req[0]: isoBw=0, timeout=900
req[0]: non_isoBw=0, timeout=900
PowerServiceHwVi:setIso: m_bwVal_Iso=311844
PowerServiceHw:setClock: PowerServiceHw[1]: requested_clock_Hz=25987500
PowerServiceHw:setClock: PowerServiceHw[0]: requested_clock_Hz=36196872
PowerServiceCore:setCameraBw: totalIsoBw=311844
SCF: Error Timeout: (propagating from src/services/capture/CaptureServiceEvent.cpp, function wait(), line 59)
Error: Camera HwEvents wait, this may indicate a hardware timeout occured,abort current/incoming cc
Created fiber 0x7f48000d10 for CC 103 globalID 103 session 0
Thread 5 is working on CC 103 session 0 globalID 103 step 0
Fiber 0x7f48000d10 is aborting in CC 103 Session 0
FiberScheduler: cc 103 session 0, fiber 0x7f48000d10 aborted

launchCC abort cc 104 session 0
Created fiber 0x7f4400d6c0 for CC 104 globalID 104 session 0
Thread 6 is working on CC 104 session 0 globalID 104 step 0
Fiber 0x7f4400d6c0 is aborting in CC 104 Session 0
SCF: Error Timeout: (propagating from src/api/Session.cpp, function capture(), line 830)
FiberScheduler: fiber 0x7f48000d10 exiting
FiberScheduler: cc 104 session 0, fiber 0x7f4400d6c0 aborted

Thread 5 getting next capture
(Argus) Error Timeout: Failed to submit first capture request (propagating from src/api/CaptureSessionImpl.cpp, function submitCaptureRequests(), line 311)
disposing CC 103 Session 0
Thread 5 is waiting
Thread 8 is waiting
Thread 7 is waiting
(Argus) Error Timeout: (propagating from src/api/CaptureSessionImpl.cpp, function threadFunction(), line 777)
FiberScheduler: fiber 0x7f4400d6c0 exiting
Thread 6 getting next capture
Thread 9 is waiting
Thread 6 is waiting
Thread 10 is waiting

PowerServiceUtils:calculateReqClock: entered
PowerServiceHw:addRequest: table size: before: 1, after:2
request table for VI 0:
req[0]: guID=0, stageID=SensorCapture
req[0]: inW=1936, inH=1100, inBpp = 12, fps=30
req[0]: outW=1936, outH=1100, outBpp=12
req[0]: out1W=0, out1H=0, out1Bpp=0
req[0]: out2W=0, out2H=0, out2Bpp=0
req[0]: clock=25987500, pixelRate=148500000, timeout=900
req[0]: isoBw=311844, timeout=900
req[0]: non_isoBw=0, timeout=900
req[1]: guID=0, stageID=SensorIspCapture
req[1]: inW=1936, inH=1100, inBpp = 12, fps=30
req[1]: outW=1936, outH=1100, outBpp=16
req[1]: out1W=0, out1H=0, out1Bpp=0
req[1]: out2W=0, out2H=0, out2Bpp=0
req[1]: clock=25987500, pixelRate=148500000, timeout=450
req[1]: isoBw=0, timeout=450
req[1]: non_isoBw=0, timeout=450
PowerServiceUtils:calculateReqClock: entered
PowerServiceHw:addRequest: table size: before: 1, after:2
request table for CSI 0:
req[0]: guID=0, stageID=SensorCapture
req[0]: inW=1936, inH=1100, inBpp = 12, fps=30
req[0]: outW=1936, outH=1100, outBpp=12
req[0]: out1W=0, out1H=0, out1Bpp=0
req[0]: out2W=0, out2H=0, out2Bpp=0
req[0]: clock=36196872, pixelRate=148500000, timeout=900
req[0]: isoBw=0, timeout=900
req[0]: non_isoBw=0, timeout=900
req[1]: guID=0, stageID=SensorIspCapture
req[1]: inW=1936, inH=1100, inBpp = 12, fps=30
req[1]: outW=1936, outH=1100, outBpp=16
req[1]: out1W=0, out1H=0, out1Bpp=0
req[1]: out2W=0, out2H=0, out2Bpp=0
req[1]: clock=36196872, pixelRate=148500000, timeout=450
req[1]: isoBw=0, timeout=450
req[1]: non_isoBw=0, timeout=450
PowerServiceUtils:calculateReqClock: entered
PowerServiceHw:addRequest: table size: before: 0, after:1
request table for ISP 0:
req[0]: guID=0, stageID=SensorIspCapture
req[0]: inW=1936, inH=1100, inBpp = 12, fps=30
req[0]: outW=130, outH=74, outBpp=16
req[0]: out1W=320, out1H=200, out1Bpp=16
req[0]: out2W=320, out2H=200, out2Bpp=16
req[0]: clock=81675000, pixelRate=148500000, timeout=450
req[0]: isoBw=980100, timeout=450
req[0]: non_isoBw=0, timeout=450
PowerServiceCore:handleRequests: timePassed = 2398
PowerServiceHwIsp:setLaBw: m_bwVal_Iso=980100 and m_bwVal_NonIso=0 KBpS

PowerServiceHw:setClock: PowerServiceHw[2]: requested_clock_Hz=81675000
PowerServiceCore:setCameraBw: totalIsoBw=980100
PowerServiceUtils:calculateReqClock: entered
PowerServiceHw:addRequest: table size: before: 1, after:2
request table for ISP 0:
req[0]: guID=0, stageID=SensorIspCapture
req[0]: inW=1936, inH=1100, inBpp = 12, fps=30
req[0]: outW=130, outH=74, outBpp=16
req[0]: out1W=320, out1H=200, out1Bpp=16
req[0]: out2W=320, out2H=200, out2Bpp=16
req[0]: clock=81675000, pixelRate=148500000, timeout=431
req[0]: isoBw=980100, timeout=431
req[0]: non_isoBw=0, timeout=431
req[1]: guID=0, stageID=SensorIspCapture
req[1]: inW=1936, inH=1100, inBpp = 12, fps=30
req[1]: outW=1936, outH=1100, outBpp=12
req[1]: out1W=320, out1H=200, out1Bpp=16
req[1]: out2W=640, out2H=364, out2Bpp=13
req[1]: clock=81675000, pixelRate=148500000, timeout=450
req[1]: isoBw=837168, timeout=450
req[1]: non_isoBw=0, timeout=450
Issue bubble captures
FiberScheduler: cc 101, session 0, fiber 0x7f480008c0 succeeded async operation

Thread 12 is working on CC 101 session 0 globalID 101 step 8
exposureTime=0.033330 analogGain=1.000100 digitalGain=1.000000 commonGain=0.033333 expComp=1.000000

lux in Statsupdate: isAohdrEnable=0 currentSceneLux 3620.250
CC 101 session 0 completed step 8 in fiber 0x7f480008c0
CC 101 session 0 completed step 9 in fiber 0x7f480008c0
CC 101 session 0 completed step 10 in fiber 0x7f480008c0
NV AF analysis algorithm is active.
AfAnalysis cc 101 push FK_ISP_RUN_NUMBER=1.
CC 101 session 0 completed step 11 in fiber 0x7f480008c0
CC 101 session 0 completed step 12 in fiber 0x7f480008c0
CC 101 session 0 completed step 13 in fiber 0x7f480008c0
CC 101 session 0 completed step 14 in fiber 0x7f480008c0
CC 101 session 0 completed step 15 in fiber 0x7f480008c0
CC 101 session 0 completed step 16 in fiber 0x7f480008c0
CC 101 session 0 completed step 17 in fiber 0x7f480008c0
FiberScheduler: cc 101, session 0, fiber 0x7f480008c0 complete

FiberScheduler: fiber 0x7f480008c0 exiting
Thread 12 getting next capture
disposing CC 101 Session 0
Thread 11 is waiting
Thread 1 is waiting
Thread 12 is waiting
Issue bubble captures
FiberScheduler: cc 102, session 0, fiber 0x7f48000b70 succeeded async operation

Thread 3 is working on CC 102 session 0 globalID 102 step 8
exposureTime=0.033330 analogGain=1.000100 digitalGain=1.000000 commonGain=0.033333 expComp=1.000000

lux in Statsupdate: isAohdrEnable=0 currentSceneLux 3621.537
CC 102 session 0 completed step 8 in fiber 0x7f48000b70
CC 102 session 0 completed step 9 in fiber 0x7f48000b70
CC 102 session 0 completed step 10 in fiber 0x7f48000b70
NV AF analysis algorithm is active.
AfAnalysis cc 102 push FK_ISP_RUN_NUMBER=2.
CC 102 session 0 completed step 11 in fiber 0x7f48000b70
CC 102 session 0 completed step 12 in fiber 0x7f48000b70
CC 102 session 0 completed step 13 in fiber 0x7f48000b70
CC 102 session 0 completed step 14 in fiber 0x7f48000b70
CC 102 session 0 completed step 15 in fiber 0x7f48000b70
CC 102 session 0 completed step 16 in fiber 0x7f48000b70
CC 102 session 0 completed step 17 in fiber 0x7f48000b70
FiberScheduler: cc 102, session 0, fiber 0x7f48000b70 complete

FiberScheduler: fiber 0x7f48000b70 exiting
Thread 3 getting next capture
disposing CC 102 Session 0
Thread 3 is waiting
Thread 4 is waiting
Thread 2 is waiting
Issue bubble captures
Issue bubble captures
Issue bubble captures
Issue bubble captures
Issue bubble captures
Issue bubble captures
Issue bubble captures
Issue bubble captures
Issue bubble captures
Issue bubble captures
Issue bubble captures
PowerServiceHw:updateRequests: table size: before: 2, after:2
request table for ISP 0:
req[0]: guID=0, stageID=SensorIspCapture
req[0]: inW=1936, inH=1100, inBpp = 12, fps=30
req[0]: outW=130, outH=74, outBpp=16
req[0]: out1W=320, out1H=200, out1Bpp=16
req[0]: out2W=320, out2H=200, out2Bpp=16
req[0]: clock=81675000, pixelRate=148500000, timeout=417
req[0]: isoBw=980100, timeout=417
req[0]: non_isoBw=0, timeout=417
req[1]: guID=0, stageID=SensorIspCapture
req[1]: inW=1936, inH=1100, inBpp = 12, fps=30
req[1]: outW=1936, outH=1100, outBpp=12
req[1]: out1W=320, out1H=200, out1Bpp=16
req[1]: out2W=640, out2H=364, out2Bpp=13
req[1]: clock=81675000, pixelRate=148500000, timeout=0
req[1]: isoBw=837168, timeout=0
req[1]: non_isoBw=0, timeout=0
Issue bubble captures
Issue bubble captures
Issue bubble captures
Issue bubble captures
Issue bubble captures
Issue bubble captures

3. cat /sys/kernel/debug/tracing/trace

entries-in-buffer/entries-written: 187/187 #P:4

_-----=> irqs-off

/ _----=> need-resched

| / _—=> hardirq/softirq

|| / _–=> preempt-depth

||| / delay

TASK-PID CPU# |||| TIMESTAMP FUNCTION

| | | |||| | |

 kworker/5:1-114   [005] ...1    74.324699: rtos_queue_peek_from_isr_failed: tstamp:2636899438 queue:0x0b4a3c58
 kworker/5:1-114   [005] ...1    74.324703: rtcpu_start: tstamp:2636900190
 kworker/5:1-114   [005] ...1    74.480694: rtos_queue_peek_from_isr_failed: tstamp:2641900349 queue:0x0b4a3c58
 kworker/5:1-114   [005] ...1    74.636695: rtos_queue_peek_from_isr_failed: tstamp:2646900810 queue:0x0b4a3c58
 kworker/5:1-114   [005] ...1    74.688707: rtos_queue_peek_from_isr_failed: tstamp:2649383435 queue:0x0b4a3c58
 kworker/5:1-114   [005] ...1    74.740706: rtos_queue_peek_from_isr_failed: tstamp:2650167809 queue:0x0b4a3c58
 kworker/5:1-114   [005] ...1    74.740710: rtcpu_start: tstamp:2650168688
 kworker/5:1-114   [005] ...1    74.896728: rtos_queue_peek_from_isr_failed: tstamp:2655168686 queue:0x0b4a3c58
 kworker/5:1-114   [005] ...1    75.052733: rtos_queue_peek_from_isr_failed: tstamp:2660169226 queue:0x0b4a3c58
 kworker/5:1-114   [005] ...1    75.208747: rtos_queue_peek_from_isr_failed: tstamp:2665169736 queue:0x0b4a3c58
 kworker/5:1-114   [005] ...1    75.364746: rtos_queue_peek_from_isr_failed: tstamp:2670170235 queue:0x0b4a3c58
 kworker/5:1-114   [005] ...1    75.520686: rtos_queue_peek_from_isr_failed: tstamp:2675170692 queue:0x0b4a3c58
 kworker/5:1-114   [005] ...1    75.680691: rtos_queue_peek_from_isr_failed: tstamp:2680171216 queue:0x0b4a3c58
 kworker/5:1-114   [005] ...1    75.836748: rtos_queue_peek_from_isr_failed: tstamp:2685171810 queue:0x0b4a3c58
 kworker/5:1-114   [005] ...1    75.992731: rtos_queue_peek_from_isr_failed: tstamp:2690172260 queue:0x0b4a3c58
 kworker/5:1-114   [005] ...1    76.200724: rtos_queue_peek_from_isr_failed: tstamp:2695172766 queue:0x0b4a3c58
 kworker/5:1-114   [005] ...1    76.356689: rtos_queue_peek_from_isr_failed: tstamp:2700173226 queue:0x0b4a3c58
 kworker/5:1-114   [005] ...1    76.512696: rtos_queue_peek_from_isr_failed: tstamp:2705173752 queue:0x0b4a3c58
 kworker/5:1-114   [005] ...1    76.668687: rtos_queue_peek_from_isr_failed: tstamp:2710174263 queue:0x0b4a3c58
 kworker/5:1-114   [005] ...1    76.824685: rtos_queue_peek_from_isr_failed: tstamp:2715174770 queue:0x0b4a3c58
 kworker/5:1-114   [005] ...1    76.980686: rtos_queue_peek_from_isr_failed: tstamp:2720175261 queue:0x0b4a3c58
 kworker/5:1-114   [005] ...1    77.136685: rtos_queue_peek_from_isr_failed: tstamp:2725175773 queue:0x0b4a3c58
 kworker/5:1-114   [005] ...1    77.188693: rtcpu_vinotify_handle_msg: tstamp:2727059620 tag:ISPBUF_FS channel:0x00 frame:0 vi_tstamp:2727059192 data:0x00000000
 kworker/5:1-114   [005] ...1    77.188695: rtcpu_vinotify_handle_msg: tstamp:2727066464 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:2727066049 data:0x00000001
 kworker/5:1-114   [005] ...1    77.188696: rtcpu_vinotify_handle_msg: tstamp:2727575734 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:2727575148 data:0x044b0002
 kworker/5:1-114   [005] ...1    77.188697: rtcpu_vinotify_handle_msg: tstamp:2727575842 tag:ISPBUF_FE channel:0x00 frame:0 vi_tstamp:2727575170 data:0x00000000
 kworker/5:1-114   [005] ...1    77.240687: rtcpu_vinotify_handle_msg: tstamp:2728101289 tag:ISPBUF_FS channel:0x00 frame:0 vi_tstamp:2728100864 data:0x00000000
 kworker/5:1-114   [005] ...1    77.240689: rtcpu_vinotify_handle_msg: tstamp:2728108132 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:2728107721 data:0x00000001
 kworker/5:1-114   [005] ...1    77.240690: rtcpu_vinotify_handle_msg: tstamp:2728617402 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:2728616820 data:0x044b0002
 kworker/5:1-114   [005] ...1    77.240691: rtcpu_vinotify_handle_msg: tstamp:2728617510 tag:ISPBUF_FE channel:0x00 frame:0 vi_tstamp:2728616841 data:0x00000000
 kworker/5:1-114   [005] ...1    77.240691: rtcpu_vinotify_handle_msg: tstamp:2729142953 tag:ISPBUF_FS channel:0x00 frame:0 vi_tstamp:2729142536 data:0x00000000
 kworker/5:1-114   [005] ...1    77.240692: rtcpu_vinotify_handle_msg: tstamp:2729149802 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:2729149392 data:0x00000001
 kworker/5:1-114   [005] ...1    77.292701: rtcpu_vinotify_handle_msg: tstamp:2729659070 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:2729658491 data:0x044b0002
 kworker/5:1-114   [005] ...1    77.292704: rtcpu_vinotify_handle_msg: tstamp:2729659175 tag:ISPBUF_FE channel:0x00 frame:0 vi_tstamp:2729658513 data:0x00000000
 kworker/5:1-114   [005] ...1    77.292706: rtos_queue_peek_from_isr_failed: tstamp:2730176267 queue:0x0b4a3c58
 kworker/5:1-114   [005] ...1    77.292707: rtcpu_vinotify_handle_msg: tstamp:2730184618 tag:ISPBUF_FS channel:0x00 frame:0 vi_tstamp:2730184207 data:0x00000000
 kworker/5:1-114   [005] ...1    77.292708: rtcpu_vinotify_handle_msg: tstamp:2730191473 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:2730191064 data:0x00000001
 kworker/5:1-114   [005] ...1    77.292709: rtcpu_vinotify_handle_msg: tstamp:2730700757 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:2730700163 data:0x044b0002
 kworker/5:1-114   [005] ...1    77.292709: rtcpu_vinotify_handle_msg: tstamp:2730700870 tag:ISPBUF_FE channel:0x00 frame:0 vi_tstamp:2730700184 data:0x00000000
 kworker/5:1-114   [005] ...1    77.344688: rtcpu_vinotify_handle_msg: tstamp:2731226302 tag:ISPBUF_FS channel:0x00 frame:0 vi_tstamp:2731225879 data:0x00000000
 kworker/5:1-114   [005] ...1    77.344691: rtcpu_vinotify_handle_msg: tstamp:2731233155 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:2731232736 data:0x00000001
 kworker/5:1-114   [005] ...1    77.344691: rtcpu_vinotify_handle_msg: tstamp:2731742420 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:2731741835 data:0x044b0002
 kworker/5:1-114   [005] ...1    77.344692: rtcpu_vinotify_handle_msg: tstamp:2731742527 tag:ISPBUF_FE channel:0x00 frame:0 vi_tstamp:2731741857 data:0x00000000
 kworker/5:1-114   [005] ...1    77.344693: rtcpu_vinotify_handle_msg: tstamp:2732267967 tag:ISPBUF_FS channel:0x00 frame:0 vi_tstamp:2732267551 data:0x00000000
 kworker/5:1-114   [005] ...1    77.344694: rtcpu_vinotify_handle_msg: tstamp:2732274816 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:2732274407 data:0x00000001
 kworker/5:1-114   [005] ...1    77.396685: rtcpu_vinotify_handle_msg: tstamp:2732784085 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:2732783506 data:0x044b0002
 kworker/5:1-114   [005] ...1    77.396686: rtcpu_vinotify_handle_msg: tstamp:2732784193 tag:ISPBUF_FE channel:0x00 frame:0 vi_tstamp:2732783528 data:0x00000000
 kworker/5:1-114   [005] ...1    77.396687: rtcpu_vinotify_handle_msg: tstamp:2733309639 tag:ISPBUF_FS channel:0x00 frame:0 vi_tstamp:2733309222 data:0x00000000
 kworker/5:1-114   [005] ...1    77.396688: rtcpu_vinotify_handle_msg: tstamp:2733316489 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:2733316079 data:0x00000001
 kworker/5:1-114   [005] ...1    77.396689: rtcpu_vinotify_handle_msg: tstamp:2733825757 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:2733825178 data:0x044b0002
 kworker/5:1-114   [005] ...1    77.396689: rtcpu_vinotify_handle_msg: tstamp:2733825864 tag:ISPBUF_FE channel:0x00 frame:0 vi_tstamp:2733825200 data:0x00000000
 kworker/5:1-114   [005] ...1    77.448684: rtcpu_vinotify_handle_msg: tstamp:2734351309 tag:ISPBUF_FS channel:0x00 frame:0 vi_tstamp:2734350895 data:0x00000000
 kworker/5:1-114   [005] ...1    77.448686: rtcpu_vinotify_handle_msg: tstamp:2734358164 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:2734357750 data:0x00000001
 kworker/5:1-114   [005] ...1    77.448687: rtcpu_vinotify_handle_msg: tstamp:2734867426 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:2734866849 data:0x044b0002
 kworker/5:1-114   [005] ...1    77.448688: rtcpu_vinotify_handle_msg: tstamp:2734867534 tag:ISPBUF_FE channel:0x00 frame:0 vi_tstamp:2734866872 data:0x00000000
 kworker/5:1-114   [005] ...1    77.448690: rtos_queue_peek_from_isr_failed: tstamp:2735176773 queue:0x0b4a3c58
 kworker/5:1-114   [005] ...1    77.448690: rtcpu_vinotify_handle_msg: tstamp:2735392982 tag:ISPBUF_FS channel:0x00 frame:0 vi_tstamp:2735392567 data:0x00000000
 kworker/5:1-114   [005] ...1    77.448691: rtcpu_vinotify_handle_msg: tstamp:2735399834 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:2735399423 data:0x00000001
 kworker/5:1-114   [005] ...1    77.500684: rtcpu_vinotify_handle_msg: tstamp:2735909099 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:2735908522 data:0x044b0002
 kworker/5:1-114   [005] ...1    77.500686: rtcpu_vinotify_handle_msg: tstamp:2735909208 tag:ISPBUF_FE channel:0x00 frame:0 vi_tstamp:2735908544 data:0x00000000
 kworker/5:1-114   [005] ...1    77.500686: rtcpu_vinotify_handle_msg: tstamp:2736434653 tag:ISPBUF_FS channel:0x00 frame:0 vi_tstamp:2736434239 data:0x00000000
 kworker/5:1-114   [005] ...1    77.500687: rtcpu_vinotify_handle_msg: tstamp:2736441507 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:2736441096 data:0x00000001
 kworker/5:1-114   [005] ...1    77.500688: rtcpu_vinotify_handle_msg: tstamp:2736950773 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:2736950195 data:0x044b0002
 kworker/5:1-114   [005] ...1    77.500689: rtcpu_vinotify_handle_msg: tstamp:2736950882 tag:ISPBUF_FE channel:0x00 frame:0 vi_tstamp:2736950216 data:0x00000000
 kworker/5:1-114   [005] ...1    77.552683: rtcpu_vinotify_handle_msg: tstamp:2737476327 tag:ISPBUF_FS channel:0x00 frame:0 vi_tstamp:2737475911 data:0x00000000
 kworker/5:1-114   [005] ...1    77.552684: rtcpu_vinotify_handle_msg: tstamp:2737483176 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:2737482768 data:0x00000001
 kworker/5:1-114   [005] ...1    77.552685: rtcpu_vinotify_handle_msg: tstamp:2737992444 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:2737991867 data:0x044b0002
 kworker/5:1-114   [005] ...1    77.552686: rtcpu_vinotify_handle_msg: tstamp:2737992551 tag:ISPBUF_FE channel:0x00 frame:0 vi_tstamp:2737991888 data:0x00000000
 kworker/5:1-114   [005] ...1    77.552687: rtcpu_vinotify_handle_msg: tstamp:2738517998 tag:ISPBUF_FS channel:0x00 frame:0 vi_tstamp:2738517583 data:0x00000000
 kworker/5:1-114   [005] ...1    77.552687: rtcpu_vinotify_handle_msg: tstamp:2738524848 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:2738524439 data:0x00000001
 kworker/5:1-114   [005] ...1    77.604681: rtcpu_vinotify_handle_msg: tstamp:2739034117 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:2739033538 data:0x044b0002
 kworker/5:1-114   [005] ...1    77.604683: rtcpu_vinotify_handle_msg: tstamp:2739034226 tag:ISPBUF_FE channel:0x00 frame:0 vi_tstamp:2739033560 data:0x00000000
 kworker/5:1-114   [005] ...1    77.604683: rtcpu_vinotify_handle_msg: tstamp:2739559668 tag:ISPBUF_FS channel:0x00 frame:0 vi_tstamp:2739559255 data:0x00000000
 kworker/5:1-114   [005] ...1    77.604684: rtcpu_vinotify_handle_msg: tstamp:2739566517 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:2739566111 data:0x00000001
 kworker/5:1-114   [005] ...1    77.604685: rtcpu_vinotify_handle_msg: tstamp:2740075790 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:2740075210 data:0x044b0002
 kworker/5:1-114   [005] ...1    77.604686: rtcpu_vinotify_handle_msg: tstamp:2740075899 tag:ISPBUF_FE channel:0x00 frame:0 vi_tstamp:2740075231 data:0x00000000
 kworker/5:1-114   [005] ...1    77.604687: rtos_queue_peek_from_isr_failed: tstamp:2740177283 queue:0x0b4a3c58
 kworker/5:1-114   [005] ...1    77.656684: rtcpu_vinotify_handle_msg: tstamp:2740601342 tag:ISPBUF_FS channel:0x00 frame:0 vi_tstamp:2740600926 data:0x00000000
 kworker/5:1-114   [005] ...1    77.656686: rtcpu_vinotify_handle_msg: tstamp:2740608190 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:2740607783 data:0x00000001
 kworker/5:1-114   [005] ...1    77.656687: rtcpu_vinotify_handle_msg: tstamp:2741117464 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:2741116882 data:0x044b0002
 kworker/5:1-114   [005] ...1    77.656687: rtcpu_vinotify_handle_msg: tstamp:2741117572 tag:ISPBUF_FE channel:0x00 frame:0 vi_tstamp:2741116904 data:0x00000000
 kworker/5:1-114   [005] ...1    77.656688: rtcpu_vinotify_handle_msg: tstamp:2741643013 tag:ISPBUF_FS channel:0x00 frame:0 vi_tstamp:2741642598 data:0x00000000
 kworker/5:1-114   [005] ...1    77.656689: rtcpu_vinotify_handle_msg: tstamp:2741649863 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:2741649456 data:0x00000001
 kworker/5:1-114   [005] ...1    77.656690: rtcpu_vinotify_handle_msg: tstamp:2742159132 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:2742158555 data:0x044b0002
 kworker/5:1-114   [005] ...1    77.656691: rtcpu_vinotify_handle_msg: tstamp:2742159240 tag:ISPBUF_FE channel:0x00 frame:0 vi_tstamp:2742158577 data:0x00000000
 kworker/5:1-114   [005] ...1    77.708684: rtcpu_vinotify_handle_msg: tstamp:2742684687 tag:ISPBUF_FS channel:0x00 frame:0 vi_tstamp:2742684271 data:0x00000000
 kworker/5:1-114   [005] ...1    77.708685: rtcpu_vinotify_handle_msg: tstamp:2742691536 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:2742691128 data:0x00000001
 kworker/5:1-114   [005] ...1    77.708686: rtcpu_vinotify_handle_msg: tstamp:2743200808 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:2743200227 data:0x044b0002
 kworker/5:1-114   [005] ...1    77.708687: rtcpu_vinotify_handle_msg: tstamp:2743200914 tag:ISPBUF_FE channel:0x00 frame:0 vi_tstamp:2743200248 data:0x00000000
 kworker/5:1-114   [005] ...1    77.708687: rtcpu_vinotify_handle_msg: tstamp:2743726360 tag:ISPBUF_FS channel:0x00 frame:0 vi_tstamp:2743725943 data:0x00000000
 kworker/5:1-114   [005] ...1    77.708688: rtcpu_vinotify_handle_msg: tstamp:2743733209 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:2743732800 data:0x00000001
 kworker/5:1-114   [005] ...1    77.760688: rtcpu_vinotify_handle_msg: tstamp:2744242477 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:2744241900 data:0x044b0002
 kworker/5:1-114   [005] ...1    77.760691: rtcpu_vinotify_handle_msg: tstamp:2744242583 tag:ISPBUF_FE channel:0x00 frame:0 vi_tstamp:2744241921 data:0x00000000
 kworker/5:1-114   [005] ...1    77.760691: rtcpu_vinotify_handle_msg: tstamp:2744768032 tag:ISPBUF_FS channel:0x00 frame:0 vi_tstamp:2744767616 data:0x00000000
 kworker/5:1-114   [005] ...1    77.760692: rtcpu_vinotify_handle_msg: tstamp:2744774881 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:2744774473 data:0x00000001
 kworker/5:1-114   [005] ...1    77.760694: rtos_queue_peek_from_isr_failed: tstamp:2745177789 queue:0x0b4a3c58
 kworker/5:1-114   [005] ...1    77.760695: rtcpu_vinotify_handle_msg: tstamp:2745284150 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:2745283572 data:0x044b0002
 kworker/5:1-114   [005] ...1    77.760696: rtcpu_vinotify_handle_msg: tstamp:2745284256 tag:ISPBUF_FE channel:0x00 frame:0 vi_tstamp:2745283593 data:0x00000000
 kworker/5:1-114   [005] ...1    77.812689: rtcpu_vinotify_handle_msg: tstamp:2745809705 tag:ISPBUF_FS channel:0x00 frame:0 vi_tstamp:2745809288 data:0x00000000
 kworker/5:1-114   [005] ...1    77.812692: rtcpu_vinotify_handle_msg: tstamp:2745816553 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:2745816145 data:0x00000001
 kworker/5:1-114   [005] ...1    77.812692: rtcpu_vinotify_handle_msg: tstamp:2746325826 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:2746325244 data:0x044b0002
 kworker/5:1-114   [005] ...1    77.812693: rtcpu_vinotify_handle_msg: tstamp:2746325932 tag:ISPBUF_FE channel:0x00 frame:0 vi_tstamp:2746325265 data:0x00000000
 kworker/5:1-114   [005] ...1    77.812694: rtcpu_vinotify_handle_msg: tstamp:2746851373 tag:ISPBUF_FS channel:0x00 frame:0 vi_tstamp:2746850960 data:0x00000000
 kworker/5:1-114   [005] ...1    77.812695: rtcpu_vinotify_handle_msg: tstamp:2746858225 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:2746857817 data:0x00000001
 kworker/5:1-114   [005] ...1    77.864685: rtcpu_vinotify_handle_msg: tstamp:2747367493 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:2747366917 data:0x044b0002
 kworker/5:1-114   [005] ...1    77.864686: rtcpu_vinotify_handle_msg: tstamp:2747367601 tag:ISPBUF_FE channel:0x00 frame:0 vi_tstamp:2747366938 data:0x00000000
 kworker/5:1-114   [005] ...1    77.864687: rtcpu_vinotify_handle_msg: tstamp:2747893047 tag:ISPBUF_FS channel:0x00 frame:0 vi_tstamp:2747892633 data:0x00000000
 kworker/5:1-114   [005] ...1    77.864688: rtcpu_vinotify_handle_msg: tstamp:2747899900 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:2747899489 data:0x00000001
 kworker/5:1-114   [005] ...1    77.864688: rtcpu_vinotify_handle_msg: tstamp:2748409164 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:2748408588 data:0x044b0002
 kworker/5:1-114   [005] ...1    77.864689: rtcpu_vinotify_handle_msg: tstamp:2748409270 tag:ISPBUF_FE channel:0x00 frame:0 vi_tstamp:2748408609 data:0x00000000
 kworker/5:1-114   [005] ...1    77.916682: rtcpu_vinotify_handle_msg: tstamp:2748934719 tag:ISPBUF_FS channel:0x00 frame:0 vi_tstamp:2748934305 data:0x00000000
 kworker/5:1-114   [005] ...1    77.916684: rtcpu_vinotify_handle_msg: tstamp:2748941569 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:2748941161 data:0x00000001
 kworker/5:1-114   [005] ...1    77.916685: rtcpu_vinotify_handle_msg: tstamp:2749450836 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:2749450260 data:0x044b0002
 kworker/5:1-114   [005] ...1    77.916686: rtcpu_vinotify_handle_msg: tstamp:2749450942 tag:ISPBUF_FE channel:0x00 frame:0 vi_tstamp:2749450282 data:0x00000000
 kworker/5:1-114   [005] ...1    77.916686: rtcpu_vinotify_handle_msg: tstamp:2749976389 tag:ISPBUF_FS channel:0x00 frame:0 vi_tstamp:2749975977 data:0x00000000
 kworker/5:1-114   [005] ...1    77.916688: rtcpu_vinotify_handle_msg: tstamp:2749983242 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:2749982834 data:0x00000001
 kworker/5:1-114   [005] ...1    77.916690: rtos_queue_peek_from_isr_failed: tstamp:2750178303 queue:0x0b4a3c58
 kworker/5:1-114   [005] ...1    77.968718: rtcpu_vinotify_handle_msg: tstamp:2750492511 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:2750491933 data:0x044b0002
 kworker/5:1-114   [005] ...1    77.968720: rtcpu_vinotify_handle_msg: tstamp:2750492619 tag:ISPBUF_FE channel:0x00 frame:0 vi_tstamp:2750491955 data:0x00000000
 kworker/5:1-114   [005] ...1    77.968721: rtcpu_vinotify_handle_msg: tstamp:2751018066 tag:ISPBUF_FS channel:0x00 frame:0 vi_tstamp:2751017650 data:0x00000000
 kworker/5:1-114   [005] ...1    77.968722: rtcpu_vinotify_handle_msg: tstamp:2751024915 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:2751024507 data:0x00000001
 kworker/5:1-114   [005] ...1    77.968723: rtcpu_vinotify_handle_msg: tstamp:2751534184 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:2751533606 data:0x044b0002
 kworker/5:1-114   [005] ...1    77.968723: rtcpu_vinotify_handle_msg: tstamp:2751534291 tag:ISPBUF_FE channel:0x00 frame:0 vi_tstamp:2751533628 data:0x00000000
 kworker/5:1-114   [005] ...1    78.020689: rtcpu_vinotify_handle_msg: tstamp:2752059739 tag:ISPBUF_FS channel:0x00 frame:0 vi_tstamp:2752059322 data:0x00000000
 kworker/5:1-114   [005] ...1    78.020692: rtcpu_vinotify_handle_msg: tstamp:2752066587 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:2752066179 data:0x00000001
 kworker/5:1-114   [005] ...1    78.020693: rtcpu_vinotify_handle_msg: tstamp:2752575856 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:2752575279 data:0x044b0002
 kworker/5:1-114   [005] ...1    78.020694: rtcpu_vinotify_handle_msg: tstamp:2752575965 tag:ISPBUF_FE channel:0x00 frame:0 vi_tstamp:2752575301 data:0x00000000
 kworker/5:1-114   [005] ...1    78.020695: rtcpu_vinotify_handle_msg: tstamp:2753101409 tag:ISPBUF_FS channel:0x00 frame:0 vi_tstamp:2753100995 data:0x00000000
 kworker/5:1-114   [005] ...1    78.020695: rtcpu_vinotify_handle_msg: tstamp:2753108256 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:2753107851 data:0x00000001
 kworker/5:1-114   [005] ...1    78.072689: rtcpu_vinotify_handle_msg: tstamp:2753617530 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:2753616951 data:0x044b0002
 kworker/5:1-114   [005] ...1    78.072691: rtcpu_vinotify_handle_msg: tstamp:2753617637 tag:ISPBUF_FE channel:0x00 frame:0 vi_tstamp:2753616973 data:0x00000000
 kworker/5:1-114   [005] ...1    78.072692: rtcpu_vinotify_handle_msg: tstamp:2754143084 tag:ISPBUF_FS channel:0x00 frame:0 vi_tstamp:2754142668 data:0x00000000
 kworker/5:1-114   [005] ...1    78.072693: rtcpu_vinotify_handle_msg: tstamp:2754149932 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:2754149524 data:0x00000001
 kworker/5:1-114   [005] ...1    78.072694: rtcpu_vinotify_handle_msg: tstamp:2754659201 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:2754658624 data:0x044b0002
 kworker/5:1-114   [005] ...1    78.072695: rtcpu_vinotify_handle_msg: tstamp:2754659308 tag:ISPBUF_FE channel:0x00 frame:0 vi_tstamp:2754658645 data:0x00000000
 kworker/5:1-114   [005] ...1    78.072697: rtos_queue_peek_from_isr_failed: tstamp:2755178804 queue:0x0b4a3c58
 kworker/5:1-114   [005] ...1    78.072698: rtcpu_vinotify_handle_msg: tstamp:2755184751 tag:ISPBUF_FS channel:0x00 frame:0 vi_tstamp:2755184340 data:0x00000000
 kworker/5:1-114   [005] ...1    78.072698: rtcpu_vinotify_handle_msg: tstamp:2755191605 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:2755191196 data:0x00000001
 kworker/5:1-114   [005] ...1    78.124686: rtcpu_vinotify_handle_msg: tstamp:2755700876 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:2755700296 data:0x044b0002
 kworker/5:1-114   [005] ...1    78.124688: rtcpu_vinotify_handle_msg: tstamp:2755700984 tag:ISPBUF_FE channel:0x00 frame:0 vi_tstamp:2755700317 data:0x00000000
 kworker/5:1-114   [005] ...1    78.124689: rtcpu_vinotify_handle_msg: tstamp:2756226426 tag:ISPBUF_FS channel:0x00 frame:0 vi_tstamp:2756226012 data:0x00000000
 kworker/5:1-114   [005] ...1    78.124689: rtcpu_vinotify_handle_msg: tstamp:2756233279 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:2756232869 data:0x00000001
 kworker/5:1-114   [005] ...1    78.124690: rtcpu_vinotify_handle_msg: tstamp:2756742547 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:2756741968 data:0x044b0002
 kworker/5:1-114   [005] ...1    78.124691: rtcpu_vinotify_handle_msg: tstamp:2756742653 tag:ISPBUF_FE channel:0x00 frame:0 vi_tstamp:2756741989 data:0x00000000
 kworker/5:1-114   [005] ...1    78.176683: rtcpu_vinotify_handle_msg: tstamp:2757268098 tag:ISPBUF_FS channel:0x00 frame:0 vi_tstamp:2757267685 data:0x00000000
 kworker/5:1-114   [005] ...1    78.176684: rtcpu_vinotify_handle_msg: tstamp:2757274954 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:2757274541 data:0x00000001
 kworker/5:1-114   [005] ...1    78.176685: rtcpu_vinotify_handle_msg: tstamp:2757784217 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:2757783640 data:0x044b0002
 kworker/5:1-114   [005] ...1    78.176686: rtcpu_vinotify_handle_msg: tstamp:2757784325 tag:ISPBUF_FE channel:0x00 frame:0 vi_tstamp:2757783661 data:0x00000000
 kworker/5:1-114   [005] ...1    78.176687: rtcpu_vinotify_handle_msg: tstamp:2758309772 tag:ISPBUF_FS channel:0x00 frame:0 vi_tstamp:2758309356 data:0x00000000
 kworker/5:1-114   [005] ...1    78.176688: rtcpu_vinotify_handle_msg: tstamp:2758316633 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:2758316213 data:0x00000001
 kworker/5:1-114   [005] ...1    78.228683: rtcpu_vinotify_handle_msg: tstamp:2758825889 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:2758825312 data:0x044b0002
 kworker/5:1-114   [005] ...1    78.228685: rtcpu_vinotify_handle_msg: tstamp:2758825997 tag:ISPBUF_FE channel:0x00 frame:0 vi_tstamp:2758825334 data:0x00000000
 kworker/5:1-114   [005] ...1    78.228686: rtcpu_vinotify_handle_msg: tstamp:2759351444 tag:ISPBUF_FS channel:0x00 frame:0 vi_tstamp:2759351030 data:0x00000000
 kworker/5:1-114   [005] ...1    78.228686: rtcpu_vinotify_handle_msg: tstamp:2759358307 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:2759357886 data:0x00000001
 kworker/5:1-114   [005] ...1    78.228687: rtcpu_vinotify_handle_msg: tstamp:2759867566 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:2759866985 data:0x044b0002
 kworker/5:1-114   [005] ...1    78.228688: rtcpu_vinotify_handle_msg: tstamp:2759867674 tag:ISPBUF_FE channel:0x00 frame:0 vi_tstamp:2759867007 data:0x00000000
 kworker/5:1-114   [005] ...1    78.280688: rtos_queue_peek_from_isr_failed: tstamp:2760179308 queue:0x0b4a3c58
 kworker/5:1-114   [005] ...1    78.280690: rtcpu_vinotify_handle_msg: tstamp:2760393116 tag:ISPBUF_FS channel:0x00 frame:0 vi_tstamp:2760392702 data:0x00000000
 kworker/5:1-114   [005] ...1    78.280691: rtcpu_vinotify_handle_msg: tstamp:2760399978 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:2760399558 data:0x00000001
 kworker/5:1-114   [005] ...1    78.280691: rtcpu_vinotify_handle_msg: tstamp:2760909238 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:2760908658 data:0x044b0002
 kworker/5:1-114   [005] ...1    78.280692: rtcpu_vinotify_handle_msg: tstamp:2760909348 tag:ISPBUF_FE channel:0x00 frame:0 vi_tstamp:2760908680 data:0x00000000
 kworker/5:1-114   [005] ...1    78.280693: rtcpu_vinotify_handle_msg: tstamp:2761434788 tag:ISPBUF_FS channel:0x00 frame:0 vi_tstamp:2761434374 data:0x00000000
 kworker/5:1-114   [005] ...1    78.280694: rtcpu_vinotify_handle_msg: tstamp:2761441650 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:2761441231 data:0x00000001
 kworker/5:1-114   [005] ...1    78.332683: rtcpu_vinotify_handle_msg: tstamp:2761950910 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:2761950330 data:0x044b0002
 kworker/5:1-114   [005] ...1    78.332684: rtcpu_vinotify_handle_msg: tstamp:2761951017 tag:ISPBUF_FE channel:0x00 frame:0 vi_tstamp:2761950352 data:0x00000000
 kworker/5:1-114   [005] ...1    78.332685: rtcpu_vinotify_handle_msg: tstamp:2762476458 tag:ISPBUF_FS channel:0x00 frame:0 vi_tstamp:2762476047 data:0x00000000
 kworker/5:1-114   [005] ...1    78.332686: rtcpu_vinotify_handle_msg: tstamp:2762483321 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:2762482904 data:0x00000001
 kworker/5:1-114   [005] ...1    78.332687: rtcpu_vinotify_handle_msg: tstamp:2762992584 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:2762992003 data:0x044b0002
 kworker/5:1-114   [005] ...1    78.332687: rtcpu_vinotify_handle_msg: tstamp:2762992693 tag:ISPBUF_FE channel:0x00 frame:0 vi_tstamp:2762992025 data:0x00000000
 kworker/5:1-114   [005] ...1    78.384685: rtcpu_vinotify_handle_msg: tstamp:2763518134 tag:ISPBUF_FS channel:0x00 frame:0 vi_tstamp:2763517719 data:0x00000000
 kworker/5:1-114   [005] ...1    78.384687: rtcpu_vinotify_handle_msg: tstamp:2763524985 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:2763524576 data:0x00000001
 kworker/5:1-114   [005] ...1    78.384688: rtcpu_vinotify_handle_msg: tstamp:2764034256 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:2764033676 data:0x044b0002
 kworker/5:1-114   [005] ...1    78.384689: rtcpu_vinotify_handle_msg: tstamp:2764034363 tag:ISPBUF_FE channel:0x00 frame:0 vi_tstamp:2764033697 data:0x00000000
 kworker/5:1-114   [005] ...1    78.384690: rtcpu_vinotify_handle_msg: tstamp:2764559817 tag:ISPBUF_FS channel:0x00 frame:0 vi_tstamp:2764559392 data:0x00000000
 kworker/5:1-114   [005] ...1    78.384690: rtcpu_vinotify_handle_msg: tstamp:2764566656 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:2764566249 data:0x00000001
 kworker/5:1-114   [005] ...1    78.436756: rtcpu_vinotify_handle_msg: tstamp:2765075926 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:2765075348 data:0x044b0002
 kworker/5:1-114   [005] ...1    78.436765: rtcpu_vinotify_handle_msg: tstamp:2765076035 tag:ISPBUF_FE channel:0x00 frame:0 vi_tstamp:2765075369 data:0x00000000
 kworker/5:1-114   [005] ...1    78.436772: rtos_queue_peek_from_isr_failed: tstamp:2765179816 queue:0x0b4a3c58
 kworker/5:1-114   [005] ...1    78.436775: rtcpu_vinotify_handle_msg: tstamp:2765601489 tag:ISPBUF_FS channel:0x00 frame:0 vi_tstamp:2765601064 data:0x00000000
 kworker/5:1-114   [005] ...1    78.436778: rtcpu_vinotify_handle_msg: tstamp:2765608329 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:2765607921 data:0x00000001
 kworker/5:1-114   [005] ...1    78.436780: rtcpu_vinotify_handle_msg: tstamp:2766117659 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:2766117021 data:0x044b0002
 kworker/5:1-114   [005] ...1    78.436783: rtcpu_vinotify_handle_msg: tstamp:2766117852 tag:ISPBUF_FE channel:0x00 frame:0 vi_tstamp:2766117042 data:0x00000000
 kworker/5:1-114   [005] ...1    78.488703: rtcpu_vinotify_handle_msg: tstamp:2766643197 tag:ISPBUF_FS channel:0x00 frame:0 vi_tstamp:2766642737 data:0x00000000
 kworker/5:1-114   [005] ...1    78.488708: rtcpu_vinotify_handle_msg: tstamp:2766650038 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:2766649593 data:0x00000001
 kworker/5:1-114   [005] ...1    78.488710: rtcpu_vinotify_handle_msg: tstamp:2767159303 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:2767158693 data:0x044b0002
 kworker/5:1-114   [005] ...1    78.488711: rtcpu_vinotify_handle_msg: tstamp:2767159447 tag:ISPBUF_FE channel:0x00 frame:0 vi_tstamp:2767158715 data:0x00000000
 kworker/5:1-114   [005] ...1    78.488715: rtos_queue_peek_from_isr_failed: tstamp:2767657434 queue:0x0b4a3c58

Anyone has met same issue or may give me some suggestion.
Thanks in advance.

hello tobleronwater,

could you please confirm you’re using same sensor modes for both application.
also, please try to use fixed-value of the exposuretime and framelength in the kernel driver.
thanks

Hi Jerry,

Yes, I use same sensor mode for both application.
And after I applied fixed exposure time and framelength, the issue still exists.

Is there any info we can get from the log I’ve post?

I also try v4l2-ctl application to capture, it only gets a full black picture the first time,
and next time always get faild log as below:

stream-count=1 --stream-to=imx390.raw -d /dev/video0
VIDIOC_S_FMT: failed: Device or resource busy
VIDIOC_REQBUFS: failed: Device or resource busy

I also post the kmesg while I first time use v4l2-ctl:
[ 82.482266] imx390 30-001a: imx390_power_on: power on
[ 82.494615] imx390 30-001a: imx390_s_stream++ enable 1

[ 86.168504] tegra-vi4 15700000.vi: PXL_SOF syncpt timeout! err = -11
[ 87.172549] tegra-vi4 15700000.vi: PXL_SOF syncpt timeout! err = -11
[ 88.176444] tegra-vi4 15700000.vi: PXL_SOF syncpt timeout! err = -11
[ 89.180537] tegra-vi4 15700000.vi: PXL_SOF syncpt timeout! err = -11
[ 90.184552] tegra-vi4 15700000.vi: ATOMP_FE syncpt timeout!
[ 90.190840] imx390 30-001a: imx390_s_stream++ enable 0
[ 90.199364] nvcsi 150c0000.nvcsi: csi4_stream_check_status (0) INTR_STATUS 0x00000008
[ 90.207306] nvcsi 150c0000.nvcsi: csi4_stream_check_status (0) ERR_INTR_STATUS 0x00000008
[ 90.277347] imx390 30-001a: imx390_power_off: power off

Please check it out.
Thanks.

hello tobleronwater,

could you please review your sensor driver to check which v4l2 control CID cause below failure.

stream-count=1 --stream-to=imx390.raw -d /dev/video0
VIDIOC_S_FMT: failed: Device or resource busy
VIDIOC_REQBUFS: failed: Device or resource busy

you could also refer to our reference camera driver imx185 for development.
thanks

Hi Jerry,

I don’t think it is caused by the CID control function directly, I’ve already emtpy all my CID function.
And I did refer to driver imx185.

One is most confusing me is that nvgstcapture and gst-launch-1.0 never fail.
Also v4l2-ctl and argus_camera are able to get the first frame.

Could you tell me what’s the sequence while v4l2-ctl and argus_camera get the first frame and the next…

There is another question, how do I post a screenshot for the sensor output format?

Thanks

hello tobleronwater,

show the capture sequence as below,
sensor init–> program syncpt–> wait for start of frame–> write frames into buffer queue–> wait for end of frame–> send buffers to user-space

could you analysis the raw dump files by 3rdparty tools, for example, 7yuv.
also, you could attach the files by editing your comments on the top-right.
thanks