Using devmem to manipulate MIPI_CAL registers

ezaro · May 22, 2019, 1:09am

Hi,

I would like to manipulate tuning parameters for our cameras’ MIPI bus. I am particularly interested in the MIPI_BIAS_PAD_CFGx registers to tune the bias level. It seems as if I should be able to manipulate these values using devmem2 and the address + offset defined in the TX2 reference manual and MIPI/CSI tuning guide.

However, when I try to read or change these values I always receive a bus error. Please see my logic in determining register addresses as well as attempts at reading these values at the bottom of my post.

Help in manually tuning the MIPI_CAL registers would be greatly appreciated. Thank you

From Tegra X2 Technical Reference Manual

MIPI_CAL | start: 0x03990000 | end: 0x0399ffff

29.2.16 MIPI_CAL_MIPI_BIAS_PAD_CFG0_0
MIPI Bias Pad Configuration Register
Offset: 0x5c | Read/Write: R/W | Reset: 0x00000000

$ sudo devmem 0x0399005c
$ /dev/mem opened.
$ Memory mapped at address 0x7f7a6fa000.
$ Bus error

JerryChang · May 22, 2019, 3:35am

hello ezaro,

mipi calibration is done when CSI is powered on.
instead of using devmem to write the registers, suggest you refer to below kernel sources for mipi calibration,
thanks

$TOP/kernel_src/kernel/nvidia/drivers/media/platform/tegra/mipical/mipi_cal.c

ezaro · May 22, 2019, 5:39pm

Hi Jerry,

I understand that the MIPI calibration runs via the kernel source mipi_cal. I have never seen this calibration complete successfully and always see a Mipi Calibration timeout. This doesn’t seem to affect the ability of our cameras to stream. Do you know why this calibration never appears to complete successfully?

Mipi cal timeout

[   56.338798] tegra_mipi_cal 3990000.mipical: Mipi cal timeout,val:8871, lanes:300000
[   56.442791] tegra_mipi_cal 3990000.mipical: Mipi cal timeout,val:8871, lanes:c00000
[   56.550763] tegra_mipi_cal 3990000.mipical: Mipi cal timeout,val:7871, lanes:3000000

We have observed intermittent PXL_SOF syncpnt timeout failures from our cameras. We would like to manually tune some of the MIPI registers to see if we can improve our system stability. Is there a way to do this?

JerryChang · May 23, 2019, 2:12am

hello ezaro,

could you please let us know which JetPack release you’re working with.
let’s debug PXL_SOF syncpnt timeout failures first,
please follow below steps to enable the VI tracing from debugfs

echo 1 > /sys/kernel/debug/tracing/tracing_on
echo 30720 > /sys/kernel/debug/tracing/buffer_size_kb
echo 1 > /sys/kernel/debug/tracing/events/tegra_rtcpu/enable
echo 1 > /sys/kernel/debug/tracing/events/freertos/enable
echo 2 > /sys/kernel/debug/camrtc/log-level
echo > /sys/kernel/debug/tracing/trace
cat /sys/kernel/debug/tracing/trace

ezaro · May 23, 2019, 8:46pm

Jetpack 3.1
Here is an output from the sensor around the time it begins to fail. It streams successfully for approximately 30 seconds to 4 minutes before failing generally.

kworker/4:1-152   [004] ...1   364.010088: rtos_queue_peek_from_isr_failed: tstamp:11674902751 queue:0x0b4a3c58
     kworker/4:1-152   [004] ...1   364.010097: rtcpu_vinotify_handle_msg: tstamp:11675205579 tag:CHANSEL_PXL_EOF channel:0x00 frame:131 vi_tstamp:3085270590 data:0x0da70002
     kworker/4:1-152   [004] ...1   364.010100: rtcpu_vinotify_handle_msg: tstamp:11675206139 tag:ISPBUF_FE channel:0x00 frame:131 vi_tstamp:3085271147 data:0x00000000
     kworker/4:1-152   [004] ...1   364.010102: rtcpu_vinotify_handle_msg: tstamp:11675755256 tag:ISPBUF_FS channel:0x00 frame:132 vi_tstamp:3085820254 data:0x00000000
     kworker/4:1-152   [004] ...1   364.010105: rtcpu_vinotify_handle_msg: tstamp:11675762975 tag:CHANSEL_PXL_SOF channel:0x00 frame:132 vi_tstamp:3085827985 data:0x00000001
     kworker/4:1-152   [004] ...1   364.062092: rtcpu_vinotify_handle_msg: tstamp:11676770949 tag:CHANSEL_PXL_EOF channel:0x00 frame:132 vi_tstamp:3086835953 data:0x0da70002
     kworker/4:1-152   [004] ...1   364.062100: rtcpu_vinotify_handle_msg: tstamp:11676771513 tag:ISPBUF_FE channel:0x00 frame:132 vi_tstamp:3086836511 data:0x00000000
     kworker/4:1-152   [004] ...1   364.062102: rtcpu_vinotify_handle_msg: tstamp:11677320621 tag:ISPBUF_FS channel:0x00 frame:133 vi_tstamp:3087385618 data:0x00000000
     kworker/4:1-152   [004] ...1   364.062105: rtcpu_vinotify_handle_msg: tstamp:11677328335 tag:CHANSEL_PXL_SOF channel:0x00 frame:133 vi_tstamp:3087393349 data:0x00000001
     kworker/4:1-152   [004] ...1   364.114077: rtcpu_vinotify_handle_msg: tstamp:11678336325 tag:CHANSEL_PXL_EOF channel:0x00 frame:133 vi_tstamp:3088401317 data:0x0da70002
     kworker/4:1-152   [004] ...1   364.114085: rtcpu_vinotify_handle_msg: tstamp:11678336888 tag:ISPBUF_FE channel:0x00 frame:133 vi_tstamp:3088401875 data:0x00000000
     kworker/4:1-152   [004] ...1   364.114087: rtcpu_vinotify_handle_msg: tstamp:11678885979 tag:ISPBUF_FS channel:0x00 frame:134 vi_tstamp:3088950983 data:0x00000000
     kworker/4:1-152   [004] ...1   364.114090: rtcpu_vinotify_handle_msg: tstamp:11678893703 tag:CHANSEL_PXL_SOF channel:0x00 frame:134 vi_tstamp:3088958713 data:0x00000001
     kworker/4:1-152   [004] ...1   364.166093: rtcpu_vinotify_handle_msg: tstamp:11679901677 tag:CHANSEL_PXL_EOF channel:0x00 frame:134 vi_tstamp:3089966681 data:0x0da70002
     kworker/4:1-152   [004] ...1   364.166100: rtcpu_vinotify_handle_msg: tstamp:11679902241 tag:ISPBUF_FE channel:0x00 frame:134 vi_tstamp:3089967239 data:0x00000000
     kworker/4:1-152   [004] ...1   364.166105: rtos_queue_peek_from_isr_failed: tstamp:11679903249 queue:0x0b4a3c58
     kworker/4:1-152   [004] ...1   364.166107: rtcpu_vinotify_handle_msg: tstamp:11680451351 tag:ISPBUF_FS channel:0x00 frame:135 vi_tstamp:3090516346 data:0x00000000
     kworker/4:1-152   [004] ...1   364.166110: rtcpu_vinotify_handle_msg: tstamp:11680459065 tag:CHANSEL_PXL_SOF channel:0x00 frame:135 vi_tstamp:3090524077 data:0x00000001
     kworker/4:1-152   [004] ...1   364.218092: rtcpu_vinotify_handle_msg: tstamp:11681467042 tag:CHANSEL_PXL_EOF channel:0x00 frame:135 vi_tstamp:3091532045 data:0x0da70002
     kworker/4:1-152   [004] ...1   364.218099: rtcpu_vinotify_handle_msg: tstamp:11681467606 tag:ISPBUF_FE channel:0x00 frame:135 vi_tstamp:3091532603 data:0x00000000
     kworker/4:1-152   [004] ...1   364.218102: rtcpu_vinotify_handle_msg: tstamp:11682016723 tag:ISPBUF_FS channel:0x00 frame:136 vi_tstamp:3092081711 data:0x00000000
     kworker/4:1-152   [004] ...1   364.218104: rtcpu_vinotify_handle_msg: tstamp:11682024431 tag:CHANSEL_PXL_SOF channel:0x00 frame:136 vi_tstamp:3092089439 data:0x00000001
     kworker/4:1-152   [004] ...1   364.270077: rtcpu_vinotify_handle_msg: tstamp:11683032420 tag:CHANSEL_PXL_EOF channel:0x00 frame:136 vi_tstamp:3093097409 data:0x0da70002
     kworker/4:1-152   [004] ...1   364.270083: rtcpu_vinotify_handle_msg: tstamp:11683032983 tag:ISPBUF_FE channel:0x00 frame:136 vi_tstamp:3093097967 data:0x00000000
     kworker/4:1-152   [004] ...1   364.270086: rtcpu_vinotify_handle_msg: tstamp:11683582075 tag:ISPBUF_FS channel:0x00 frame:137 vi_tstamp:3093647074 data:0x00000000
     kworker/4:1-152   [004] ...1   364.270088: rtcpu_vinotify_handle_msg: tstamp:11683589794 tag:CHANSEL_PXL_SOF channel:0x00 frame:137 vi_tstamp:3093654803 data:0x00000001
     kworker/4:1-152   [004] ...1   364.322077: rtcpu_vinotify_handle_msg: tstamp:11684597773 tag:CHANSEL_PXL_EOF channel:0x00 frame:137 vi_tstamp:3094662773 data:0x0da70002
     kworker/4:1-152   [004] ...1   364.322084: rtcpu_vinotify_handle_msg: tstamp:11684598337 tag:ISPBUF_FE channel:0x00 frame:137 vi_tstamp:3094663330 data:0x00000000
     kworker/4:1-152   [004] ...1   364.322089: rtos_queue_peek_from_isr_failed: tstamp:11684903763 queue:0x0b4a3c58
     kworker/4:1-152   [004] ...1   364.322092: rtcpu_vinotify_handle_msg: tstamp:11685147430 tag:ISPBUF_FS channel:0x00 frame:138 vi_tstamp:3095212438 data:0x00000000
     kworker/4:1-152   [004] ...1   364.322094: rtcpu_vinotify_handle_msg: tstamp:11685155151 tag:CHANSEL_PXL_SOF channel:0x00 frame:138 vi_tstamp:3095220167 data:0x00000001
     kworker/4:1-152   [004] ...1   364.374076: rtcpu_vinotify_handle_msg: tstamp:11686163133 tag:CHANSEL_PXL_EOF channel:0x00 frame:138 vi_tstamp:3096228137 data:0x0da70002
     kworker/4:1-152   [004] ...1   364.374083: rtcpu_vinotify_handle_msg: tstamp:11686163697 tag:ISPBUF_FE channel:0x00 frame:138 vi_tstamp:3096228695 data:0x00000000
     kworker/4:1-152   [004] ...1   364.374086: rtcpu_vinotify_handle_msg: tstamp:11686712798 tag:ISPBUF_FS channel:0x00 frame:139 vi_tstamp:3096777802 data:0x00000000
     kworker/4:1-152   [004] ...1   364.374088: rtcpu_vinotify_handle_msg: tstamp:11686720521 tag:CHANSEL_PXL_SOF channel:0x00 frame:139 vi_tstamp:3096785533 data:0x00000001
     kworker/4:1-152   [004] ...1   364.426077: rtcpu_vinotify_handle_msg: tstamp:11687728500 tag:CHANSEL_PXL_EOF channel:0x00 frame:139 vi_tstamp:3097793501 data:0x0da70002
     kworker/4:1-152   [004] ...1   364.426083: rtcpu_vinotify_handle_msg: tstamp:11687729064 tag:ISPBUF_FE channel:0x00 frame:139 vi_tstamp:3097794059 data:0x00000000
     kworker/4:1-152   [004] ...1   364.426086: rtcpu_vinotify_handle_msg: tstamp:11688278163 tag:ISPBUF_FS channel:0x00 frame:140 vi_tstamp:3098343166 data:0x00000000
     kworker/4:1-152   [004] ...1   364.426088: rtcpu_vinotify_handle_msg: tstamp:11688285886 tag:CHANSEL_PXL_SOF channel:0x00 frame:140 vi_tstamp:3098350896 data:0x00000001
     kworker/4:1-152   [004] ...1   364.478105: rtcpu_vinotify_handle_msg: tstamp:11689293862 tag:CHANSEL_PXL_EOF channel:0x00 frame:140 vi_tstamp:3099358865 data:0x0da70002
     kworker/4:1-152   [004] ...1   364.478111: rtcpu_vinotify_handle_msg: tstamp:11689294427 tag:ISPBUF_FE channel:0x00 frame:140 vi_tstamp:3099359422 data:0x00000000
     kworker/4:1-152   [004] ...1   364.478114: rtcpu_vinotify_handle_msg: tstamp:11689843541 tag:ISPBUF_FS channel:0x00 frame:141 vi_tstamp:3099908529 data:0x00000000
     kworker/4:1-152   [004] ...1   364.478116: rtcpu_vinotify_handle_msg: tstamp:11689851247 tag:CHANSEL_PXL_SOF channel:0x00 frame:141 vi_tstamp:3099916259 data:0x00000001
     kworker/4:1-152   [004] ...1   364.478121: rtos_queue_peek_from_isr_failed: tstamp:11689904263 queue:0x0b4a3c58
     kworker/4:1-152   [004] ...1   364.530073: rtcpu_vinotify_handle_msg: tstamp:11690859222 tag:CHANSEL_PXL_EOF channel:0x00 frame:141 vi_tstamp:3100924228 data:0x0da70002
     kworker/4:1-152   [004] ...1   364.530079: rtcpu_vinotify_handle_msg: tstamp:11690859787 tag:ISPBUF_FE channel:0x00 frame:141 vi_tstamp:3100924787 data:0x00000000
     kworker/4:1-152   [004] ...1   364.530082: rtcpu_vinotify_handle_msg: tstamp:11691408893 tag:ISPBUF_FS channel:0x00 frame:142 vi_tstamp:3101473894 data:0x00000000
     kworker/4:1-152   [004] ...1   364.530084: rtcpu_vinotify_handle_msg: tstamp:11691416613 tag:CHANSEL_PXL_SOF channel:0x00 frame:142 vi_tstamp:3101481623 data:0x00000001
     kworker/4:1-152   [004] ...1   364.582078: rtcpu_vinotify_handle_msg: tstamp:11692424587 tag:CHANSEL_PXL_EOF channel:0x00 frame:142 vi_tstamp:3102489593 data:0x0da70002
     kworker/4:1-152   [004] ...1   364.582085: rtcpu_vinotify_handle_msg: tstamp:11692425152 tag:ISPBUF_FE channel:0x00 frame:142 vi_tstamp:3102490150 data:0x00000000
     kworker/4:1-152   [004] ...1   364.582087: rtcpu_vinotify_handle_msg: tstamp:11692974259 tag:ISPBUF_FS channel:0x00 frame:143 vi_tstamp:3103039257 data:0x00000000
     kworker/4:1-152   [004] ...1   364.582090: rtcpu_vinotify_handle_msg: tstamp:11692981977 tag:CHANSEL_PXL_SOF channel:0x00 frame:143 vi_tstamp:3103046986 data:0x00000001
     kworker/4:1-152   [004] ...1   364.634077: rtcpu_vinotify_handle_msg: tstamp:11693989956 tag:CHANSEL_PXL_EOF channel:0x00 frame:143 vi_tstamp:3104054956 data:0x0da70002
     kworker/4:1-152   [004] ...1   364.634084: rtcpu_vinotify_handle_msg: tstamp:11693990516 tag:ISPBUF_FE channel:0x00 frame:143 vi_tstamp:3104055514 data:0x00000000
     kworker/4:1-152   [004] ...1   364.634087: rtcpu_vinotify_handle_msg: tstamp:11694539623 tag:ISPBUF_FS channel:0x00 frame:144 vi_tstamp:3104604621 data:0x00000000
     kworker/4:1-152   [004] ...1   364.634089: rtcpu_vinotify_handle_msg: tstamp:11694547344 tag:CHANSEL_PXL_SOF channel:0x00 frame:144 vi_tstamp:3104612352 data:0x00000001
     kworker/4:1-152   [004] ...1   364.634094: rtos_queue_peek_from_isr_failed: tstamp:11694904771 queue:0x0b4a3c58
     kworker/4:1-152   [004] ...1   364.686065: rtcpu_vinotify_handle_msg: tstamp:11695555314 tag:CHANSEL_PXL_EOF channel:0x00 frame:144 vi_tstamp:3105620320 data:0x0da70002
     kworker/4:1-152   [004] ...1   364.686071: rtcpu_vinotify_handle_msg: tstamp:11695555879 tag:ISPBUF_FE channel:0x00 frame:144 vi_tstamp:3105620878 data:0x00000000
     kworker/4:1-152   [004] ...1   364.686074: rtcpu_vinotify_handle_msg: tstamp:11696104986 tag:ISPBUF_FS channel:0x00 frame:145 vi_tstamp:3106169985 data:0x00000000
     kworker/4:1-152   [004] ...1   364.686076: rtcpu_vinotify_handle_msg: tstamp:11696112704 tag:CHANSEL_PXL_SOF channel:0x00 frame:145 vi_tstamp:3106177715 data:0x00000001
     kworker/4:1-152   [004] ...1   364.738092: rtcpu_vinotify_handle_msg: tstamp:11697120684 tag:CHANSEL_PXL_EOF channel:0x00 frame:145 vi_tstamp:3107185684 data:0x0da70002
     kworker/4:1-152   [004] ...1   364.738100: rtcpu_vinotify_handle_msg: tstamp:11697121247 tag:ISPBUF_FE channel:0x00 frame:145 vi_tstamp:3107186242 data:0x00000000
     kworker/4:1-152   [004] ...1   364.738103: rtcpu_vinotify_handle_msg: tstamp:11697670361 tag:ISPBUF_FS channel:0x00 frame:146 vi_tstamp:3107735349 data:0x00000000
     kworker/4:1-152   [004] ...1   364.738105: rtcpu_vinotify_handle_msg: tstamp:11697678071 tag:CHANSEL_PXL_SOF channel:0x00 frame:146 vi_tstamp:3107743080 data:0x00000001
     kworker/4:1-152   [004] ...1   364.738108: rtcpu_vinotify_handle_msg: tstamp:11698686058 tag:CHANSEL_PXL_EOF channel:0x00 frame:146 vi_tstamp:3108751048 data:0x0da70002
     kworker/4:1-152   [004] ...1   364.738110: rtcpu_vinotify_handle_msg: tstamp:11698686621 tag:ISPBUF_FE channel:0x00 frame:146 vi_tstamp:3108751606 data:0x00000000
     kworker/4:1-152   [004] ...1   364.790098: rtcpu_vinotify_handle_msg: tstamp:11699235715 tag:ISPBUF_FS channel:0x00 frame:147 vi_tstamp:3109300714 data:0x00000000
     kworker/4:1-152   [004] ...1   364.790106: rtcpu_vinotify_handle_msg: tstamp:11699243432 tag:CHANSEL_PXL_SOF channel:0x00 frame:147 vi_tstamp:3109308442 data:0x00000001
     kworker/4:1-152   [004] ...1   364.790111: rtos_queue_peek_from_isr_failed: tstamp:11699905284 queue:0x0b4a3c58
     kworker/4:1-152   [004] ...1   364.790113: rtcpu_vinotify_handle_msg: tstamp:11700251403 tag:CHANSEL_PXL_EOF channel:0x00 frame:147 vi_tstamp:3110316412 data:0x0da70002
     kworker/4:1-152   [004] ...1   364.790116: rtcpu_vinotify_handle_msg: tstamp:11700251962 tag:ISPBUF_FE channel:0x00 frame:147 vi_tstamp:3110316970 data:0x00000000
     kworker/4:1-152   [004] ...1   364.946066: rtcpu_vinotify_handle_msg: tstamp:11703931804 tag:ISPBUF_FS channel:0x00 frame:150 vi_tstamp:3113996805 data:0x00000000
     kworker/4:1-152   [004] ...1   364.946075: rtcpu_vinotify_handle_msg: tstamp:11703939527 tag:CHANSEL_PXL_SOF channel:0x00 frame:150 vi_tstamp:3114004533 data:0x00000001
     kworker/4:1-152   [004] ...1   364.946080: rtos_queue_peek_from_isr_failed: tstamp:11704905790 queue:0x0b4a3c58
     kworker/4:1-152   [004] ...1   364.946083: rtcpu_vinotify_handle_msg: tstamp:11704947497 tag:CHANSEL_PXL_EOF channel:0x00 frame:150 vi_tstamp:3115012504 data:0x0da70002
     kworker/4:1-152   [004] ...1   364.946085: rtcpu_vinotify_handle_msg: tstamp:11704948054 tag:ISPBUF_FE channel:0x00 frame:150 vi_tstamp:3115013061 data:0x00000000
     kworker/4:1-152   [004] ...1   364.998073: rtcpu_vinotify_handle_msg: tstamp:11705497171 tag:ISPBUF_FS channel:0x00 frame:151 vi_tstamp:3115562168 data:0x00000000
     kworker/4:1-152   [004] ...1   364.998082: rtcpu_vinotify_handle_msg: tstamp:11705504889 tag:CHANSEL_PXL_SOF channel:0x00 frame:151 vi_tstamp:3115569898 data:0x00000001
     kworker/4:1-152   [004] ...1   364.998084: rtcpu_vinotify_handle_msg: tstamp:11706512876 tag:CHANSEL_PXL_EOF channel:0x00 frame:151 vi_tstamp:3116577867 data:0x0da70002
     kworker/4:1-152   [004] ...1   364.998087: rtcpu_vinotify_handle_msg: tstamp:11706513440 tag:ISPBUF_FE channel:0x00 frame:151 vi_tstamp:3116578425 data:0x00000000
     kworker/4:1-152   [004] ...1   365.050063: rtcpu_vinotify_handle_msg: tstamp:11707062535 tag:ISPBUF_FS channel:0x00 frame:152 vi_tstamp:3117127532 data:0x00000000
     kworker/4:1-152   [004] ...1   365.050071: rtcpu_vinotify_handle_msg: tstamp:11707070249 tag:CHANSEL_PXL_SOF channel:0x00 frame:152 vi_tstamp:3117135262 data:0x00000001
     kworker/4:1-152   [004] ...1   365.050074: rtcpu_vinotify_handle_msg: tstamp:11708078228 tag:CHANSEL_PXL_EOF channel:0x00 frame:152 vi_tstamp:3118143231 data:0x0da70002
     kworker/4:1-152   [004] ...1   365.050076: rtcpu_vinotify_handle_msg: tstamp:11708078792 tag:ISPBUF_FE channel:0x00 frame:152 vi_tstamp:3118143789 data:0x00000000
     kworker/4:1-152   [004] ...1   365.102082: rtcpu_vinotify_handle_msg: tstamp:11708627897 tag:ISPBUF_FS channel:0x00 frame:153 vi_tstamp:3118692897 data:0x00000000
     kworker/4:1-152   [004] ...1   365.102090: rtcpu_vinotify_handle_msg: tstamp:11708635616 tag:CHANSEL_PXL_SOF channel:0x00 frame:153 vi_tstamp:3118700627 data:0x00000001
     kworker/4:1-152   [004] ...1   365.102092: rtcpu_vinotify_handle_msg: tstamp:11709643593 tag:CHANSEL_PXL_EOF channel:0x00 frame:153 vi_tstamp:3119708595 data:0x0da70002
     kworker/4:1-152   [004] ...1   365.102094: rtcpu_vinotify_handle_msg: tstamp:11709644149 tag:ISPBUF_FE channel:0x00 frame:153 vi_tstamp:3119709153 data:0x00000000
     kworker/4:1-152   [004] ...1   365.102099: rtos_queue_peek_from_isr_failed: tstamp:11709906298 queue:0x0b4a3c58
     kworker/4:1-152   [004] ...1   365.154070: rtcpu_vinotify_handle_msg: tstamp:11710193253 tag:ISPBUF_FS channel:0x00 frame:154 vi_tstamp:3120258260 data:0x00000000
     kworker/4:1-152   [004] ...1   365.154078: rtcpu_vinotify_handle_msg: tstamp:11710200980 tag:CHANSEL_PXL_SOF channel:0x00 frame:154 vi_tstamp:3120265990 data:0x00000001
     kworker/4:1-152   [004] ...1   365.154080: rtcpu_vinotify_handle_msg: tstamp:11711208956 tag:CHANSEL_PXL_EOF channel:0x00 frame:154 vi_tstamp:3121273959 data:0x0da70002
     kworker/4:1-152   [004] ...1   365.154083: rtcpu_vinotify_handle_msg: tstamp:11711209519 tag:ISPBUF_FE channel:0x00 frame:154 vi_tstamp:3121274516 data:0x00000000
     kworker/4:1-152   [004] ...1   365.206593: rtcpu_vinotify_handle_msg: tstamp:11711758624 tag:ISPBUF_FS channel:0x00 frame:155 vi_tstamp:3121823624 data:0x00000000
     kworker/4:1-152   [004] ...1   365.206602: rtcpu_vinotify_handle_msg: tstamp:11711766341 tag:CHANSEL_PXL_SOF channel:0x00 frame:155 vi_tstamp:3121831353 data:0x00000001
     kworker/4:1-152   [004] ...1   365.206604: rtcpu_vinotify_handle_msg: tstamp:11712774322 tag:CHANSEL_PXL_EOF channel:0x00 frame:155 vi_tstamp:3122839323 data:0x0da70002
     kworker/4:1-152   [004] ...1   365.206606: rtcpu_vinotify_handle_msg: tstamp:11712774884 tag:ISPBUF_FE channel:0x00 frame:155 vi_tstamp:3122839881 data:0x00000000
     kworker/4:1-152   [004] ...1   365.206609: rtcpu_vinotify_handle_msg: tstamp:11713323985 tag:ISPBUF_FS channel:0x00 frame:156 vi_tstamp:3123388988 data:0x00000000
     kworker/4:1-152   [004] ...1   365.206611: rtcpu_vinotify_handle_msg: tstamp:11713331707 tag:CHANSEL_PXL_SOF channel:0x00 frame:156 vi_tstamp:3123396717 data:0x00000001
     kworker/4:1-152   [004] ...1   365.258094: rtcpu_vinotify_handle_msg: tstamp:11714339691 tag:CHANSEL_PXL_EOF channel:0x00 frame:156 vi_tstamp:3124404687 data:0x0da70002
     kworker/4:1-152   [004] ...1   365.258101: rtcpu_vinotify_handle_msg: tstamp:11714340254 tag:ISPBUF_FE channel:0x00 frame:156 vi_tstamp:3124405244 data:0x00000000
     kworker/4:1-152   [004] ...1   365.258107: rtcpu_vinotify_handle_msg: tstamp:11714889364 tag:ISPBUF_FS channel:0x00 frame:157 vi_tstamp:3124954352 data:0x00000000
     kworker/4:1-152   [004] ...1   365.258110: rtcpu_vinotify_handle_msg: tstamp:11714897072 tag:CHANSEL_PXL_SOF channel:0x00 frame:157 vi_tstamp:3124962082 data:0x00000001
     kworker/4:1-152   [004] ...1   365.258115: rtos_queue_peek_from_isr_failed: tstamp:11714906794 queue:0x0b4a3c58
     kworker/4:1-152   [004] ...1   365.310086: rtcpu_vinotify_handle_msg: tstamp:11715905064 tag:CHANSEL_PXL_EOF channel:0x00 frame:157 vi_tstamp:3125970051 data:0x0da70002
     kworker/4:1-152   [004] ...1   365.310093: rtcpu_vinotify_handle_msg: tstamp:11715905629 tag:ISPBUF_FE channel:0x00 frame:157 vi_tstamp:3125970609 data:0x00000000
     kworker/4:1-152   [004] ...1   365.310096: rtcpu_vinotify_handle_msg: tstamp:11716454719 tag:ISPBUF_FS channel:0x00 frame:158 vi_tstamp:3126519716 data:0x00000000
     kworker/4:1-152   [004] ...1   365.310099: rtcpu_vinotify_handle_msg: tstamp:11716462437 tag:CHANSEL_PXL_SOF channel:0x00 frame:158 vi_tstamp:3126527446 data:0x00000001
     kworker/4:1-152   [004] ...1   365.362140: rtcpu_vinotify_handle_msg: tstamp:11717470412 tag:CHANSEL_PXL_EOF channel:0x00 frame:158 vi_tstamp:3127535415 data:0x0da70002
     kworker/4:1-152   [004] ...1   365.362148: rtcpu_vinotify_handle_msg: tstamp:11717470974 tag:ISPBUF_FE channel:0x00 frame:158 vi_tstamp:3127535973 data:0x00000000
     kworker/4:1-152   [004] ...1   365.362150: rtcpu_vinotify_handle_msg: tstamp:11718020077 tag:ISPBUF_FS channel:0x00 frame:159 vi_tstamp:3128085080 data:0x00000000
     kworker/4:1-152   [004] ...1   365.362153: rtcpu_vinotify_handle_msg: tstamp:11718027799 tag:CHANSEL_PXL_SOF channel:0x00 frame:159 vi_tstamp:3128092809 data:0x00000001
     kworker/4:1-152   [004] ...1   365.414089: rtcpu_vinotify_handle_msg: tstamp:11719035774 tag:CHANSEL_PXL_EOF channel:0x00 frame:159 vi_tstamp:3129100779 data:0x0da70002
     kworker/4:1-152   [004] ...1   365.414096: rtcpu_vinotify_handle_msg: tstamp:11719036336 tag:ISPBUF_FE channel:0x00 frame:159 vi_tstamp:3129101336 data:0x00000000
     kworker/4:1-152   [004] ...1   365.414098: rtcpu_vinotify_handle_msg: tstamp:11719585443 tag:ISPBUF_FS channel:0x00 frame:160 vi_tstamp:3129650443 data:0x00000000
     kworker/4:1-152   [004] ...1   365.414101: rtcpu_vinotify_handle_msg: tstamp:11719593161 tag:CHANSEL_PXL_SOF channel:0x00 frame:160 vi_tstamp:3129658173 data:0x00000001
     kworker/4:1-152   [004] ...1   365.466059: rtos_queue_peek_from_isr_failed: tstamp:11719907311 queue:0x0b4a3c58
     kworker/4:1-152   [004] ...1   365.466065: rtcpu_vinotify_handle_msg: tstamp:11720601144 tag:CHANSEL_PXL_EOF channel:0x00 frame:160 vi_tstamp:3130666142 data:0x0da70002
     kworker/4:1-152   [004] ...1   365.466068: rtcpu_vinotify_handle_msg: tstamp:11720601711 tag:ISPBUF_FE channel:0x00 frame:160 vi_tstamp:3130666701 data:0x00000000
     kworker/4:1-152   [004] ...1   365.466070: rtcpu_vinotify_handle_msg: tstamp:11721150808 tag:ISPBUF_FS channel:0x00 frame:161 vi_tstamp:3131215808 data:0x00000000
     kworker/4:1-152   [004] ...1   365.466071: rtcpu_vinotify_handle_msg: tstamp:11721158530 tag:CHANSEL_PXL_SOF channel:0x00 frame:161 vi_tstamp:3131223538 data:0x00000001
     kworker/4:1-152   [004] ...1   365.518113: rtcpu_vinotify_handle_msg: tstamp:11722166502 tag:CHANSEL_PXL_EOF channel:0x00 frame:161 vi_tstamp:3132231507 data:0x0da70002
     kworker/4:1-152   [004] ...1   365.518120: rtcpu_vinotify_handle_msg: tstamp:11722167067 tag:ISPBUF_FE channel:0x00 frame:161 vi_tstamp:3132232064 data:0x00000000
     kworker/4:1-152   [004] ...1   365.518123: rtcpu_vinotify_handle_msg: tstamp:11722716169 tag:ISPBUF_FS channel:0x00 frame:162 vi_tstamp:3132781172 data:0x00000000
     kworker/4:1-152   [004] ...1   365.518126: rtcpu_vinotify_handle_msg: tstamp:11722723892 tag:CHANSEL_PXL_SOF channel:0x00 frame:162 vi_tstamp:3132788902 data:0x00000001
     kworker/4:1-152   [004] ...1   365.570091: rtcpu_vinotify_handle_msg: tstamp:11723731870 tag:CHANSEL_PXL_EOF channel:0x00 frame:162 vi_tstamp:3133796870 data:0x0da70002
     kworker/4:1-152   [004] ...1   365.570098: rtcpu_vinotify_handle_msg: tstamp:11723732434 tag:ISPBUF_FE channel:0x00 frame:162 vi_tstamp:3133797428 data:0x00000000
     kworker/4:1-152   [004] ...1   365.570101: rtcpu_vinotify_handle_msg: tstamp:11724281538 tag:ISPBUF_FS channel:0x00 frame:163 vi_tstamp:3134346535 data:0x00000000
     kworker/4:1-152   [004] ...1   365.570104: rtcpu_vinotify_handle_msg: tstamp:11724289254 tag:CHANSEL_PXL_SOF channel:0x00 frame:163 vi_tstamp:3134354264 data:0x00000001
     kworker/4:1-152   [004] ...1   365.622072: rtos_queue_peek_from_isr_failed: tstamp:11724907816 queue:0x0b4a3c58
     kworker/4:1-152   [004] ...1   365.622080: rtcpu_vinotify_handle_msg: tstamp:11725297235 tag:CHANSEL_PXL_EOF channel:0x00 frame:163 vi_tstamp:3135362234 data:0x0da70002
     kworker/4:1-152   [004] ...1   365.622083: rtcpu_vinotify_handle_msg: tstamp:11725297801 tag:ISPBUF_FE channel:0x00 frame:163 vi_tstamp:3135362792 data:0x00000000
     kworker/4:1-152   [004] ...1   365.622085: rtcpu_vinotify_handle_msg: tstamp:11725846912 tag:ISPBUF_FS channel:0x00 frame:164 vi_tstamp:3135911899 data:0x00000000
     kworker/4:1-152   [004] ...1   365.622088: rtcpu_vinotify_handle_msg: tstamp:11725854618 tag:CHANSEL_PXL_SOF channel:0x00 frame:164 vi_tstamp:3135919628 data:0x00000001
     kworker/4:1-152   [004] ...1   365.674066: rtcpu_vinotify_handle_msg: tstamp:11726862593 tag:CHANSEL_PXL_EOF channel:0x00 frame:164 vi_tstamp:3136927598 data:0x0da70002
     kworker/4:1-152   [004] ...1   365.674072: rtcpu_vinotify_handle_msg: tstamp:11726863156 tag:ISPBUF_FE channel:0x00 frame:164 vi_tstamp:3136928156 data:0x00000000
     kworker/4:1-152   [004] ...1   365.674075: rtcpu_vinotify_handle_msg: tstamp:11727412264 tag:ISPBUF_FS channel:0x00 frame:165 vi_tstamp:3137477263 data:0x00000000
     kworker/4:1-152   [004] ...1   365.674078: rtcpu_vinotify_handle_msg: tstamp:11727419983 tag:CHANSEL_PXL_SOF channel:0x00 frame:165 vi_tstamp:3137484994 data:0x00000001
     kworker/4:1-152   [004] ...1   365.726060: rtcpu_vinotify_handle_msg: tstamp:11728427955 tag:CHANSEL_PXL_EOF channel:0x00 frame:165 vi_tstamp:3138492962 data:0x0da70002
     kworker/4:1-152   [004] ...1   365.726067: rtcpu_vinotify_handle_msg: tstamp:11728428528 tag:ISPBUF_FE channel:0x00 frame:165 vi_tstamp:3138493519 data:0x00000000
     kworker/4:1-152   [004] ...1   365.726070: rtcpu_vinotify_handle_msg: tstamp:11728977630 tag:ISPBUF_FS channel:0x00 frame:166 vi_tstamp:3139042627 data:0x00000000
     kworker/4:1-152   [004] ...1   365.726072: rtcpu_vinotify_handle_msg: tstamp:11728985346 tag:CHANSEL_PXL_SOF channel:0x00 frame:166 vi_tstamp:3139050357 data:0x00000001
     kworker/4:1-152   [004] ...1   365.778074: rtos_queue_peek_from_isr_failed: tstamp:11729908337 queue:0x0b4a3c58
     kworker/4:1-152   [004] ...1   365.778082: rtcpu_vinotify_handle_msg: tstamp:11729993323 tag:CHANSEL_PXL_EOF channel:0x00 frame:166 vi_tstamp:3140058325 data:0x0da70002
     kworker/4:1-152   [004] ...1   365.778085: rtcpu_vinotify_handle_msg: tstamp:11729993882 tag:ISPBUF_FE channel:0x00 frame:166 vi_tstamp:3140058884 data:0x00000000
     kworker/4:1-152   [004] ...1   365.778088: rtcpu_vinotify_handle_msg: tstamp:11730542991 tag:ISPBUF_FS channel:0x00 frame:167 vi_tstamp:3140607991 data:0x00000000
     kworker/4:1-152   [004] ...1   365.778090: rtcpu_vinotify_handle_msg: tstamp:11730550711 tag:CHANSEL_PXL_SOF channel:0x00 frame:167 vi_tstamp:3140615720 data:0x00000001
     kworker/4:1-152   [004] ...1   365.830066: rtcpu_vinotify_handle_msg: tstamp:11731558685 tag:CHANSEL_PXL_EOF channel:0x00 frame:167 vi_tstamp:3141623690 data:0x0da70002
     kworker/4:1-152   [004] ...1   365.830073: rtcpu_vinotify_handle_msg: tstamp:11731559249 tag:ISPBUF_FE channel:0x00 frame:167 vi_tstamp:3141624247 data:0x00000000
     kworker/4:1-152   [004] ...1   365.830076: rtcpu_vinotify_handle_msg: tstamp:11732108365 tag:ISPBUF_FS channel:0x00 frame:168 vi_tstamp:3142173355 data:0x00000000
     kworker/4:1-152   [004] ...1   365.830078: rtcpu_vinotify_handle_msg: tstamp:11732116075 tag:CHANSEL_PXL_SOF channel:0x00 frame:168 vi_tstamp:3142181083 data:0x00000001
     kworker/4:1-152   [004] ...1   365.882072: rtcpu_vinotify_handle_msg: tstamp:11733124050 tag:CHANSEL_PXL_EOF channel:0x00 frame:168 vi_tstamp:3143189053 data:0x0da70002
     kworker/4:1-152   [004] ...1   365.882079: rtcpu_vinotify_handle_msg: tstamp:11733124614 tag:ISPBUF_FE channel:0x00 frame:168 vi_tstamp:3143189612 data:0x00000000
     kworker/4:1-152   [004] ...1   365.882081: rtcpu_vinotify_handle_msg: tstamp:11733673736 tag:ISPBUF_FS channel:0x00 frame:169 vi_tstamp:3143738719 data:0x00000000
     kworker/4:1-152   [004] ...1   365.882084: rtcpu_vinotify_handle_msg: tstamp:11733681442 tag:CHANSEL_PXL_SOF channel:0x00 frame:169 vi_tstamp:3143746449 data:0x00000001
     kworker/4:1-152   [004] ...1   365.934065: rtcpu_vinotify_handle_msg: tstamp:11734689416 tag:CHANSEL_PXL_EOF channel:0x00 frame:169 vi_tstamp:3144754418 data:0x0da70002
     kworker/4:1-152   [004] ...1   365.934072: rtcpu_vinotify_handle_msg: tstamp:11734689981 tag:ISPBUF_FE channel:0x00 frame:169 vi_tstamp:3144754975 data:0x00000000
     kworker/4:1-152   [004] ...1   365.934077: rtos_queue_peek_from_isr_failed: tstamp:11734908827 queue:0x0b4a3c58
     kworker/4:1-152   [004] ...1   365.934080: rtcpu_vinotify_handle_msg: tstamp:11735239080 tag:ISPBUF_FS channel:0x00 frame:170 vi_tstamp:3145304083 data:0x00000000
     kworker/4:1-152   [004] ...1   365.934083: rtcpu_vinotify_handle_msg: tstamp:11735246802 tag:CHANSEL_PXL_SOF channel:0x00 frame:170 vi_tstamp:3145311812 data:0x00000001
     kworker/4:1-152   [004] ...1   365.986064: rtcpu_vinotify_handle_msg: tstamp:11736254777 tag:CHANSEL_PXL_EOF channel:0x00 frame:170 vi_tstamp:3146319782 data:0x0da70002
     kworker/4:1-152   [004] ...1   365.986071: rtcpu_vinotify_handle_msg: tstamp:11736255341 tag:ISPBUF_FE channel:0x00 frame:170 vi_tstamp:3146320339 data:0x00000000
     kworker/4:1-152   [004] ...1   365.986073: rtcpu_vinotify_handle_msg: tstamp:11736804448 tag:ISPBUF_FS channel:0x00 frame:171 vi_tstamp:3146869446 data:0x00000000
     kworker/4:1-152   [004] ...1   365.986076: rtcpu_vinotify_handle_msg: tstamp:11736812165 tag:CHANSEL_PXL_SOF channel:0x00 frame:171 vi_tstamp:3146877177 data:0x00000001
     kworker/4:1-152   [004] ...1   366.038063: rtcpu_vinotify_handle_msg: tstamp:11737820140 tag:CHANSEL_PXL_EOF channel:0x00 frame:171 vi_tstamp:3147885145 data:0x0da70002
     kworker/4:1-152   [004] ...1   366.038070: rtcpu_vinotify_handle_msg: tstamp:11737820702 tag:ISPBUF_FE channel:0x00 frame:171 vi_tstamp:3147885703 data:0x00000000
     kworker/4:1-152   [004] ...1   366.038073: rtcpu_vinotify_handle_msg: tstamp:11738369814 tag:ISPBUF_FS channel:0x00 frame:172 vi_tstamp:3148434811 data:0x00000000
     kworker/4:1-152   [004] ...1   366.038076: rtcpu_vinotify_handle_msg: tstamp:11738377532 tag:CHANSEL_PXL_SOF channel:0x00 frame:172 vi_tstamp:3148442539 data:0x00000001
     kworker/4:1-152   [004] ...1   366.090079: rtcpu_vinotify_handle_msg: tstamp:11739385504 tag:CHANSEL_PXL_EOF channel:0x00 frame:172 vi_tstamp:3149450509 data:0x0da70002
     kworker/4:1-152   [004] ...1   366.090088: rtcpu_vinotify_handle_msg: tstamp:11739386067 tag:ISPBUF_FE channel:0x00 frame:172 vi_tstamp:3149451067 data:0x00000000
     kworker/4:1-152   [004] ...1   366.090094: rtos_queue_peek_from_isr_failed: tstamp:11739909337 queue:0x0b4a3c58
     kworker/4:1-152   [004] ...1   366.090096: rtcpu_vinotify_handle_msg: tstamp:11739935163 tag:ISPBUF_FS channel:0x00 frame:173 vi_tstamp:3150000174 data:0x00000000
     kworker/4:1-152   [004] ...1   366.090099: rtcpu_vinotify_handle_msg: tstamp:11739942900 tag:CHANSEL_PXL_SOF channel:0x00 frame:173 vi_tstamp:3150007905 data:0x00000001
     kworker/4:1-152   [004] ...1   366.090102: rtcpu_vinotify_handle_msg: tstamp:11740950873 tag:CHANSEL_PXL_EOF channel:0x00 frame:173 vi_tstamp:3151015873 data:0x0da70002
     kworker/4:1-152   [004] ...1   366.090104: rtcpu_vinotify_handle_msg: tstamp:11740951438 tag:ISPBUF_FE channel:0x00 frame:173 vi_tstamp:3151016430 data:0x00000000
     kworker/4:1-152   [004] ...1   366.142087: rtcpu_vinotify_handle_msg: tstamp:11741500545 tag:ISPBUF_FS channel:0x00 frame:174 vi_tstamp:3151565538 data:0x00000000
     kworker/4:1-152   [004] ...1   366.142094: rtcpu_vinotify_handle_msg: tstamp:11741508259 tag:CHANSEL_PXL_SOF channel:0x00 frame:174 vi_tstamp:3151573269 data:0x00000001
     kworker/4:1-152   [004] ...1   366.142097: rtcpu_vinotify_handle_msg: tstamp:11742516231 tag:CHANSEL_PXL_EOF channel:0x00 frame:174 vi_tstamp:3152581236 data:0x0da70002
     kworker/4:1-152   [004] ...1   366.142100: rtcpu_vinotify_handle_msg: tstamp:11742516791 tag:ISPBUF_FE channel:0x00 frame:174 vi_tstamp:3152581795 data:0x00000000
     kworker/4:1-152   [004] ...1   366.194089: rtcpu_vinotify_handle_msg: tstamp:11743065914 tag:ISPBUF_FS channel:0x00 frame:175 vi_tstamp:3153130902 data:0x00000000
     kworker/4:1-152   [004] ...1   366.194100: rtcpu_vinotify_handle_msg: tstamp:11743073620 tag:CHANSEL_PXL_SOF channel:0x00 frame:175 vi_tstamp:3153138631 data:0x00000001
     kworker/4:1-152   [004] ...1   366.194103: rtcpu_vinotify_handle_msg: tstamp:11744081606 tag:CHANSEL_PXL_EOF channel:0x00 frame:175 vi_tstamp:3154146601 data:0x0da70002
     kworker/4:1-152   [004] ...1   366.194105: rtcpu_vinotify_handle_msg: tstamp:11744082169 tag:ISPBUF_FE channel:0x00 frame:175 vi_tstamp:3154147158 data:0x00000000

Here is the output of DMESG at the point of failure.

[code]
[ 394.504413] misc tegra_camera_ctrl: ISO BW req 4761972 > 4500000 (max) capping to max
[ 568.472033] fence timeout on [ffffffc15e474500] after 1500ms
[ 568.472045] fence timeout on [ffffffc15e7b7200] after 1500ms
[ 568.472056] fence timeout on [ffffffc15e474700] after 1500ms
[ 568.472066] name=[nvhost_sync:63], current value=9271 waiting value=9272
[ 568.472085] name=[nvhost_sync:35], current value=9270 waiting value=9271
[ 568.472088] ---- mlocks ----
[ 568.472093] ---- mlocks ----
[ 568.472108] 8: locked by channel 6
[ 568.472111] 8: locked by channel 6

[ 568.472136] ---- syncpts ----
[ 568.472138] ---- syncpts ----
[ 568.472154] id 1 (disp_a) min 6 max 6 refs 1 (previous client : )
[ 568.472168] id 4 (disp_d) min 11662 max 11662 refs 1 (previous client : )
[ 568.472178] id 5 (disp_e) min 1 max 1 refs 1 (previous client : )
[ 568.472189] id 7 (vblank0) min 2796 max 0 refs 1 (previous client : )
[ 568.472201] id 9 (dsi) min 496 max 0 refs 1 (previous client : )
[ 568.472212] id 11 (vblank1) min 31559 max 0 refs 1 (previous client : )
[ 568.472236] id 21 (17000000.gp10b_507) min 115846 max 115846 refs 1 (previous client : )
[ 568.472247] id 22 (17000000.gp10b_506) min 192 max 192 refs 1 (previous client : )
[ 568.472259] id 23 (17000000.gp10b_505) min 60492 max 60492 refs 1 (previous client : 17000000.gp10b_505)
[ 568.472269] id 24 (17000000.gp10b_504) min 8 max 8 refs 1 (previous client : )
[ 568.472281] id 25 (17000000.gp10b_503) min 2686 max 2686 refs 1 (previous client : 17000000.gp10b_503)
[ 568.472293] id 28 (17000000.gp10b_502) min 14 max 14 refs 1 (previous client : )
[ 568.472304] id 29 (17000000.gp10b_501) min 7940 max 7940 refs 1 (previous client : )
[ 568.472314] id 30 (17000000.gp10b_500) min 36 max 36 refs 1 (previous client : 17000000.gp10b_500)
[ 568.472325] id 31 (17000000.gp10b_499) min 10820 max 10820 refs 1 (previous client : )
[ 568.472338] id 32 (15600000.isp_nvcamera-daemon_0) min 18640 max 18644 refs 4 (previous client : 17000000.gp10b_498)
[ 568.472349] id 33 (15600000.isp_nvcamera-daemon_1) min 9286 max 9288 refs 4 (previous client : 17000000.gp10b_497)
[ 568.472359] id 34 (15600000.isp_nvcamera-daemon_2) min 9270 max 9272 refs 4 (previous client : )
[ 568.472369] id 35 (15600000.isp_nvcamera-daemon_3) min 9270 max 9272 refs 4 (previous client : )
[ 568.472379] id 36 (15600000.isp_nvcamera-daemon_4) min 64907 max 64916 refs 8 (previous client : )
[ 568.472389] id 37 (15600000.isp_nvcamera-daemon_5) min 9271 max 9272 refs 4 (previous client : )
[ 568.472405] id 42 (17000000.gp10b_494) min 2 max 2 refs 1 (previous client : )
[ 568.472417] id 44 (15340000.vic_gst-launch-1.0_0) min 27798 max 27798 refs 1 (previous client : )
[ 568.472428] id 45 (17000000.gp10b_490) min 7 max 7 refs 1 (previous client : 15700000.vi_0)
[ 568.472440] id 47 (17000000.gp10b_488) min 2 max 2 refs 1 (previous client : 15700000.vi_1)
[ 568.472450] id 48 (17000000.gp10b_487) min 8 max 8 refs 1 (previous client : 15700000.vi_2)
[ 568.472460] id 49 (17000000.gp10b_486) min 16 max 16 refs 1 (previous client : 150c0000.nvcsi_0)
[ 568.472478] id 56 (17000000.gp10b_485) min 6 max 6 refs 1 (previous client : )
[ 568.472488] id 57 (17000000.gp10b_484) min 6 max 6 refs 1 (previous client : )
[ 568.472497] id 58 (17000000.gp10b_483) min 6 max 6 refs 1 (previous client : )
[ 568.472506] id 59 (17000000.gp10b_482) min 6 max 6 refs 1 (previous client : )
[ 568.472515] id 60 (17000000.gp10b_481) min 6 max 6 refs 1 (previous client : )
[ 568.472524] id 61 (15700000.vi_0) min 7 max 7 refs 2 (previous client : )
[ 568.472534] id 62 (15700000.vi_0) min 9367 max 9368 refs 4 (previous client : )
[ 568.472544] id 63 (15700000.vi_1) min 9271 max 9272 refs 4 (previous client : )
[ 568.472554] id 64 (15700000.vi_2) min 9270 max 9272 refs 4 (previous client : )
[ 568.472563] id 65 (150c0000.nvcsi_0) min 20 max 20 refs 2 (previous client : )

[ 568.473265] ---- channels ----
[ 568.473272] id 1 (disp_a) min 6 max 6 refs 1 (previous client : )
[ 568.473288] id 4 (disp_d) min 11662 max 11662 refs 1 (previous client : )
[ 568.473291]
channel 1 - 15820000.se

[ 568.473297] NvHost basic channel registers:
[ 568.473300] id 5 (disp_e) min 1 max 1 refs 1 (previous client : )
[ 568.473305] CMDFIFO_STAT_0: 00002040
[ 568.473311] CMDFIFO_RDATA_0: 0194451b
[ 568.473314] id 7 (vblank0) min 2796 max 0 refs 1 (previous client : )
[ 568.473320] CMDP_OFFSET_0: 00000000
[ 568.473326] id 9 (dsi) min 496 max 0 refs 1 (previous client : )
[ 568.473328] CMDP_CLASS_0: 00000000
[ 568.473334] CHANNELSTAT_0: 00000000
[ 568.473338] id 11 (vblank1) min 31559 max 0 refs 1 (previous client : )
[ 568.473340] The CDMA sync queue is empty.

[ 568.473354]
channel 2 - 15830000.se

[ 568.473358] NvHost basic channel registers:
[ 568.473361] id 21 (17000000.gp10b_507) min 115846 max 115846 refs 1 (previous client : )
[ 568.473364] CMDFIFO_STAT_0: 00002040
[ 568.473370] CMDFIFO_RDATA_0: 92cc3ca0
[ 568.473373] id 22 (17000000.gp10b_506) min 192 max 192 refs 1 (previous client : )
[ 568.473378] CMDP_OFFSET_0: 00000000
[ 568.473383] CMDP_CLASS_0: 00000000
[ 568.473386] id 23 (17000000.gp10b_505) min 60492 max 60492 refs 1 (previous client : 17000000.gp10b_505)
[ 568.473388] CHANNELSTAT_0: 00000000
[ 568.473393] The CDMA sync queue is empty.
[ 568.473397] id 24 (17000000.gp10b_504) min 8 max 8 refs 1 (previous client : )

[ 568.473407]
channel 3 - 15840000.se

[ 568.473410] id 25 (17000000.gp10b_503) min 2686 max 2686 refs 1 (previous client : 17000000.gp10b_503)
[ 568.473413] NvHost basic channel registers:
[ 568.473419] CMDFIFO_STAT_0: 00002040
[ 568.473423] id 28 (17000000.gp10b_502) min 14 max 14 refs 1 (previous client : )
[ 568.473425] CMDFIFO_RDATA_0: 01005142
[ 568.473434] id 29 (17000000.gp10b_501) min 7940 max 7940 refs 1 (previous client : )
[ 568.473436] CMDP_OFFSET_0: 00000000
[ 568.473442] CMDP_CLASS_0: 00000000
[ 568.473445] id 30 (17000000.gp10b_500) min 36 max 36 refs 1 (previous client : 17000000.gp10b_500)
[ 568.473448] CHANNELSTAT_0: 00000000
[ 568.473452] The CDMA sync queue is empty.

[ 568.473458] id 31 (17000000.gp10b_499) min 10820 max 10820 refs 1 (previous client : )
[ 568.473464]
channel 6 - 15600000.isp

[ 568.473469] NvHost basic channel registers:
[ 568.473472] id 32 (15600000.isp_nvcamera-daemon_0) min 18640 max 18644 refs 4 (previous client : 17000000.gp10b_498)
[ 568.473474] CMDFIFO_STAT_0: 00004000
[ 568.473480] CMDFIFO_RDATA_0: 004e0041
[ 568.473484] id 33 (15600000.isp_nvcamera-daemon_1) min 9286 max 9288 refs 4 (previous client : 17000000.gp10b_497)
[ 568.473488] CMDP_OFFSET_0: 00000050
[ 568.473493] CMDP_CLASS_0: 00000001
[ 568.473496] id 34 (15600000.isp_nvcamera-daemon_2) min 9270 max 9272 refs 4 (previous client : )
[ 568.473498] CHANNELSTAT_0: 00000000
[ 568.473507] id 35 (15600000.isp_nvcamera-daemon_3) min 9270 max 9272 refs 4 (previous client : )
[ 568.473515]
ffffffc15e7f4c00: JOB, syncpt_id=32, syncpt_val=18642, first_get=000004f0, timeout=10000, num_slots=19
[ 568.473517] id 36 (15600000.isp_nvcamera-daemon_4) min 64907 max 64916 refs 8 (previous client : )
[ 568.473527] id 37 (15600000.isp_nvcamera-daemon_5) min 9271 max 9272 refs 4 (previous client : )
[ 568.473536] GATHER at 5a708000+3c2c, 12 words
[ 568.473546] 20000001
[ 568.473547] id 42 (17000000.gp10b_494) min 2 max 2 refs 1 (previous client : )
[ 568.473560] 00006420 20000001 00006821
[ 568.473561] id 44 (15340000.vic_gst-launch-1.0_0) min 27798 max 27798 refs 1 (previous client : )
[ 568.473573] 20000001 00006c22 20000001
[ 568.473574] id 45 (17000000.gp10b_490) min 7 max 7 refs 1 (previous client : 15700000.vi_0)
[ 568.473586] 00007c23 20000001 00007425
[ 568.473587] id 47 (17000000.gp10b_488) min 2 max 2 refs 1 (previous client : 15700000.vi_1)
[ 568.473596] 200c0001 00000005
[ 568.473599] id 48 (17000000.gp10b_487) min 8 max 8 refs 1 (previous client : 15700000.vi_2)
[ 568.473608] GATHER at 5a708000+3c5c, 2 words
[ 568.473610] id 49 (17000000.gp10b_486) min 16 max 16 refs 1 (previous client : 150c0000.nvcsi_0)
[ 568.473619] 20000001 00000024

[ 568.473629] id 56 (17000000.gp10b_485) min 6 max 6 refs 1 (previous client : )
[ 568.473632]
channel 5 - 150c0000.nvcsi

[ 568.473637] NvHost basic channel registers:
[ 568.473639] id 57 (17000000.gp10b_484) min 6 max 6 refs 1 (previous client : )
[ 568.473643] CMDFIFO_STAT_0: 00002040
[ 568.473649] id 58 (17000000.gp10b_483) min 6 max 6 refs 1 (previous client : )
[ 568.473651] CMDFIFO_RDATA_0: 00000041
[ 568.473658] id 59 (17000000.gp10b_482) min 6 max 6 refs 1 (previous client : )
[ 568.473660] CMDP_OFFSET_0: 00000000
[ 568.473666] CMDP_CLASS_0: 00000001
[ 568.473668] id 60 (17000000.gp10b_481) min 6 max 6 refs 1 (previous client : )
[ 568.473671] CHANNELSTAT_0: 00000000
[ 568.473675] The CDMA sync queue is empty.
[ 568.473678] id 61 (15700000.vi_0) min 7 max 7 refs 2 (previous client : )

[ 568.473688] id 62 (15700000.vi_0) min 9367 max 9368 refs 4 (previous client : )
[ 568.473690]
channel 0 - 15700000.vi

[ 568.473694] NvHost basic channel registers:
[ 568.473698] id 63 (15700000.vi_1) min 9271 max 9272 refs 4 (previous client : )
[ 568.473701] CMDFIFO_STAT_0: 00002040
[ 568.473706] CMDFIFO_RDATA_0: 0000003d
[ 568.473709] id 64 (15700000.vi_2) min 9270 max 9272 refs 4 (previous client : )
[ 568.473713] CMDP_OFFSET_0: 00000000
[ 568.473718] id 65 (150c0000.nvcsi_0) min 20 max 20 refs 2 (previous client : )
[ 568.473720] CMDP_CLASS_0: 00000001
[ 568.473725] CHANNELSTAT_0: 00000000
[ 568.473730] The CDMA sync queue is empty.

[ 568.473738]
channel 4 - 15700000.vi

[ 568.473742] NvHost basic channel registers:
[ 568.473747] CMDFIFO_STAT_0: 0000001f
[ 568.473753] CMDFIFO_RDATA_0: 304e0005
[ 568.473760] CMDP_OFFSET_0: 00000050
[ 568.473765] CMDP_CLASS_0: 00000001
[ 568.473770] CHANNELSTAT_0: 00000000
[ 568.473784]
ffffffc15e7a4c00: JOB, syncpt_id=64, syncpt_val=9271, first_get=00000328, timeout=0, num_slots=6
[ 568.473799] GATHER at 5a718000+1d2c, 6 words
[ 568.473823] 304e0005 0000fd8b 00000024 304e0005 00002436 0000003f
[ 568.473832] GATHER at 5a718000+1d44, 26 words
[ 568.473918] 90000001 a0000401 00000000 90000001 a000404d 00000001 90000001 a0004020 00000000 90000003 a0004042 5a536000 00000000 00000001 90000001 a0004048 00000000 90000001 a000400a 00000000 90000001 a0004001 00000001 90000001 a0004007 00000003
[ 568.473926] GATHER at 5a718000+1dac, 2 words
[ 568.473936] 20000001 0000003e

[ 568.473947]
---- host general irq ----

[ 568.473954] sync_intc0mask = 0x00000001
[ 568.473960] sync_intmask = 0x50000003
[ 568.473964]
---- host syncpt irq mask ----

[ 568.473969]
---- host syncpt irq status ----

[ 568.473977] syncpt_thresh_cpu0_int_status(0) = 0x00000000
[ 568.473984] syncpt_thresh_cpu0_int_status(1) = 0x00000000
[ 568.473991] syncpt_thresh_cpu0_int_status(2) = 0x00000000
[ 568.473997] syncpt_thresh_cpu0_int_status(3) = 0x00000000
[ 568.474003] syncpt_thresh_cpu0_int_status(4) = 0x00000000
[ 568.474009] syncpt_thresh_cpu0_int_status(5) = 0x00000000
[ 568.474015] syncpt_thresh_cpu0_int_status(6) = 0x00000000
[ 568.474021] syncpt_thresh_cpu0_int_status(7) = 0x00000000
[ 568.474027] syncpt_thresh_cpu0_int_status(8) = 0x00000000
[ 568.474033] syncpt_thresh_cpu0_int_status(9) = 0x00000000
[ 568.474040] syncpt_thresh_cpu0_int_status(10) = 0x00000000
[ 568.474047] syncpt_thresh_cpu0_int_status(11) = 0x00000000
[ 568.474053] syncpt_thresh_cpu0_int_status(12) = 0x00000000
[ 568.474060] syncpt_thresh_cpu0_int_status(13) = 0x00000000
[ 568.474066] syncpt_thresh_cpu0_int_status(14) = 0x00000000
[ 568.474072] syncpt_thresh_cpu0_int_status(15) = 0x00000000
[ 568.474078] syncpt_thresh_cpu0_int_status(16) = 0x00000000
[ 568.474085] syncpt_thresh_cpu0_int_status(17) = 0x00000000

[ 568.474428] ---- channels ----
[ 568.474463]
channel 1 - 15820000.se

[ 568.474468] NvHost basic channel registers:
[ 568.474477] CMDFIFO_STAT_0: 00002040
[ 568.474484] CMDFIFO_RDATA_0: 0194451b
[ 568.474493] CMDP_OFFSET_0: 00000000
[ 568.474499] CMDP_CLASS_0: 00000000
[ 568.474505] CHANNELSTAT_0: 00000000
[ 568.474510] The CDMA sync queue is empty.

[ 568.474525]
channel 2 - 15830000.se

[ 568.474529] NvHost basic channel registers:
[ 568.474535] CMDFIFO_STAT_0: 00002040
[ 568.474541] CMDFIFO_RDATA_0: 92cc3ca0
[ 568.474549] CMDP_OFFSET_0: 00000000
[ 568.474554] CMDP_CLASS_0: 00000000
[ 568.474560] CHANNELSTAT_0: 00000000
[ 568.474564] The CDMA sync queue is empty.

[ 568.474579]
channel 3 - 15840000.se

[ 568.474583] NvHost basic channel registers:
[ 568.474588] CMDFIFO_STAT_0: 00002040
[ 568.474594] CMDFIFO_RDATA_0: 01005142
[ 568.474601] CMDP_OFFSET_0: 00000000
[ 568.474606] CMDP_CLASS_0: 00000000
[ 568.474612] CHANNELSTAT_0: 00000000
[ 568.474616] The CDMA sync queue is empty.

[ 568.474629]
channel 6 - 15600000.isp

[ 568.474633] NvHost basic channel registers:
[ 568.474639] CMDFIFO_STAT_0: 00004000
[ 568.474645] CMDFIFO_RDATA_0: 004e0041
[ 568.474653] CMDP_OFFSET_0: 00000050
[ 568.474658] CMDP_CLASS_0: 00000001
[ 568.474664] CHANNELSTAT_0: 00000000
[ 568.474698]
ffffffc15e7f4c00: JOB, syncpt_id=32, syncpt_val=18642, first_get=000004f0, timeout=10000, num_slots=19
[ 568.474711] GATHER at 5a708000+3c2c, 12 words
[ 568.474759] 20000001 00006420 20000001 00006821 20000001 00006c22 20000001 00007c23 20000001 00007425 200c0001 00000005
[ 568.474770] GATHER at 5a708000+3c5c, 2 words
[ 568.474782] 20000001 00000024

[ 568.474796]
channel 5 - 150c0000.nvcsi

[ 568.474800] NvHost basic channel registers:
[ 568.474806] CMDFIFO_STAT_0: 00002040
[ 568.474812] CMDFIFO_RDATA_0: 00000041
[ 568.474820] CMDP_OFFSET_0: 00000000
[ 568.474825] CMDP_CLASS_0: 00000001
[ 568.474830] CHANNELSTAT_0: 00000000
[ 568.474834] The CDMA sync queue is empty.

[ 568.474845]
channel 0 - 15700000.vi

[ 568.474849] NvHost basic channel registers:
[ 568.474854] CMDFIFO_STAT_0: 00002040
[ 568.474860] CMDFIFO_RDATA_0: 0000003d
[ 568.474867] CMDP_OFFSET_0: 00000000
[ 568.474872] CMDP_CLASS_0: 00000001
[ 568.474877] CHANNELSTAT_0: 00000000
[ 568.474881] The CDMA sync queue is empty.

[ 568.474889]
channel 4 - 15700000.vi

[ 568.474892] NvHost basic channel registers:
[ 568.474898] CMDFIFO_STAT_0: 0000001f
[ 568.474903] CMDFIFO_RDATA_0: 304e0005
[ 568.474910] CMDP_OFFSET_0: 00000050
[ 568.474915] CMDP_CLASS_0: 00000001
[ 568.474920] CHANNELSTAT_0: 00000000
[ 568.474935]
ffffffc15e7a4c00: JOB, syncpt_id=64, syncpt_val=9271, first_get=00000328, timeout=0, num_slots=6
[ 568.474944] GATHER at 5a718000+1d2c, 6 words
[ 568.474969] 304e0005 0000fd8b 00000024 304e0005 00002436 0000003f
[ 568.474977] GATHER at 5a718000+1d44, 26 words
[ 568.475064] 90000001 a0000401 00000000 90000001 a000404d 00000001 90000001 a0004020 00000000 90000003 a0004042 5a536000 00000000 00000001 90000001 a0004048 00000000 90000001 a000400a 00000000 90000001 a0004001 00000001 90000001 a0004007 00000003
[ 568.475072] GATHER at 5a718000+1dac, 2 words
[ 568.475083] 20000001 0000003e

[ 568.475094]
---- host general irq ----

[ 568.475101] sync_intc0mask = 0x00000001
[ 568.475107] sync_intmask = 0x50000003
[ 568.475111]
---- host syncpt irq mask ----

[ 568.475115]
---- host syncpt irq status ----

[ 568.475123] syncpt_thresh_cpu0_int_status(0) = 0x00000000
[ 568.475130] syncpt_thresh_cpu0_int_status(1) = 0x00000000
[ 568.475136] syncpt_thresh_cpu0_int_status(2) = 0x00000000
[ 568.475143] syncpt_thresh_cpu0_int_status(3) = 0x00000000
[ 568.475149] syncpt_thresh_cpu0_int_status(4) = 0x00000000
[ 568.475155] syncpt_thresh_cpu0_int_status(5) = 0x00000000
[ 568.475161] syncpt_thresh_cpu0_int_status(6) = 0x00000000
[ 568.475167] syncpt_thresh_cpu0_int_status(7) = 0x00000000
[ 568.475173] syncpt_thresh_cpu0_int_status(8) = 0x00000000
[ 568.475179] syncpt_thresh_cpu0_int_status(9) = 0x00000000
[ 568.475186] syncpt_thresh_cpu0_int_status(10) = 0x00000000
[ 568.475192] syncpt_thresh_cpu0_int_status(11) = 0x00000000
[ 568.475199] syncpt_thresh_cpu0_int_status(12) = 0x00000000
[ 568.475205] syncpt_thresh_cpu0_int_status(13) = 0x00000000
[ 568.475211] syncpt_thresh_cpu0_int_status(14) = 0x00000000
[ 568.475217] syncpt_thresh_cpu0_int_status(15) = 0x00000000
[ 568.475224] syncpt_thresh_cpu0_int_status(16) = 0x00000000
[ 568.475230] syncpt_thresh_cpu0_int_status(17) = 0x00000000
[ 570.024380] name=[nvhost_sync:32], current value=18640 waiting value=18641
[ 570.031365] ---- mlocks ----
[ 570.034431] 8: locked by channel 6

[ 570.039382] ---- syncpts ----
[ 570.042500] id 1 (disp_a) min 6 max 6 refs 1 (previous client : )
[ 570.048659] id 4 (disp_d) min 11664 max 11664 refs 1 (previous client : )
[ 570.055491] id 5 (disp_e) min 1 max 1 refs 1 (previous client : )
[ 570.061693] id 7 (vblank0) min 2796 max 0 refs 1 (previous client : )
[ 570.068164] id 9 (dsi) min 496 max 0 refs 1 (previous client : )
[ 570.074235] id 11 (vblank1) min 31655 max 0 refs 1 (previous client : )
[ 570.080943] id 21 (17000000.gp10b_507) min 115862 max 115862 refs 1 (previous client : )
[ 570.089074] id 22 (17000000.gp10b_506) min 192 max 192 refs 1 (previous client : )
[ 570.096704] id 23 (17000000.gp10b_505) min 60502 max 60502 refs 1 (previous client : 17000000.gp10b_505)
[ 570.106212] id 24 (17000000.gp10b_504) min 8 max 8 refs 1 (previous client : )
[ 570.113501] id 25 (17000000.gp10b_503) min 2686 max 2686 refs 1 (previous client : 17000000.gp10b_503)
[ 570.122821] id 28 (17000000.gp10b_502) min 14 max 14 refs 1 (previous client : )
[ 570.130285] id 29 (17000000.gp10b_501) min 7940 max 7940 refs 1 (previous client : )
[ 570.138044] id 30 (17000000.gp10b_500) min 36 max 36 refs 1 (previous client : 17000000.gp10b_500)
[ 570.147051] id 31 (17000000.gp10b_499) min 10820 max 10820 refs 1 (previous client : )
[ 570.154966] id 32 (15600000.isp_nvcamera-daemon_0) min 18640 max 18644 refs 4 (previous client : 17000000.gp10b_498)
[ 570.165521] id 33 (15600000.isp_nvcamera-daemon_1) min 9286 max 9288 refs 4 (previous client : 17000000.gp10b_497)
[ 570.175900] id 34 (15600000.isp_nvcamera-daemon_2) min 9270 max 9272 refs 4 (previous client : )
[ 570.184680] id 35 (15600000.isp_nvcamera-daemon_3) min 9270 max 9272 refs 4 (previous client : )
[ 570.193500] id 36 (15600000.isp_nvcamera-daemon_4) min 64907 max 64916 refs 8 (previous client : )
[ 570.202455] id 37 (15600000.isp_nvcamera-daemon_5) min 9271 max 9272 refs 4 (previous client : )
[ 570.211278] id 42 (17000000.gp10b_494) min 2 max 2 refs 1 (previous client : )
[ 570.218500] id 44 (15340000.vic_gst-launch-1.0_0) min 27804 max 27804 refs 1 (previous client : )
[ 570.227404] id 45 (17000000.gp10b_490) min 7 max 7 refs 1 (previous client : 15700000.vi_0)
[ 570.235753] id 47 (17000000.gp10b_488) min 2 max 2 refs 1 (previous client : 15700000.vi_1)
[ 570.244138] id 48 (17000000.gp10b_487) min 8 max 8 refs 1 (previous client : 15700000.vi_2)
[ 570.252486] id 49 (17000000.gp10b_486) min 16 max 16 refs 1 (previous client : 150c0000.nvcsi_0)
[ 570.261309] id 56 (17000000.gp10b_485) min 6 max 6 refs 1 (previous client : )
[ 570.268530] id 57 (17000000.gp10b_484) min 6 max 6 refs 1 (previous client : )
[ 570.275793] id 58 (17000000.gp10b_483) min 6 max 6 refs 1 (previous client : )
[ 570.283014] id 59 (17000000.gp10b_482) min 6 max 6 refs 1 (previous client : )
[ 570.290234] id 60 (17000000.gp10b_481) min 6 max 6 refs 1 (previous client : )
[ 570.297494] id 61 (15700000.vi_0) min 7 max 7 refs 2 (previous client : )
[ 570.304279] id 62 (15700000.vi_0) min 9367 max 9368 refs 4 (previous client : )
[ 570.311629] id 63 (15700000.vi_1) min 9271 max 9272 refs 4 (previous client : )
[ 570.318937] id 64 (15700000.vi_2) min 9270 max 9272 refs 4 (previous client : )
[ 570.326287] id 65 (150c0000.nvcsi_0) min 20 max 20 refs 2 (previous client : )

[ 570.335484] ---- channels ----
[ 570.338550]
channel 1 - 15820000.se

[ 570.345029] NvHost basic channel registers:
[ 570.349215] CMDFIFO_STAT_0: 00002040
[ 570.352879] CMDFIFO_RDATA_0: 0194451b
[ 570.356547] CMDP_OFFSET_0: 00000000
[ 570.360250] CMDP_CLASS_0: 00000000
[ 570.363904] CHANNELSTAT_0: 00000000
[ 570.367571] The CDMA sync queue is empty.

[ 570.373078]
channel 2 - 15830000.se

[ 570.379556] NvHost basic channel registers:
[ 570.383743] CMDFIFO_STAT_0: 00002040
[ 570.387406] CMDFIFO_RDATA_0: 92cc3ca0
[ 570.391073] CMDP_OFFSET_0: 00000000
[ 570.394777] CMDP_CLASS_0: 00000000
[ 570.398445] CHANNELSTAT_0: 00000000
[ 570.402108] The CDMA sync queue is empty.

[ 570.407617]
channel 3 - 15840000.se

[ 570.414150] NvHost basic channel registers:
[ 570.418700] CMDFIFO_STAT_0: 00002040
[ 570.422447] CMDFIFO_RDATA_0: 01005142
[ 570.426195] CMDP_OFFSET_0: 00000000
[ 570.429949] CMDP_CLASS_0: 00000000
[ 570.433669] CHANNELSTAT_0: 00000000
[ 570.437378] The CDMA sync queue is empty.

[ 570.442933]
channel 6 - 15600000.isp

[ 570.449560] NvHost basic channel registers:
[ 570.453774] CMDFIFO_STAT_0: 00004000
[ 570.457463] CMDFIFO_RDATA_0: 004e0041
[ 570.461149] CMDP_OFFSET_0: 00000050
[ 570.464843] CMDP_CLASS_0: 00000001
[ 570.468525] CHANNELSTAT_0: 00000000
[ 570.472219]
ffffffc15e7f4c00: JOB, syncpt_id=32, syncpt_val=18642, first_get=000004f0, timeout=10000, num_slots=19
[ 570.484055] GATHER at 5a708000+3c2c, 12 words
[ 570.488809] 20000001 00006420 20000001 00006821 20000001 00006c22 20000001 00007c23 20000001 00007425 200c0001 00000005
[ 570.499848] GATHER at 5a708000+3c5c, 2 words
[ 570.504479] 20000001 00000024

[ 570.509096]
channel 5 - 150c0000.nvcsi

[ 570.515841] NvHost basic channel registers:
[ 570.520052] CMDFIFO_STAT_0: 00002040
[ 570.523710] CMDFIFO_RDATA_0: 00000041
[ 570.527394] CMDP_OFFSET_0: 00000000
[ 570.531095] CMDP_CLASS_0: 00000001
[ 570.534780] CHANNELSTAT_0: 00000000
[ 570.538468] The CDMA sync queue is empty.

[ 570.544035]
channel 0 - 15700000.vi

[ 570.550493] NvHost basic channel registers:
[ 570.554702] CMDFIFO_STAT_0: 00002040
[ 570.558386] CMDFIFO_RDATA_0: 0000003d
[ 570.562079] CMDP_OFFSET_0: 00000000
[ 570.565762] CMDP_CLASS_0: 00000001
[ 570.569452] CHANNELSTAT_0: 00000000
[ 570.573135] The CDMA sync queue is empty.

[ 570.578688]
channel 4 - 15700000.vi

[ 570.585145] NvHost basic channel registers:
[ 570.589355] CMDFIFO_STAT_0: 0000001f
[ 570.593040] CMDFIFO_RDATA_0: 304e0005
[ 570.596731] CMDP_OFFSET_0: 00000050
[ 570.600413] CMDP_CLASS_0: 00000001
[ 570.604103] CHANNELSTAT_0: 00000000
[ 570.607765]
ffffffc15e7a4c00: JOB, syncpt_id=64, syncpt_val=9271, first_get=00000328, timeout=0, num_slots=6
[ 570.619077] GATHER at 5a718000+1d2c, 6 words
[ 570.623719] 304e0005 0000fd8b 00000024 304e0005 00002436 0000003f
[ 570.630009] GATHER at 5a718000+1d44, 26 words
[ 570.634729] 90000001 a0000401 00000000 90000001 a000404d 00000001 90000001 a0004020 00000000 90000003 a0004042 5a536000 00000000 00000001 90000001 a0004048 00000000 90000001 a000400a 00000000 90000001 a0004001 00000001 90000001 a0004007 00000003
[ 570.656918] GATHER at 5a718000+1dac, 2 words
[ 570.661565] 20000001 0000003e

[ 570.666158]
---- host general irq ----

[ 570.672903] sync_intc0mask = 0x00000001
[ 570.676764] sync_intmask = 0x50000003
[ 570.680457]
---- host syncpt irq mask ----

[ 570.687524]
---- host syncpt irq status ----

[ 570.694780] syncpt_thresh_cpu0_int_status(0) = 0x00000000
[ 570.700202] syncpt_thresh_cpu0_int_status(1) = 0x00000000
[ 570.705628] syncpt_thresh_cpu0_int_status(2) = 0x00000000
[ 570.711043] syncpt_thresh_cpu0_int_status(3) = 0x00000000
[ 570.716470] syncpt_thresh_cpu0_int_status(4) = 0x00000000
[ 570.721891] syncpt_thresh_cpu0_int_status(5) = 0x00000000
[ 570.727316] syncpt_thresh_cpu0_int_status(6) = 0x00000000
[ 570.732733] syncpt_thresh_cpu0_int_status(7) = 0x00000000
[ 570.738157] syncpt_thresh_cpu0_int_status(8) = 0x00000000
[ 570.743573] syncpt_thresh_cpu0_int_status(9) = 0x00000000
[ 570.748994] syncpt_thresh_cpu0_int_status(10) = 0x00000000
[ 570.754495] syncpt_thresh_cpu0_int_status(11) = 0x00000000
[ 570.760003] syncpt_thresh_cpu0_int_status(12) = 0x00000000
[ 570.765510] syncpt_thresh_cpu0_int_status(13) = 0x00000000
[ 570.771046] syncpt_thresh_cpu0_int_status(14) = 0x00000000
[ 570.776612] syncpt_thresh_cpu0_int_status(15) = 0x00000000
[ 570.782134] syncpt_thresh_cpu0_int_status(16) = 0x00000000
[ 570.787642] syncpt_thresh_cpu0_int_status(17) = 0x00000000
[ 572.972131] host1x 13e10000.host1x: CaptureSchedule: syncpoint id 36 (15600000.isp_nvcamera-daemon_4) stuck waiting 64908, timeout=-1
[ 572.984290] ---- syncpts ----
[ 572.987284] id 1 (disp_a) min 6 max 6 refs 1 (previous client : )
[ 572.993630] id 4 (disp_d) min 11666 max 11666 refs 1 (previous client : )
[ 573.000512] id 5 (disp_e) min 1 max 1 refs 1 (previous client : )
[ 573.006722] id 7 (vblank0) min 2796 max 0 refs 1 (previous client : )
[ 573.013290] id 9 (dsi) min 496 max 0 refs 1 (previous client : )
[ 573.019395] id 11 (vblank1) min 31832 max 0 refs 1 (previous client : )
[ 573.026137] id 21 (17000000.gp10b_507) min 115870 max 115870 refs 1 (previous client : )
[ 573.034274] id 22 (17000000.gp10b_506) min 192 max 192 refs 1 (previous client : )
[ 573.041949] id 23 (17000000.gp10b_505) min 60512 max 60512 refs 1 (previous client : 17000000.gp10b_505)
[ 573.051475] id 24 (17000000.gp10b_504) min 8 max 8 refs 1 (previous client : )
[ 573.058778] id 25 (17000000.gp10b_503) min 2686 max 2686 refs 1 (previous client : 17000000.gp10b_503)
[ 573.068114] id 28 (17000000.gp10b_502) min 14 max 14 refs 1 (previous client : )
[ 573.075580] id 29 (17000000.gp10b_501) min 7940 max 7940 refs 1 (previous client : )
[ 573.083342] id 30 (17000000.gp10b_500) min 36 max 36 refs 1 (previous client : 17000000.gp10b_500)
[ 573.092366] id 31 (17000000.gp10b_499) min 10820 max 10820 refs 1 (previous client : )
[ 573.100289] id 32 (15600000.isp_nvcamera-daemon_0) min 18640 max 18644 refs 4 (previous client : 17000000.gp10b_498)
[ 573.110872] id 33 (15600000.isp_nvcamera-daemon_1) min 9286 max 9288 refs 4 (previous client : 17000000.gp10b_497)
[ 573.121232] id 34 (15600000.isp_nvcamera-daemon_2) min 9270 max 9272 refs 4 (previous client : )
[ 573.130088] id 35 (15600000.isp_nvcamera-daemon_3) min 9270 max 9272 refs 4 (previous client : )
[ 573.138892] id 36 (15600000.isp_nvcamera-daemon_4) min 64907 max 64916 refs 8 (previous client : )
[ 573.147889] id 37 (15600000.isp_nvcamera-daemon_5) min 9271 max 9272 refs 4 (previous client : )
[ 573.156680] id 42 (17000000.gp10b_494) min 2 max 2 refs 1 (previous client : )
[ 573.163943] id 44 (15340000.vic_gst-launch-1.0_0) min 27804 max 27804 refs 1 (previous client : )
[ 573.172815] id 45 (17000000.gp10b_490) min 7 max 7 refs 1 (previous client : 15700000.vi_0)
[ 573.181267] id 47 (17000000.gp10b_488) min 2 max 2 refs 1 (previous client : 15700000.vi_1)
[ 573.189857] id 48 (17000000.gp10b_487) min 8 max 8 refs 1 (previous client : 15700000.vi_2)
[ 573.198297] id 49 (17000000.gp10b_486) min 16 max 16 refs 1 (previous client : 150c0000.nvcsi_0)
[ 573.207150] id 56 (17000000.gp10b_485) min 6 max 6 refs 1 (previous client : )
[ 573.214423] id 57 (17000000.gp10b_484) min 6 max 6 refs 1 (previous client : )
[ 573.221700] id 58 (17000000.gp10b_483) min 6 max 6 refs 1 (previous client : )
[ 573.228987] id 59 (17000000.gp10b_482) min 6 max 6 refs 1 (previous client : )
[ 573.236253] id 60 (17000000.gp10b_481) min 6 max 6 refs 1 (previous client : )
[ 573.243533] id 61 (15700000.vi_0) min 7 max 7 refs 2 (previous client : )
[ 573.250344] id 62 (15700000.vi_0) min 9367 max 9368 refs 4 (previous client : )
[ 573.257677] id 63 (15700000.vi_1) min 9271 max 9272 refs 4 (previous client : )
[ 573.265004] id 64 (15700000.vi_2) min 9270 max 9272 refs 4 (previous client : )
[ 573.272336] id 65 (150c0000.nvcsi_0) min 20 max 20 refs 2 (previous client : )

[ 576.980196] host1x 13e10000.host1x: cdma_handle_timeout: timeout: 32 (15600000.isp_nvcamera-daemon_0) clientid 1, HW thresh 18640, done 18642
[ 576.992991] host1x 13e10000.host1x: cdma_handle_timeout: timeout: 33 (15600000.isp_nvcamera-daemon_1) clientid 1, HW thresh 9286, done 9287
[ 577.005600] host1x 13e10000.host1x: cdma_handle_timeout: timeout: 34 (15600000.isp_nvcamera-daemon_2) clientid 1, HW thresh 9270, done 9271
[ 577.018289] host1x 13e10000.host1x: cdma_handle_timeout: timeout: 35 (15600000.isp_nvcamera-daemon_3) clientid 1, HW thresh 9270, done 9271
[ 577.030901] host1x 13e10000.host1x: cdma_handle_timeout: timeout: 37 (15600000.isp_nvcamera-daemon_5) clientid 1, HW thresh 9271, done 9271
[ 577.043518] host1x 13e10000.host1x: cdma_handle_timeout: timeout: 36 (15600000.isp_nvcamera-daemon_4) clientid 1, HW thresh 64907, done 64907
[ 577.056293] ---- mlocks ----
[ 577.059196] 8: locked by channel 6

[ 577.064222] ---- syncpts ----
[ 577.067221] id 1 (disp_a) min 6 max 6 refs 1 (previous client : )
[ 577.073365] id 4 (disp_d) min 11666 max 11666 refs 1 (previous client : )
[ 577.080247] id 5 (disp_e) min 1 max 1 refs 1 (previous client : )
[ 577.086359] id 7 (vblank0) min 2796 max 0 refs 1 (previous client : )
[ 577.092864] id 9 (dsi) min 496 max 0 refs 1 (previous client : )
[ 577.098892] id 11 (vblank1) min 32077 max 0 refs 1 (previous client : )
[ 577.105543] id 21 (17000000.gp10b_507) min 115870 max 115870 refs 1 (previous client : )
[ 577.113683] id 22 (17000000.gp10b_506) min 192 max 192 refs 1 (previous client : )
[ 577.121298] id 23 (17000000.gp10b_505) min 60512 max 60512 refs 1 (previous client : 17000000.gp10b_505)
[ 577.130822] id 24 (17000000.gp10b_504) min 8 max 8 refs 1 (previous client : )
[ 577.138081] id 25 (17000000.gp10b_503) min 2686 max 2686 refs 1 (previous client : 17000000.gp10b_503)
[ 577.147575] id 28 (17000000.gp10b_502) min 14 max 14 refs 1 (previous client : )
[ 577.155136] id 29 (17000000.gp10b_501) min 7940 max 7940 refs 1 (previous client : )
[ 577.162943] id 30 (17000000.gp10b_500) min 36 max 36 refs 1 (previous client : 17000000.gp10b_500)
[ 577.172072] id 31 (17000000.gp10b_499) min 10820 max 10820 refs 1 (previous client : )
[ 577.180267] id 32 (15600000.isp_nvcamera-daemon_0) min 18640 max 18644 refs 4 (previous client : 17000000.gp10b_498)
[ 577.190822] id 33 (15600000.isp_nvcamera-daemon_1) min 9286 max 9288 refs 4 (previous client : 17000000.gp10b_497)
[ 577.201181] id 34 (15600000.isp_nvcamera-daemon_2) min 9270 max 9272 refs 4 (previous client : )
[ 577.210015] id 35 (15600000.isp_nvcamera-daemon_3) min 9270 max 9272 refs 4 (previous client : )
[ 577.218810] id 36 (15600000.isp_nvcamera-daemon_4) min 64907 max 64916 refs 8 (previous client : )
[ 577.227776] id 37 (15600000.isp_nvcamera-daemon_5) min 9271 max 9272 refs 4 (previous client : )
[ 577.236596] id 42 (17000000.gp10b_494) min 2 max 2 refs 1 (previous client : )
[ 577.243839] id 44 (15340000.vic_gst-launch-1.0_0) min 27804 max 27804 refs 1 (previous client : )
[ 577.253868] id 45 (17000000.gp10b_490) min 7 max 7 refs 1 (previous client : 15700000.vi_0)
[ 577.262374] id 47 (17000000.gp10b_488) min 2 max 2 refs 1 (previous client : 15700000.vi_1)
[ 577.270770] id 48 (17000000.gp10b_487) min 8 max 8 refs 1 (previous client : 15700000.vi_2)
[ 577.279248] id 49 (17000000.gp10b_486) min 16 max 16 refs 1 (previous client : 150c0000.nvcsi_0)
[ 577.288046] id 56 (17000000.gp10b_485) min 6 max 6 refs 1 (previous client : )
[ 577.295280] id 57 (17000000.gp10b_484) min 6 max 6 refs 1 (previous client : )
[ 577.302508] id 58 (17000000.gp10b_483) min 6 max 6 refs 1 (previous client : )
[ 577.309736] id 59 (17000000.gp10b_482) min 6 max 6 refs 1 (previous client : )
[ 577.316964] id 60 (17000000.gp10b_481) min 6 max 6 refs 1 (previous client : )
[ 577.324185] id 61 (15700000.vi_0) min 7 max 7 refs 2 (previous client : )
[ 577.330978] id 62 (15700000.vi_0) min 9367 max 9368 refs 4 (previous client : )
[ 577.338328] id 63 (15700000.vi_1) min 9271 max 9272 refs 4 (previous client : )
[ 577.345644] id 64 (15700000.vi_2) min 9270 max 9272 refs 4 (previous client : )
[ 577.352951] id 65 (150c0000.nvcsi_0) min 20 max 20 refs 2 (previous client : )

[ 577.362163] ---- channels ----
[ 577.365243]
channel 1 - 15820000.se

[ 577.371770] NvHost basic channel registers:
[ 577.375971] CMDFIFO_STAT_0: 00002040
[ 577.379647] CMDFIFO_RDATA_0: 0194451b
[ 577.383325] CMDP_OFFSET_0: 00000000
[ 577.387001] CMDP_CLASS_0: 00000000
[ 577.390670] CHANNELSTAT_0: 00000000
[ 577.394341] The CDMA sync queue is empty.

[ 577.399842]
channel 2 - 15830000.se

[ 577.406324] NvHost basic channel registers:
[ 577.410521] CMDFIFO_STAT_0: 00002040
[ 577.414196] CMDFIFO_RDATA_0: 92cc3ca0
[ 577.417875] CMDP_OFFSET_0: 00000000
[ 577.421569] CMDP_CLASS_0: 00000000
[ 577.425259] CHANNELSTAT_0: 00000000
[ 577.428960] The CDMA sync queue is empty.

[ 577.434460]
channel 3 - 15840000.se

[ 577.441077] NvHost basic channel registers:
[ 577.445271] CMDFIFO_STAT_0: 00002040
[ 577.448938] CMDFIFO_RDATA_0: 01005142
[ 577.452610] CMDP_OFFSET_0: 00000000
[ 577.456278] CMDP_CLASS_0: 00000000
[ 577.459934] CHANNELSTAT_0: 00000000
[ 577.463601] The CDMA sync queue is empty.

[ 577.469157]
channel 6 - 15600000.isp

[ 577.475687] NvHost basic channel registers:
[ 577.479876] CMDFIFO_STAT_0: 00004000
[ 577.483542] CMDFIFO_RDATA_0: 004e0041
[ 577.487213] CMDP_OFFSET_0: 00000050
[ 577.490887] CMDP_CLASS_0: 00000001
[ 577.494573] CHANNELSTAT_0: 00000000
[ 577.498247]
ffffffc15e7f4c00: JOB, syncpt_id=32, syncpt_val=18642, first_get=000004f0, timeout=10000, num_slots=19
[ 577.5

JerryChang · May 28, 2019, 8:17am

hello ezaro,

there are some known issues with JetPack-3.1/TX2’s VI driver,
please refer to below for kernel patches or integrate your working progress to the latest release.

please refer to Topic 1038067 for the patch to fix FE syncpt wait
please check Topic 1020202 to fix missing timestamp for vi4

ezaro · May 29, 2019, 10:19pm

Jerry,

The FE syncpt wait patch is targeted at 3.2 which contains a number of changes to the vi4_fops structures. Is there a fix that targets 3.1?

JerryChang · May 30, 2019, 2:37am

hello ezaro,

may I know is there any specific reason to keep JetPack-3.1 (l4t-r28.1) for development,
since we’ll keep updating kernel sources to include fixes, suggest you moving to the latest rel-28 release package (i.e. l4t-r28.3) for better support.
thanks

ezaro · May 30, 2019, 3:41pm

We are already fairly deep into our development cycle which has always been based off JetPack-3.1. A version bump could require a large port effort. If we were to make this consideration would you suggest that we move to JetPack-3.2 or 3.3?

JerryChang · May 31, 2019, 1:50am

hello ezaro,

please note that, JetPack-3.2 and 3.3 were based-on same l4t release version.
you might check JetPack Archive to have more details.
there were only sources release package for l4t-r28.3, please check them in the Jetson Download Center.
thanks