Testing IMX204 camera with Jetson Xavier

Hi JerryChang,

This is also my understanding, let me enable the VI tracing log, then share to you.

By the way, are you aware of SLVS_XCE pin, currently I am not using, whether this pin has impact.

Thanks alot!

Hi JerryChang,
Here is VI tracing logs

# tracer: nop
#
# entries-in-buffer/entries-written: 1096/1096   #P:4
#
#                              _-----=> irqs-off
#                             / _----=> need-resched
#                            | / _---=> hardirq/softirq
#                            || / _--=> preempt-depth
#                            ||| /     delay
#           TASK-PID   CPU#  ||||    TIMESTAMP  FUNCTION
#              | |       |   ||||       |         |
     kworker/0:1-818   [000] ....   615.443022: rtos_queue_peek_from_isr_failed: tstamp:19436753279 queue:0x0bcbcf78
     kworker/0:1-818   [000] ....   615.554953: rtos_queue_peek_from_isr_failed: tstamp:19441753283 queue:0x0bcbcf78
     kworker/0:1-818   [000] ....   615.722936: rtos_queue_peek_from_isr_failed: tstamp:19446753301 queue:0x0bcbcf78
     kworker/0:1-818   [000] ....   615.890982: rtos_queue_peek_from_isr_failed: tstamp:19451753275 queue:0x0bcbcf78
     kworker/0:1-818   [000] ....   616.058936: rtos_queue_peek_from_isr_failed: tstamp:19456753287 queue:0x0bcbcf78
     kworker/0:1-818   [000] ....   616.226926: rtos_queue_peek_from_isr_failed: tstamp:19461753279 queue:0x0bcbcf78
     kworker/0:1-818   [000] ....   616.394984: rtos_queue_peek_from_isr_failed: tstamp:19466753328 queue:0x0bcbcf78
     kworker/0:1-818   [000] ....   616.678934: rtos_queue_peek_from_isr_failed: tstamp:19476753275 queue:0x0bcbcf78
     kworker/0:1-818   [000] ....   616.846950: rtos_queue_peek_from_isr_failed: tstamp:19481753280 queue:0x0bcbcf78
     kworker/0:1-818   [000] ....   617.014939: rtos_queue_peek_from_isr_failed: tstamp:19486753279 queue:0x0bcbcf78
     kworker/0:1-818   [000] ....   617.182944: rtos_queue_peek_from_isr_failed: tstamp:19491753322 queue:0x0bcbcf78
     kworker/0:1-818   [000] ....   617.350920: rtos_queue_peek_from_isr_failed: tstamp:19496753266 queue:0x0bcbcf78
     kworker/0:1-818   [000] ....   617.518977: rtos_queue_peek_from_isr_failed: tstamp:19501753275 queue:0x0bcbcf78
     kworker/0:1-818   [000] ....   617.687030: rtos_queue_peek_from_isr_failed: tstamp:19506753279 queue:0x0bcbcf78
     kworker/0:1-818   [000] ....   617.798945: rtos_queue_peek_from_isr_failed: tstamp:19511753279 queue:0x0bcbcf78
     kworker/0:1-818   [000] ....   617.966968: rtos_queue_peek_from_isr_failed: tstamp:19516753286 queue:0x0bcbcf78
     kworker/0:1-818   [000] ....   618.134975: rtos_queue_peek_from_isr_failed: tstamp:19521753297 queue:0x0bcbcf78
     kworker/0:1-818   [000] ....   618.302974: rtos_queue_peek_from_isr_failed: tstamp:19526753279 queue:0x0bcbcf78
     kworker/0:1-818   [000] ....   618.471050: rtos_queue_peek_from_isr_failed: tstamp:19531753297 queue:0x0bcbcf78
     kworker/0:1-818   [000] ....   618.639038: rtos_queue_peek_from_isr_failed: tstamp:19536753275 queue:0x0bcbcf78
     kworker/0:1-818   [000] ....   618.806997: rtos_queue_peek_from_isr_failed: tstamp:19541753279 queue:0x0bcbcf78
     kworker/0:1-818   [000] ....   618.918991: rtos_queue_peek_from_isr_failed: tstamp:19546753297 queue:0x0bcbcf78
     kworker/0:1-818   [000] ....   619.086966: rtos_queue_peek_from_isr_failed: tstamp:19551753293 queue:0x0bcbcf78
     kworker/0:1-818   [000] ....   619.258958: rtos_queue_peek_from_isr_failed: tstamp:19556753278 queue:0x0bcbcf78
     kworker/0:1-818   [000] ....   619.427013: rtos_queue_peek_from_isr_failed: tstamp:19561753275 queue:0x0bcbcf78
     kworker/0:1-818   [000] ....   619.595024: rtos_queue_peek_from_isr_failed: tstamp:19566753275 queue:0x0bcbcf78
     kworker/0:1-818   [000] ....   619.763022: rtos_queue_peek_from_isr_failed: tstamp:19571753279 queue:0x0bcbcf78
     kworker/0:1-818   [000] ....   619.874976: rtos_queue_peek_from_isr_failed: tstamp:19576753279 queue:0x0bcbcf78
     kworker/0:1-818   [000] ....   620.043009: rtos_queue_peek_from_isr_failed: tstamp:19581753288 queue:0x0bcbcf78
     kworker/0:1-818   [000] ....   620.211083: rtos_queue_peek_from_isr_failed: tstamp:19586753280 queue:0x0bcbcf78
     kworker/0:1-818   [000] ....   620.378931: rtos_queue_peek_from_isr_failed: tstamp:19591753286 queue:0x0bcbcf78
     kworker/0:1-818   [000] ....   620.490967: rtos_queue_peek_from_isr_failed: tstamp:19594956835 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   678.950513: rtos_queue_peek_from_isr_failed: tstamp:21422897299 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   678.950521: rtcpu_start: tstamp:21422899948
     kworker/0:2-9010  [000] ....   679.006561: rtos_queue_send_from_isr_failed: tstamp:21423048494 queue:0x0bcb41f8
     kworker/0:2-9010  [000] ....   679.006571: rtos_queue_send_from_isr_failed: tstamp:21423048724 queue:0x0bcb8a60
     kworker/0:2-9010  [000] ....   679.006573: rtos_queue_send_from_isr_failed: tstamp:21423048946 queue:0x0bcba5e0
     kworker/0:2-9010  [000] ....   679.006575: rtos_queue_send_from_isr_failed: tstamp:21423049166 queue:0x0bcbb3a0
     kworker/0:2-9010  [000] ....   679.006576: rtos_queue_send_from_isr_failed: tstamp:21423049385 queue:0x0bcbc160
     kworker/0:2-9010  [000] ....   679.006581: rtcpu_string: tstamp:21423050111 id:0x04010000 str:"Configuring ISP GoS.
"
     kworker/0:2-9010  [000] ....   679.006631: rtcpu_string: tstamp:21423050391 id:0x04010000 str:"  VM GOS[#0] addr=0xe4900000
"
     kworker/0:2-9010  [000] ....   679.006643: rtcpu_string: tstamp:21423050722 id:0x04010000 str:"  VM GOS[#1] addr=0xe4901000
"
     kworker/0:2-9010  [000] ....   679.006652: rtcpu_string: tstamp:21423051088 id:0x04010000 str:"  VM GOS[#2] addr=0xe4902000
"
     kworker/0:2-9010  [000] ....   679.006661: rtcpu_string: tstamp:21423051398 id:0x04010000 str:"  VM GOS[#3] addr=0xe4903000
"
     kworker/0:2-9010  [000] ....   679.006670: rtcpu_string: tstamp:21423051714 id:0x04010000 str:"  VM GOS[#4] addr=0xe4904000
"
     kworker/0:2-9010  [000] ....   679.006678: rtcpu_string: tstamp:21423052021 id:0x04010000 str:"  VM GOS[#5] addr=0xe4905000
"
     kworker/0:2-9010  [000] ....   679.006687: rtcpu_string: tstamp:21423070451 id:0x04010000 str:"WARNING: t194/isp5.c:901 [config_channel] ""
     kworker/0:2-9010  [000] ....   679.006689: rtcpu_string: tstamp:21423070937 id:0x04010000 str:"All error notifications not enabled: correctable"
     kworker/0:2-9010  [000] ....   679.006696: rtcpu_string: tstamp:21423071141 id:0x04010000 str:"=0x00 uncorrectable=0x00"
     kworker/0:2-9010  [000] ....   679.006697: rtcpu_string: tstamp:21423071424 id:0x04010000 str:""
"
     kworker/0:2-9010  [000] ....   679.118491: rtos_queue_peek_from_isr_failed: tstamp:21427897725 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   679.290512: rtos_queue_peek_from_isr_failed: tstamp:21432897724 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   679.458556: rtos_queue_send_from_isr_failed: tstamp:21437859005 queue:0x0bcb41f8
     kworker/0:2-9010  [000] ....   679.458566: rtos_queue_send_from_isr_failed: tstamp:21437859235 queue:0x0bcb8a60
     kworker/0:2-9010  [000] ....   679.458568: rtos_queue_send_from_isr_failed: tstamp:21437859458 queue:0x0bcba5e0
     kworker/0:2-9010  [000] ....   679.458570: rtos_queue_send_from_isr_failed: tstamp:21437859674 queue:0x0bcbb3a0
     kworker/0:2-9010  [000] ....   679.458571: rtos_queue_send_from_isr_failed: tstamp:21437859892 queue:0x0bcbc160
     kworker/0:2-9010  [000] ....   679.458576: rtcpu_string: tstamp:21437860535 id:0x04010000 str:"Configuring VI GoS.
"
     kworker/0:2-9010  [000] ....   679.458630: rtcpu_string: tstamp:21437860806 id:0x04010000 str:"VM GOS[#0] addr=0xe4900000
"
     kworker/0:2-9010  [000] ....   679.458643: rtcpu_string: tstamp:21437861129 id:0x04010000 str:"VM GOS[#1] addr=0xe4901000
"
     kworker/0:2-9010  [000] ....   679.458652: rtcpu_string: tstamp:21437861496 id:0x04010000 str:"VM GOS[#2] addr=0xe4902000
"
     kworker/0:2-9010  [000] ....   679.458661: rtcpu_string: tstamp:21437861801 id:0x04010000 str:"VM GOS[#3] addr=0xe4903000
"
     kworker/0:2-9010  [000] ....   679.458671: rtcpu_string: tstamp:21437862107 id:0x04010000 str:"VM GOS[#4] addr=0xe4904000
"
     kworker/0:2-9010  [000] ....   679.458679: rtcpu_string: tstamp:21437862413 id:0x04010000 str:"VM GOS[#5] addr=0xe4905000
"
     kworker/0:2-9010  [000] ....   679.458687: rtcpu_string: tstamp:21437870904 id:0x04010000 str:"vi5_hwinit: firmware CL2018101701 protocol versi"
     kworker/0:2-9010  [000] ....   679.458695: rtcpu_string: tstamp:21437871093 id:0x04010000 str:"on 2.2
"
     kworker/0:2-9010  [000] ....   679.458752: rtcpu_string: tstamp:21437884171 id:0x04010000 str:"ERROR: t194/vi5.c:285 [vi5_update_streams] ""
     kworker/0:2-9010  [000] ....   679.458755: rtcpu_string: tstamp:21437884521 id:0x04010000 str:"VI not active"
"
     kworker/0:2-9010  [000] ....   679.458768: rtos_queue_send_from_isr_failed: tstamp:21437891551 queue:0x0bcb41f8
     kworker/0:2-9010  [000] ....   679.458770: rtos_queue_send_from_isr_failed: tstamp:21437891778 queue:0x0bcb8a60
     kworker/0:2-9010  [000] ....   679.458772: rtos_queue_send_from_isr_failed: tstamp:21437892007 queue:0x0bcba5e0
     kworker/0:2-9010  [000] ....   679.458773: rtos_queue_send_from_isr_failed: tstamp:21437892226 queue:0x0bcbb3a0
     kworker/0:2-9010  [000] ....   679.458775: rtos_queue_send_from_isr_failed: tstamp:21437892444 queue:0x0bcbc160
     kworker/0:2-9010  [000] ....   679.458778: rtos_queue_peek_from_isr_failed: tstamp:21437897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   679.630445: rtos_queue_peek_from_isr_failed: tstamp:21442897731 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   679.798520: rtos_queue_peek_from_isr_failed: tstamp:21447897719 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   679.854514: rtos_queue_send_from_isr_failed: tstamp:21450208466 queue:0x0bcb41f8
     kworker/0:2-9010  [000] ....   679.854523: rtos_queue_send_from_isr_failed: tstamp:21450208686 queue:0x0bcb8a60
     kworker/0:2-9010  [000] ....   679.854524: rtos_queue_send_from_isr_failed: tstamp:21450208908 queue:0x0bcba5e0
     kworker/0:2-9010  [000] ....   679.854526: rtos_queue_send_from_isr_failed: tstamp:21450209126 queue:0x0bcbb3a0
     kworker/0:2-9010  [000] ....   679.854527: rtos_queue_send_from_isr_failed: tstamp:21450209346 queue:0x0bcbc160
     kworker/0:2-9010  [000] ....   679.854529: rtos_queue_send_from_isr_failed: tstamp:21450209621 queue:0x0bcb4190
     kworker/0:2-9010  [000] ....   679.854530: rtos_queue_send_from_isr_failed: tstamp:21450209829 queue:0x0bcb41f8
     kworker/0:2-9010  [000] ....   679.854532: rtos_queue_send_from_isr_failed: tstamp:21450210102 queue:0x0bcb89f8
     kworker/0:2-9010  [000] ....   679.854533: rtos_queue_send_from_isr_failed: tstamp:21450210308 queue:0x0bcb8a60
     kworker/0:2-9010  [000] ....   679.854534: rtos_queue_send_from_isr_failed: tstamp:21450210517 queue:0x0bcba578
     kworker/0:2-9010  [000] ....   679.854536: rtos_queue_send_from_isr_failed: tstamp:21450210722 queue:0x0bcba5e0
     kworker/0:2-9010  [000] ....   679.854537: rtos_queue_send_from_isr_failed: tstamp:21450210930 queue:0x0bcbb338
     kworker/0:2-9010  [000] ....   679.854538: rtos_queue_send_from_isr_failed: tstamp:21450211134 queue:0x0bcbb3a0
     kworker/0:2-9010  [000] ....   679.854540: rtos_queue_send_from_isr_failed: tstamp:21450211342 queue:0x0bcbc0f8
     kworker/0:2-9010  [000] ....   679.854541: rtos_queue_send_from_isr_failed: tstamp:21450211546 queue:0x0bcbc160
     kworker/0:2-9010  [000] ....   679.854542: rtos_queue_send_from_isr_failed: tstamp:21450232671 queue:0x0bcb41f8
     kworker/0:2-9010  [000] ....   679.854544: rtos_queue_send_from_isr_failed: tstamp:21450232894 queue:0x0bcb8a60
     kworker/0:2-9010  [000] ....   679.854545: rtos_queue_send_from_isr_failed: tstamp:21450233117 queue:0x0bcba5e0
     kworker/0:2-9010  [000] ....   679.854546: rtos_queue_send_from_isr_failed: tstamp:21450233335 queue:0x0bcbb3a0
     kworker/0:2-9010  [000] ....   679.854548: rtos_queue_send_from_isr_failed: tstamp:21450233553 queue:0x0bcbc160
     kworker/0:2-9010  [000] ....   679.854549: rtos_queue_send_from_isr_failed: tstamp:21450238839 queue:0x0bcb41f8
     kworker/0:2-9010  [000] ....   679.854550: rtos_queue_send_from_isr_failed: tstamp:21450239058 queue:0x0bcb8a60
     kworker/0:2-9010  [000] ....   679.854552: rtos_queue_send_from_isr_failed: tstamp:21450239280 queue:0x0bcba5e0
     kworker/0:2-9010  [000] ....   679.854555: rtos_queue_send_from_isr_failed: tstamp:21450239503 queue:0x0bcbb3a0
     kworker/0:2-9010  [000] ....   679.854556: rtos_queue_send_from_isr_failed: tstamp:21450239721 queue:0x0bcbc160
     kworker/0:2-9010  [000] ....   679.854558: rtos_queue_send_from_isr_failed: tstamp:21450938362 queue:0x0bcb41f8
     kworker/0:2-9010  [000] ....   679.854559: rtos_queue_send_from_isr_failed: tstamp:21450938585 queue:0x0bcb8a60
     kworker/0:2-9010  [000] ....   679.854560: rtos_queue_send_from_isr_failed: tstamp:21450938808 queue:0x0bcba5e0
     kworker/0:2-9010  [000] ....   679.854562: rtos_queue_send_from_isr_failed: tstamp:21450939029 queue:0x0bcbb3a0
     kworker/0:2-9010  [000] ....   679.854563: rtos_queue_send_from_isr_failed: tstamp:21450939249 queue:0x0bcbc160
     kworker/0:2-9010  [000] ....   679.854567: rtcpu_string: tstamp:21450939851 id:0x04010000 str:"Configuring VI GoS.
"
     kworker/0:2-9010  [000] ....   679.854630: rtcpu_string: tstamp:21450940130 id:0x04010000 str:"VM GOS[#0] addr=0xe4900000
"
     kworker/0:2-9010  [000] ....   679.854644: rtcpu_string: tstamp:21450940458 id:0x04010000 str:"VM GOS[#1] addr=0xe4901000
"
     kworker/0:2-9010  [000] ....   679.854653: rtcpu_string: tstamp:21450940822 id:0x04010000 str:"VM GOS[#2] addr=0xe4902000
"
     kworker/0:2-9010  [000] ....   679.854661: rtcpu_string: tstamp:21450941129 id:0x04010000 str:"VM GOS[#3] addr=0xe4903000
"
     kworker/0:2-9010  [000] ....   679.854669: rtcpu_string: tstamp:21450941447 id:0x04010000 str:"VM GOS[#4] addr=0xe4904000
"
     kworker/0:2-9010  [000] ....   679.854677: rtcpu_string: tstamp:21450941756 id:0x04010000 str:"VM GOS[#5] addr=0xe4905000
"
     kworker/0:2-9010  [000] ....   679.854686: rtcpu_string: tstamp:21450942798 id:0x04010000 str:"ERROR: t194/vi5.c:285 [vi5_update_streams] ""
     kworker/0:2-9010  [000] ....   679.854689: rtcpu_string: tstamp:21450943114 id:0x04010000 str:"VI not active"
"
     kworker/0:2-9010  [000] ....   679.854751: rtos_queue_send_from_isr_failed: tstamp:21450962679 queue:0x0bcb41f8
     kworker/0:2-9010  [000] ....   679.854752: rtos_queue_send_from_isr_failed: tstamp:21450962903 queue:0x0bcb8a60
     kworker/0:2-9010  [000] ....   679.854754: rtos_queue_send_from_isr_failed: tstamp:21450963127 queue:0x0bcba5e0
     kworker/0:2-9010  [000] ....   679.854755: rtos_queue_send_from_isr_failed: tstamp:21450963345 queue:0x0bcbb3a0
     kworker/0:2-9010  [000] ....   679.854756: rtos_queue_send_from_isr_failed: tstamp:21450963563 queue:0x0bcbc160
     kworker/0:2-9010  [000] ....   679.854758: rtos_queue_send_from_isr_failed: tstamp:21450971194 queue:0x0bcb41f8
     kworker/0:2-9010  [000] ....   679.854759: rtos_queue_send_from_isr_failed: tstamp:21450971417 queue:0x0bcb8a60
     kworker/0:2-9010  [000] ....   679.854760: rtos_queue_send_from_isr_failed: tstamp:21450971639 queue:0x0bcba5e0
     kworker/0:2-9010  [000] ....   679.854762: rtos_queue_send_from_isr_failed: tstamp:21450971857 queue:0x0bcbb3a0
     kworker/0:2-9010  [000] ....   679.854763: rtos_queue_send_from_isr_failed: tstamp:21450972076 queue:0x0bcbc160
     kworker/0:2-9010  [000] ....   679.910717: rtos_queue_peek_from_isr_failed: tstamp:21452897720 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   680.082453: rtos_queue_send_from_isr_failed: tstamp:21457054196 queue:0x0bcb41f8
     kworker/0:2-9010  [000] ....   680.082462: rtos_queue_send_from_isr_failed: tstamp:21457054415 queue:0x0bcb8a60
     kworker/0:2-9010  [000] ....   680.082464: rtos_queue_send_from_isr_failed: tstamp:21457054635 queue:0x0bcba5e0
     kworker/0:2-9010  [000] ....   680.082466: rtos_queue_send_from_isr_failed: tstamp:21457054853 queue:0x0bcbb3a0
     kworker/0:2-9010  [000] ....   680.082468: rtos_queue_send_from_isr_failed: tstamp:21457055071 queue:0x0bcbc160
     kworker/0:2-9010  [000] ....   680.082517: rtcpu_string: tstamp:21457056225 id:0x04010000 str:"VI GOS[#0] set to VM GOS[4] base 0xe4904000
"
     kworker/0:2-9010  [000] ....   680.082560: rtcpu_vinotify_event: tstamp:21457096154 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:20905932640 data:0x10000000
     kworker/0:2-9010  [000] ....   680.082562: rtcpu_vinotify_event: tstamp:21457096370 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:20905951392 data:0x31000001
     kworker/0:2-9010  [000] ....   680.082563: rtcpu_vinotify_event: tstamp:21457096623 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:20905956256 data:0x07020001
     kworker/0:2-9010  [000] ....   680.082565: rtos_queue_send_from_isr_failed: tstamp:21457135109 queue:0x0bcb41f8
     kworker/0:2-9010  [000] ....   680.082566: rtos_queue_send_from_isr_failed: tstamp:21457135333 queue:0x0bcb8a60
     kworker/0:2-9010  [000] ....   680.082567: rtos_queue_send_from_isr_failed: tstamp:21457135556 queue:0x0bcba5e0
     kworker/0:2-9010  [000] ....   680.082569: rtos_queue_send_from_isr_failed: tstamp:21457135775 queue:0x0bcbb3a0
     kworker/0:2-9010  [000] ....   680.082570: rtos_queue_send_from_isr_failed: tstamp:21457135994 queue:0x0bcbc160
     kworker/0:2-9010  [000] ....   680.082571: rtos_queue_send_from_isr_failed: tstamp:21457155560 queue:0x0bcb41f8
     kworker/0:2-9010  [000] ....   680.082573: rtos_queue_send_from_isr_failed: tstamp:21457155782 queue:0x0bcb8a60
     kworker/0:2-9010  [000] ....   680.082574: rtos_queue_send_from_isr_failed: tstamp:21457156009 queue:0x0bcba5e0
     kworker/0:2-9010  [000] ....   680.082575: rtos_queue_send_from_isr_failed: tstamp:21457156229 queue:0x0bcbb3a0
     kworker/0:2-9010  [000] ....   680.082577: rtos_queue_send_from_isr_failed: tstamp:21457156447 queue:0x0bcbc160
     kworker/0:2-9010  [000] ....   680.082578: rtcpu_vinotify_event: tstamp:21457553597 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:20908515584 data:0x10000000
     kworker/0:2-9010  [000] ....   680.082579: rtcpu_vinotify_event: tstamp:21457553856 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:20908534528 data:0x31000002
     kworker/0:2-9010  [000] ....   680.082583: rtos_queue_peek_from_isr_failed: tstamp:21457897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   680.250434: rtos_queue_peek_from_isr_failed: tstamp:21462897736 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   680.418417: rtos_queue_peek_from_isr_failed: tstamp:21467897716 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   680.586427: rtos_queue_peek_from_isr_failed: tstamp:21472897716 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   680.754538: rtos_queue_peek_from_isr_failed: tstamp:21477897716 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   680.922490: rtos_queue_peek_from_isr_failed: tstamp:21482897716 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   681.034439: rtos_queue_peek_from_isr_failed: tstamp:21487897735 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   681.202437: rtos_queue_peek_from_isr_failed: tstamp:21492897716 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   681.370434: rtos_queue_peek_from_isr_failed: tstamp:21497897716 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   681.538443: rtos_queue_peek_from_isr_failed: tstamp:21502897716 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   681.706460: rtos_queue_peek_from_isr_failed: tstamp:21507897720 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   681.874406: rtos_queue_peek_from_isr_failed: tstamp:21512897737 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   682.042484: rtos_queue_peek_from_isr_failed: tstamp:21517897759 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   682.154528: rtos_queue_peek_from_isr_failed: tstamp:21522897759 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   682.322474: rtos_queue_peek_from_isr_failed: tstamp:21527897759 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   682.490483: rtos_queue_peek_from_isr_failed: tstamp:21532897759 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   682.658426: rtos_queue_peek_from_isr_failed: tstamp:21537897776 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   682.826410: rtos_queue_peek_from_isr_failed: tstamp:21542897755 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   682.994446: rtos_queue_peek_from_isr_failed: tstamp:21547897755 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   683.162469: rtos_queue_peek_from_isr_failed: tstamp:21552897755 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   683.274474: rtos_queue_peek_from_isr_failed: tstamp:21557897759 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   683.442450: rtos_queue_peek_from_isr_failed: tstamp:21562897776 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   683.610452: rtos_queue_peek_from_isr_failed: tstamp:21567897755 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   683.778433: rtos_queue_peek_from_isr_failed: tstamp:21572897758 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   683.946429: rtos_queue_peek_from_isr_failed: tstamp:21577897755 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   684.114420: rtos_queue_peek_from_isr_failed: tstamp:21582897755 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   684.282424: rtos_queue_peek_from_isr_failed: tstamp:21587897775 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   684.394417: rtos_queue_peek_from_isr_failed: tstamp:21592897764 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   684.562432: rtos_queue_peek_from_isr_failed: tstamp:21597897764 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   684.730437: rtos_queue_peek_from_isr_failed: tstamp:21602897755 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   684.898398: rtos_queue_peek_from_isr_failed: tstamp:21607897758 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   685.066390: rtos_queue_peek_from_isr_failed: tstamp:21612897685 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   685.234436: rtos_queue_peek_from_isr_failed: tstamp:21617897737 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   685.402462: rtos_queue_peek_from_isr_failed: tstamp:21622897716 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   685.514497: rtos_queue_peek_from_isr_failed: tstamp:21627897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   685.682446: rtos_queue_peek_from_isr_failed: tstamp:21632897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   685.854501: rtos_queue_peek_from_isr_failed: tstamp:21637897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   686.022451: rtos_queue_peek_from_isr_failed: tstamp:21642897720 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   686.190416: rtos_queue_peek_from_isr_failed: tstamp:21647897719 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   686.358498: rtos_queue_peek_from_isr_failed: tstamp:21652897716 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   686.470402: rtos_queue_peek_from_isr_failed: tstamp:21657897716 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   686.638428: rtos_queue_peek_from_isr_failed: tstamp:21662897716 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   686.806405: rtos_queue_peek_from_isr_failed: tstamp:21667897716 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   686.974438: rtos_queue_peek_from_isr_failed: tstamp:21672897718 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   687.142468: rtos_queue_peek_from_isr_failed: tstamp:21677897716 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   687.310556: rtos_queue_peek_from_isr_failed: tstamp:21682897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   687.478760: rtos_queue_peek_from_isr_failed: tstamp:21687897716 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   687.590494: rtos_queue_peek_from_isr_failed: tstamp:21692897725 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   687.762466: rtos_queue_peek_from_isr_failed: tstamp:21697897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   687.934501: rtos_queue_peek_from_isr_failed: tstamp:21702897719 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   688.102496: rtos_queue_peek_from_isr_failed: tstamp:21707897719 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   688.270435: rtos_queue_peek_from_isr_failed: tstamp:21712897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   688.442458: rtos_queue_peek_from_isr_failed: tstamp:21717897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   688.554500: rtos_queue_peek_from_isr_failed: tstamp:21722897719 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   688.722396: rtos_queue_peek_from_isr_failed: tstamp:21727897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   688.890505: rtos_queue_peek_from_isr_failed: tstamp:21732897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   689.058494: rtos_queue_peek_from_isr_failed: tstamp:21737897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   689.226391: rtos_queue_peek_from_isr_failed: tstamp:21742897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   689.394461: rtos_queue_peek_from_isr_failed: tstamp:21747897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   689.562387: rtos_queue_peek_from_isr_failed: tstamp:21752897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   689.674382: rtos_queue_peek_from_isr_failed: tstamp:21757897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   689.842415: rtos_queue_peek_from_isr_failed: tstamp:21762897714 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   690.010378: rtos_queue_peek_from_isr_failed: tstamp:21767897718 queue:0x0bcbcf78
     kworker/0:1-818   [000] ....   690.178482: rtos_queue_peek_from_isr_failed: tstamp:21772897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   690.350417: rtos_queue_peek_from_isr_failed: tstamp:21777897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   690.518367: rtos_queue_peek_from_isr_failed: tstamp:21782897719 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   690.630359: rtos_queue_peek_from_isr_failed: tstamp:21787897736 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   690.798405: rtos_queue_peek_from_isr_failed: tstamp:21792897719 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   690.966402: rtos_queue_peek_from_isr_failed: tstamp:21797897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   691.134414: rtos_queue_peek_from_isr_failed: tstamp:21802897720 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   691.302355: rtos_queue_peek_from_isr_failed: tstamp:21807897716 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   691.470368: rtos_queue_peek_from_isr_failed: tstamp:21812897716 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   691.638372: rtos_queue_peek_from_isr_failed: tstamp:21817897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   691.750363: rtos_queue_peek_from_isr_failed: tstamp:21822897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   691.918337: rtos_queue_peek_from_isr_failed: tstamp:21827897732 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   692.086333: rtos_queue_peek_from_isr_failed: tstamp:21832897720 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   692.254474: rtos_queue_peek_from_isr_failed: tstamp:21837897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   692.422458: rtos_queue_peek_from_isr_failed: tstamp:21842897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   692.590452: rtos_queue_peek_from_isr_failed: tstamp:21847897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   692.758435: rtos_queue_peek_from_isr_failed: tstamp:21852897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   692.870359: rtos_queue_peek_from_isr_failed: tstamp:21857897722 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   693.038393: rtos_queue_peek_from_isr_failed: tstamp:21862897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   693.206457: rtos_queue_peek_from_isr_failed: tstamp:21867897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   693.374427: rtos_queue_peek_from_isr_failed: tstamp:21872897724 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   693.542314: rtos_queue_peek_from_isr_failed: tstamp:21877897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   693.710376: rtos_queue_peek_from_isr_failed: tstamp:21882897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   693.878409: rtos_queue_peek_from_isr_failed: tstamp:21887897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   693.990390: rtos_queue_peek_from_isr_failed: tstamp:21892897714 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   694.158414: rtos_queue_peek_from_isr_failed: tstamp:21897897720 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   694.326329: rtos_queue_peek_from_isr_failed: tstamp:21902897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   694.494429: rtos_queue_peek_from_isr_failed: tstamp:21907897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   694.662309: rtos_queue_peek_from_isr_failed: tstamp:21912897735 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   694.830342: rtos_queue_peek_from_isr_failed: tstamp:21917897755 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   694.998312: rtos_queue_peek_from_isr_failed: tstamp:21922897733 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   695.110308: rtos_queue_peek_from_isr_failed: tstamp:21927897718 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   695.278327: rtos_queue_peek_from_isr_failed: tstamp:21932897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   695.450310: rtos_queue_peek_from_isr_failed: tstamp:21937897690 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   695.618307: rtos_queue_peek_from_isr_failed: tstamp:21942897723 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   695.786292: rtos_queue_peek_from_isr_failed: tstamp:21947897716 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   695.954299: rtos_queue_peek_from_isr_failed: tstamp:21952897716 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   696.122337: rtos_queue_peek_from_isr_failed: tstamp:21957897713 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   696.234347: rtos_queue_peek_from_isr_failed: tstamp:21962897736 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   696.402338: rtos_queue_peek_from_isr_failed: tstamp:21967897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   696.570358: rtos_queue_peek_from_isr_failed: tstamp:21972897716 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   696.738302: rtos_queue_peek_from_isr_failed: tstamp:21977897716 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   696.906291: rtos_queue_peek_from_isr_failed: tstamp:21982897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   697.074290: rtos_queue_peek_from_isr_failed: tstamp:21987897737 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   697.242292: rtos_queue_peek_from_isr_failed: tstamp:21992897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   697.354341: rtos_queue_peek_from_isr_failed: tstamp:21997897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   697.522341: rtos_queue_peek_from_isr_failed: tstamp:22002897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   697.690331: rtos_queue_peek_from_isr_failed: tstamp:22007897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   697.858316: rtos_queue_peek_from_isr_failed: tstamp:22012897733 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   698.026288: rtos_queue_peek_from_isr_failed: tstamp:22017897722 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   698.194330: rtos_queue_peek_from_isr_failed: tstamp:22022897711 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   698.362338: rtos_queue_peek_from_isr_failed: tstamp:22027897716 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   698.474371: rtos_queue_peek_from_isr_failed: tstamp:22032897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   698.642303: rtos_queue_peek_from_isr_failed: tstamp:22037897733 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   698.810305: rtos_queue_peek_from_isr_failed: tstamp:22042897718 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   698.978405: rtos_queue_peek_from_isr_failed: tstamp:22047897685 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   699.146287: rtos_queue_peek_from_isr_failed: tstamp:22052897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   699.314335: rtos_queue_peek_from_isr_failed: tstamp:22057897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   699.482361: rtos_queue_peek_from_isr_failed: tstamp:22062897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   699.594340: rtos_queue_peek_from_isr_failed: tstamp:22067897718 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   699.762348: rtos_queue_peek_from_isr_failed: tstamp:22072897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   699.930365: rtos_queue_peek_from_isr_failed: tstamp:22077897735 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   700.098343: rtos_queue_peek_from_isr_failed: tstamp:22082897735 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   700.266384: rtos_queue_peek_from_isr_failed: tstamp:22087897718 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   700.434320: rtos_queue_peek_from_isr_failed: tstamp:22092897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   700.602319: rtos_queue_peek_from_isr_failed: tstamp:22097897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   700.714309: rtos_queue_peek_from_isr_failed: tstamp:22102897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   700.882302: rtos_queue_peek_from_isr_failed: tstamp:22107897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   701.050307: rtos_queue_peek_from_isr_failed: tstamp:22112897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   701.218311: rtos_queue_peek_from_isr_failed: tstamp:22117897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   701.386266: rtos_queue_peek_from_isr_failed: tstamp:22122897722 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   701.554259: rtos_queue_peek_from_isr_failed: tstamp:22127897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   701.722299: rtos_queue_peek_from_isr_failed: tstamp:22132897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   701.834414: rtos_queue_peek_from_isr_failed: tstamp:22137897718 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   702.002303: rtos_queue_peek_from_isr_failed: tstamp:22142897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   702.170323: rtos_queue_peek_from_isr_failed: tstamp:22147897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   702.342268: rtos_queue_peek_from_isr_failed: tstamp:22152897716 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   702.510309: rtos_queue_peek_from_isr_failed: tstamp:22157897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   702.678244: rtos_queue_peek_from_isr_failed: tstamp:22162897737 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   702.790259: rtos_queue_peek_from_isr_failed: tstamp:22167897723 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   702.958260: rtos_queue_peek_from_isr_failed: tstamp:22172897719 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   703.126269: rtos_queue_peek_from_isr_failed: tstamp:22177897757 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   703.294237: rtos_queue_peek_from_isr_failed: tstamp:22182897722 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   703.462510: rtos_queue_peek_from_isr_failed: tstamp:22187897735 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   703.630244: rtos_queue_peek_from_isr_failed: tstamp:22192897718 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   703.798260: rtos_queue_peek_from_isr_failed: tstamp:22197897684 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   703.910436: rtos_queue_peek_from_isr_failed: tstamp:22202897720 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   704.078346: rtos_queue_peek_from_isr_failed: tstamp:22207897716 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   704.246296: rtos_queue_peek_from_isr_failed: tstamp:22212897733 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   704.414228: rtos_queue_peek_from_isr_failed: tstamp:22217897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   704.582229: rtos_queue_peek_from_isr_failed: tstamp:22222897719 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   704.750243: rtos_queue_peek_from_isr_failed: tstamp:22227897716 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   704.922235: rtos_queue_peek_from_isr_failed: tstamp:22232897758 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   705.034256: rtos_queue_peek_from_isr_failed: tstamp:22237897736 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   705.202235: rtos_queue_peek_from_isr_failed: tstamp:22242897716 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   705.370228: rtos_queue_peek_from_isr_failed: tstamp:22247897716 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   705.538247: rtos_queue_peek_from_isr_failed: tstamp:22252897722 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   705.706290: rtos_queue_peek_from_isr_failed: tstamp:22257897775 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   705.874229: rtos_queue_peek_from_isr_failed: tstamp:22262897776 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   706.042243: rtos_queue_peek_from_isr_failed: tstamp:22267897759 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   706.154217: rtos_queue_peek_from_isr_failed: tstamp:22272897758 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   706.322213: rtos_queue_peek_from_isr_failed: tstamp:22277897775 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   706.490273: rtos_queue_peek_from_isr_failed: tstamp:22282897772 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   706.658224: rtos_queue_peek_from_isr_failed: tstamp:22287897772 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   706.826212: rtos_queue_peek_from_isr_failed: tstamp:22292897755 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   706.994219: rtos_queue_peek_from_isr_failed: tstamp:22297897773 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   707.162201: rtos_queue_peek_from_isr_failed: tstamp:22302897758 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   707.274199: rtos_queue_peek_from_isr_failed: tstamp:22307897757 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   707.442205: rtos_queue_peek_from_isr_failed: tstamp:22312897773 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   707.610243: rtos_queue_peek_from_isr_failed: tstamp:22317897754 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   707.778210: rtos_queue_peek_from_isr_failed: tstamp:22322897772 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   707.946205: rtos_queue_peek_from_isr_failed: tstamp:22327897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   708.114202: rtos_queue_peek_from_isr_failed: tstamp:22332897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   708.282254: rtos_queue_peek_from_isr_failed: tstamp:22337897716 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   708.394210: rtos_queue_peek_from_isr_failed: tstamp:22342897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   708.562214: rtos_queue_peek_from_isr_failed: tstamp:22347897719 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   708.730202: rtos_queue_peek_from_isr_failed: tstamp:22352897718 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   708.898214: rtos_queue_peek_from_isr_failed: tstamp:22357897755 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   709.066192: rtos_queue_peek_from_isr_failed: tstamp:22362897735 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   709.234283: rtos_queue_peek_from_isr_failed: tstamp:22367897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   709.402222: rtos_queue_peek_from_isr_failed: tstamp:22372897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   709.514195: rtos_queue_peek_from_isr_failed: tstamp:22377897736 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   709.682185: rtos_queue_peek_from_isr_failed: tstamp:22382897719 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   709.850188: rtos_queue_peek_from_isr_failed: tstamp:22387897736 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   710.018250: rtos_queue_peek_from_isr_failed: tstamp:22392897755 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   710.186238: rtos_queue_peek_from_isr_failed: tstamp:22397897759 queue:0x0bcbcf78
     kworker/0:1-818   [000] ....   710.354289: rtos_queue_peek_from_isr_failed: tstamp:22402897777 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   710.522189: rtos_queue_peek_from_isr_failed: tstamp:22407897751 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   710.634216: rtos_queue_peek_from_isr_failed: tstamp:22412897776 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   710.802241: rtos_queue_peek_from_isr_failed: tstamp:22417897763 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   710.970278: rtos_queue_peek_from_isr_failed: tstamp:22422897755 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   711.138209: rtos_queue_peek_from_isr_failed: tstamp:22427897755 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   711.306216: rtos_queue_peek_from_isr_failed: tstamp:22432897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   711.474208: rtos_queue_peek_from_isr_failed: tstamp:22437897737 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   711.642198: rtos_queue_peek_from_isr_failed: tstamp:22442897724 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   711.754193: rtos_queue_peek_from_isr_failed: tstamp:22447897718 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   711.922202: rtos_queue_peek_from_isr_failed: tstamp:22452897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   712.090212: rtos_queue_peek_from_isr_failed: tstamp:22457897719 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   712.258177: rtos_queue_peek_from_isr_failed: tstamp:22462897733 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   712.426199: rtos_queue_peek_from_isr_failed: tstamp:22467897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   712.594171: rtos_queue_peek_from_isr_failed: tstamp:22472897714 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   712.762191: rtos_queue_peek_from_isr_failed: tstamp:22477897759 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   712.874171: rtos_queue_peek_from_isr_failed: tstamp:22482897759 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   713.042168: rtos_queue_peek_from_isr_failed: tstamp:22487897777 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   713.210155: rtos_queue_peek_from_isr_failed: tstamp:22492897772 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   713.378158: rtos_queue_peek_from_isr_failed: tstamp:22497897758 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   713.546204: rtos_queue_peek_from_isr_failed: tstamp:22502897759 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   713.714154: rtos_queue_peek_from_isr_failed: tstamp:22507897759 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   713.882139: rtos_queue_peek_from_isr_failed: tstamp:22512897780 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   713.994168: rtos_queue_peek_from_isr_failed: tstamp:22517897760 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   714.166225: rtos_queue_peek_from_isr_failed: tstamp:22522897716 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   714.334149: rtos_queue_peek_from_isr_failed: tstamp:22527897716 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   714.502202: rtos_queue_peek_from_isr_failed: tstamp:22532897716 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   714.670161: rtos_queue_peek_from_isr_failed: tstamp:22537897771 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   714.838174: rtos_queue_peek_from_isr_failed: tstamp:22542897757 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   714.950137: rtos_queue_peek_from_isr_failed: tstamp:22547897759 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   715.118206: rtos_queue_peek_from_isr_failed: tstamp:22552897759 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   715.286156: rtos_queue_peek_from_isr_failed: tstamp:22557897757 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   715.454249: rtos_queue_peek_from_isr_failed: tstamp:22562897776 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   715.622151: rtos_queue_peek_from_isr_failed: tstamp:22567897757 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   715.790164: rtos_queue_peek_from_isr_failed: tstamp:22572897759 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   715.958150: rtos_queue_peek_from_isr_failed: tstamp:22577897760 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   716.070149: rtos_queue_peek_from_isr_failed: tstamp:22582897759 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   716.238124: rtos_queue_peek_from_isr_failed: tstamp:22587897777 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   716.406134: rtos_queue_peek_from_isr_failed: tstamp:22592897755 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   716.574137: rtos_queue_peek_from_isr_failed: tstamp:22597897758 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   716.742134: rtos_queue_peek_from_isr_failed: tstamp:22602897754 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   716.910129: rtos_queue_peek_from_isr_failed: tstamp:22607897755 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   717.078123: rtos_queue_peek_from_isr_failed: tstamp:22612897780 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   717.190125: rtos_queue_peek_from_isr_failed: tstamp:22617897755 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   717.358141: rtos_queue_peek_from_isr_failed: tstamp:22622897755 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   717.526123: rtos_queue_peek_from_isr_failed: tstamp:22627897755 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   717.694128: rtos_queue_peek_from_isr_failed: tstamp:22632897755 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   717.862112: rtos_queue_peek_from_isr_failed: tstamp:22637897775 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   718.030131: rtos_queue_peek_from_isr_failed: tstamp:22642897755 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   718.198114: rtos_queue_peek_from_isr_failed: tstamp:22647897758 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   718.310120: rtos_queue_peek_from_isr_failed: tstamp:22652897758 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   718.478208: rtos_queue_peek_from_isr_failed: tstamp:22657897757 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   718.650146: rtos_queue_peek_from_isr_failed: tstamp:22662897758 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   718.818136: rtos_queue_peek_from_isr_failed: tstamp:22667897753 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   718.986145: rtos_queue_peek_from_isr_failed: tstamp:22672897759 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   719.154165: rtos_queue_peek_from_isr_failed: tstamp:22677897758 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   719.322120: rtos_queue_peek_from_isr_failed: tstamp:22682897760 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   719.434110: rtos_queue_peek_from_isr_failed: tstamp:22687897776 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   719.602103: rtos_queue_peek_from_isr_failed: tstamp:22692897758 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   719.770164: rtos_queue_peek_from_isr_failed: tstamp:22697897755 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   719.938199: rtos_queue_peek_from_isr_failed: tstamp:22702897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   720.106159: rtos_queue_peek_from_isr_failed: tstamp:22707897716 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   720.274104: rtos_queue_peek_from_isr_failed: tstamp:22712897737 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   720.442143: rtos_queue_peek_from_isr_failed: tstamp:22717897740 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   720.554158: rtos_queue_peek_from_isr_failed: tstamp:22722897716 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   720.722105: rtos_queue_peek_from_isr_failed: tstamp:22727897755 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   720.890106: rtos_queue_peek_from_isr_failed: tstamp:22732897753 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   721.058164: rtos_queue_peek_from_isr_failed: tstamp:22737897779 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   721.226080: rtos_queue_peek_from_isr_failed: tstamp:22742897758 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   721.394097: rtos_queue_peek_from_isr_failed: tstamp:22747897759 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   721.562102: rtos_queue_peek_from_isr_failed: tstamp:22752897776 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   721.674080: rtos_queue_peek_from_isr_failed: tstamp:22757897763 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   721.842109: rtos_queue_peek_from_isr_failed: tstamp:22762897776 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   722.010113: rtos_queue_peek_from_isr_failed: tstamp:22767897758 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   722.178076: rtos_queue_peek_from_isr_failed: tstamp:22772897759 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   722.346149: rtos_queue_peek_from_isr_failed: tstamp:22777897759 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   722.514122: rtos_queue_peek_from_isr_failed: tstamp:22782897716 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   722.682082: rtos_queue_peek_from_isr_failed: tstamp:22787897735 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   722.794070: rtos_queue_peek_from_isr_failed: tstamp:22792897716 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   722.962075: rtos_queue_peek_from_isr_failed: tstamp:22797897719 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   723.130086: rtos_queue_peek_from_isr_failed: tstamp:22802897755 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   723.298070: rtos_queue_peek_from_isr_failed: tstamp:22807897757 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   723.466102: rtos_queue_peek_from_isr_failed: tstamp:22812897755 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   723.634109: rtos_queue_peek_from_isr_failed: tstamp:22817897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   723.802083: rtos_queue_peek_from_isr_failed: tstamp:22822897716 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   723.914146: rtos_queue_peek_from_isr_failed: tstamp:22827897716 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   724.082114: rtos_queue_peek_from_isr_failed: tstamp:22832897720 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   724.250142: rtos_queue_peek_from_isr_failed: tstamp:22837897733 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   724.418071: rtos_queue_peek_from_isr_failed: tstamp:22842897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   724.586167: rtos_queue_peek_from_isr_failed: tstamp:22847897716 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   724.754109: rtos_queue_peek_from_isr_failed: tstamp:22852897716 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   724.922069: rtos_queue_peek_from_isr_failed: tstamp:22857897737 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   725.034064: rtos_queue_peek_from_isr_failed: tstamp:22862897737 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   725.202099: rtos_queue_peek_from_isr_failed: tstamp:22867897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   725.370086: rtos_queue_peek_from_isr_failed: tstamp:22872897718 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   725.538080: rtos_queue_peek_from_isr_failed: tstamp:22877897733 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   725.706198: rtos_queue_peek_from_isr_failed: tstamp:22882897735 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   725.874112: rtos_queue_peek_from_isr_failed: tstamp:22887897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   726.042086: rtos_queue_peek_from_isr_failed: tstamp:22892897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   726.154054: rtos_queue_peek_from_isr_failed: tstamp:22897897716 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   726.322065: rtos_queue_peek_from_isr_failed: tstamp:22902897716 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   726.490115: rtos_queue_peek_from_isr_failed: tstamp:22907897757 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   726.658047: rtos_queue_peek_from_isr_failed: tstamp:22912897781 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   726.826066: rtos_queue_peek_from_isr_failed: tstamp:22917897764 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   726.994102: rtos_queue_peek_from_isr_failed: tstamp:22922897764 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   727.162033: rtos_queue_peek_from_isr_failed: tstamp:22927897757 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   727.274089: rtos_queue_peek_from_isr_failed: tstamp:22932897687 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   727.442047: rtos_queue_peek_from_isr_failed: tstamp:22937897737 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   727.610041: rtos_queue_peek_from_isr_failed: tstamp:22942897716 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   727.778113: rtos_queue_peek_from_isr_failed: tstamp:22947897719 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   727.946039: rtos_queue_peek_from_isr_failed: tstamp:22952897776 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   728.114045: rtos_queue_peek_from_isr_failed: tstamp:22957897762 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   728.282026: rtos_queue_peek_from_isr_failed: tstamp:22962897777 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   728.394043: rtos_queue_peek_from_isr_failed: tstamp:22967897684 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   728.562090: rtos_queue_peek_from_isr_failed: tstamp:22972897719 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   728.730046: rtos_queue_peek_from_isr_failed: tstamp:22977897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   728.898028: rtos_queue_peek_from_isr_failed: tstamp:22982897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   729.066024: rtos_queue_peek_from_isr_failed: tstamp:22987897737 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   729.234019: rtos_queue_peek_from_isr_failed: tstamp:22992897759 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   729.402025: rtos_queue_peek_from_isr_failed: tstamp:22997897755 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   729.514029: rtos_queue_peek_from_isr_failed: tstamp:23002897759 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   729.682083: rtos_queue_peek_from_isr_failed: tstamp:23007897716 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   729.850063: rtos_queue_peek_from_isr_failed: tstamp:23012897736 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   730.018054: rtos_queue_peek_from_isr_failed: tstamp:23017897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   730.186060: rtos_queue_peek_from_isr_failed: tstamp:23022897716 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   730.354043: rtos_queue_peek_from_isr_failed: tstamp:23027897755 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   730.522060: rtos_queue_peek_from_isr_failed: tstamp:23032897755 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   730.634020: rtos_queue_peek_from_isr_failed: tstamp:23037897775 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   730.802034: rtos_queue_peek_from_isr_failed: tstamp:23042897755 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   730.970014: rtos_queue_peek_from_isr_failed: tstamp:23047897758 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   731.138008: rtos_queue_peek_from_isr_failed: tstamp:23052897759 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   731.306010: rtos_queue_peek_from_isr_failed: tstamp:23057897775 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   731.474131: rtos_queue_peek_from_isr_failed: tstamp:23062897773 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   731.642014: rtos_queue_peek_from_isr_failed: tstamp:23067897759 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   731.754009: rtos_queue_peek_from_isr_failed: tstamp:23072897757 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   731.922007: rtos_queue_peek_from_isr_failed: tstamp:23077897775 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   732.090004: rtos_queue_peek_from_isr_failed: tstamp:23082897775 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   732.258008: rtos_queue_peek_from_isr_failed: tstamp:23087897777 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   732.426005: rtos_queue_peek_from_isr_failed: tstamp:23092897759 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   732.594002: rtos_queue_peek_from_isr_failed: tstamp:23097897777 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   732.762008: rtos_queue_peek_from_isr_failed: tstamp:23102897758 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   732.874005: rtos_queue_peek_from_isr_failed: tstamp:23107897759 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   733.042040: rtos_queue_peek_from_isr_failed: tstamp:23112897777 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   733.210035: rtos_queue_peek_from_isr_failed: tstamp:23117897755 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   733.378006: rtos_queue_peek_from_isr_failed: tstamp:23122897777 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   733.546049: rtos_queue_peek_from_isr_failed: tstamp:23127897755 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   733.713987: rtos_queue_peek_from_isr_failed: tstamp:23132897755 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   733.881984: rtos_queue_peek_from_isr_failed: tstamp:23137897777 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   733.994029: rtos_queue_peek_from_isr_failed: tstamp:23142897757 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   734.162043: rtos_queue_peek_from_isr_failed: tstamp:23147897754 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   734.330024: rtos_queue_peek_from_isr_failed: tstamp:23152897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   734.498059: rtos_queue_peek_from_isr_failed: tstamp:23157897719 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   734.666038: rtos_queue_peek_from_isr_failed: tstamp:23162897737 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   734.834015: rtos_queue_peek_from_isr_failed: tstamp:23167897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   735.002141: rtos_queue_peek_from_isr_failed: tstamp:23172897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   735.114038: rtos_queue_peek_from_isr_failed: tstamp:23177897733 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   735.282043: rtos_queue_peek_from_isr_failed: tstamp:23182897711 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   735.450056: rtos_queue_peek_from_isr_failed: tstamp:23187897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   735.618028: rtos_queue_peek_from_isr_failed: tstamp:23192897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   735.786014: rtos_queue_peek_from_isr_failed: tstamp:23197897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   735.954061: rtos_queue_peek_from_isr_failed: tstamp:23202897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   736.121985: rtos_queue_peek_from_isr_failed: tstamp:23207897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   736.233963: rtos_queue_peek_from_isr_failed: tstamp:23212897737 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   736.401988: rtos_queue_peek_from_isr_failed: tstamp:23217897716 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   736.570061: rtos_queue_peek_from_isr_failed: tstamp:23222897777 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   736.737972: rtos_queue_peek_from_isr_failed: tstamp:23227897755 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   736.906001: rtos_queue_peek_from_isr_failed: tstamp:23232897764 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   737.074012: rtos_queue_peek_from_isr_failed: tstamp:23237897758 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   737.242026: rtos_queue_peek_from_isr_failed: tstamp:23242897755 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   737.354010: rtos_queue_peek_from_isr_failed: tstamp:23247897680 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   737.522015: rtos_queue_peek_from_isr_failed: tstamp:23252897719 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   737.690005: rtos_queue_peek_from_isr_failed: tstamp:23257897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   737.857968: rtos_queue_peek_from_isr_failed: tstamp:23262897735 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   738.025947: rtos_queue_peek_from_isr_failed: tstamp:23267897724 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   738.194022: rtos_queue_peek_from_isr_failed: tstamp:23272897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   738.362035: rtos_queue_peek_from_isr_failed: tstamp:23277897716 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   738.474022: rtos_queue_peek_from_isr_failed: tstamp:23282897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   738.642022: rtos_queue_peek_from_isr_failed: tstamp:23287897716 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   738.809964: rtos_queue_peek_from_isr_failed: tstamp:23292897716 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   738.977990: rtos_queue_peek_from_isr_failed: tstamp:23297897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   739.145999: rtos_queue_peek_from_isr_failed: tstamp:23302897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   739.313998: rtos_queue_peek_from_isr_failed: tstamp:23307897720 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   739.481952: rtos_queue_peek_from_isr_failed: tstamp:23312897729 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   739.594057: rtos_queue_peek_from_isr_failed: tstamp:23317897718 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   739.761945: rtos_queue_peek_from_isr_failed: tstamp:23322897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   739.930012: rtos_queue_peek_from_isr_failed: tstamp:23327897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   740.097989: rtos_queue_peek_from_isr_failed: tstamp:23332897718 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   740.266054: rtos_queue_peek_from_isr_failed: tstamp:23337897738 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   740.433994: rtos_queue_peek_from_isr_failed: tstamp:23342897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   740.602007: rtos_queue_peek_from_isr_failed: tstamp:23347897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   740.713950: rtos_queue_peek_from_isr_failed: tstamp:23352897716 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   740.885983: rtos_queue_peek_from_isr_failed: tstamp:23357897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   741.054042: rtos_queue_peek_from_isr_failed: tstamp:23362897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   741.225978: rtos_queue_peek_from_isr_failed: tstamp:23367897718 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   741.394036: rtos_queue_peek_from_isr_failed: tstamp:23372897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   741.561926: rtos_queue_peek_from_isr_failed: tstamp:23377897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   741.673983: rtos_queue_peek_from_isr_failed: tstamp:23382897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   741.841999: rtos_queue_peek_from_isr_failed: tstamp:23387897735 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   742.010111: rtos_queue_peek_from_isr_failed: tstamp:23392897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   742.177929: rtos_queue_peek_from_isr_failed: tstamp:23397897716 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   742.345937: rtos_queue_peek_from_isr_failed: tstamp:23402897715 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   742.513935: rtos_queue_peek_from_isr_failed: tstamp:23407897755 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   742.681915: rtos_queue_peek_from_isr_failed: tstamp:23412897775 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   742.793914: rtos_queue_peek_from_isr_failed: tstamp:23417897757 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   742.961937: rtos_queue_peek_from_isr_failed: tstamp:23422897754 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   743.129931: rtos_queue_peek_from_isr_failed: tstamp:23427897754 queue:0x0bcbcf78
     kworker/0:2-9010  [000] ....   743.298001: rtos_queue_peek_from_isr_failed:

When SLVS is being used, the SPI communication for Xavier to SLVS sensor is through SPI, SLVS_XCE pin acts as XCE for SLVS sensor card that utilizes PCIe connector.

Hi Trumany,

Thanks a lot for your explanation!

That means XCE pin is to enable SPI communication, similar to Chip Select pin. However, I could not find XCE pin usage inside Imx204 SPI driver. And from my observation SLVS_XCE pin is not connecting to SPI_CS pin in carrier board.

I did work around for this to make the communication happened. Please hint me if something not correct.

Regards,
Hung

Suggest to ask vendor for XCE pin usage of camera.

Hi Trumany,

I am clear at XCE pin from camera sensor. But not clear about SLVS_XCE pin defined in Xavier carrier board schematic and Xavier pinmux template file. Hope Nvidia is about to clarify.

Please have a look and Xavier carrier board schematic, then you will understand about my concern.

Anyway, I am able to communicate with camera sensor via SPI, right now I am facing the problem with VI5 driver, since “VI is not active.”

Please share your experience about the possible failures there.

Thanks!

Regarding to Imx204 camera, you please share us with how many SLVS-EC lanes nvidia has tested.
In tegra194-camera-e3377-a00.dtsi, bus-width is 8

host1x {
		vi@15c10000 {
			num-channels = <1>;
			ports {
				#address-cells = <1>;
				#size-cells = <0>;
				port@0 {
					reg = <0>;
					status = "okay";
					e3377_vi_in0: endpoint {
						port-index = <0>;
						<b>bus-width = <8>;</b>
						remote-endpoint = <&e3377_slvs_ec_out0>;
					};
				};
			};
		};

		slvs-ec@15ac0000 {
			status = "okay";
			streams {
                                #address-cells = <1>;
                                #size-cells = <0>;
				stream@0 {
                                        reg = <0>;
                                        lanes = <0 1 2 3 4 5 6 7>;
					ports {
						#address-cells = <1>;
						#size-cells = <0>;
						port@0 {
							reg = <0>;
							e3377_slvs_ec_in0: endpoint@0 {
								port-index = <0>;
								<b>bus-width = <8>;</b>
								remote-endpoint = <&e3377_imx204_out0>;
							};
						};
						port@1 {
							reg = <1>;
							e3377_slvs_ec_out0: endpoint@1 {
								remote-endpoint = <&e3377_vi_in0>;
							};
						};
					};
				};
			};
		};
	};

But in tegra194-camera-plugin-manager.dtsi, bus-width is override by 4.

override@6 {
				target = <&e3377_vi_in0>;
				_overlay_ {
					status = "okay";
					port-index = <0>;
					<b>bus-width = <4>;</b>
					remote-endpoint = <&e3377_slvs_ec_out0>;
				};
/* Enable SLVS-EC ports */
			override@8 {
				target = <&slvs_ec_stream0>;
				_overlay_ {
					status = "okay";
				};
			};
			override@9 {
				target = <&slvs_ec_stream0_port0>;
				_overlay_ {
					status = "okay";
				};
			};
			override@10 {
				target = <&e3377_slvs_ec_in0>;
				_overlay_ {
					status = "okay";
					port-index = <0>;
					<b>bus-width = <4>;</b>
					remote-endpoint = <&e3377_imx204_out0>;
				};
			};
			override@11 {
				target = <&slvs_ec_stream0_port1>;
				_overlay_ {
					status = "okay";
				};
			};
			override@12 {
				target = <&e3377_slvs_ec_out0>;
				_overlay_ {
					status = "okay";
					remote-endpoint = <&e3377_vi_in0>;
				};
			};

hello Hung-Lam,

regarding to comment #27, we had test 8-lane slvs-ec.
there’s a typo in the plugin-manager, those bus-width settings should be 8.
please update l4t-r32.1 device tree as following.
thanks

diff --git a/kernel-dts/t19x-common-modules/tegra194-camera-plugin-manager.dtsi b/kernel-dts/t19x-common-modules/tegra194-camera-plugin-manager.dtsi
index cc1c5f9..7c10f35 100644
--- a/kernel-dts/t19x-common-modules/tegra194-camera-plugin-manager.dtsi
+++ b/kernel-dts/t19x-common-modules/tegra194-camera-plugin-manager.dtsi
@@ -1589,7 +1589,7 @@
                                _overlay_ {
                                        status = "okay";
                                        port-index = <0>;
-                                       bus-width = <4>;
+                                       bus-width = <8>;
                                        remote-endpoint = <&e3377_slvs_ec_out0>;
                                };
                        };
@@ -1611,7 +1611,7 @@
                                _overlay_ {
                                        status = "okay";
                                        port-index = <0>;
-                                       bus-width = <4>;
+                                       bus-width = <8>;
                                        remote-endpoint = <&e3377_imx204_out0>;
                                };

Thanks a lot, JerryChang!

I have modified these, but not solve the problem yet. I have finally decided to test with SLVSEC 4 lanes. I changed sensor configure to 4 lanes and respective dtsi files.

I have seen the slvsec signals coming from sony sensor through those 4 lanes by a high speed oscilloscope. From the sensor spi communication was fine. But there are still errors with “VI not active”.

I have enable the trace to see additional logs but not been helpful. Therefore I tried to read

VI_CSIMUX_INPUT_STREAM_MUX_0

@base_address: 0x15f00000, byte Offset: 0x4664, using devmem tool as below:

busybox devmem 0x15f04664
return 0x00000000

that means VI STREAM0 to STREAM5 connecting to NVCSI0-5 only, not to SLVS-EC mainstream.

You please let me know which command in DT or slvs.c/slvsec.c supporting NVCSI/SLVSEC muxing. Whether I can use devmem for read/write Xavier memory locations as above. Thanks a lot!

Much appreciate if Nvidia experts can help me to identify and fix the problem faster, as I am really behind our development schedule.

hello Hung-Lam,

may I have your confirmation, had you configure phy mode as slvs in your sensor device tree.
for example,

phy_mode = "SLVS"

hi JerryChang,

Definitely yes, Imx204 device tree has already defined it. I did not modify it, just modified the other camera parameter to adapt with hardware I set-up e.g. mclk,…

spi@c260000 {
		status = "okay";
		spi-max-frequency = <1000000>;	/* Modify from 12Mhz to 1Mhz for debugging */
		imx204@0 {
			compatible = "nvidia,imx204_spi";
			reg = <0>;
			status = "okay";
			spi-max-frequency = <1000000>;	/* Modify from 12Mhz to 1Mhz for debugging */

			/* Physical dimensions of sensor. Couldnt find direct number. need to test physically */
			physical_w = "8.748";
			physical_h = "6.624";

			/* enable delay gain due to no hardware group hold support */
			delayed_gain = "true";

			/* Define any required hw resources needed by driver */
			/* ie, clocks, io pins, power sources */
			/* mclk = "cam_mclk1"; Not in use. */
			devname = "imx204_spi";

			/* Define regulators*/
			vdig-supply = <&slvsec_dvdd_1v2_cam>;
			vif-supply = <&slvsec_ovdd_1v8_cam>;
			vana-supply = <&slvsec_avdd_3v3_cam>;
			
			/* Define regulators*/
			dvdd-reg = "vdig";
			iovdd-reg = "vif";
			avdd-reg = "vana";

			/* Sensor Model */
			sensor_model = "imx204";

			focus_macro = "100";
			focus_infinity = "208";
			focus_max_slew_rate = "180";
			min_aperture = "2";
			max_aperture = "90";
			min_aperture_fnumber = "2000";
			max_aperture_fnumber = "22000";
			aperture_max_slew_rate = "180";
			/* <FNumber*1000 motor-pos> */
			fnumber_map = <2000 2>, <2800 34>, <4000 49>, <5600 59>,
						<8000 67>, <11000 71>, <16000 75>, <22000 78>;

			mode0 {
				mclk_khz = "74250";
				num_lanes = "4";
				tegra_sinterface = "serial_a";
				<b>phy_mode = "SLVS";</b>
				discontinuous_clk = "no";
				dpcm_enable = "false";
				cil_settletime = "0";

				active_w = "1944";
				active_h = "1496";
				pixel_t = "bayer_rggb";
				readout_orientation = "0";
				line_length = "3800";
				inherent_gain = "1";
				mclk_multiplier = "20";
				pix_clk_hz = "1340000000";

				min_gain_val = "0.0";
				max_gain_val = "480.0";
				step_gain_val = "1";
				default_gain = "10";				
				min_hdr_ratio = "1";
				max_hdr_ratio = "1";				
				min_framerate = "1.5";
				max_framerate = "20";				
				min_exp_time = "13";
				max_exp_time = "33333";
			};
			ports {
				#address-cells = <1>;
				#size-cells = <0>;
				port@0 {
					reg = <0>;
					e3377_imx204_out0: endpoint {
						port-index = <0>;
						bus-width = <4>;
						remote-endpoint = <&e3377_slvs_ec_in0>;
					};
				};
			};
		};

hello Hung-Lam,

couple of suggestions as below,

  1. there’s another configuration files (jetson-xavier-slvs-ec.conf) which include slvs pinmux config.
    may I know had you update the board as below.
$ sudo ./flash.sh jetson-xavier-slvs-ec mmcblk0p1
  1. since you’re taking reference driver for customization. you may also disable the plugin-manager.
    please also check Using Main Platform Device Tree File session for reference.
    thanks

Hello JerryChang,

  1. This is known to us, i have modified jetson-xavier.conf content as same as jetson-xavier-slvs-ec.conf to enable SLVS for NVHS UPHY
source "${LDK_DIR}/p2972-0000.conf.common";

# Set BIT:[21:20]  of ODM data to enable SVLS for NVHS UPHY
ODMDATA=0x9291000;
PINMUX_CONFIG="tegra19x-mb1-pinmux-p2888-slvs-0000-a00-p2822-0000-a00.cfg";
  1. I am still using plug-in manager with an external EEPROM on the adapter board to enable our device.
    I have also tried using Main Platform Device Tree File.

My office is in Fremont,California. May I pay a visit to Nvidia office in San-Jose and send your team our experiment board + camera sensor for your team’s testing/support?

Thank you very much!

hello Hung-Lam,

could you please check and see if enable-nvhs-uphy-slvs file shows up,
for example,

$ ls /proc/device-tree/chosen/plugin-manager/odm-data

if not, slvs-ec will not work.
thanks

Hi JerryChang,

Yes, enable-nvhs-uphy-slvs file shows up in /proc/device-tree/chosen/plugin-manager/odm-data

That means slvs-ec phy enabled.

Thanks for your hints, but the problem of VI not active still there. Hope to get more hints from you.

Hung

I believe that enable-pcie-c5-endpoint file showing-up has no impact to slvs uphy, please help to confirm this. Thanks!

hello Hung-Lam,

could you please replace RTCPU firmware with the attachment to check if we could solve “VI not active” issues.
you should update the $OUT/Linux_for_Tegra/bootloader/camera-rtcpu-rce.img and using flash scripts to update that.
for example,

# please back-up your firmware first.
$ sudo cp bootloader/camera-rtcpu-rce.img bootloader/camera-rtcpu-rce.img-bk

# replace firmware with the attachment, then update rce-fw partition
$ sudo cp devtalk1052753_Jun28_camera-rtcpu-rce.img $OUT/Linux_for_Tegra/bootloader/camera-rtcpu-rce.img
$ sudo ./flash.sh -r -k rce-fw jetson-xavier mmcblk0p1

devtalk1052753_Jun28.tar.gz (148 KB)

Hi JerryChang,

Thanks a lot for your support!

VI not active issues disappeared. May I know that this RTCPU firmware just to remove “VI not active” error message, or VI is now working properly.

Besides, when VI tried to attempt to reset capture channel, there was always an error of “no linked CSI subdev”, but actually there was only SLVS-EC subdev, not CSI subdev. SLVS-EC subdev has been bound to VI engine.

[  506.015588] tegra194-vi5 15c10000.vi: <b>unable to find linked csi subdev</b>
[  506.015746] tegra194-vi5 15c10000.vi: fatal: error recovery failed

Regards,
Hung

hello Hung-Lam,

basically, we’re not marking the VI channel busy and caused this “VI not active” error.
however,
since our RTCPU treats SLVS-EC as special case and does not care about the error, that error does not affect the normal SLVS-EC operations.

could you please share more details, you should check why VI stream failed and trigger error recovery function.
i.e. vi5_channel_error_recover()
thanks