Jetson Xavier CSI2 non-image data capture (packet data type 0x12)

a.gilles · October 27, 2020, 11:30am

Hello,

I am using Jetson Xavier AGX loaded with JetPack 32.1 and a custom image sensor connected to it over MIPI CSI2.
The sensor is configured to send non-image data (statistics) using CSI2 packets with data type 0x12.
I see that libargus seems to proide methods to grab such non-image data (CaptureMetadata object - Jetson Linux API Reference: CaptureMetadata | NVIDIA Docs) .
But I cannot use the libargus for performances and control reasons.

Since libargus sits on top of the kernel drivers, I just need to understand the interface it uses with the kernel to grab these non-image data.

After several hours of code digging inside NVIDIA & v4l linux kernel drivers, I do not see evidence of how to grab the content of these 0x12 CSI2 data packets to the userland (using some ioctl or any other kernel communication means on a device).

Can anyone please help me and eventually give me orientations on how to interface the NVIDIA/v4l drivers to grab CSI2 0x12 non-image data ?

Thanks in advance,
Alex.

kayccc · October 28, 2020, 3:34am

Moving to Jetson AGX Xavier forum for resolution.

JerryChang · October 28, 2020, 6:19am

hello a.gilles,

may I know what’s your use-case.
you may start with v4l2 standard controls besides working with libargus,
for example,
you may refer to Applications Using V4L2 IOCTL Directly to verify basic functionality during sensor bring-up.
thanks

a.gilles · October 28, 2020, 8:30am

Hello JerryChang

Thank for fast feedback !

I design a testbench to validates the functions of a MIPI sensor.
Basic functionalities were covered already, like configuration and streaming in different video resolutions.
The only function that needs to be closed is the MIPI 0x12 non-image data packets retrieval.
I am sure that these 0x12 MIPI packets are sent by the sensor. They are surely received by the AGX MIPI interface as well.

The link you provided covers basic functionalities using IOCTL, I do not see the non-image data subject being covered.

Is the libargus source code available ?

Regards,
Alex.

JerryChang · October 28, 2020, 8:51am

hello a.gilles,

please check an example of a device tree node for the IMX185 V4L2 sensor driver,
there’s sensor active region as 1920x1080, and also with an extra embedded metadata rows for each frame.
it’s pixel parser to handle both (embedded data & image data) from single CSI camera.
for example,

imx185_a@1a {
    compatible = "nvidia,imx185"; 
    mode0 {
        ...
        active_w = "1920";
        active_h = "1080";
        ...
        embedded_metadata_height = "1";

please access Xavier TRM, you may check [Figure 7.6 External Connectivity Diagram] for reference.
please also refer to [Property-Value Pairs] in Sensor Software Driver Programming Guide for the description of embedded_metadata_height.

I think it might not works since you would like to handle non-image data packets, which means you should configure invalid active regions into device tree.

BTW,
there’re some MMAPI samples, libargus source code are not available
thanks

a.gilles · October 28, 2020, 5:43pm

Hello JerryChang,

I went through the embedded_metadata_height inside the DT already.
To my understading, embedded_metadata_height relates to non-image data embedded into each frame. at least this is what I understood from the drivers source code. It does not seem to relate to the 0x12 MIPI non-image data packets.

I refer to kernel source file vi5_fops.c, function vi5_setup_surface() where I see that the embedded_data_height property (loaded earlier from DT) is used to setup

Can you confirm that device-tree “embedded_metadata_height” has no link with the MIPI 0x12 CSI2 packets ?

Thanks,
Alex.

JerryChang · October 29, 2020, 7:43am

hello a.gilles,

CSI data types of 0x12 shows the embedded data, it should not be a problem.
we don’t have use-case to process non-image data packets.
as I mentioned in post #6, it’s pixel parser to handle both (embedded data & image data) from single CSI camera.

may I know what’s your VI tracing logs reports.
you may gather those as following,
for example,

echo 1 > /sys/kernel/debug/tracing/tracing_on
echo 30720 > /sys/kernel/debug/tracing/buffer_size_kb
echo 1 > /sys/kernel/debug/tracing/events/tegra_rtcpu/enable
echo 1 > /sys/kernel/debug/tracing/events/freertos/enable
echo 2 > /sys/kernel/debug/camrtc/log-level
echo > /sys/kernel/debug/tracing/trace
cat /sys/kernel/debug/tracing/trace

there’s DTYPE to identify NVCSI datatypes.
please also access L4T sources,
you may also check header file, camrtc-capture.h to decode the NVCSI datatypes from VI tracing logs.
for example,
$L4T_Sources/r32.4.3/Linux_for_Tegra/source/public/kernel/nvidia/include/soc/tegra/camrtc-capture.h

a.gilles · December 8, 2020, 9:48am

Hello JerryChang,

Sorry to be back so lately.
Thank you for the information.
Here is the trace log for an acquisition where the sensor sends 0x12 data type frames in addition to picture frames.
From that log, do you recognize traces that reveal the presence of 0x12 data type frames ?
I will check inside the pixel parser handling driver code.

Thanks,
Alex.

     kworker/0:2-22878 [000] .... 68526.784443: rtcpu_nvcsi_intr: tstamp:2141656879062 class:GLOBAL type:PHY_INTR0 phy:1 cil:0 st:0 vc:0 status:0x00000010
 kworker/0:2-22878 [000] .... 68526.784448: rtcpu_nvcsi_intr: tstamp:2141656879062 class:CORRECTABLE_ERR type:PHY_INTR phy:1 cil:0 st:0 vc:0 status:0x00000010
 kworker/0:2-22878 [000] .... 68526.784453: rtcpu_nvcsi_intr: tstamp:2141656887753 class:GLOBAL type:PHY_INTR0 phy:1 cil:0 st:0 vc:0 status:0x00000100
 kworker/0:2-22878 [000] .... 68526.784547: rtcpu_nvcsi_intr: tstamp:2141656887753 class:CORRECTABLE_ERR type:PHY_INTR phy:1 cil:0 st:0 vc:0 status:0x00000100
 kworker/0:2-22878 [000] .... 68526.784555: rtos_queue_peek_from_isr_failed: tstamp:2141657009743 queue:0x0bcbcf78
 kworker/0:2-22878 [000] .... 68526.784564: rtcpu_start: tstamp:2141657022235
 kworker/0:2-22878 [000] .... 68526.784569: rtos_queue_send_from_isr_failed: tstamp:2141657041182 queue:0x0bcb41f8
 kworker/0:2-22878 [000] .... 68526.784574: rtos_queue_send_from_isr_failed: tstamp:2141657041318 queue:0x0bcb8a60
 kworker/0:2-22878 [000] .... 68526.784579: rtos_queue_send_from_isr_failed: tstamp:2141657041456 queue:0x0bcba5e0
 kworker/0:2-22878 [000] .... 68526.784583: rtos_queue_send_from_isr_failed: tstamp:2141657041589 queue:0x0bcbb3a0
 kworker/0:2-22878 [000] .... 68526.784588: rtos_queue_send_from_isr_failed: tstamp:2141657041724 queue:0x0bcbc160
 kworker/0:2-22878 [000] .... 68526.784594: rtcpu_string: tstamp:2141657042172 id:0x04010000 str:"Configuring VI GoS."
 kworker/0:2-22878 [000] .... 68526.784646: rtcpu_string: tstamp:2141657042336 id:0x04010000 str:"VM GOS[#0] addr=0xe4900000"
 kworker/0:2-22878 [000] .... 68526.784673: rtcpu_string: tstamp:2141657042580 id:0x04010000 str:"VM GOS[#1] addr=0xe4901000"
 kworker/0:2-22878 [000] .... 68526.784695: rtcpu_string: tstamp:2141657042854 id:0x04010000 str:"VM GOS[#2] addr=0xe4902000"
 kworker/0:2-22878 [000] .... 68526.784716: rtcpu_string: tstamp:2141657043074 id:0x04010000 str:"VM GOS[#3] addr=0xe4903000"
 kworker/0:2-22878 [000] .... 68526.784738: rtcpu_string: tstamp:2141657043293 id:0x04010000 str:"VM GOS[#4] addr=0xe4904000"
 kworker/0:2-22878 [000] .... 68526.784760: rtcpu_string: tstamp:2141657043512 id:0x04010000 str:"VM GOS[#5] addr=0xe4905000"
 kworker/0:2-22878 [000] .... 68526.784781: rtcpu_string: tstamp:2141657057899 id:0x04010000 str:"vi5_hwinit: firmware CL2018101701 protocol versi"
 kworker/0:2-22878 [000] .... 68526.784788: rtcpu_string: tstamp:2141657058026 id:0x04010000 str:"on 2.2"
 kworker/0:2-22878 [000] .... 68526.784811: rtos_queue_send_from_isr_failed: tstamp:2141657103175 queue:0x0bcb41f8
 kworker/0:2-22878 [000] .... 68526.784816: rtos_queue_send_from_isr_failed: tstamp:2141657103328 queue:0x0bcb8a60
 kworker/0:2-22878 [000] .... 68526.784821: rtos_queue_send_from_isr_failed: tstamp:2141657103469 queue:0x0bcba5e0
 kworker/0:2-22878 [000] .... 68526.784826: rtos_queue_send_from_isr_failed: tstamp:2141657103604 queue:0x0bcbb3a0
 kworker/0:2-22878 [000] .... 68526.784831: rtos_queue_send_from_isr_failed: tstamp:2141657103738 queue:0x0bcbc160
 kworker/0:2-22878 [000] .... 68526.784835: rtcpu_string: tstamp:2141657104570 id:0x04010000 str:"VI GOS[#0] set to VM GOS[4] base 0xe4904000"
 kworker/0:2-22878 [000] .... 68526.784859: rtcpu_vinotify_error: tstamp:2141657109233 tag:CSIMUX_STREAM channel:0x00 frame:0 vi_tstamp:2141657105339 data:0x00000100
 kworker/0:2-22878 [000] .... 68526.784865: rtcpu_vinotify_event: tstamp:2141657548297 tag:CSIMUX_STREAM channel:0x00 frame:0 vi_tstamp:2141657105339 data:0x00000100
 kworker/0:2-22878 [000] .... 68526.784871: rtcpu_vinotify_event: tstamp:2141657548429 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:2141423078912 data:0x10000000
 kworker/0:2-22878 [000] .... 68526.784876: rtcpu_vinotify_event: tstamp:2141657548578 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:2141423108576 data:0x31000001
 kworker/0:2-22878 [000] .... 68526.784880: rtcpu_vinotify_event: tstamp:2141657548705 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:2141423117728 data:0x10000000
 kworker/0:2-22878 [000] .... 68526.784885: rtcpu_vinotify_event: tstamp:2141657548891 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:2141423125312 data:0x07020001
 kworker/0:2-22878 [000] .... 68526.784889: rtcpu_vinotify_event: tstamp:2141657549017 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:2141423152736 data:0x31000002
 kworker/0:2-22878 [000] .... 68526.784894: rtcpu_vinotify_event: tstamp:2141657549176 tag:FS channel:0x00 frame:27 vi_tstamp:2141657333069 data:0x00000012
 kworker/0:2-22878 [000] .... 68526.784898: rtcpu_vinotify_event: tstamp:2141657549303 tag:ATOMP_FS channel:0x00 frame:27 vi_tstamp:2141657333071 data:0x00000000
 kworker/0:2-22878 [000] .... 68526.784903: rtcpu_vinotify_event: tstamp:2141657549485 tag:CHANSEL_PXL_SOF channel:0x23 frame:27 vi_tstamp:2141657333564 data:0x00000001
 kworker/0:2-22878 [000] .... 68526.784908: rtcpu_vinotify_event: tstamp:2141657549607 tag:RESERVED_19 channel:0x23 frame:27 vi_tstamp:2141430216288 data:0x08020001
 kworker/0:2-22878 [000] .... 68526.840302: rtcpu_vinotify_event: tstamp:2141657685644 tag:CHANSEL_PXL_EOF channel:0x23 frame:27 vi_tstamp:2141657679859 data:0x05770002
 kworker/0:2-22878 [000] .... 68526.840307: rtcpu_vinotify_event: tstamp:2141657685775 tag:ATOMP_FRAME_DONE channel:0x23 frame:27 vi_tstamp:2141657679883 data:0x00000000
 kworker/0:2-22878 [000] .... 68526.840308: rtcpu_vinotify_event: tstamp:2141657685918 tag:RESERVED_19 channel:0x23 frame:27 vi_tstamp:2141441301024 data:0x02020001
 kworker/0:2-22878 [000] .... 68526.840309: rtcpu_vinotify_event: tstamp:2141657686042 tag:FE channel:0x00 frame:27 vi_tstamp:2141657680009 data:0x00000022
 kworker/0:2-22878 [000] .... 68526.840310: rtcpu_vinotify_event: tstamp:2141657686204 tag:ATOMP_FE channel:0x00 frame:27 vi_tstamp:2141657680012 data:0x00000000
 kworker/0:2-22878 [000] .... 68526.840311: rtcpu_vinotify_event: tstamp:2141657686327 tag:RESERVED_19 channel:0x23 frame:27 vi_tstamp:2141441323680 data:0x00020001
 kworker/0:2-22878 [000] .... 68526.840353: rtos_queue_send_from_isr_failed: tstamp:2141657861445 queue:0x0bcb41f8
 kworker/0:2-22878 [000] .... 68526.840355: rtos_queue_send_from_isr_failed: tstamp:2141657861585 queue:0x0bcb8a60
 kworker/0:2-22878 [000] .... 68526.840356: rtos_queue_send_from_isr_failed: tstamp:2141657861727 queue:0x0bcba5e0
 kworker/0:2-22878 [000] .... 68526.840357: rtos_queue_send_from_isr_failed: tstamp:2141657861860 queue:0x0bcbb3a0
 kworker/0:2-22878 [000] .... 68526.840358: rtos_queue_send_from_isr_failed: tstamp:2141657861993 queue:0x0bcbc160
 kworker/0:2-22878 [000] .... 68526.840359: rtcpu_vinotify_event: tstamp:2141658032739 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:2141441349376 data:0x07020002
 kworker/0:2-22878 [000] .... 68526.840360: rtcpu_vinotify_event: tstamp:2141658032869 tag:FS channel:0x00 frame:28 vi_tstamp:2141657680153 data:0x00000012
 kworker/0:2-22878 [000] .... 68526.840361: rtcpu_vinotify_event: tstamp:2141658033014 tag:ATOMP_FS channel:0x00 frame:28 vi_tstamp:2141657680155 data:0x00000000
 kworker/0:2-22878 [000] .... 68526.840362: rtcpu_vinotify_event: tstamp:2141658033139 tag:CHANSEL_PXL_SOF channel:0x23 frame:28 vi_tstamp:2141657680649 data:0x00000001
 kworker/0:2-22878 [000] .... 68526.840363: rtcpu_vinotify_event: tstamp:2141658033298 tag:RESERVED_19 channel:0x23 frame:28 vi_tstamp:2141441366976 data:0x08020002
 kworker/0:2-22878 [000] .... 68526.840387: rtcpu_vinotify_event: tstamp:2141658033420 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:2141441626624 data:0x10000000
 kworker/0:2-22878 [000] .... 68526.840388: rtcpu_vinotify_event: tstamp:2141658033562 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:2141441653376 data:0x31000003
 kworker/0:2-22878 [000] .... 68526.840389: rtcpu_vinotify_event: tstamp:2141658033683 tag:CHANSEL_PXL_EOF channel:0x23 frame:28 vi_tstamp:2141658026942 data:0x05770002
 kworker/0:2-22878 [000] .... 68526.840390: rtcpu_vinotify_event: tstamp:2141658033823 tag:ATOMP_FRAME_DONE channel:0x23 frame:28 vi_tstamp:2141658026965 data:0x00000000
 kworker/0:2-22878 [000] .... 68526.840391: rtcpu_vinotify_event: tstamp:2141658033945 tag:RESERVED_19 channel:0x23 frame:28 vi_tstamp:2141452407680 data:0x02020002
 kworker/0:2-22878 [000] .... 68526.840392: rtcpu_vinotify_event: tstamp:2141658034089 tag:FE channel:0x00 frame:28 vi_tstamp:2141658027093 data:0x00000022
 kworker/0:2-22878 [000] .... 68526.840394: rtcpu_vinotify_event: tstamp:2141658034216 tag:ATOMP_FE channel:0x00 frame:28 vi_tstamp:2141658027095 data:0x00000000
 kworker/0:2-22878 [000] .... 68526.840395: rtcpu_vinotify_event: tstamp:2141658034376 tag:RESERVED_19 channel:0x23 frame:28 vi_tstamp:2141452430368 data:0x00020002
 kworker/0:2-22878 [000] .... 68526.840396: rtcpu_vinotify_event: tstamp:2141658034496 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:2141452449984 data:0x07020003
 kworker/0:2-22878 [000] .... 68526.840398: rtcpu_vinotify_event: tstamp:2141658034657 tag:FS channel:0x00 frame:29 vi_tstamp:2141658027236 data:0x00000012
 kworker/0:2-22878 [000] .... 68526.840399: rtcpu_vinotify_event: tstamp:2141658034782 tag:ATOMP_FS channel:0x00 frame:29 vi_tstamp:2141658027238 data:0x00000000
 kworker/0:2-22878 [000] .... 68526.840401: rtos_queue_send_from_isr_failed: tstamp:2141658206812 queue:0x0bcb41f8
 kworker/0:2-22878 [000] .... 68526.840402: rtos_queue_send_from_isr_failed: tstamp:2141658206954 queue:0x0bcb8a60
 kworker/0:2-22878 [000] .... 68526.840403: rtos_queue_send_from_isr_failed: tstamp:2141658207096 queue:0x0bcba5e0
 kworker/0:2-22878 [000] .... 68526.840404: rtos_queue_send_from_isr_failed: tstamp:2141658207230 queue:0x0bcbb3a0
 kworker/0:2-22878 [000] .... 68526.840405: rtos_queue_send_from_isr_failed: tstamp:2141658207362 queue:0x0bcbc160
 kworker/0:2-22878 [000] .... 68526.840407: rtcpu_vinotify_event: tstamp:2141658383906 tag:CHANSEL_PXL_SOF channel:0x23 frame:29 vi_tstamp:2141658027731 data:0x00000001
 kworker/0:2-22878 [000] .... 68526.840408: rtcpu_vinotify_event: tstamp:2141658384036 tag:RESERVED_19 channel:0x23 frame:29 vi_tstamp:2141452473600 data:0x08020003
 kworker/0:2-22878 [000] .... 68526.840409: rtcpu_vinotify_event: tstamp:2141658384198 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:2141452772160 data:0x10000000
 kworker/0:2-22878 [000] .... 68526.840410: rtcpu_vinotify_event: tstamp:2141658384320 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:2141452798912 data:0x31000004
 kworker/0:2-22878 [000] .... 68526.840411: rtcpu_vinotify_event: tstamp:2141658384478 tag:CHANSEL_PXL_EOF channel:0x23 frame:29 vi_tstamp:2141658374026 data:0x05770002
 kworker/0:2-22878 [000] .... 68526.840412: rtcpu_vinotify_event: tstamp:2141658384600 tag:ATOMP_FRAME_DONE channel:0x23 frame:29 vi_tstamp:2141658374049 data:0x00000000
 kworker/0:2-22878 [000] .... 68526.840413: rtcpu_vinotify_event: tstamp:2141658384740 tag:RESERVED_19 channel:0x23 frame:29 vi_tstamp:2141463514336 data:0x02020003
 kworker/0:2-22878 [000] .... 68526.840414: rtcpu_vinotify_event: tstamp:2141658384866 tag:FE channel:0x00 frame:29 vi_tstamp:2141658374176 data:0x00000022
 kworker/0:2-22878 [000] .... 68526.840415: rtcpu_vinotify_event: tstamp:2141658385049 tag:ATOMP_FE channel:0x00 frame:29 vi_tstamp:2141658374179 data:0x00000000
 kworker/0:2-22878 [000] .... 68526.840416: rtcpu_vinotify_event: tstamp:2141658385169 tag:RESERVED_19 channel:0x23 frame:29 vi_tstamp:2141463537024 data:0x00020003
 kworker/0:2-22878 [000] .... 68526.840417: rtcpu_vinotify_event: tstamp:2141658385329 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:2141463556672 data:0x07020004
 kworker/0:2-22878 [000] .... 68526.840418: rtcpu_vinotify_event: tstamp:2141658385452 tag:FS channel:0x00 frame:30 vi_tstamp:2141658374319 data:0x00000012
 kworker/0:2-22878 [000] .... 68526.840419: rtcpu_vinotify_event: tstamp:2141658385610 tag:ATOMP_FS channel:0x00 frame:30 vi_tstamp:2141658374322 data:0x00000000
 kworker/0:2-22878 [000] .... 68526.840426: rtcpu_vinotify_event: tstamp:2141658385732 tag:CHANSEL_PXL_SOF channel:0x23 frame:30 vi_tstamp:2141658374814 data:0x00000001
 kworker/0:2-22878 [000] .... 68526.840427: rtcpu_vinotify_event: tstamp:2141658385896 tag:RESERVED_19 channel:0x23 frame:30 vi_tstamp:2141463574272 data:0x08020004
 kworker/0:2-22878 [000] .... 68526.840428: rtcpu_vinotify_event: tstamp:2141658386019 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:2141463754144 data:0x10000000
 kworker/0:2-22878 [000] .... 68526.840429: rtos_queue_send_from_isr_failed: tstamp:2141658602879 queue:0x0bcb41f8
 kworker/0:2-22878 [000] .... 68526.840430: rtos_queue_send_from_isr_failed: tstamp:2141658603018 queue:0x0bcb8a60
 kworker/0:2-22878 [000] .... 68526.840431: rtos_queue_send_from_isr_failed: tstamp:2141658603157 queue:0x0bcba5e0
 kworker/0:2-22878 [000] .... 68526.840432: rtos_queue_send_from_isr_failed: tstamp:2141658603289 queue:0x0bcbb3a0
 kworker/0:2-22878 [000] .... 68526.840433: rtos_queue_send_from_isr_failed: tstamp:2141658603422 queue:0x0bcbc160
 kworker/0:2-22878 [000] .... 68526.840435: rtcpu_vinotify_event: tstamp:2141658866316 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:2141463860992 data:0x31000005
 kworker/0:2-22878 [000] .... 68526.840436: rtcpu_vinotify_event: tstamp:2141658866444 tag:CHANSEL_PXL_EOF channel:0x23 frame:30 vi_tstamp:2141658721107 data:0x05770002
 kworker/0:2-22878 [000] .... 68526.840437: rtcpu_vinotify_event: tstamp:2141658866588 tag:ATOMP_FRAME_DONE channel:0x23 frame:30 vi_tstamp:2141658721131 data:0x00000000
 kworker/0:2-22878 [000] .... 68526.840438: rtcpu_vinotify_event: tstamp:2141658866709 tag:RESERVED_19 channel:0x23 frame:30 vi_tstamp:2141474620960 data:0x02020004
 kworker/0:2-22878 [000] .... 68526.840439: rtcpu_vinotify_event: tstamp:2141658866853 tag:FE channel:0x00 frame:30 vi_tstamp:2141658721259 data:0x00000022
 kworker/0:2-22878 [000] .... 68526.840440: rtcpu_vinotify_event: tstamp:2141658866982 tag:ATOMP_FE channel:0x00 frame:30 vi_tstamp:2141658721262 data:0x00000000
 kworker/0:2-22878 [000] .... 68526.840441: rtcpu_vinotify_event: tstamp:2141658867122 tag:RESERVED_19 channel:0x23 frame:30 vi_tstamp:2141474643616 data:0x00020004
 kworker/0:2-22878 [000] .... 68526.840442: rtcpu_vinotify_event: tstamp:2141658867244 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:2141474663264 data:0x07020005
 kworker/0:2-22878 [000] .... 68526.840443: rtcpu_vinotify_event: tstamp:2141658867383 tag:FS channel:0x00 frame:31 vi_tstamp:2141658721403 data:0x00000012
 kworker/0:2-22878 [000] .... 68526.840444: rtcpu_vinotify_event: tstamp:2141658867507 tag:ATOMP_FS channel:0x00 frame:31 vi_tstamp:2141658721405 data:0x00000000
 kworker/0:2-22878 [000] .... 68526.840445: rtcpu_vinotify_event: tstamp:2141658867647 tag:CHANSEL_PXL_SOF channel:0x23 frame:31 vi_tstamp:2141658721897 data:0x00000001
 kworker/0:2-22878 [000] .... 68526.840446: rtcpu_vinotify_event: tstamp:2141658867769 tag:RESERVED_19 channel:0x23 frame:31 vi_tstamp:2141474680864 data:0x08020005
 kworker/0:2-22878 [000] .... 68526.840448: rtcpu_vinotify_event: tstamp:2141658867912 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:2141474863712 data:0x10000000
 kworker/0:2-22878 [000] .... 68526.840449: rtcpu_vinotify_event: tstamp:2141658868033 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:2141474890464 data:0x31000006
 kworker/0:2-22878 [000] .... 68526.840450: rtos_queue_send_from_isr_failed: tstamp:2141658956764 queue:0x0bcb41f8
 kworker/0:2-22878 [000] .... 68526.840451: rtos_queue_send_from_isr_failed: tstamp:2141658956906 queue:0x0bcb8a60
 kworker/0:2-22878 [000] .... 68526.840474: rtos_queue_send_from_isr_failed: tstamp:2141658957046 queue:0x0bcba5e0
 kworker/0:2-22878 [000] .... 68526.840475: rtos_queue_send_from_isr_failed: tstamp:2141658957179 queue:0x0bcbb3a0
 kworker/0:2-22878 [000] .... 68526.840476: rtos_queue_send_from_isr_failed: tstamp:2141658957313 queue:0x0bcbc160
 kworker/0:2-22878 [000] .... 68526.840477: rtcpu_vinotify_event: tstamp:2141659074005 tag:CHANSEL_PXL_EOF channel:0x23 frame:31 vi_tstamp:2141659068192 data:0x05770002
 kworker/0:2-22878 [000] .... 68526.840478: rtcpu_vinotify_event: tstamp:2141659074132 tag:ATOMP_FRAME_DONE channel:0x23 frame:31 vi_tstamp:2141659068216 data:0x00000000
 kworker/0:2-22878 [000] .... 68526.840480: rtos_queue_send_from_isr_failed: tstamp:2141659237825 queue:0x0bcb41f8
 kworker/0:2-22878 [000] .... 68526.840481: rtos_queue_send_from_isr_failed: tstamp:2141659237964 queue:0x0bcb8a60
 kworker/0:2-22878 [000] .... 68526.840482: rtos_queue_send_from_isr_failed: tstamp:2141659238105 queue:0x0bcba5e0
 kworker/0:2-22878 [000] .... 68526.840483: rtos_queue_send_from_isr_failed: tstamp:2141659238237 queue:0x0bcbb3a0
 kworker/0:2-22878 [000] .... 68526.840484: rtos_queue_send_from_isr_failed: tstamp:2141659238371 queue:0x0bcbc160
 kworker/0:2-22878 [000] .... 68526.896295: rtcpu_vinotify_event: tstamp:2141659421108 tag:RESERVED_19 channel:0x23 frame:31 vi_tstamp:2141485733056 data:0x02020005
 kworker/0:2-22878 [000] .... 68526.896300: rtcpu_vinotify_event: tstamp:2141659421239 tag:FE channel:0x00 frame:31 vi_tstamp:2141659068343 data:0x00000022
 kworker/0:2-22878 [000] .... 68526.896303: rtcpu_vinotify_event: tstamp:2141659421387 tag:ATOMP_FE channel:0x00 frame:31 vi_tstamp:2141659068345 data:0x00000000
 kworker/0:2-22878 [000] .... 68526.896305: rtcpu_vinotify_event: tstamp:2141659421511 tag:RESERVED_19 channel:0x23 frame:31 vi_tstamp:2141485756000 data:0x00020005
 kworker/0:2-22878 [000] .... 68526.896307: rtcpu_vinotify_event: tstamp:2141659421671 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:2141485776096 data:0x07020006
 kworker/0:2-22878 [000] .... 68526.896309: rtcpu_vinotify_event: tstamp:2141659421794 tag:FS channel:0x00 frame:32 vi_tstamp:2141659068486 data:0x00000012
 kworker/0:2-22878 [000] .... 68526.896311: rtcpu_vinotify_event: tstamp:2141659421954 tag:ATOMP_FS channel:0x00 frame:32 vi_tstamp:2141659068488 data:0x00000000
 kworker/0:2-22878 [000] .... 68526.896364: rtcpu_vinotify_event: tstamp:2141659422077 tag:CHANSEL_PXL_SOF channel:0x23 frame:32 vi_tstamp:2141659068983 data:0x00000001
 kworker/0:2-22878 [000] .... 68526.896366: rtcpu_vinotify_event: tstamp:2141659422218 tag:RESERVED_19 channel:0x23 frame:32 vi_tstamp:2141485793696 data:0x08020006
 kworker/0:2-22878 [000] .... 68526.896368: rtcpu_vinotify_event: tstamp:2141659422340 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:2141486013440 data:0x10000000
 kworker/0:2-22878 [000] .... 68526.896371: rtcpu_vinotify_event: tstamp:2141659422484 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:2141486040160 data:0x31000007
 kworker/0:2-22878 [000] .... 68526.896373: rtcpu_vinotify_event: tstamp:2141659422605 tag:CHANSEL_PXL_EOF channel:0x23 frame:32 vi_tstamp:2141659415276 data:0x05770002
 kworker/0:2-22878 [000] .... 68526.896375: rtcpu_vinotify_event: tstamp:2141659422764 tag:ATOMP_FRAME_DONE channel:0x23 frame:32 vi_tstamp:2141659415299 data:0x00000000
 kworker/0:2-22878 [000] .... 68526.896377: rtcpu_vinotify_event: tstamp:2141659422885 tag:RESERVED_19 channel:0x23 frame:32 vi_tstamp:2141496834368 data:0x02020006
 kworker/0:2-22878 [000] .... 68526.896379: rtcpu_vinotify_event: tstamp:2141659423048 tag:FE channel:0x00 frame:32 vi_tstamp:2141659415426 data:0x00000022
 kworker/0:2-22878 [000] .... 68526.896381: rtcpu_vinotify_event: tstamp:2141659423171 tag:ATOMP_FE channel:0x00 frame:32 vi_tstamp:2141659415429 data:0x00000000
 kworker/0:2-22878 [000] .... 68526.896394: rtos_queue_send_from_isr_failed: tstamp:2141659614994 queue:0x0bcb41f8
 kworker/0:2-22878 [000] .... 68526.896397: rtos_queue_send_from_isr_failed: tstamp:2141659615134 queue:0x0bcb8a60
 kworker/0:2-22878 [000] .... 68526.896399: rtos_queue_send_from_isr_failed: tstamp:2141659615277 queue:0x0bcba5e0
 kworker/0:2-22878 [000] .... 68526.896402: rtos_queue_send_from_isr_failed: tstamp:2141659615412 queue:0x0bcbb3a0
 kworker/0:2-22878 [000] .... 68526.896406: rtos_queue_send_from_isr_failed: tstamp:2141659615544 queue:0x0bcbc160
 kworker/0:2-22878 [000] .... 68526.896409: rtcpu_vinotify_event: tstamp:2141659768250 tag:RESERVED_19 channel:0x23 frame:32 vi_tstamp:2141496862592 data:0x00020006
 kworker/0:2-22878 [000] .... 68526.896411: rtcpu_vinotify_event: tstamp:2141659768393 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:2141496882656 data:0x07020007
 kworker/0:2-22878 [000] .... 68526.896413: rtcpu_vinotify_event: tstamp:2141659768538 tag:FS channel:0x00 frame:33 vi_tstamp:2141659415568 data:0x00000012
 kworker/0:2-22878 [000] .... 68526.896415: rtcpu_vinotify_event: tstamp:2141659768665 tag:ATOMP_FS channel:0x00 frame:33 vi_tstamp:2141659415570 data:0x00000000
 kworker/0:2-22878 [000] .... 68526.896417: rtcpu_vinotify_event: tstamp:2141659768826 tag:CHANSEL_PXL_SOF channel:0x23 frame:33 vi_tstamp:2141659416064 data:0x00000001
 kworker/0:2-22878 [000] .... 68526.896420: rtcpu_vinotify_event: tstamp:2141659768948 tag:RESERVED_19 channel:0x23 frame:33 vi_tstamp:2141496900256 data:0x08020007
 kworker/0:2-22878 [000] .... 68526.896422: rtcpu_vinotify_event: tstamp:2141659769092 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:2141497197632 data:0x10000000
 kworker/0:2-22878 [000] .... 68526.896424: rtcpu_vinotify_event: tstamp:2141659769214 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:2141497224352 data:0x31000008
 kworker/0:2-22878 [000] .... 68526.896426: rtcpu_vinotify_event: tstamp:2141659769354 tag:CHANSEL_PXL_EOF channel:0x23 frame:33 vi_tstamp:2141659762359 data:0x05770002
 kworker/0:2-22878 [000] .... 68526.896428: rtcpu_vinotify_event: tstamp:2141659769476 tag:ATOMP_FRAME_DONE channel:0x23 frame:33 vi_tstamp:2141659762383 data:0x00000000
 kworker/0:2-22878 [000] .... 68526.896430: rtcpu_vinotify_event: tstamp:2141659769625 tag:RESERVED_19 channel:0x23 frame:33 vi_tstamp:2141507940992 data:0x02020007
 kworker/0:2-22878 [000] .... 68526.896432: rtcpu_vinotify_event: tstamp:2141659769748 tag:FE channel:0x00 frame:33 vi_tstamp:2141659762509 data:0x00000022
 kworker/0:2-22878 [000] .... 68526.896435: rtcpu_vinotify_event: tstamp:2141659769906 tag:ATOMP_FE channel:0x00 frame:33 vi_tstamp:2141659762512 data:0x00000000
 kworker/0:2-22878 [000] .... 68526.896474: rtcpu_vinotify_event: tstamp:2141659770028 tag:RESERVED_19 channel:0x23 frame:33 vi_tstamp:2141507963648 data:0x00020007
 kworker/0:2-22878 [000] .... 68526.896476: rtcpu_vinotify_event: tstamp:2141659770168 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:2141507983328 data:0x07020008
 kworker/0:2-22878 [000] .... 68526.896479: rtcpu_vinotify_event: tstamp:2141659770290 tag:FS channel:0x00 frame:34 vi_tstamp:2141659762653 data:0x00000012
 kworker/0:2-22878 [000] .... 68526.896483: rtos_queue_send_from_isr_failed: tstamp:2141659977037 queue:0x0bcb41f8
 kworker/0:2-22878 [000] .... 68526.896485: rtos_queue_send_from_isr_failed: tstamp:2141659977177 queue:0x0bcb8a60
 kworker/0:2-22878 [000] .... 68526.896487: rtos_queue_send_from_isr_failed: tstamp:2141659977318 queue:0x0bcba5e0
 kworker/0:2-22878 [000] .... 68526.896489: rtos_queue_send_from_isr_failed: tstamp:2141659977449 queue:0x0bcbb3a0
 kworker/0:2-22878 [000] .... 68526.896492: rtos_queue_send_from_isr_failed: tstamp:2141659977581 queue:0x0bcbc160
 kworker/0:2-22878 [000] .... 68526.896494: rtcpu_vinotify_event: tstamp:2141660115258 tag:ATOMP_FS channel:0x00 frame:34 vi_tstamp:2141659762655 data:0x00000000
 kworker/0:2-22878 [000] .... 68526.896496: rtcpu_vinotify_event: tstamp:2141660115400 tag:CHANSEL_PXL_SOF channel:0x23 frame:34 vi_tstamp:2141659763150 data:0x00000001
 kworker/0:2-22878 [000] .... 68526.896498: rtcpu_vinotify_event: tstamp:2141660115564 tag:RESERVED_19 channel:0x23 frame:34 vi_tstamp:2141508006944 data:0x08020008
 kworker/0:2-22878 [000] .... 68526.896500: rtcpu_vinotify_event: tstamp:2141660115687 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:2141508288064 data:0x10000000
 kworker/0:2-22878 [000] .... 68526.896502: rtcpu_vinotify_event: tstamp:2141660115846 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:2141508314784 data:0x31000009
 kworker/0:2-22878 [000] .... 68526.896505: rtcpu_vinotify_event: tstamp:2141660115968 tag:CHANSEL_PXL_EOF channel:0x23 frame:34 vi_tstamp:2141660109441 data:0x05770002
 kworker/0:2-22878 [000] .... 68526.896508: rtcpu_vinotify_event: tstamp:2141660116126 tag:ATOMP_FRAME_DONE channel:0x23 frame:34 vi_tstamp:2141660109464 data:0x00000000
 kworker/0:2-22878 [000] .... 68526.896510: rtcpu_vinotify_event: tstamp:2141660116266 tag:RESERVED_19 channel:0x23 frame:34 vi_tstamp:2141519047616 data:0x02020008
 kworker/0:2-22878 [000] .... 68526.896513: rtcpu_vinotify_event: tstamp:2141660116429 tag:FE channel:0x00 frame:34 vi_tstamp:2141660109593 data:0x00000022
 kworker/0:2-22878 [000] .... 68526.896515: rtcpu_vinotify_event: tstamp:2141660116558 tag:ATOMP_FE channel:0x00 frame:34 vi_tstamp:2141660109595 data:0x00000000
 kworker/0:2-22878 [000] .... 68526.896517: rtcpu_vinotify_event: tstamp:2141660116718 tag:RESERVED_19 channel:0x23 frame:34 vi_tstamp:2141519070272 data:0x00020008
 kworker/0:2-22878 [000] .... 68526.896519: rtcpu_vinotify_event: tstamp:2141660116841 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:2141519089920 data:0x07020009
 kworker/0:2-22878 [000] .... 68526.896521: rtcpu_vinotify_event: tstamp:2141660116982 tag:FS channel:0x00 frame:35 vi_tstamp:2141660109737 data:0x00000012
 kworker/0:2-22878 [000] .... 68526.896524: rtcpu_vinotify_event: tstamp:2141660117105 tag:ATOMP_FS channel:0x00 frame:35 vi_tstamp:2141660109739 data:0x00000000
 kworker/0:2-22878 [000] .... 68526.896526: rtcpu_vinotify_event: tstamp:2141660117245 tag:CHANSEL_PXL_SOF channel:0x23 frame:35 vi_tstamp:2141660110232 data:0x00000001
 kworker/0:2-22878 [000] .... 68526.896528: rtcpu_vinotify_event: tstamp:2141660117385 tag:RESERVED_19 channel:0x23 frame:35 vi_tstamp:2141519107552 data:0x08020009
 kworker/0:2-22878 [000] .... 68526.896532: rtos_queue_send_from_isr_failed: tstamp:2141660314009 queue:0x0bcb41f8
 kworker/0:2-22878 [000] .... 68526.896534: rtos_queue_send_from_isr_failed: tstamp:2141660314149 queue:0x0bcb8a60
 kworker/0:2-22878 [000] .... 68526.896536: rtos_queue_send_from_isr_failed: tstamp:2141660314289 queue:0x0bcba5e0
 kworker/0:2-22878 [000] .... 68526.896538: rtos_queue_send_from_isr_failed: tstamp:2141660314421 queue:0x0bcbb3a0
 kworker/0:2-22878 [000] .... 68526.896540: rtos_queue_send_from_isr_failed: tstamp:2141660314554 queue:0x0bcbc160
 kworker/0:2-22878 [000] .... 68526.896544: rtcpu_vinotify_event: tstamp:2141660575378 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:2141519401696 data:0x10000000
 kworker/0:2-22878 [000] .... 68526.896546: rtcpu_vinotify_event: tstamp:2141660575508 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:2141519428416 data:0x3100000a
 kworker/0:2-22878 [000] .... 68526.896548: rtcpu_vinotify_event: tstamp:2141660575651 tag:CHANSEL_PXL_EOF channel:0x23 frame:35 vi_tstamp:2141660456526 data:0x05770002
 kworker/0:2-22878 [000] .... 68526.896550: rtcpu_vinotify_event: tstamp:2141660575774 tag:ATOMP_FRAME_DONE channel:0x23 frame:35 vi_tstamp:2141660456549 data:0x00000000
 kworker/0:2-22878 [000] .... 68526.896553: rtcpu_vinotify_event: tstamp:2141660575916 tag:RESERVED_19 channel:0x23 frame:35 vi_tstamp:2141530154400 data:0x02020009
 kworker/0:2-22878 [000] .... 68526.896555: rtcpu_vinotify_event: tstamp:2141660576042 tag:FE channel:0x00 frame:35 vi_tstamp:2141660456677 data:0x00000022
 kworker/0:2-22878 [000] .... 68526.896557: rtcpu_vinotify_event: tstamp:2141660576183 tag:ATOMP_FE channel:0x00 frame:35 vi_tstamp:2141660456679 data:0x00000000
 kworker/0:2-22878 [000] .... 68526.896559: rtcpu_vinotify_event: tstamp:2141660576305 tag:RESERVED_19 channel:0x23 frame:35 vi_tstamp:2141530177056 data:0x00020009
 kworker/0:2-22878 [000] .... 68526.896576: rtcpu_vinotify_event: tstamp:2141660576447 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:2141530196704 data:0x0702000a
 kworker/0:2-22878 [000] .... 68526.896578: rtcpu_vinotify_event: tstamp:2141660576571 tag:FS channel:0x00 frame:36 vi_tstamp:2141660456820 data:0x00000012
 kworker/0:2-22878 [000] .... 68526.896580: rtcpu_vinotify_event: tstamp:2141660576711 tag:ATOMP_FS channel:0x00 frame:36 vi_tstamp:2141660456823 data:0x00000000
 kworker/0:2-22878 [000] .... 68526.896583: rtcpu_vinotify_event: tstamp:2141660576833 tag:CHANSEL_PXL_SOF channel:0x23 frame:36 vi_tstamp:2141660457317 data:0x00000001
 kworker/0:2-22878 [000] .... 68526.896585: rtcpu_vinotify_event: tstamp:2141660576973 tag:RESERVED_19 channel:0x23 frame:36 vi_tstamp:2141530214304 data:0x0802000a
 kworker/0:2-22878 [000] .... 68526.896627: rtcpu_vinotify_event: tstamp:2141660577094 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:2141530408000 data:0x10000000
 kworker/0:2-22878 [000] .... 68526.896629: rtcpu_vinotify_event: tstamp:2141660577235 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:2141530434720 data:0x3100000b
 kworker/0:2-22878 [000] .... 68526.896632: rtos_queue_send_from_isr_failed: tstamp:2141660662240 queue:0x0bcb41f8
 kworker/0:2-22878 [000] .... 68526.896634: rtos_queue_send_from_isr_failed: tstamp:2141660662380 queue:0x0bcb8a60
 kworker/0:2-22878 [000] .... 68526.896636: rtos_queue_send_from_isr_failed: tstamp:2141660662519 queue:0x0bcba5e0
 kworker/0:2-22878 [000] .... 68526.896638: rtos_queue_send_from_isr_failed: tstamp:2141660662651 queue:0x0bcbb3a0
 kworker/0:2-22878 [000] .... 68526.896641: rtos_queue_send_from_isr_failed: tstamp:2141660662785 queue:0x0bcbc160
 kworker/0:2-22878 [000] .... 68526.896643: rtcpu_vinotify_event: tstamp:2141660809417 tag:CHANSEL_PXL_EOF channel:0x23 frame:36 vi_tstamp:2141660803607 data:0x05770002
 kworker/0:2-22878 [000] .... 68526.896647: rtos_queue_send_from_isr_failed: tstamp:2141661002834 queue:0x0bcb41f8
 kworker/0:2-22878 [000] .... 68526.896649: rtos_queue_send_from_isr_failed: tstamp:2141661002972 queue:0x0bcb8a60
 kworker/0:2-22878 [000] .... 68526.896651: rtos_queue_send_from_isr_failed: tstamp:2141661003113 queue:0x0bcba5e0
 kworker/0:2-22878 [000] .... 68526.896653: rtos_queue_send_from_isr_failed: tstamp:2141661003245 queue:0x0bcbb3a0
 kworker/0:2-22878 [000] .... 68526.896656: rtos_queue_send_from_isr_failed: tstamp:2141661003379 queue:0x0bcbc160
 kworker/0:2-22878 [000] .... 68526.952459: rtcpu_vinotify_event: tstamp:2141661156505 tag:ATOMP_FRAME_DONE channel:0x23 frame:36 vi_tstamp:2141660803632 data:0x00000000
 kworker/0:2-22878 [000] .... 68526.952473: rtcpu_vinotify_event: tstamp:2141661156636 tag:RESERVED_19 channel:0x23 frame:36 vi_tstamp:2141541266336 data:0x0202000a
 kworker/0:2-22878 [000] .... 68526.952475: rtcpu_vinotify_event: tstamp:2141661156784 tag:FE channel:0x00 frame:36 vi_tstamp:2141660803760 data:0x00000022
 kworker/0:2-22878 [000] .... 68526.952477: rtcpu_vinotify_event: tstamp:2141661156915 tag:ATOMP_FE channel:0x00 frame:36 vi_tstamp:2141660803763 data:0x00000000
 kworker/0:2-22878 [000] .... 68526.952479: rtcpu_vinotify_event: tstamp:2141661157076 tag:RESERVED_19 channel:0x23 frame:36 vi_tstamp:2141541289280 data:0x0002000a
 kworker/0:2-22878 [000] .... 68526.952480: rtcpu_vinotify_event: tstamp:2141661157200 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:2141541309376 data:0x0702000b
 kworker/0:2-22878 [000] .... 68526.952571: rtcpu_vinotify_event: tstamp:2141661157349 tag:FS channel:0x00 frame:37 vi_tstamp:2141660803904 data:0x00000012
 kworker/0:2-22878 [000] .... 68526.952573: rtcpu_vinotify_event: tstamp:2141661157476 tag:ATOMP_FS channel:0x00 frame:37 vi_tstamp:2141660803906 data:0x00000000
 kworker/0:2-22878 [000] .... 68526.952577: rtcpu_vinotify_event: tstamp:2141661157633 tag:CHANSEL_PXL_SOF channel:0x23 frame:37 vi_tstamp:2141660804398 data:0x00000001
 kworker/0:2-22878 [000] .... 68526.952579: rtcpu_vinotify_event: tstamp:2141661157754 tag:RESERVED_19 channel:0x23 frame:37 vi_tstamp:2141541326944 data:0x0802000b
 kworker/0:2-22878 [000] .... 68526.952581: rtcpu_vinotify_event: tstamp:2141661157895 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:2141541557728 data:0x10000000
 kworker/0:2-22878 [000] .... 68526.952582: rtcpu_vinotify_event: tstamp:2141661158016 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:2141541584480 data:0x3100000c
 kworker/0:2-22878 [000] .... 68526.952584: rtcpu_vinotify_event: tstamp:2141661158156 tag:CHANSEL_PXL_EOF channel:0x23 frame:37 vi_tstamp:2141661150693 data:0x05770002
 kworker/0:2-22878 [000] .... 68526.952586: rtcpu_vinotify_event: tstamp:2141661158279 tag:ATOMP_FRAME_DONE channel:0x23 frame:37 vi_tstamp:2141661150717 data:0x00000000
 kworker/0:2-22878 [000] .... 68526.952588: rtcpu_vinotify_event: tstamp:2141661158419 tag:RESERVED_19 channel:0x23 frame:37 vi_tstamp:2141552367712 data:0x0202000b
 kworker/0:2-22878 [000] .... 68526.952590: rtcpu_vinotify_event: tstamp:2141661158541 tag:FE channel:0x00 frame:37 vi_tstamp:2141661150844 data:0x00000022
 kworker/0:2-22878 [000] .... 68526.952659: rtos_queue_send_from_isr_failed: tstamp:2141661169207 queue:0x0bcb41f8
 kworker/0:2-22878 [000] .... 68526.952662: rtos_queue_send_from_isr_failed: tstamp:2141661169347 queue:0x0bcb8a60
 kworker/0:2-22878 [000] .... 68526.952664: rtos_queue_send_from_isr_failed: tstamp:2141661169489 queue:0x0bcba5e0
 kworker/0:2-22878 [000] .... 68526.952666: rtos_queue_send_from_isr_failed: tstamp:2141661169622 queue:0x0bcbb3a0
 kworker/0:2-22878 [000] .... 68526.952668: rtos_queue_send_from_isr_failed: tstamp:2141661169754 queue:0x0bcbc160
 kworker/0:2-22878 [000] .... 68526.952669: rtos_queue_send_from_isr_failed: tstamp:2141661383301 queue:0x0bcb41f8
 kworker/0:2-22878 [000] .... 68526.952671: rtos_queue_send_from_isr_failed: tstamp:2141661383520 queue:0x0bcb8a60
 kworker/0:2-22878 [000] .... 68526.952673: rtos_queue_send_from_isr_failed: tstamp:2141661383743 queue:0x0bcba5e0
 kworker/0:2-22878 [000] .... 68526.952675: rtos_queue_send_from_isr_failed: tstamp:2141661383979 queue:0x0bcbb3a0
 kworker/0:2-22878 [000] .... 68526.952677: rtos_queue_send_from_isr_failed: tstamp:2141661384197 queue:0x0bcbc160
 kworker/0:2-22878 [000] .... 68526.952679: rtcpu_vinotify_event: tstamp:2141661443411 tag:ATOMP_FE channel:0x00 frame:37 vi_tstamp:2141661150846 data:0x00000000
 kworker/0:2-22878 [000] .... 68526.952681: rtcpu_vinotify_event: tstamp:2141661443628 tag:RESERVED_19 channel:0x23 frame:37 vi_tstamp:2141552396000 data:0x0002000b
 kworker/0:2-22878 [000] .... 68526.952683: rtcpu_vinotify_event: tstamp:2141661443882 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:2141552416096 data:0x0702000c
 kworker/0:2-22878 [000] .... 68526.952685: rtcpu_vinotify_event: tstamp:2141661444093 tag:FS channel:0x00 frame:38 vi_tstamp:2141661150987 data:0x00000012
 kworker/0:2-22878 [000] .... 68526.952686: rtcpu_vinotify_event: tstamp:2141661444343 tag:ATOMP_FS channel:0x00 frame:38 vi_tstamp:2141661150989 data:0x00000000
 kworker/0:2-22878 [000] .... 68526.952688: rtcpu_vinotify_event: tstamp:2141661444551 tag:CHANSEL_PXL_SOF channel:0x23 frame:38 vi_tstamp:2141661151483 data:0x00000001
 kworker/0:2-22878 [000] .... 68526.952690: rtcpu_vinotify_event: tstamp:2141661444800 tag:RESERVED_19 channel:0x23 frame:38 vi_tstamp:2141552433664 data:0x0802000c
 kworker/0:2-22878 [000] .... 68526.952692: rtcpu_vinotify_event: tstamp:2141661445006 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:2141552726176 data:0x10000000
 kworker/0:2-22878 [000] .... 68526.952693: rtcpu_vinotify_event: tstamp:2141661445255 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:2141552752928 data:0x3100000d
 kworker/0:2-22878 [000] .... 68526.952695: rtcpu_vinotify_event: tstamp:2141661445466 tag:CHANSEL_LOAD_FRAMED channel:0x04 frame:38 vi_tstamp:2141661384828 data:0x38000592
 kworker/0:2-22878 [000] .... 68526.952697: rtcpu_vinotify_event: tstamp:2141661445715 tag:CHANSEL_FAULT_FE channel:0x04 frame:38 vi_tstamp:2141661384828 data:0x00000000
 kworker/0:2-22878 [000] .... 68526.952699: rtcpu_vinotify_event: tstamp:2141661445924 tag:ATOMP_FE channel:0x00 frame:38 vi_tstamp:2141661384828 data:0x00000000
 kworker/0:2-22878 [000] .... 68526.952704: rtos_queue_peek_from_isr_failed: tstamp:2141662010197 queue:0x0bcbcf78
 kworker/0:2-22878 [000] .... 68527.120526: rtos_queue_peek_from_isr_failed: tstamp:2141667010215 queue:0x0bcbcf78
 kworker/0:2-22878 [000] .... 68527.292395: rtos_queue_peek_from_isr_failed: tstamp:2141672010212 queue:0x0bcbcf78
 kworker/0:2-22878 [000] .... 68527.404511: rtos_queue_peek_from_isr_failed: tstamp:2141677010214 queue:0x0bcbcf78
 kworker/0:2-22878 [000] .... 68527.572575: rtos_queue_peek_from_isr_failed: tstamp:2141682010214 queue:0x0bcbcf78
 kworker/0:2-22878 [000] .... 68527.740525: rtos_queue_peek_from_isr_failed: tstamp:2141687010216 queue:0x0bcbcf78
 kworker/0:2-22878 [000] .... 68527.908616: rtos_queue_peek_from_isr_failed: tstamp:2141692010216 queue:0x0bcbcf78
 kworker/0:2-22878 [000] .... 68528.076538: rtos_queue_peek_from_isr_failed: tstamp:2141697010216 queue:0x0bcbcf78

JerryChang · December 17, 2020, 3:24am

hello a.gilles,

I assume you’re able to access the sensor stream to have your use-case, right?
there’s no errors reported according to VI tracing logs, it also capture start-of-frame and end-of-frame signaling to indicate a frame capture.
for example,

rtcpu_vinotify_event: tstamp:2141657549485 tag:CHANSEL_PXL_SOF channel:0x23 frame:27 vi_tstamp:2141657333564 data:0x00000001
rtcpu_vinotify_event: tstamp:2141657685644 tag:CHANSEL_PXL_EOF channel:0x23 frame:27 vi_tstamp:2141657679859 data:0x05770002

a.gilles · December 17, 2020, 8:30am

Hello JerryChang,

I can capture the video stream, but it should contain 0x12 non-image CSI2 data packets as well.
I do not see any trace of these 0x12 packets being decoded by the VI.

If the VI is not configured to accept the 0x12 data packets, will the VI report error events of unexpected packets arriving ?

Would it be a solution to configure the V4L with a video mode where the CSI2 data type 0x12 is used as VI filter ?

Thank you,
Regards,
Alex.

JerryChang · December 17, 2020, 8:36am

hello a.gilles,

is there embedded data line on your sensor stream?
please check Sensor Software Driver Programming Guide, you may enable embedded_metadata_height property to parse that by pixel parser.
thanks

a.gilles · December 17, 2020, 8:53am

JerryChang,

No, no embedded data line, I am talking about non-image data being sent by the sensor outside frames, using CSI2 packets of data types 0x12.

Do you mean that VI actually grabs these 0x12 CSI2 data packets and make the data available to the V4L layers as metadata embedded into frames ?

I feel some confusion between embedded data inside frames and non-image data sent over 0x12 CSI2 packets.

Regards,
Alex.

JerryChang · December 17, 2020, 9:07am

hello a.gilles,

you may access Xavier Series SoC Technical Reference Manual via download center.
please check [7.2.1.1.3 NVCSI 2.0 Capabilities], it’s pixel parser to handle the traffic (embedded data and image data) from one camera device;
there’s embedded_metadata_height DT property to report the lines for distinguish.
thanks