No CSI data received from raw sensor

[ron.persky]

Hi,

I wanted to follow-up on the following thread:

Configuration for raw data over CSI

Hi, I have an FPGA that sends me raw data over CSI interface (not a camera). The data resolution is 1024x128, and each pixel is 16bit. I have written a custom CSI driver based on ov5693 template, and updated my device tree as well. (As described here: Jetson AGX Xavier MIPI CSI-2 without I2C from FPGA) My question is how to configure in dtsi the following: mode_type = ? pixel_phase = ? csi_pixel_bit_depth = ? line_length = ? to get 16bits per pixel of raw data. Regards, Ron

The reason for no data previously received was that the CSI sensor had continuous CSI clock, but my own CSI driver wasn’t configured properly.
I have fixed the CSI driver, and now I can see the FS and FE.
But the data still can’t be received.

Here are the trace logs:

# tracer: nop
#
# entries-in-buffer/entries-written: 933/933   #P:4
#
#                              _-----=> irqs-off
#                             / _----=> need-resched
#                            | / _---=> hardirq/softirq
#                            || / _--=> preempt-depth
#                            ||| /     delay
#           TASK-PID   CPU#  ||||    TIMESTAMP  FUNCTION
#              | |       |   ||||       |         |
        v4l2-ctl-8635  [002] ....   505.448396: tegra_channel_open: vi-output, ov5693 30-0036
        v4l2-ctl-8635  [000] ....   505.457769: tegra_channel_set_power: ov5693 30-0036 : 0x1
        v4l2-ctl-8635  [000] ....   505.457813: camera_common_s_power: status : 0x1
        v4l2-ctl-8635  [000] ....   505.468076: tegra_channel_set_power: 15a00000.nvcsi--1 : 0x1
        v4l2-ctl-8635  [000] ....   505.468083: csi_s_power: enable : 0x1
        v4l2-ctl-8635  [000] ....   505.475085: tegra_channel_capture_setup: vnc_id 0 W 2048 H 128 fmt c4
        v4l2-ctl-8635  [000] ....   505.496514: tegra_channel_set_stream: enable : 0x1
     kworker/0:1-808   [000] ....   505.502446: rtos_queue_peek_from_isr_failed: tstamp:16117279144 queue:0x0bcbcf78
     kworker/0:1-808   [000] ....   505.502460: rtcpu_start: tstamp:16117281047
     kworker/0:1-808   [000] ....   505.502464: rtos_queue_send_from_isr_failed: tstamp:16117418493 queue:0x0bcb41f8
     kworker/0:1-808   [000] ....   505.502467: rtos_queue_send_from_isr_failed: tstamp:16117418795 queue:0x0bcb8a60
     kworker/0:1-808   [000] ....   505.502468: rtos_queue_send_from_isr_failed: tstamp:16117419093 queue:0x0bcba5e0
     kworker/0:1-808   [000] ....   505.502469: rtos_queue_send_from_isr_failed: tstamp:16117419390 queue:0x0bcbb3a0
     kworker/0:1-808   [000] ....   505.502470: rtos_queue_send_from_isr_failed: tstamp:16117419687 queue:0x0bcbc160
     kworker/0:1-808   [000] ....   505.502473: rtcpu_string: tstamp:16117420546 id:0x04010000 str:"Configuring VI GoS.
"
     kworker/0:1-808   [000] ....   505.502534: rtcpu_string: tstamp:16117420911 id:0x04010000 str:"VM GOS[#0] addr=0xc2100000
"
     kworker/0:1-808   [000] ....   505.502542: rtcpu_string: tstamp:16117421333 id:0x04010000 str:"VM GOS[#1] addr=0xc2101000
"
     kworker/0:1-808   [000] ....   505.502552: rtcpu_string: tstamp:16117421833 id:0x04010000 str:"VM GOS[#2] addr=0xc2102000
"
     kworker/0:1-808   [000] ....   505.502559: rtcpu_string: tstamp:16117422239 id:0x04010000 str:"VM GOS[#3] addr=0xc2103000
"
     kworker/0:1-808   [000] ....   505.502566: rtcpu_string: tstamp:16117422644 id:0x04010000 str:"VM GOS[#4] addr=0xc2104000
"
     kworker/0:1-808   [000] ....   505.502573: rtcpu_string: tstamp:16117423048 id:0x04010000 str:"VM GOS[#5] addr=0xc2105000
"
     kworker/0:1-808   [000] ....   505.502580: rtcpu_string: tstamp:16117434115 id:0x04010000 str:"vi5_hwinit: firmware CL2018101701 protocol versi"
     kworker/0:1-808   [000] ....   505.502581: rtcpu_string: tstamp:16117434381 id:0x04010000 str:"on 2.2
"
     kworker/0:1-808   [000] ....   505.502588: rtos_queue_send_from_isr_failed: tstamp:16117466461 queue:0x0bcb41f8
     kworker/0:1-808   [000] ....   505.502589: rtos_queue_send_from_isr_failed: tstamp:16117466816 queue:0x0bcb8a60
     kworker/0:1-808   [000] ....   505.502589: rtos_queue_send_from_isr_failed: tstamp:16117467125 queue:0x0bcba5e0
     kworker/0:1-808   [000] ....   505.502590: rtos_queue_send_from_isr_failed: tstamp:16117467418 queue:0x0bcbb3a0
     kworker/0:1-808   [000] ....   505.502590: rtos_queue_send_from_isr_failed: tstamp:16117467716 queue:0x0bcbc160
     kworker/0:1-808   [000] ....   505.502591: rtcpu_string: tstamp:16117469237 id:0x04010000 str:"VI GOS[#0] set to VM GOS[4] base 0xc2104000
"
        v4l2-ctl-8635  [000] ....   505.517198: tegra_channel_set_stream: 15a00000.nvcsi--1 : 0x1
        v4l2-ctl-8635  [000] ....   505.517202: csi_s_stream: enable : 0x1
        v4l2-ctl-8635  [000] ....   505.517211: tegra_channel_set_stream: ov5693 30-0036 : 0x1
     kworker/0:1-808   [000] ....   505.558436: rtcpu_vinotify_event: tstamp:16117746780 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:17542856928 data:0x10000000
     kworker/0:1-808   [000] ....   505.558439: rtcpu_vinotify_event: tstamp:16117746936 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:17542863872 data:0x31000001
     kworker/0:1-808   [000] ....   505.558440: rtcpu_vinotify_event: tstamp:16117747111 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:17542864864 data:0x07020001
     kworker/0:1-808   [000] ....   505.558441: rtcpu_vinotify_event: tstamp:16117747257 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:17542937056 data:0x10000000
     kworker/0:1-808   [000] ....   505.558442: rtcpu_vinotify_event: tstamp:16117747427 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:17542944096 data:0x31000002
     kworker/0:1-808   [000] ....   505.558444: rtos_queue_send_from_isr_failed: tstamp:16118119761 queue:0x0bcb41f8
     kworker/0:1-808   [000] ....   505.558446: rtos_queue_send_from_isr_failed: tstamp:16118119921 queue:0x0bcb8a60
     kworker/0:1-808   [000] ....   505.558447: rtos_queue_send_from_isr_failed: tstamp:16118120084 queue:0x0bcba5e0
     kworker/0:1-808   [000] ....   505.558448: rtos_queue_send_from_isr_failed: tstamp:16118120241 queue:0x0bcbb3a0
     kworker/0:1-808   [000] ....   505.558449: rtos_queue_send_from_isr_failed: tstamp:16118120398 queue:0x0bcbc160
     kworker/0:1-808   [000] ....   505.558452: rtcpu_nvcsi_intr: tstamp:16118122977 class:GLOBAL type:PHY_INTR0 phy:0 cil:0 st:0 vc:0 status:0x00000001
     kworker/0:1-808   [000] ....   505.558459: rtos_queue_send_from_isr_failed: tstamp:16118537379 queue:0x0bcb41f8
     kworker/0:1-808   [000] ....   505.558460: rtos_queue_send_from_isr_failed: tstamp:16118537541 queue:0x0bcb8a60
     kworker/0:1-808   [000] ....   505.558461: rtos_queue_send_from_isr_failed: tstamp:16118537721 queue:0x0bcba5e0
     kworker/0:1-808   [000] ....   505.558462: rtos_queue_send_from_isr_failed: tstamp:16118537878 queue:0x0bcbb3a0
     kworker/0:1-808   [000] ....   505.558463: rtos_queue_send_from_isr_failed: tstamp:16118538035 queue:0x0bcbc160
     kworker/0:1-808   [000] ....   505.558465: rtcpu_vinotify_event: tstamp:16118685780 tag:FS channel:0x00 frame:0 vi_tstamp:16118524829 data:0x00000010
     kworker/0:1-808   [000] ....   505.558465: rtcpu_vinotify_event: tstamp:16118685957 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:16118524830 data:0x00000000
     kworker/0:1-808   [000] ....   505.558466: rtcpu_vinotify_event: tstamp:16118686108 tag:CHANSEL_PXL_SOF channel:0x23 frame:0 vi_tstamp:16118527032 data:0x00000001
     kworker/0:1-808   [000] ....   505.558467: rtcpu_vinotify_event: tstamp:16118686287 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:17576659200 data:0x08020001
     kworker/0:1-808   [000] ....   505.558468: rtcpu_vinotify_event: tstamp:16118686435 tag:CHANSEL_FAULT channel:0x23 frame:0 vi_tstamp:16118527189 data:0x00000200
     kworker/0:1-808   [000] ....   505.558469: rtcpu_vinotify_event: tstamp:16118686609 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:17576664672 data:0x01020001
     kworker/0:1-808   [000] ....   505.558470: rtcpu_vinotify_event: tstamp:16118805649 tag:CHANSEL_FAULT channel:0x23 frame:0 vi_tstamp:16118805038 data:0x007f0202
     kworker/0:1-808   [000] ....   505.558471: rtcpu_vinotify_event: tstamp:16118805823 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:17585555808 data:0x01020001
     kworker/0:1-808   [000] ....   505.558472: rtcpu_vinotify_event: tstamp:16118805971 tag:ATOMP_FRAME_DONE channel:0x23 frame:0 vi_tstamp:16118805053 data:0x00000000
     kworker/0:1-808   [000] ....   505.558473: rtcpu_vinotify_event: tstamp:16118806138 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:17585556384 data:0x02020001
     kworker/0:1-808   [000] ....   505.558474: rtcpu_vinotify_event: tstamp:16118806286 tag:FE channel:0x00 frame:0 vi_tstamp:16118805084 data:0x00000020
     kworker/0:1-808   [000] ....   505.558475: rtcpu_vinotify_event: tstamp:16119092745 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:16118805084 data:0x00000000
     kworker/0:1-808   [000] ....   505.558502: rtcpu_vinotify_event: tstamp:16119092894 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:17585559008 data:0x07020002
     kworker/0:1-808   [000] ....   505.558503: rtcpu_vinotify_event: tstamp:16119093065 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:17585567936 data:0x10000000
     kworker/0:1-808   [000] ....   505.558504: rtcpu_vinotify_event: tstamp:16119093209 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:17585573376 data:0x31000003
     kworker/0:1-808   [000] ....   505.614459: rtos_queue_send_from_isr_failed: tstamp:16119790557 queue:0x0bcb41f8
     kworker/0:1-808   [000] ....   505.614463: rtos_queue_send_from_isr_failed: tstamp:16119790740 queue:0x0bcb8a60
     kworker/0:1-808   [000] ....   505.614464: rtos_queue_send_from_isr_failed: tstamp:16119790902 queue:0x0bcba5e0
     kworker/0:1-808   [000] ....   505.614465: rtos_queue_send_from_isr_failed: tstamp:16119791059 queue:0x0bcbb3a0
     kworker/0:1-808   [000] ....   505.614466: rtos_queue_send_from_isr_failed: tstamp:16119791213 queue:0x0bcbc160
     kworker/0:1-808   [000] ....   505.614468: rtcpu_vinotify_event: tstamp:16120031758 tag:FS channel:0x00 frame:0 vi_tstamp:16119774816 data:0x00000010
     kworker/0:1-808   [000] ....   505.614471: rtcpu_vinotify_event: tstamp:16120031912 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:16119774816 data:0x00000000
     kworker/0:1-808   [000] ....   505.614472: rtcpu_vinotify_event: tstamp:16120032089 tag:CHANSEL_PXL_SOF channel:0x23 frame:0 vi_tstamp:16119777019 data:0x00000001
     kworker/0:1-808   [000] ....   505.614472: rtcpu_vinotify_event: tstamp:16120032239 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:17616658752 data:0x08020002
     kworker/0:1-808   [000] ....   505.614473: rtcpu_vinotify_event: tstamp:16120032417 tag:CHANSEL_FAULT channel:0x23 frame:0 vi_tstamp:16119777175 data:0x00000200
     kworker/0:1-808   [000] ....   505.614474: rtcpu_vinotify_event: tstamp:16120032566 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:17616664256 data:0x01020002
     kworker/0:1-808   [000] ....   505.614474: rtcpu_vinotify_event: tstamp:16120055630 tag:CHANSEL_FAULT channel:0x23 frame:0 vi_tstamp:16120055025 data:0x007f0202
     kworker/0:1-808   [000] ....   505.614475: rtcpu_vinotify_event: tstamp:16120055778 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:17625555392 data:0x01020002
     kworker/0:1-808   [000] ....   505.614475: rtcpu_vinotify_event: tstamp:16120055950 tag:ATOMP_FRAME_DONE channel:0x23 frame:0 vi_tstamp:16120055040 data:0x00000000
     kworker/0:1-808   [000] ....   505.614476: rtcpu_vinotify_event: tstamp:16120056097 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:17625555936 data:0x02020002
     kworker/0:1-808   [000] ....   505.614476: rtcpu_vinotify_event: tstamp:16120056268 tag:FE channel:0x00 frame:0 vi_tstamp:16120055070 data:0x00000020
     kworker/0:1-808   [000] ....   505.614477: rtcpu_vinotify_event: tstamp:16120056416 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:16120055071 data:0x00000000
     kworker/0:1-808   [000] ....   505.614478: rtcpu_vinotify_event: tstamp:16120344721 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:17625558560 data:0x07020003
     kworker/0:1-808   [000] ....   505.614478: rtcpu_vinotify_event: tstamp:16120344869 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:17625570592 data:0x10000000
     kworker/0:1-808   [000] ....   505.614479: rtcpu_vinotify_event: tstamp:16120345041 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:17625574496 data:0x31000004
     kworker/0:1-808   [000] ....   505.614480: rtos_queue_send_from_isr_failed: tstamp:16121038860 queue:0x0bcb41f8
     kworker/0:1-808   [000] ....   505.614481: rtos_queue_send_from_isr_failed: tstamp:16121039043 queue:0x0bcb8a60
     kworker/0:1-808   [000] ....   505.614482: rtos_queue_send_from_isr_failed: tstamp:16121039206 queue:0x0bcba5e0
     kworker/0:1-808   [000] ....   505.614483: rtos_queue_send_from_isr_failed: tstamp:16121039363 queue:0x0bcbb3a0
     kworker/0:1-808   [000] ....   505.614484: rtos_queue_send_from_isr_failed: tstamp:16121039517 queue:0x0bcbc160
     kworker/0:1-808   [000] ....   505.670407: rtcpu_vinotify_event: tstamp:16121283743 tag:FS channel:0x00 frame:0 vi_tstamp:16121024802 data:0x00000010
     kworker/0:1-808   [000] ....   505.670409: rtcpu_vinotify_event: tstamp:16121283921 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:16121024802 data:0x00000000
     kworker/0:1-808   [000] ....   505.670411: rtcpu_vinotify_event: tstamp:16121284071 tag:CHANSEL_PXL_SOF channel:0x23 frame:0 vi_tstamp:16121027005 data:0x00000001
     kworker/0:1-808   [000] ....   505.670412: rtcpu_vinotify_event: tstamp:16121284246 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:17656658304 data:0x08020003
     kworker/0:1-808   [000] ....   505.670413: rtcpu_vinotify_event: tstamp:16121284394 tag:CHANSEL_FAULT channel:0x23 frame:0 vi_tstamp:16121027162 data:0x00000200
     kworker/0:1-808   [000] ....   505.670413: rtcpu_vinotify_event: tstamp:16121284569 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:17656663808 data:0x01020003
     kworker/0:1-808   [000] ....   505.670414: rtcpu_vinotify_event: tstamp:16121305665 tag:CHANSEL_FAULT channel:0x23 frame:0 vi_tstamp:16121305011 data:0x007f0202
     kworker/0:1-808   [000] ....   505.670414: rtcpu_vinotify_event: tstamp:16121305837 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:17665554976 data:0x01020003
     kworker/0:1-808   [000] ....   505.670415: rtcpu_vinotify_event: tstamp:16121305985 tag:ATOMP_FRAME_DONE channel:0x23 frame:0 vi_tstamp:16121305026 data:0x00000000
     kworker/0:1-808   [000] ....   505.670416: rtcpu_vinotify_event: tstamp:16121306155 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:17665555520 data:0x02020003
     kworker/0:1-808   [000] ....   505.670416: rtcpu_vinotify_event: tstamp:16121306303 tag:FE channel:0x00 frame:0 vi_tstamp:16121305057 data:0x00000020
     kworker/0:1-808   [000] ....   505.670417: rtcpu_vinotify_event: tstamp:16121306473 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:16121305057 data:0x00000000
     kworker/0:1-808   [000] ....   505.670420: rtcpu_vinotify_event: tstamp:16121306618 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:17665557440 data:0x07020004
     kworker/0:1-808   [000] ....   505.670425: rtcpu_vinotify_event: tstamp:16121596701 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:17665567360 data:0x10000000
     kworker/0:1-808   [000] ....   505.670425: rtcpu_vinotify_event: tstamp:16121596849 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:17665572832 data:0x31000005
     kworker/0:1-808   [000] ....   505.670433: rtos_queue_peek_from_isr_failed: tstamp:16122279499 queue:0x0bcbcf78
     kworker/0:1-808   [000] ....   505.670435: rtos_queue_send_from_isr_failed: tstamp:16122288883 queue:0x0bcb41f8
     kworker/0:1-808   [000] ....   505.670437: rtos_queue_send_from_isr_failed: tstamp:16122289045 queue:0x0bcb8a60
     kworker/0:1-808   [000] ....   505.670438: rtos_queue_send_from_isr_failed: tstamp:16122289209 queue:0x0bcba5e0
     kworker/0:1-808   [000] ....   505.670439: rtos_queue_send_from_isr_failed: tstamp:16122289364 queue:0x0bcbb3a0
     kworker/0:1-808   [000] ....   505.670440: rtos_queue_send_from_isr_failed: tstamp:16122289520 queue:0x0bcbc160
     kworker/0:1-808   [000] ....   505.670441: rtcpu_vinotify_event: tstamp:16122535719 tag:FS channel:0x00 frame:0 vi_tstamp:16122274788 data:0x00000010
     kworker/0:1-808   [000] ....   505.670442: rtcpu_vinotify_event: tstamp:16122535876 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:16122274788 data:0x00000000
     kworker/0:1-808   [000] ....   505.670442: rtcpu_vinotify_event: tstamp:16122536054 tag:CHANSEL_PXL_SOF channel:0x23 frame:0 vi_tstamp:16122276991 data:0x00000001
     kworker/0:1-808   [000] ....   505.670443: rtcpu_vinotify_event: tstamp:16122536203 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:17696657888 data:0x08020004
     kworker/0:1-808   [000] ....   505.670443: rtcpu_vinotify_event: tstamp:16122536377 tag:CHANSEL_FAULT channel:0x23 frame:0 vi_tstamp:16122277148 data:0x00000200
     kworker/0:1-808   [000] ....   505.670444: rtcpu_vinotify_event: tstamp:16122536525 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:17696663360 data:0x01020004
     kworker/0:1-808   [000] ....   505.670445: rtcpu_vinotify_event: tstamp:16122555859 tag:CHANSEL_FAULT channel:0x23 frame:0 vi_tstamp:16122554997 data:0x007f0202
     kworker/0:1-808   [000] ....   505.670445: rtcpu_vinotify_event: tstamp:16122556007 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:17705554528 data:0x01020004
     kworker/0:1-808   [000] ....   505.670446: rtcpu_vinotify_event: tstamp:16122556180 tag:ATOMP_FRAME_DONE channel:0x23 frame:0 vi_tstamp:16122555013 data:0x00000000
     kworker/0:1-808   [000] ....   505.670447: rtcpu_vinotify_event: tstamp:16122556326 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:17705555104 data:0x02020004
     kworker/0:1-808   [000] ....   505.670447: rtcpu_vinotify_event: tstamp:16122556497 tag:FE channel:0x00 frame:0 vi_tstamp:16122555044 data:0x00000020
     kworker/0:1-808   [000] ....   505.670448: rtcpu_vinotify_event: tstamp:16122556645 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:16122555044 data:0x00000000
     kworker/0:1-808   [000] ....   505.670448: rtcpu_vinotify_event: tstamp:16122556816 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:17705556992 data:0x07020005
     kworker/0:1-808   [000] ....   505.670449: rtcpu_vinotify_event: tstamp:16122556963 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:17705563712 data:0x10000000
     kworker/0:1-808   [000] ....   505.670450: rtcpu_vinotify_event: tstamp:16122848761 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:17705574944 data:0x31000006
     kworker/0:1-808   [000] ....   505.726413: rtos_queue_send_from_isr_failed: tstamp:16123538261 queue:0x0bcb41f8
     kworker/0:1-808   [000] ....   505.726416: rtos_queue_send_from_isr_failed: tstamp:16123538423 queue:0x0bcb8a60
     kworker/0:1-808   [000] ....   505.726417: rtos_queue_send_from_isr_failed: tstamp:16123538585 queue:0x0bcba5e0
     kworker/0:1-808   [000] ....   505.726418: rtos_queue_send_from_isr_failed: tstamp:16123538741 queue:0x0bcbb3a0
     kworker/0:1-808   [000] ....   505.726419: rtos_queue_send_from_isr_failed: tstamp:16123538900 queue:0x0bcbc160
     kworker/0:1-808   [000] ....   505.726421: rtcpu_vinotify_event: tstamp:16123787842 tag:FS channel:0x00 frame:0 vi_tstamp:16123524774 data:0x00000010
     kworker/0:1-808   [000] ....   505.726423: rtcpu_vinotify_event: tstamp:16123788018 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:16123524775 data:0x00000000
     kworker/0:1-808   [000] ....   505.726423: rtcpu_vinotify_event: tstamp:16123788170 tag:CHANSEL_PXL_SOF channel:0x23 frame:0 vi_tstamp:16123526972 data:0x00000001
     kworker/0:1-808   [000] ....   505.726424: rtcpu_vinotify_event: tstamp:16123788345 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:17736657312 data:0x08020005
     kworker/0:1-808   [000] ....   505.726425: rtcpu_vinotify_event: tstamp:16123788493 tag:CHANSEL_FAULT channel:0x23 frame:0 vi_tstamp:16123527129 data:0x00000200
     kworker/0:1-808   [000] ....   505.726426: rtcpu_vinotify_event: tstamp:16123788669 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:17736662816 data:0x01020005
     kworker/0:1-808   [000] ....   505.726426: rtcpu_vinotify_event: tstamp:16123805898 tag:CHANSEL_FAULT channel:0x23 frame:0 vi_tstamp:16123804984 data:0x007f0202
     kworker/0:1-808   [000] ....   505.726427: rtcpu_vinotify_event: tstamp:16123806072 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:17745554080 data:0x01020005
     kworker/0:1-808   [000] ....   505.726427: rtcpu_vinotify_event: tstamp:16123806217 tag:ATOMP_FRAME_DONE channel:0x23 frame:0 vi_tstamp:16123805000 data:0x00000000
     kworker/0:1-808   [000] ....   505.726428: rtcpu_vinotify_event: tstamp:16123806387 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:17745554656 data:0x02020005
     kworker/0:1-808   [000] ....   505.726429: rtcpu_vinotify_event: tstamp:16123806535 tag:FE channel:0x00 frame:0 vi_tstamp:16123805030 data:0x00000020
     kworker/0:1-808   [000] ....   505.726430: rtcpu_vinotify_event: tstamp:16123806704 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:16123805030 data:0x00000000
     kworker/0:1-808   [000] ....   505.726430: rtcpu_vinotify_event: tstamp:16123806851 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:17745556576 data:0x07020006
     kworker/0:1-808   [000] ....   505.726431: rtcpu_vinotify_event: tstamp:16123807023 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:17745561472 data:0x10000000
     kworker/0:1-808   [000] ....   505.726431: rtcpu_vinotify_event: tstamp:16123807169 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:17745565376 data:0x31000007
     kworker/0:1-808   [000] ....   505.782414: rtcpu_vinotify_event: tstamp:16124789372 tag:FS channel:0x00 frame:0 vi_tstamp:16124774761 data:0x00000010
     kworker/0:1-808   [000] ....   505.782416: rtcpu_vinotify_event: tstamp:16124789542 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:16124774761 data:0x00000000
     kworker/0:1-808   [000] ....   505.782417: rtos_queue_send_from_isr_failed: tstamp:16124789717 queue:0x0bcb41f8
     kworker/0:1-808   [000] ....   505.782420: rtos_queue_send_from_isr_failed: tstamp:16124789886 queue:0x0bcb8a60
     kworker/0:1-808   [000] ....   505.782422: rtos_queue_send_from_isr_failed: tstamp:16124790054 queue:0x0bcba5e0
     kworker/0:1-808   [000] ....   505.782423: rtos_queue_send_from_isr_failed: tstamp:16124790216 queue:0x0bcbb3a0
     kworker/0:1-808   [000] ....   505.782424: rtos_queue_send_from_isr_failed: tstamp:16124790378 queue:0x0bcbc160
     kworker/0:1-808   [000] ....   505.782425: rtcpu_vinotify_event: tstamp:16124790609 tag:CHANSEL_PXL_SOF channel:0x23 frame:0 vi_tstamp:16124776959 data:0x00000001
     kworker/0:1-808   [000] ....   505.782426: rtcpu_vinotify_event: tstamp:16124790760 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:17776656864 data:0x08020006
     kworker/0:1-808   [000] ....   505.782426: rtcpu_vinotify_event: tstamp:16124790935 tag:CHANSEL_FAULT channel:0x23 frame:0 vi_tstamp:16124777116 data:0x00000200
     kworker/0:1-808   [000] ....   505.782427: rtcpu_vinotify_event: tstamp:16124791085 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:17776662368 data:0x01020006
     kworker/0:1-808   [000] ....   505.782428: rtcpu_vinotify_event: tstamp:16125102428 tag:CHANSEL_FAULT channel:0x23 frame:0 vi_tstamp:16125054970 data:0x007f0202
     kworker/0:1-808   [000] ....   505.782428: rtcpu_vinotify_event: tstamp:16125102581 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:17785553632 data:0x01020006
     kworker/0:1-808   [000] ....   505.782429: rtcpu_vinotify_event: tstamp:16125102755 tag:ATOMP_FRAME_DONE channel:0x23 frame:0 vi_tstamp:16125054986 data:0x00000000
     kworker/0:1-808   [000] ....   505.782430: rtcpu_vinotify_event: tstamp:16125102904 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:17785554208 data:0x02020006
     kworker/0:1-808   [000] ....   505.782430: rtcpu_vinotify_event: tstamp:16125103075 tag:FE channel:0x00 frame:0 vi_tstamp:16125055016 data:0x00000020
     kworker/0:1-808   [000] ....   505.782431: rtcpu_vinotify_event: tstamp:16125103227 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:16125055017 data:0x00000000
     kworker/0:1-808   [000] ....   505.782431: rtcpu_vinotify_event: tstamp:16125103400 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:17785556128 data:0x07020007
     kworker/0:1-808   [000] ....   505.782432: rtcpu_vinotify_event: tstamp:16125103546 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:17785560896 data:0x10000000
     kworker/0:1-808   [000] ....   505.782433: rtcpu_vinotify_event: tstamp:16125103716 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:17785564768 data:0x31000008
     kworker/0:1-808   [000] ....   505.782433: rtcpu_vinotify_event: tstamp:16126025290 tag:FS channel:0x00 frame:0 vi_tstamp:16126024747 data:0x00000010
     kworker/0:1-808   [000] ....   505.782435: rtos_queue_send_from_isr_failed: tstamp:16126038201 queue:0x0bcb41f8
     kworker/0:1-808   [000] ....   505.782436: rtos_queue_send_from_isr_failed: tstamp:16126038366 queue:0x0bcb8a60
     kworker/0:1-808   [000] ....   505.782437: rtos_queue_send_from_isr_failed: tstamp:16126038550 queue:0x0bcba5e0
     kworker/0:1-808   [000] ....   505.782438: rtos_queue_send_from_isr_failed: tstamp:16126038707 queue:0x0bcbb3a0
     kworker/0:1-808   [000] ....   505.782439: rtos_queue_send_from_isr_failed: tstamp:16126038863 queue:0x0bcbc160
     kworker/0:1-808   [000] ....   505.782440: rtcpu_vinotify_event: tstamp:16126323101 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:16126024747 data:0x00000000
     kworker/0:1-808   [000] ....   505.782441: rtcpu_vinotify_event: tstamp:16126323254 tag:CHANSEL_PXL_SOF channel:0x23 frame:0 vi_tstamp:16126026950 data:0x00000001
     kworker/0:1-808   [000] ....   505.782441: rtcpu_vinotify_event: tstamp:16126323432 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:17816656608 data:0x08020007
     kworker/0:1-808   [000] ....   505.782442: rtcpu_vinotify_event: tstamp:16126323579 tag:CHANSEL_FAULT channel:0x23 frame:0 vi_tstamp:16126027107 data:0x00000200
     kworker/0:1-808   [000] ....   505.782442: rtcpu_vinotify_event: tstamp:16126323752 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:17816662048 data:0x01020007
     kworker/0:1-808   [000] ....   505.782443: rtcpu_vinotify_event: tstamp:16126323896 tag:CHANSEL_FAULT channel:0x23 frame:0 vi_tstamp:16126304957 data:0x007f0202
     kworker/0:1-808   [000] ....   505.782444: rtcpu_vinotify_event: tstamp:16126324066 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:17825553216 data:0x01020007
     kworker/0:1-808   [000] ....   505.782444: rtcpu_vinotify_event: tstamp:16126324211 tag:ATOMP_FRAME_DONE channel:0x23 frame:0 vi_tstamp:16126304973 data:0x00000000
     kworker/0:1-808   [000] ....   505.782445: rtcpu_vinotify_event: tstamp:16126324382 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:17825553792 data:0x02020007
     kworker/0:1-808   [000] ....   505.782445: rtcpu_vinotify_event: tstamp:16126324532 tag:FE channel:0x00 frame:0 vi_tstamp:16126305003 data:0x00000020
     kworker/0:1-808   [000] ....   505.782446: rtcpu_vinotify_event: tstamp:16126324704 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:16126305003 data:0x00000000
     kworker/0:1-808   [000] ....   505.782446: rtcpu_vinotify_event: tstamp:16126324849 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:17825555680 data:0x07020008
     kworker/0:1-808   [000] ....   505.782447: rtcpu_vinotify_event: tstamp:16126325019 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:17825561664 data:0x10000000
     kworker/0:1-808   [000] ....   505.782448: rtcpu_vinotify_event: tstamp:16126325164 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:17825565568 data:0x31000009
     kworker/0:1-808   [000] ....   505.838398: rtcpu_vinotify_event: tstamp:16127275277 tag:FS channel:0x00 frame:0 vi_tstamp:16127274734 data:0x00000010
     kworker/0:1-808   [000] ....   505.838400: rtcpu_vinotify_event: tstamp:16127275430 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:16127274734 data:0x00000000
     kworker/0:1-808   [000] ....   505.838408: rtos_queue_peek_from_isr_failed: tstamp:16127279504 queue:0x0bcbcf78
     kworker/0:1-808   [000] ....   505.838411: rtos_queue_send_from_isr_failed: tstamp:16127289565 queue:0x0bcb41f8
     kworker/0:1-808   [000] ....   505.838413: rtos_queue_send_from_isr_failed: tstamp:16127289726 queue:0x0bcb8a60
     kworker/0:1-808   [000] ....   505.838414: rtos_queue_send_from_isr_failed: tstamp:16127289888 queue:0x0bcba5e0
     kworker/0:1-808   [000] ....   505.838415: rtos_queue_send_from_isr_failed: tstamp:16127290045 queue:0x0bcbb3a0
     kworker/0:1-808   [000] ....   505.838416: rtos_queue_send_from_isr_failed: tstamp:16127290201 queue:0x0bcbc160

Is there any indication for the reason from the trace ?

Regards,
Ron

[ShaneCCC]

The log show PIXEL_SHORT_LINE that could be the output line doesn’t as expect.

     kworker/0:1-808   [000] ....   505.782442: rtcpu_vinotify_event: tstamp:16126323579 tag:CHANSEL_FAULT channel:0x23 frame:0 vi_tstamp:16126027107 data:0x00000200

[ron.persky]

Thanks Shane,

I have now succeeded receiving full frame via v4l2src.
But I can’t seem to receive it via GStreamer.

The raw sensor format is:

v4l2-ctl --list-formats-ext

ioctl: VIDIOC_ENUM_FMT
        Index       : 0
        Type        : Video Capture
        Pixel Format: 'RG12'
        Name        : 12-bit Bayer RGRG/GBGB
                Size: Discrete 2048x128
                        Interval: Discrete 0.040s (25.000 fps)

Received full frame via v4l2src:

v4l2-ctl -d /dev/video0 --set-ctrl bypass_mode=0 --stream-mmap --stream-count=1 --

stream-to=test.raw --verbose
VIDIOC_QUERYCAP: ok
VIDIOC_S_EXT_CTRLS: ok
VIDIOC_REQBUFS: ok
VIDIOC_QUERYBUF: ok
VIDIOC_QBUF: ok
VIDIOC_QUERYBUF: ok
VIDIOC_QBUF: ok
VIDIOC_QUERYBUF: ok
VIDIOC_QBUF: ok
VIDIOC_QUERYBUF: ok
VIDIOC_QBUF: ok
VIDIOC_STREAMON: ok
        Index    : 0
        Type     : Video Capture
        Flags    : mapped
        Field    : None
        Sequence : 0
        Length   : 524288
        Bytesused: 524288
        Timestamp: 1613.689053s (Monotonic, End-of-Frame)
 
        VIDIOC_STREAMOFF: ok

But when I try to run v4l2 via GStreamer, I get the following:

gst-launch-1.0 v4l2src device=/dev/video0 ! appsink

Setting pipeline to PAUSED ...
Pipeline is live and does not need PREROLL ...
ERROR: from element /GstPipeline:pipeline0/GstV4l2Src:v4l2src0: Internal data stream error.
Additional debug info:
gstbasesrc.c(3055): gst_base_src_loop (): /GstPipeline:pipeline0/GstV4l2Src:v4l2src0:
streaming stopped, reason not-negotiated (-4)
ERROR: pipeline doesn't want to preroll.
Setting pipeline to PAUSED ...
Setting pipeline to READY ...
Setting pipeline to NULL ...
Freeing pipeline ...

Because of the “not-negotiated” error, I tried to specify the format.

gst-launch-1.0 v4l2src device=/dev/video0 ! 'video/x-raw, width=2048, height=128, format='RG12', framerate=25/1' ! appsink

WARNING: erroneous pipeline: could not link v4l2src0 to appsink0, v4l2src0 can't handle caps video/x-raw, width=(int)2048, height=(int)128, format=(string)RG12, framerate=(fraction)25/1

So my question is, how do I get the raw CSI stream go through GStreamer.

My main purpose is to receive the raw CSI frame via CV2 VideoCapture and process it myself.

Thanks,
Ron

[ShaneCCC]

Using nvarguscamerasrc or nvgstcapture-1.0 to verify the Bayer sensor.

[ron.persky]

Both nvarguscamerasrc and nvgstcapture-1.0 gives me “No camera available” error.
But v4l2src still working.

gst-launch-1.0 nvarguscamerasrc sensor_id=0 ! nvoverlaysink

Setting pipeline to PAUSED ...
Pipeline is live and does not need PREROLL ...
Setting pipeline to PLAYING ...
New clock: GstSystemClock
Error generated. /dvs/git/dirty/git-master_linux/multimedia/nvgstreamer/gst-nvarguscamera/gstnvarguscamerasrc.cpp, execute:557 No cameras available
Got EOS from element "pipeline0".
Execution ended after 0:00:00.124455257
Setting pipeline to PAUSED ...
Setting pipeline to READY ...
Setting pipeline to NULL ...

nvgstcapture-1.0

Encoder null, cannot set bitrate!
Encoder Profile = High
Supported resolutions in case of ARGUS Camera
  (2) : 640x480
  (3) : 1280x720
  (4) : 1920x1080
  (5) : 2104x1560
  (6) : 2592x1944
  (7) : 2616x1472
  (8) : 3840x2160
  (9) : 3896x2192
  (10): 4208x3120
  (11): 5632x3168
  (12): 5632x4224

Runtime ARGUS Camera Commands:

  Help : 'h'
  Quit : 'q'
  Set Capture Mode:
      mo:<val>
          (1): image
          (2): video
  Get Capture Mode:
      gmo
  Set sensor orientation:
      so:<val>
          (0): none
          (1): Rotate counter-clockwise 90 degrees
          (2): Rotate 180 degrees
          (3): Rotate clockwise 90 degrees
  Get sensor orientation:
      gso
  Set sensor mode:
      smo:<val> e.g., smo:1
  Get sensor mode:
      gsmo
  Set Whitebalance Mode:
      wb:<val>
          (0): off
          (1): auto
          (2): incandescent
          (3): fluorescent
          (4): warm-fluorescent
          (5): daylight
          (6): cloudy-daylight
          (7): twilight
          (8): shade
          (9): manual
  Get Whitebalance Mode:
      gwb
  Set Saturation (0 to 2):
      st:<val> e.g., st:1.25
  Get Saturation:
      gst
  Set Exposure Compensation (-2 to 2):
      ec:<val> e.g., ec:-2
  Get Exposure Compensation:
      gec
  Set Auto Whitebalance Lock:
      awbl:<val> e.g., awbl:0
  Get Auto Whitebalance Lock:
      awbl
  Set Auto Exposure Lock:
      ael:<val> e.g., ael:0
  Get Auto Exposure Lock:
      gael
  Set TNR Mode:
      tnrm:<val> e.g., tnrm:1
          (0): OFF
          (1): FAST
          (2): HIGH QUALITY
  Get TNR Mode:
      gtnrm
  Set TNR Strength (-1 to 1):
      tnrs:<val> e.g., tnrs:0.5
  Get TNR Strength:
      gtnrs
  Set EE Mode:
      eem:<val> e.g., eem:1
          (0): OFF
          (1): FAST
          (2): HIGH QUALITY
  Get EE Mode:
      geem
  Set EE Strength (-1 to 1):
      ees:<val> e.g., ees:0.5
  Get EE Strength:
      gees
  Set Auto Exposure Anti-Banding (0 to 3):
      aeab:<val> e.g., aeab:2
          (0): OFF
          (1): MODE AUTO
          (2): MODE 50HZ
          (3): MODE 60HZ
  Get Auto Exposure Anti-Banding:
      gaeab
  Set Gain Range:
      gr:<val><space><val> e.g., gr:1 16
  Get Gain Range:
      ggr
  Set Exposure Time Range:
      etr:<val><space><val> e.g., etr:34000 35000
  Get Exposure Time Range:
      getr
  Set ISP Digital Gain Range:
      dgr:<val><space><val> e.g., dgr:2 152
  Get ISP Digital Gain Range:
      gdgr
  Capture: enter 'j' OR
           followed by a timer (e.g., jx5000, capture after 5 seconds) OR
           followed by multishot count (e.g., j:6, capture 6 images)
           timer/multihot values are optional, capture defaults to single shot with timer=0s
  Start Recording : enter '1'
  Stop Recording  : enter '0'
  Video snapshot  : enter '2' (While recording video)
  Get Preview Resolution:
      gpcr
  Get Image Capture Resolution:
      gicr
  Get Video Capture Resolution:
      gvcr


Runtime encoder configuration options:

  Set Encoding Bit-rate(in bytes):
      br:<val> e.g., br:4000000
  Get Encoding Bit-rate(in bytes):
      gbr
  Set Encoding Profile(only for H.264):
      ep:<val> e.g., ep:1
          (0): Baseline
          (1): Main
          (2): High
  Get Encoding Profile(only for H.264):
      gep
  Force IDR Frame on video Encoder(only for H.264):
      Enter 'f'


bitrate = 4000000
Encoder Profile = High
Encoder control-rate = 1
Encoder EnableTwopassCBR = 0
Opening in BLOCKING MODE
** Message: 09:14:51.458: <main:4670> iterating capture loop ....
NvMMLiteOpen : Block : BlockType = 4
===== NVMEDIA: NVENC =====
NvMMLiteBlockCreate : Block : BlockType = 4
Error generated. /dvs/git/dirty/git-master_linux/multimedia/nvgstreamer/gst-nvarguscamera/gstnvarguscamerasrc.cpp, execute:557 No cameras available

[ron.persky]

The raw CSI sensor resolution is 2048x128.
Doesn’t seems to be supported by ARGUS

[ShaneCCC]

It’s support.
It could be the device tree context have problem. Have a review the context of tegra_camera_platform{}
Have a confirm the devname is correct.

[ron.persky]

I have reviewed the tegra_camera_platform in the device tree, but nothing seems to be related

num_csi_lanes is 4
max_lane_speed is 600000 (for 600Mbps per lane)
min_bits_per_pixel is 12 for raw12
max_pixel_rate is 200000 (same as in mode0 pix_clk_hz)

tegra-camera-platform {
		compatible = "nvidia, tegra-camera-platform";
		num_csi_lanes = <4>;
		max_lane_speed = <600000>;
		min_bits_per_pixel = <12>;
		vi_peak_byte_per_pixel = <2>;
		vi_bw_margin_pct = <25>;
		max_pixel_rate = <200000>;
		isp_peak_byte_per_pixel = <5>;
		isp_bw_margin_pct = <25>;

		modules {
			module0 {
				badge = "e3326_front_P5V27C";
				position = "rear";
				orientation = "1";
				drivernode0 {
					/* Declare PCL support driver (classically known as guid)  */
					pcl_id = "v4l2_sensor";
					/* Driver v4l2 device name */
					devname = "ov5693 2-0036";
					/* Declare the device-tree hierarchy to driver instance */
					proc-device-tree = "/proc/device-tree/i2c@3180000/ov5693_c@36";
				};
				drivernode1 {
					/* Declare PCL support driver (classically known as guid)  */
					pcl_id = "v4l2_lens";
					proc-device-tree = "/proc/device-tree/e3326_lens_ov5693@P5V27C/";
				};
			};
		};
	};

[ShaneCCC]

From your log the strings of devname should be below.

devname = "ov5693 30-0036";

[ron.persky]

Good catch!

Also, there is i2c switch on the board, so

proc-device-tree = "/proc/device-tree/i2c@3180000/tca9546@70/i2c@0/ov5693_c@36";

nvarguscamerasrc seems to be working now!

However I still can’t see the raw frame on the screen.
After running:

gst-launch-1.0 nvarguscamerasrc sensor_id=0 ! nvoverlaysink

It is halted after

CONSUMER: Producer has connected; continuing.

[ron.persky]

Below are the trace logs for the nvarguscamerasrc

What could be the reason no CSI traffic is received with nvarguscamerasrc , but does received with v4l2src ?

# tracer: nop
#
# entries-in-buffer/entries-written: 354/354   #P:4
#
#                              _-----=> irqs-off
#                             / _----=> need-resched
#                            | / _---=> hardirq/softirq
#                            || / _--=> preempt-depth
#                            ||| /     delay
#           TASK-PID   CPU#  ||||    TIMESTAMP  FUNCTION
#              | |       |   ||||       |         |
     kworker/0:0-4     [000] ....   367.690344: rtos_queue_peek_from_isr_failed: tstamp:11816106884 queue:0x0bcbcf78
     kworker/0:0-4     [000] ....   367.690351: rtcpu_start: tstamp:11816108326
     kworker/0:0-4     [000] ....   367.690353: rtos_queue_send_from_isr_failed: tstamp:11816117990 queue:0x0bcb41f8
     kworker/0:0-4     [000] ....   367.690354: rtos_queue_send_from_isr_failed: tstamp:11816118152 queue:0x0bcb8a60
     kworker/0:0-4     [000] ....   367.690354: rtos_queue_send_from_isr_failed: tstamp:11816118313 queue:0x0bcba5e0
     kworker/0:0-4     [000] ....   367.690355: rtos_queue_send_from_isr_failed: tstamp:11816118474 queue:0x0bcbb3a0
     kworker/0:0-4     [000] ....   367.690355: rtos_queue_send_from_isr_failed: tstamp:11816118630 queue:0x0bcbc160
     kworker/0:0-4     [000] ....   367.690357: rtcpu_string: tstamp:11816119112 id:0x04010000 str:"Configuring ISP GoS.
"
     kworker/0:0-4     [000] ....   367.690387: rtcpu_string: tstamp:11816119304 id:0x04010000 str:"  VM GOS[#0] addr=0xc2100000
"
     kworker/0:0-4     [000] ....   367.690395: rtcpu_string: tstamp:11816119571 id:0x04010000 str:"  VM GOS[#1] addr=0xc2101000
"
     kworker/0:0-4     [000] ....   367.690402: rtcpu_string: tstamp:11816119858 id:0x04010000 str:"  VM GOS[#2] addr=0xc2102000
"
     kworker/0:0-4     [000] ....   367.690411: rtcpu_string: tstamp:11816120104 id:0x04010000 str:"  VM GOS[#3] addr=0xc2103000
"
     kworker/0:0-4     [000] ....   367.690418: rtcpu_string: tstamp:11816120349 id:0x04010000 str:"  VM GOS[#4] addr=0xc2104000
"
     kworker/0:0-4     [000] ....   367.690433: rtcpu_string: tstamp:11816120594 id:0x04010000 str:"  VM GOS[#5] addr=0xc2105000
"
     kworker/0:0-4     [000] ....   367.690442: rtcpu_string: tstamp:11816133715 id:0x04010000 str:"WARNING: t194/isp5.c:901 [config_channel] ""
     kworker/0:0-4     [000] ....   367.690442: rtcpu_string: tstamp:11816134108 id:0x04010000 str:"All error notifications not enabled: correctable"
     kworker/0:0-4     [000] ....   367.690444: rtcpu_string: tstamp:11816134235 id:0x04010000 str:"=0x00 uncorrectable=0x00"
     kworker/0:0-4     [000] ....   367.690445: rtcpu_string: tstamp:11816134441 id:0x04010000 str:""
"
  nvargus-daemon-8669  [003] ....   367.820309: tegra_channel_open: vi-output, ov5693 30-0036
  nvargus-daemon-8669  [003] ....   367.820323: tegra_channel_set_power: ov5693 30-0036 : 0x1
  nvargus-daemon-8669  [003] ....   367.820331: camera_common_s_power: status : 0x1
  nvargus-daemon-8669  [001] ....   367.824820: tegra_channel_set_power: 15a00000.nvcsi--1 : 0x1
  nvargus-daemon-8669  [001] ....   367.824826: csi_s_power: enable : 0x1
  nvargus-daemon-8669  [001] ....   367.825017: tegra_channel_close: vi-output, ov5693 30-0036
  nvargus-daemon-8669  [001] ....   367.825022: tegra_channel_set_power: ov5693 30-0036 : 0x0
  nvargus-daemon-8669  [001] ....   367.825027: camera_common_s_power: status : 0x0
  nvargus-daemon-8669  [001] ....   367.827234: tegra_channel_set_power: 15a00000.nvcsi--1 : 0x0
  nvargus-daemon-8669  [001] ....   367.827236: csi_s_power: enable : 0x0
  nvargus-daemon-8669  [001] ....   367.829771: tegra_channel_open: vi-output, ov5693 30-0036
  nvargus-daemon-8669  [001] ....   367.829777: tegra_channel_set_power: ov5693 30-0036 : 0x1
  nvargus-daemon-8669  [001] ....   367.829781: camera_common_s_power: status : 0x1
  nvargus-daemon-8669  [001] ....   367.834155: tegra_channel_set_power: 15a00000.nvcsi--1 : 0x1
  nvargus-daemon-8669  [001] ....   367.834158: csi_s_power: enable : 0x1
  nvargus-daemon-8669  [001] ....   367.834331: tegra_channel_close: vi-output, ov5693 30-0036
  nvargus-daemon-8669  [001] ....   367.834334: tegra_channel_set_power: ov5693 30-0036 : 0x0
  nvargus-daemon-8669  [001] ....   367.834338: camera_common_s_power: status : 0x0
  nvargus-daemon-8669  [001] ....   367.836538: tegra_channel_set_power: 15a00000.nvcsi--1 : 0x0
  nvargus-daemon-8669  [001] ....   367.836540: csi_s_power: enable : 0x0
  nvargus-daemon-8669  [001] ....   367.852438: tegra_channel_open: vi-output, ov5693 30-0036
  nvargus-daemon-8669  [001] ....   367.852449: tegra_channel_set_power: ov5693 30-0036 : 0x1
  nvargus-daemon-8669  [001] ....   367.852459: camera_common_s_power: status : 0x1
  nvargus-daemon-8669  [001] ....   367.856863: tegra_channel_set_power: 15a00000.nvcsi--1 : 0x1
  nvargus-daemon-8669  [001] ....   367.856867: csi_s_power: enable : 0x1
  nvargus-daemon-8669  [001] ....   367.856894: tegra_channel_close: vi-output, ov5693 30-0036
  nvargus-daemon-8669  [001] ....   367.856897: tegra_channel_set_power: ov5693 30-0036 : 0x0
  nvargus-daemon-8669  [001] ....   367.856899: camera_common_s_power: status : 0x0
     kworker/0:0-4     [000] ....   367.858332: rtos_queue_peek_from_isr_failed: tstamp:11821107268 queue:0x0bcbcf78
  nvargus-daemon-8669  [001] ....   367.859089: tegra_channel_set_power: 15a00000.nvcsi--1 : 0x0
  nvargus-daemon-8669  [001] ....   367.859091: csi_s_power: enable : 0x0
  nvargus-daemon-8669  [001] ....   367.859892: tegra_channel_open: vi-output, ov5693 30-0036
  nvargus-daemon-8669  [001] ....   367.859897: tegra_channel_set_power: ov5693 30-0036 : 0x1
  nvargus-daemon-8669  [001] ....   367.859900: camera_common_s_power: status : 0x1
  nvargus-daemon-8669  [001] ....   367.864232: tegra_channel_set_power: 15a00000.nvcsi--1 : 0x1
  nvargus-daemon-8669  [001] ....   367.864234: csi_s_power: enable : 0x1
  nvargus-daemon-8669  [001] ....   367.864317: tegra_channel_close: vi-output, ov5693 30-0036
  nvargus-daemon-8669  [001] ....   367.864320: tegra_channel_set_power: ov5693 30-0036 : 0x0
  nvargus-daemon-8669  [001] ....   367.864323: camera_common_s_power: status : 0x0
  nvargus-daemon-8669  [001] ....   367.867162: tegra_channel_set_power: 15a00000.nvcsi--1 : 0x0
  nvargus-daemon-8669  [001] ....   367.867164: csi_s_power: enable : 0x0
  nvargus-daemon-8669  [001] ....   367.868001: tegra_channel_open: vi-output, ov5693 30-0036
  nvargus-daemon-8669  [001] ....   367.868007: tegra_channel_set_power: ov5693 30-0036 : 0x1
  nvargus-daemon-8669  [001] ....   367.868011: camera_common_s_power: status : 0x1
  nvargus-daemon-8669  [001] ....   367.872586: tegra_channel_set_power: 15a00000.nvcsi--1 : 0x1
  nvargus-daemon-8669  [001] ....   367.872588: csi_s_power: enable : 0x1
  nvargus-daemon-8669  [001] ....   367.872660: tegra_channel_close: vi-output, ov5693 30-0036
  nvargus-daemon-8669  [001] ....   367.872663: tegra_channel_set_power: ov5693 30-0036 : 0x0
  nvargus-daemon-8669  [001] ....   367.872664: camera_common_s_power: status : 0x0
  nvargus-daemon-8669  [001] ....   367.874844: tegra_channel_set_power: 15a00000.nvcsi--1 : 0x0
  nvargus-daemon-8669  [001] ....   367.874846: csi_s_power: enable : 0x0
     kworker/0:0-4     [000] ....   367.970344: rtos_queue_send_from_isr_failed: tstamp:11823417106 queue:0x0bcb41f8
     kworker/0:0-4     [000] ....   367.970349: rtos_queue_send_from_isr_failed: tstamp:11823417272 queue:0x0bcb8a60
     kworker/0:0-4     [000] ....   367.970349: rtos_queue_send_from_isr_failed: tstamp:11823417434 queue:0x0bcba5e0
     kworker/0:0-4     [000] ....   367.970350: rtos_queue_send_from_isr_failed: tstamp:11823417591 queue:0x0bcbb3a0
     kworker/0:0-4     [000] ....   367.970351: rtos_queue_send_from_isr_failed: tstamp:11823417747 queue:0x0bcbc160
     kworker/0:0-4     [000] ....   367.970353: rtcpu_string: tstamp:11823418272 id:0x04010000 str:"Configuring VI GoS.
"
     kworker/0:0-4     [000] ....   367.970406: rtcpu_string: tstamp:11823418462 id:0x04010000 str:"VM GOS[#0] addr=0xc2100000
"
     kworker/0:0-4     [000] ....   367.970414: rtcpu_string: tstamp:11823418726 id:0x04010000 str:"VM GOS[#1] addr=0xc2101000
"
     kworker/0:0-4     [000] ....   367.970424: rtcpu_string: tstamp:11823419006 id:0x04010000 str:"VM GOS[#2] addr=0xc2102000
"
     kworker/0:0-4     [000] ....   367.970431: rtcpu_string: tstamp:11823419249 id:0x04010000 str:"VM GOS[#3] addr=0xc2103000
"
     kworker/0:0-4     [000] ....   367.970438: rtcpu_string: tstamp:11823419493 id:0x04010000 str:"VM GOS[#4] addr=0xc2104000
"
     kworker/0:0-4     [000] ....   367.970445: rtcpu_string: tstamp:11823419737 id:0x04010000 str:"VM GOS[#5] addr=0xc2105000
"
     kworker/0:0-4     [000] ....   367.970452: rtcpu_string: tstamp:11823427365 id:0x04010000 str:"vi5_hwinit: firmware CL2018101701 protocol versi"
     kworker/0:0-4     [000] ....   367.970454: rtcpu_string: tstamp:11823427495 id:0x04010000 str:"on 2.2
"
     kworker/0:0-4     [000] ....   367.970461: rtos_queue_send_from_isr_failed: tstamp:11823439179 queue:0x0bcb41f8
     kworker/0:0-4     [000] ....   367.970462: rtos_queue_send_from_isr_failed: tstamp:11823439343 queue:0x0bcb8a60
     kworker/0:0-4     [000] ....   367.970462: rtos_queue_send_from_isr_failed: tstamp:11823439507 queue:0x0bcba5e0
     kworker/0:0-4     [000] ....   367.970463: rtos_queue_send_from_isr_failed: tstamp:11823439666 queue:0x0bcbb3a0
     kworker/0:0-4     [000] ....   367.970463: rtos_queue_send_from_isr_failed: tstamp:11823439823 queue:0x0bcbc160
     kworker/0:0-4     [000] ....   368.026337: rtos_queue_peek_from_isr_failed: tstamp:11826107268 queue:0x0bcbcf78
 CaptureSchedule-8689  [001] ....   368.135005: tegra_channel_open: vi-output, ov5693 30-0036
 CaptureSchedule-8689  [001] ....   368.135020: tegra_channel_set_power: ov5693 30-0036 : 0x1
 CaptureSchedule-8689  [001] ....   368.135030: camera_common_s_power: status : 0x1
     kworker/0:0-4     [000] ....   368.138332: rtos_queue_send_from_isr_failed: tstamp:11830028108 queue:0x0bcb41f8
     kworker/0:0-4     [000] ....   368.138336: rtos_queue_send_from_isr_failed: tstamp:11830028268 queue:0x0bcb8a60
     kworker/0:0-4     [000] ....   368.138336: rtos_queue_send_from_isr_failed: tstamp:11830028430 queue:0x0bcba5e0
     kworker/0:0-4     [000] ....   368.138337: rtos_queue_send_from_isr_failed: tstamp:11830028589 queue:0x0bcbb3a0
     kworker/0:0-4     [000] ....   368.138338: rtos_queue_send_from_isr_failed: tstamp:11830028746 queue:0x0bcbc160
     kworker/0:0-4     [000] ....   368.138338: rtos_queue_send_from_isr_failed: tstamp:11830028960 queue:0x0bcb4190
     kworker/0:0-4     [000] ....   368.138339: rtos_queue_send_from_isr_failed: tstamp:11830029107 queue:0x0bcb41f8
     kworker/0:0-4     [000] ....   368.138339: rtos_queue_send_from_isr_failed: tstamp:11830029252 queue:0x0bcb89f8
     kworker/0:0-4     [000] ....   368.138340: rtos_queue_send_from_isr_failed: tstamp:11830029418 queue:0x0bcb8a60
     kworker/0:0-4     [000] ....   368.138340: rtos_queue_send_from_isr_failed: tstamp:11830029565 queue:0x0bcba578

[ron.persky]

When running the command

gst-launch-1.0 -v v4l2src device="/dev/video0" ! 'video/x-raw, width=2048, height=128, format=RG12, framerate=25/1' ! nvoverlaysink

I get the following error

WARNING: erroneous pipeline: could not link v4l2src0 to nvoverlaysink-nvoverlaysink0, v4l2src0 can't handle caps video/x-raw, width=(int)2048, height=(int)128, format=(string)RG12, framerate=(fraction)25/1

Why would it say so ? If this is the supported format in the driver ?

v4l2-ctl --list-formats-ext

ioctl: VIDIOC_ENUM_FMT
        Index       : 0
        Type        : Video Capture
        Pixel Format: 'RG12'
        Name        : 12-bit Bayer RGRG/GBGB
                Size: Discrete 2048x128
                        Interval: Discrete 0.040s (25.000 fps)

[ShaneCCC]

It’s because any of display sink didn’t support RAW data. You may need bayer2rgb element to handle it.

GitHub - jdthomas/bayer2rgb: Command line utility to convert bayer grid data...

RAW Image Compression | Color Space Conversion | RidgeRun

[ron.persky]

Thanks Shane,

But this is not camera image CSI frame, so I can’t convert it to any other format.
This is automotive radar ADC samples passed over CSI.

When saving to file with v4l2-ctl, and then opening the file with Python openCV, I can see the data is correct and valid.

Is there any solution to read the data frame-by-frame from openCV with nvarguscamerasrc or v4l2-ctl ?

Thanks,
Ron

[ShaneCCC]

So it’s not Bayer format output?
Then nvarguscamerasrc should have problem to support it.
You may need implement v4l2 base API for it.

[ron.persky]

@ShaneCCC

You may need implement v4l2 base API for it.

What do you mean by this ?

I am now working with v4l2-ctl and streaming each frame via UDP, but after a few seconds of running, there is VIDIOC_REQBUFS error (probably due to the fact that it is not optimized to the system like the nvarguscamerasrc.

[ShaneCCC]

Do you mean can’t capture continuously?
Can below command running a while?

v4l2-ctl --stream-mmap -c bypass_mode=0

[ron.persky]

Hi Shane,

I was working frame-by-frame, so I called each time v4l2-ctl with stream-count=1, process the frame, and called v4l2-ctl again.

I moved into continuous mode and everything works now!

Thanks,
Ron

[ShaneCCC]

Great to hear that.
BTW current camera driver only support streaming mode.