V4l2-ctl raw reading works in JP4.5 but doesn't work in JP 4.6

Robotics & Edge Computing Jetson & Embedded Systems Jetson TX2
1

Hi.
I’m using TX2NX with JP 4.6.3. I created a camera driver (IMX585) which is working fine in JP 4.5.2, I can read RAW image by command v4l2-ctl --set-fmt-video=width=3856,height=2180,pixelformat=RG12 --stream-mmap --set-ctrl=sensor_mode=0,bypass_mode=0,frame_rate=15000000,exposure=30000,gain=0,hdr_enable=0 --stream-count=1 --stream-skip=10 -d /dev/video0 --verbose flawlessly as well as using argus_camera app without problem.

But on JP 4.6.3, argus_camera app works and give the same output as JP 4.5, but v4l2-ctl raw reading (using command above) doesn’t work.

The v4l2-ctl hangs after STREAMON, dmesg message and trace as below:
v4l2-ctl

v4l2-ctl_hangs
v4l2-ctl_hangs663×513 218 KB

dmesg

[  139.976798] tegra-vi4 15700000.vi: PXL_SOF syncpt timeout! err = -11
[  139.983327] tegra-vi4 15700000.vi: tegra_channel_error_recovery: attempting to reset the capture channel
[  140.312795] tegra-vi4 15700000.vi: PXL_SOF syncpt timeout! err = -11
[  140.319512] tegra-vi4 15700000.vi: tegra_channel_error_recovery: attempting to reset the capture channel
[  140.644818] tegra-vi4 15700000.vi: PXL_SOF syncpt timeout! err = -11
[  140.651283] tegra-vi4 15700000.vi: tegra_channel_error_recovery: attempting to reset the capture channel
...

Trace

# tracer: nop
#
# entries-in-buffer/entries-written: 2810/2810   #P:4
#
#                              _-----=> irqs-off
#                             / _----=> need-resched
#                            | / _---=> hardirq/softirq
#                            || / _--=> preempt-depth
#                            ||| /     delay
#           TASK-PID   CPU#  ||||    TIMESTAMP  FUNCTION
#              | |       |   ||||       |         |
     kworker/4:1-5175  [004] .... 11508.920760: rtos_queue_peek_from_isr_failed: tstamp:359789624279 queue:0x0b4b4940
     kworker/4:1-5175  [004] .... 11509.088745: rtos_queue_peek_from_isr_failed: tstamp:359794624271 queue:0x0b4b4940
     kworker/4:1-5175  [004] .... 11509.256747: rtos_queue_peek_from_isr_failed: tstamp:359799624265 queue:0x0b4b4940
     kworker/4:1-5175  [004] .... 11509.424813: rtos_queue_peek_from_isr_failed: tstamp:359804624257 queue:0x0b4b4940
     kworker/4:1-5175  [004] .... 11509.592748: rtos_queue_peek_from_isr_failed: tstamp:359809624251 queue:0x0b4b4940
     kworker/4:1-5175  [004] .... 11509.704746: rtos_queue_peek_from_isr_failed: tstamp:359814624245 queue:0x0b4b4940
     kworker/4:1-5175  [004] .... 11509.872755: rtos_queue_peek_from_isr_failed: tstamp:359819624239 queue:0x0b4b4940
     kworker/4:1-5175  [004] .... 11510.040754: rtos_queue_peek_from_isr_failed: tstamp:359824624231 queue:0x0b4b4940
     kworker/4:1-5175  [004] .... 11510.208747: rtos_queue_peek_from_isr_failed: tstamp:359829624223 queue:0x0b4b4940
     kworker/4:1-5175  [004] .... 11510.376761: rtos_queue_peek_from_isr_failed: tstamp:359834624216 queue:0x0b4b4940
     kworker/4:1-5175  [004] .... 11510.544766: rtos_queue_peek_from_isr_failed: tstamp:359839624210 queue:0x0b4b4940
     kworker/4:1-5175  [004] .... 11510.712760: rtos_queue_peek_from_isr_failed: tstamp:359844624204 queue:0x0b4b4940
     kworker/4:1-5175  [004] .... 11510.824771: rtos_queue_peek_from_isr_failed: tstamp:359849624207 queue:0x0b4b4940
     kworker/4:1-5175  [004] .... 11510.992735: rtos_queue_peek_from_isr_failed: tstamp:359854624187 queue:0x0b4b4940
     kworker/4:1-5175  [004] .... 11511.160775: rtos_queue_peek_from_isr_failed: tstamp:359859624181 queue:0x0b4b4940
     kworker/4:1-5175  [004] .... 11511.328762: rtos_queue_peek_from_isr_failed: tstamp:359864624175 queue:0x0b4b4940
     kworker/4:1-5175  [004] .... 11511.496749: rtos_queue_peek_from_isr_failed: tstamp:359869624169 queue:0x0b4b4940
     kworker/4:1-5175  [004] .... 11511.664763: rtos_queue_peek_from_isr_failed: tstamp:359874624163 queue:0x0b4b4940
     kworker/4:1-5175  [004] .... 11511.832777: rtos_queue_peek_from_isr_failed: tstamp:359879624157 queue:0x0b4b4940
     kworker/4:1-5175  [004] .... 11511.944750: rtos_queue_peek_from_isr_failed: tstamp:359884624149 queue:0x0b4b4940
     kworker/4:1-5175  [004] .... 11512.112770: rtos_queue_peek_from_isr_failed: tstamp:359889624141 queue:0x0b4b4940
     kworker/4:1-5175  [004] .... 11512.280753: rtos_queue_peek_from_isr_failed: tstamp:359894624135 queue:0x0b4b4940
     kworker/4:1-5175  [004] .... 11512.448773: rtos_queue_peek_from_isr_failed: tstamp:359899624128 queue:0x0b4b4940
     kworker/4:1-5175  [004] .... 11512.616752: rtos_queue_peek_from_isr_failed: tstamp:359904624122 queue:0x0b4b4940
     kworker/4:1-5175  [004] .... 11512.784820: rtos_queue_peek_from_isr_failed: tstamp:359909624116 queue:0x0b4b4940
     kworker/4:1-5175  [004] .... 11512.952726: rtos_queue_peek_from_isr_failed: tstamp:359914624108 queue:0x0b4b4940
     kworker/4:1-5175  [004] .... 11513.064744: rtos_queue_peek_from_isr_failed: tstamp:359919624100 queue:0x0b4b4940
     kworker/4:1-5175  [004] .... 11513.232777: rtos_queue_peek_from_isr_failed: tstamp:359924624094 queue:0x0b4b4940
     kworker/4:1-5175  [004] .... 11513.400746: rtos_queue_peek_from_isr_failed: tstamp:359929624091 queue:0x0b4b4940
     kworker/4:1-5175  [004] .... 11513.568747: rtos_queue_peek_from_isr_failed: tstamp:359934624082 queue:0x0b4b4940
     kworker/4:1-5175  [004] .... 11513.743916: rtos_queue_peek_from_isr_failed: tstamp:359939624074 queue:0x0b4b4940
     kworker/4:1-5175  [004] .... 11513.908751: rtos_queue_peek_from_isr_failed: tstamp:359944624068 queue:0x0b4b4940
     kworker/4:1-5175  [004] .... 11513.964704: rtos_queue_peek_from_isr_failed: tstamp:359947020926 queue:0x0b4b4940
        v4l2-ctl-5289  [000] .... 11533.569296: tegra_channel_open: vi-output, imx585 9-001a
        v4l2-ctl-5289  [000] .... 11533.588746: tegra_channel_set_power: imx585 9-001a : 0x1
        v4l2-ctl-5289  [000] .... 11533.588759: camera_common_s_power: status : 0x1
        v4l2-ctl-5289  [000] .... 11533.889261: tegra_channel_set_power: 150c0000.nvcsi--2 : 0x1
        v4l2-ctl-5289  [000] .... 11533.889271: csi_s_power: enable : 0x1
        v4l2-ctl-5289  [000] .... 11533.892985: tegra_channel_capture_setup: vnc_id 0 W 3856 H 2180 fmt 20
 vi-output, imx5-5290  [005] .... 11533.893235: tegra_channel_set_stream: enable : 0x1
 vi-output, imx5-5290  [000] .... 11533.894669: tegra_channel_set_stream: 150c0000.nvcsi--2 : 0x1
 vi-output, imx5-5290  [000] .... 11533.894673: csi_s_stream: enable : 0x1
 vi-output, imx5-5290  [000] .... 11533.894713: tegra_channel_set_stream: imx585 9-001a : 0x1
     kworker/4:1-5175  [004] .... 11533.920699: rtos_queue_peek_from_isr_failed: tstamp:360570492669 queue:0x0b4b4940
     kworker/4:1-5175  [004] .... 11533.920701: rtcpu_start: tstamp:360570495668
     kworker/4:1-5175  [004] .... 11533.920703: rtos_queue_send_from_isr_failed: tstamp:360570508531 queue:0x0b4a7698
     kworker/4:1-5175  [004] .... 11533.920704: rtos_queue_send_from_isr_failed: tstamp:360570508639 queue:0x0b4ab1a8
     kworker/4:1-5175  [004] .... 11533.920704: rtos_queue_send_from_isr_failed: tstamp:360570508746 queue:0x0b4acdd8
     kworker/4:1-5175  [004] .... 11533.920705: rtos_queue_send_from_isr_failed: tstamp:360570508855 queue:0x0b4af718
     kworker/4:1-5175  [004] .... 11533.920705: rtos_queue_send_from_isr_failed: tstamp:360570508960 queue:0x0b4b04d8
     kworker/4:1-5175  [004] .... 11533.920706: rtos_queue_send_from_isr_failed: tstamp:360570509069 queue:0x0b4b1298
     kworker/4:1-5175  [004] .... 11533.920707: rtos_queue_send_from_isr_failed: tstamp:360570509174 queue:0x0b4b2058
     kworker/4:1-5175  [004] .... 11533.920708: rtos_queue_send_failed: tstamp:360570509633 queue:0x0b4a7698
     kworker/4:1-5175  [004] .... 11533.920709: rtos_queue_send_from_isr_failed: tstamp:360570518429 queue:0x0b4a7698
     kworker/4:1-5175  [004] .... 11533.920709: rtos_queue_send_from_isr_failed: tstamp:360570518536 queue:0x0b4ab1a8
     kworker/4:1-5175  [004] .... 11533.920710: rtos_queue_send_from_isr_failed: tstamp:360570518641 queue:0x0b4acdd8
     kworker/4:1-5175  [004] .... 11533.920711: rtos_queue_send_from_isr_failed: tstamp:360570518750 queue:0x0b4af718
     kworker/4:1-5175  [004] .... 11533.920711: rtos_queue_send_from_isr_failed: tstamp:360570518859 queue:0x0b4b04d8
     kworker/4:1-5175  [004] .... 11533.920712: rtos_queue_send_from_isr_failed: tstamp:360570518963 queue:0x0b4b1298
     kworker/4:1-5175  [004] .... 11533.920713: rtos_queue_send_from_isr_failed: tstamp:360570519068 queue:0x0b4b2058
     kworker/4:1-5175  [004] .... 11533.920713: rtos_queue_send_failed: tstamp:360570520012 queue:0x0b4a7698
 vi-output, imx5-5290  [003] .... 11534.038798: tegra_channel_capture_frame: sof:11533.917993280
     kworker/4:1-5175  [004] .... 11534.088756: rtcpu_vinotify_event: tstamp:360575074293 tag:ATOMP_FS channel:0x00 frame:1 vi_tstamp:360575073917 data:0x00000000
     kworker/4:1-5175  [004] .... 11534.088762: rtcpu_vinotify_event: tstamp:360575079154 tag:CHANSEL_PXL_SOF channel:0x00 frame:1 vi_tstamp:360575078780 data:0x00000001
     kworker/4:1-5175  [004] .... 11534.088764: rtcpu_vinotify_event: tstamp:360575084380 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:1 vi_tstamp:360575084011 data:0x08000000
     kworker/4:1-5175  [004] .... 11534.088768: rtos_queue_peek_from_isr_failed: tstamp:360575492991 queue:0x0b4b4940
     kworker/4:1-5175  [004] .... 11534.088770: rtcpu_vinotify_event: tstamp:360575584752 tag:CHANSEL_PXL_EOF channel:0x00 frame:1 vi_tstamp:360575583843 data:0x08830002
     kworker/4:1-5175  [004] .... 11534.088772: rtcpu_vinotify_event: tstamp:360575584870 tag:CHANSEL_FAULT channel:0x00 frame:1 vi_tstamp:360575583871 data:0x00010800
     kworker/4:1-5175  [004] .... 11534.088774: rtcpu_vinotify_event: tstamp:360575585066 tag:ATOMP_FE channel:0x00 frame:1 vi_tstamp:360575584088 data:0x00000000
 vi-output, imx5-5290  [000] .... 11534.257563: tegra_channel_capture_setup: vnc_id 0 W 3856 H 2180 fmt 20
 vi-output, imx5-5290  [000] .... 11534.257600: tegra_channel_capture_frame: sof:11533.917993280
     kworker/4:1-5175  [004] .... 11534.260704: rtos_queue_peek_from_isr_failed: tstamp:360580492981 queue:0x0b4b4940
     kworker/4:1-5175  [004] .... 11534.260707: rtos_queue_send_from_isr_failed: tstamp:360581899781 queue:0x0b4a7698
     kworker/4:1-5175  [004] .... 11534.260708: rtos_queue_send_from_isr_failed: tstamp:360581899891 queue:0x0b4ab1a8
     kworker/4:1-5175  [004] .... 11534.260709: rtos_queue_send_from_isr_failed: tstamp:360581900000 queue:0x0b4acdd8
     kworker/4:1-5175  [004] .... 11534.260710: rtos_queue_send_from_isr_failed: tstamp:360581900109 queue:0x0b4af718
     kworker/4:1-5175  [004] .... 11534.260711: rtos_queue_send_from_isr_failed: tstamp:360581900213 queue:0x0b4b04d8
     kworker/4:1-5175  [004] .... 11534.260712: rtos_queue_send_from_isr_failed: tstamp:360581900318 queue:0x0b4b1298
     kworker/4:1-5175  [004] .... 11534.260713: rtos_queue_send_from_isr_failed: tstamp:360581900423 queue:0x0b4b2058
     kworker/4:1-5175  [004] .... 11534.260715: rtos_queue_send_failed: tstamp:360581900971 queue:0x0b4a7698
     kworker/4:1-5175  [004] .... 11534.260716: rtos_queue_send_from_isr_failed: tstamp:360581905925 queue:0x0b4a7698
     kworker/4:1-5175  [004] .... 11534.260717: rtos_queue_send_from_isr_failed: tstamp:360581906031 queue:0x0b4ab1a8
     kworker/4:1-5175  [004] .... 11534.260718: rtos_queue_send_from_isr_failed: tstamp:360581906137 queue:0x0b4acdd8
     kworker/4:1-5175  [004] .... 11534.260719: rtos_queue_send_from_isr_failed: tstamp:360581906245 queue:0x0b4af718
     kworker/4:1-5175  [004] .... 11534.260720: rtos_queue_send_from_isr_failed: tstamp:360581906349 queue:0x0b4b04d8
     kworker/4:1-5175  [004] .... 11534.260721: rtos_queue_send_from_isr_failed: tstamp:360581906453 queue:0x0b4b1298
     kworker/4:1-5175  [004] .... 11534.260722: rtos_queue_send_from_isr_failed: tstamp:360581906556 queue:0x0b4b2058
     kworker/4:1-5175  [004] .... 11534.260723: rtos_queue_send_failed: tstamp:360581906980 queue:0x0b4a7698
     kworker/4:1-5175  [004] .... 11534.260724: rtos_queue_send_from_isr_failed: tstamp:360581912599 queue:0x0b4a7698
     kworker/4:1-5175  [004] .... 11534.260725: rtos_queue_send_from_isr_failed: tstamp:360581912709 queue:0x0b4ab1a8
     kworker/4:1-5175  [004] .... 11534.260726: rtos_queue_send_from_isr_failed: tstamp:360581912814 queue:0x0b4acdd8
     kworker/4:1-5175  [004] .... 11534.260727: rtos_queue_send_from_isr_failed: tstamp:360581912922 queue:0x0b4af718
     kworker/4:1-5175  [004] .... 11534.260728: rtos_queue_send_from_isr_failed: tstamp:360581913024 queue:0x0b4b04d8
     kworker/4:1-5175  [004] .... 11534.260729: rtos_queue_send_from_isr_failed: tstamp:360581913128 queue:0x0b4b1298
     kworker/4:1-5175  [004] .... 11534.260730: rtos_queue_send_from_isr_failed: tstamp:360581913233 queue:0x0b4b2058
     kworker/4:1-5175  [004] .... 11534.260730: rtos_queue_send_failed: tstamp:360581913674 queue:0x0b4a7698
     kworker/4:1-5175  [004] .... 11534.260731: rtos_queue_send_from_isr_failed: tstamp:360581916135 queue:0x0b4a7698
     kworker/4:1-5175  [004] .... 11534.260732: rtos_queue_send_from_isr_failed: tstamp:360581916241 queue:0x0b4ab1a8
     kworker/4:1-5175  [004] .... 11534.260733: rtos_queue_send_from_isr_failed: tstamp:360581916348 queue:0x0b4acdd8
     kworker/4:1-5175  [004] .... 11534.260734: rtos_queue_send_from_isr_failed: tstamp:360581916455 queue:0x0b4af718
     kworker/4:1-5175  [004] .... 11534.260735: rtos_queue_send_from_isr_failed: tstamp:360581916559 queue:0x0b4b04d8
     kworker/4:1-5175  [004] .... 11534.260736: rtos_queue_send_from_isr_failed: tstamp:360581916664 queue:0x0b4b1298
     kworker/4:1-5175  [004] .... 11534.260737: rtos_queue_send_from_isr_failed: tstamp:360581916769 queue:0x0b4b2058
     kworker/4:1-5175  [004] .... 11534.260738: rtos_queue_send_failed: tstamp:360581917683 queue:0x0b4a7698
     kworker/4:1-5175  [004] .... 11534.316753: rtcpu_vinotify_event: tstamp:360583415267 tag:CSIMUX_STREAM channel:0xff frame:0 vi_tstamp:360583414895 data:0x00000001
 vi-output, imx5-5290  [003] .... 11534.372428: tegra_channel_capture_frame: sof:11534.251632608
     kworker/4:1-5175  [004] .... 11534.372756: rtos_queue_peek_from_isr_failed: tstamp:360585492976 queue:0x0b4b4940
     kworker/4:1-5175  [004] .... 11534.372762: rtcpu_vinotify_event: tstamp:360585500518 tag:ATOMP_FS channel:0x00 frame:6 vi_tstamp:360585500143 data:0x00000000
     kworker/4:1-5175  [004] .... 11534.372765: rtcpu_vinotify_event: tstamp:360585505376 tag:CHANSEL_PXL_SOF channel:0x00 frame:6 vi_tstamp:360585505007 data:0x00000001
     kworker/4:1-5175  [004] .... 11534.372767: rtcpu_vinotify_event: tstamp:360585510274 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:6 vi_tstamp:360585509905 data:0x08000000
     kworker/4:1-5175  [004] .... 11534.428750: rtcpu_vinotify_event: tstamp:360586010978 tag:CHANSEL_PXL_EOF channel:0x00 frame:6 vi_tstamp:360586010069 data:0x08830002
     kworker/4:1-5175  [004] .... 11534.428756: rtcpu_vinotify_event: tstamp:360586011100 tag:CHANSEL_FAULT channel:0x00 frame:6 vi_tstamp:360586010098 data:0x00010800
     kworker/4:1-5175  [004] .... 11534.428758: rtcpu_vinotify_event: tstamp:360586011296 tag:ATOMP_FE channel:0x00 frame:6 vi_tstamp:360586010315 data:0x00000000
     kworker/4:1-5175  [004] .... 11534.540758: rtos_queue_peek_from_isr_failed: tstamp:360590492969 queue:0x0b4b4940
 vi-output, imx5-5290  [005] .... 11534.589514: tegra_channel_capture_setup: vnc_id 0 W 3856 H 2180 fmt 20
 vi-output, imx5-5290  [005] .... 11534.589549: tegra_channel_capture_frame: sof:11534.251632608
     kworker/4:1-5175  [004] .... 11534.596698: rtos_queue_send_from_isr_failed: tstamp:360592275016 queue:0x0b4a7698
     kworker/4:1-5175  [004] .... 11534.596701: rtos_queue_send_from_isr_failed: tstamp:360592275128 queue:0x0b4ab1a8
     kworker/4:1-5175  [004] .... 11534.596702: rtos_queue_send_from_isr_failed: tstamp:360592275236 queue:0x0b4acdd8
     kworker/4:1-5175  [004] .... 11534.596703: rtos_queue_send_from_isr_failed: tstamp:360592275343 queue:0x0b4af718
     kworker/4:1-5175  [004] .... 11534.596704: rtos_queue_send_from_isr_failed: tstamp:360592275448 queue:0x0b4b04d8
     kworker/4:1-5175  [004] .... 11534.596705: rtos_queue_send_from_isr_failed: tstamp:360592275553 queue:0x0b4b1298
     kworker/4:1-5175  [004] .... 11534.596706: rtos_queue_send_from_isr_failed: tstamp:360592275657 queue:0x0b4b2058
     kworker/4:1-5175  [004] .... 11534.596708: rtos_queue_send_failed: tstamp:360592276211 queue:0x0b4a7698
     kworker/4:1-5175  [004] .... 11534.596709: rtos_queue_send_from_isr_failed: tstamp:360592280342 queue:0x0b4a7698
     kworker/4:1-5175  [004] .... 11534.596709: rtos_queue_send_from_isr_failed: tstamp:360592280448 queue:0x0b4ab1a8
     kworker/4:1-5175  [004] .... 11534.596710: rtos_queue_send_from_isr_failed: tstamp:360592280556 queue:0x0b4acdd8
     kworker/4:1-5175  [004] .... 11534.596711: rtos_queue_send_from_isr_failed: tstamp:360592280663 queue:0x0b4af718
     kworker/4:1-5175  [004] .... 11534.596712: rtos_queue_send_from_isr_failed: tstamp:360592280767 queue:0x0b4b04d8
     kworker/4:1-5175  [004] .... 11534.596713: rtos_queue_send_from_isr_failed: tstamp:360592280871 queue:0x0b4b1298
     kworker/4:1-5175  [004] .... 11534.596714: rtos_queue_send_from_isr_failed: tstamp:360592280976 queue:0x0b4b2058
     kworker/4:1-5175  [004] .... 11534.596715: rtos_queue_send_failed: tstamp:360592281400 queue:0x0b4a7698
     kworker/4:1-5175  [004] .... 11534.596716: rtos_queue_send_from_isr_failed: tstamp:360592286323 queue:0x0b4a7698
     kworker/4:1-5175  [004] .... 11534.596716: rtos_queue_send_from_isr_failed: tstamp:360592286430 queue:0x0b4ab1a8
     kworker/4:1-5175  [004] .... 11534.596717: rtos_queue_send_from_isr_failed: tstamp:360592286536 queue:0x0b4acdd8
     kworker/4:1-5175  [004] .... 11534.596718: rtos_queue_send_from_isr_failed: tstamp:360592286644 queue:0x0b4af718
     kworker/4:1-5175  [004] .... 11534.596719: rtos_queue_send_from_isr_failed: tstamp:360592286747 queue:0x0b4b04d8
     kworker/4:1-5175  [004] .... 11534.596720: rtos_queue_send_from_isr_failed: tstamp:360592286851 queue:0x0b4b1298
     kworker/4:1-5175  [004] .... 11534.596721: rtos_queue_send_from_isr_failed: tstamp:360592286956 queue:0x0b4b2058
     kworker/4:1-5175  [004] .... 11534.596722: rtos_queue_send_failed: tstamp:360592287387 queue:0x0b4a7698
     kworker/4:1-5175  [004] .... 11534.596723: rtos_queue_send_from_isr_failed: tstamp:360592289691 queue:0x0b4a7698
     kworker/4:1-5175  [004] .... 11534.596723: rtos_queue_send_from_isr_failed: tstamp:360592289797 queue:0x0b4ab1a8
     kworker/4:1-5175  [004] .... 11534.596724: rtos_queue_send_from_isr_failed: tstamp:360592289905 queue:0x0b4acdd8
     kworker/4:1-5175  [004] .... 11534.596725: rtos_queue_send_from_isr_failed: tstamp:360592290014 queue:0x0b4af718
     kworker/4:1-5175  [004] .... 11534.596726: rtos_queue_send_from_isr_failed: tstamp:360592290118 queue:0x0b4b04d8
     kworker/4:1-5175  [004] .... 11534.596728: rtos_queue_send_from_isr_failed: tstamp:360592290222 queue:0x0b4b1298
     kworker/4:1-5175  [004] .... 11534.596729: rtos_queue_send_from_isr_failed: tstamp:360592290328 queue:0x0b4b2058
     kworker/4:1-5175  [004] .... 11534.596730: rtos_queue_send_failed: tstamp:360592291246 queue:0x0b4a7698
     kworker/4:1-5175  [004] .... 11534.652765: rtcpu_vinotify_event: tstamp:360593841494 tag:CSIMUX_STREAM channel:0xff frame:0 vi_tstamp:360593841121 data:0x00000001
 vi-output, imx5-5290  [003] .... 11534.706076: tegra_channel_capture_frame: sof:11534.585271776
     kworker/4:1-5175  [004] .... 11534.708763: rtos_queue_peek_from_isr_failed: tstamp:360595492963 queue:0x0b4b4940
     kworker/4:1-5175  [004] .... 11534.708769: rtcpu_vinotify_event: tstamp:360595926741 tag:ATOMP_FS channel:0x00 frame:11 vi_tstamp:360595926369 data:0x00000000
     kworker/4:1-5175  [004] .... 11534.708771: rtcpu_vinotify_event: tstamp:360595931604 tag:CHANSEL_PXL_SOF channel:0x00 frame:11 vi_tstamp:360595931233 data:0x00000001
     kworker/4:1-5175  [004] .... 11534.708773: rtcpu_vinotify_event: tstamp:360595936801 tag:CHANSEL_LOAD_FRAMED channel:0x01 frame:11 vi_tstamp:360595936431 data:0x08000000
     kworker/4:1-5175  [004] .... 11534.764832: rtcpu_vinotify_event: tstamp:360596437205 tag:CHANSEL_PXL_EOF channel:0x00 frame:11 vi_tstamp:360596436296 data:0x08830002
     kworker/4:1-5175  [004] .... 11534.764839: rtcpu_vinotify_event: tstamp:360596437331 tag:CHANSEL_FAULT channel:0x00 frame:11 vi_tstamp:360596436325 data:0x00010800
     kworker/4:1-5175  [004] .... 11534.764841: rtcpu_vinotify_event: tstamp:360596437525 tag:ATOMP_FE channel:0x00 frame:11 vi_tstamp:360596436542 data:0x00000000
     kworker/4:1-5175  [004] .... 11534.876769: rtos_queue_peek_from_isr_failed: tstamp:360600492965 queue:0x0b4b4940
 vi-output, imx5-5290  [000] .... 11534.925718: tegra_channel_capture_setup: vnc_id 0 W 3856 H 2180 fmt 20
 vi-output, imx5-5290  [000] .... 11534.925758: tegra_channel_capture_frame: sof:11534.585271776
...

Looks at the trace, it looks like I have error tag:CHANSEL_FAULT channel:0x00 frame:11 vi_tstamp:360596436325 data:0x00010800. According to Jetson/l4t/Camera BringUp - eLinux.org, it looks like the error is PIXEL_SPURIOUS? Which means the line information is missing in the image data.

Is there any update in JP 4.6 that can cause this error?

Look at register setting applied for image sensor, all registers are set to identical values between JP 4.6 and JP 4.5.
Device tree is also the same for both Jetpack.

Thank you so much for reading and sharing.

3

hello HnilND,

can you access to the camera stream without raw dumps?
for example, $ v4l2-ctl -d /dev/video0 --set-fmt-video=width=3856,height=2180,pixelformat=RG12 --set-ctrl bypass_mode=0 --stream-mmap --stream-count=100

4

Hi Jerry,

It gives the same error with your command.
I would like to update the dmesg messages, there is ERR_INTR_STATUS in dmesg that maybe is valuable info.

root@Orbit-3900:~# [   92.391906]  Setting framerate control to: 30000001
[   92.665037] tegra-vi4 15700000.vi: PXL_SOF syncpt timeout! err = -11                                                                                                                                      
[   92.671405] tegra-vi4 15700000.vi: tegra_channel_error_recovery: attempting to reset the capture channel
[   92.933033] tegra-vi4 15700000.vi: PXL_SOF syncpt timeout! err = -11                                                                                                                                      
[   92.939418] tegra-vi4 15700000.vi: tegra_channel_error_recovery: attempting to reset the capture channel
[   93.197087] tegra-vi4 15700000.vi: PXL_SOF syncpt timeout! err = -11                                                                                                                                      
[   93.203449] tegra-vi4 15700000.vi: tegra_channel_error_recovery: attempting to reset the capture channel
[   93.465034] tegra-vi4 15700000.vi: PXL_SOF syncpt timeout! err = -11                                                                                                                                      
[   93.471400] tegra-vi4 15700000.vi: tegra_channel_error_recovery: attempting to reset the capture channel
[   93.733033] tegra-vi4 15700000.vi: PXL_SOF syncpt timeout! err = -11                                                                                                                                      
[   93.739408] tegra-vi4 15700000.vi: tegra_channel_error_recovery: attempting to reset the capture channel
[   94.001053] tegra-vi4 15700000.vi: PXL_SOF syncpt timeout! err = -11                                                                                                                                      
[   94.007419] tegra-vi4 15700000.vi: tegra_channel_error_recovery: attempting to reset the capture channel
[   94.265040] tegra-vi4 15700000.vi: PXL_SOF syncpt timeout! err = -11                                                                                                                                      
[   94.271400] tegra-vi4 15700000.vi: tegra_channel_error_recovery: attempting to reset the capture channel
[   94.533025] tegra-vi4 15700000.vi: PXL_SOF syncpt timeout! err = -11                                                                                                                                      
[   94.539384] tegra-vi4 15700000.vi: tegra_channel_error_recovery: attempting to reset the capture channel
[   94.801036] tegra-vi4 15700000.vi: PXL_SOF syncpt timeout! err = -11                                                                                                                                      
[   94.807405] tegra-vi4 15700000.vi: tegra_channel_error_recovery: attempting to reset the capture channel
[   95.065050] tegra-vi4 15700000.vi: PXL_SOF syncpt timeout! err = -11
[   95.071418] tegra-vi4 15700000.vi: tegra_channel_error_recovery: attempting to reset the capture channel
[   95.301031] tegra-vi4 15700000.vi: PXL_SOF syncpt timeout! err = -11
[   95.307399] tegra-vi4 15700000.vi: tegra_channel_error_recovery: attempting to reset the capture channel
[   95.317141] nvcsi 150c0000.nvcsi: csi4_stream_check_status (0) INTR_STATUS 0x00000006
[   95.324981] nvcsi 150c0000.nvcsi: csi4_stream_check_status (0) ERR_INTR_STATUS 0x00000006
[   95.569041] tegra-vi4 15700000.vi: PXL_SOF syncpt timeout! err = -11
5

may I know what’s the format dumps… $ v4l2-ctl -d /dev/video0 --list-formats-ext

6

Hi Jerry,

This is list formats. Two first modes are normal modes, two last are PWL HDR modes.

~# v4l2-ctl -d /dev/video0 --list-formats-ext
ioctl: VIDIOC_ENUM_FMT
        Type: Video Capture

        [0]: 'RG12' (12-bit Bayer RGRG/GBGB)
                Size: Discrete 3856x2180
                        Interval: Discrete 0.017s (60.000 fps)
                Size: Discrete 1928x1090
                        Interval: Discrete 0.017s (60.000 fps)
                Size: Discrete 3856x2180
                        Interval: Discrete 0.017s (60.000 fps)
                Size: Discrete 1928x1090
                        Interval: Discrete 0.017s (60.000 fps)
7

hello HnilND,

v4l use resolution to distinguish the active sensor modes, these modes with the same resolution might confused the driver.

let’s narrow down the issue in two ways, (1) could you please disable those PWL HDR modes on driver side for testing again. (2) please check all these sensor modes works normally in argus_camera apps.

8

Hi Jerry,

I will try to remove two later modes.

However, JP 4.5 works fine with the same v4l2-ctl command and these 4 modes.
argus_camera works well with these 4 modes, both JP 4.5 and JP 4.6.

9

Hi again,

I just removed two HDR modes. The behavior of v4l2-ctl command is the same as before.

# v4l2-ctl -d /dev/video0 --list-formats-ext
ioctl: VIDIOC_ENUM_FMT
        Type: Video Capture

        [0]: 'RG12' (12-bit Bayer RGRG/GBGB)
                Size: Discrete 3856x2180
                        Interval: Discrete 0.017s (60.000 fps)
                Size: Discrete 1928x1090
                        Interval: Discrete 0.017s (60.000 fps)

~# v4l2-ctl -d /dev/video0 --set-fmt-video=width=3856,height=2180,pixelformat=RG12 --set-ctrl bypass_mode=0 --stream-mmap --stream-count=100 --verbose
VIDIOC_QUERYCAP: ok
VIDIOC_S_EXT_CTRLS: ok
VIDIOC_G_FMT: ok
VIDIOC_S_FMT: ok
Format Video Capture:
        Width/Height      : 3856/2180
        Pixel Format      : 'RG12' (12-bit Bayer RGRG/GBGB)
        Field             : None
        Bytes per Line    : 7936
        Size Image        : 17300480
        Colorspace        : sRGB
        Transfer Function : Default (maps to sRGB)
        YCbCr/HSV Encoding: Default (maps to ITU-R 601)
        Quantization      : Default (maps to Full Range)
        Flags             : 
                VIDIOC_REQBUFS returned 0 (Success)
                VIDIOC_QUERYBUF returned 0 (Success)
                VIDIOC_QUERYBUF returned 0 (Success)
                VIDIOC_QUERYBUF returned 0 (Success)
                VIDIOC_QUERYBUF returned 0 (Success)
                VIDIOC_QBUF returned 0 (Success)
                VIDIOC_QBUF returned 0 (Success)
                VIDIOC_QBUF returned 0 (Success)
                VIDIOC_QBUF returned 0 (Success)
                VIDIOC_STREAMON returned 0 (Success)
^C

dmesg

[   75.158382]  Setting framerate control to: 30000001   
[   75.432939] tegra-vi4 15700000.vi: PXL_SOF syncpt timeout! err = -11
[   75.439302] tegra-vi4 15700000.vi: tegra_channel_error_recovery: attempting to reset the capture channel
[   75.696942] tegra-vi4 15700000.vi: PXL_SOF syncpt timeout! err = -11
[   75.703311] tegra-vi4 15700000.vi: tegra_channel_error_recovery: attempting to reset the capture channel
[   75.964954] tegra-vi4 15700000.vi: PXL_SOF syncpt timeout! err = -11                                                                                                                                      
[   75.971322] tegra-vi4 15700000.vi: tegra_channel_error_recovery: attempting to reset the capture channel
[   76.232931] tegra-vi4 15700000.vi: PXL_SOF syncpt timeout! err = -11                                                                                                                                      
[   76.239301] tegra-vi4 15700000.vi: tegra_channel_error_recovery: attempting to reset the capture channel
[   76.496941] tegra-vi4 15700000.vi: PXL_SOF syncpt timeout! err = -11                                                                                                                                      
[   76.503309] tegra-vi4 15700000.vi: tegra_channel_error_recovery: attempting to reset the capture channel
[   76.732947] tegra-vi4 15700000.vi: PXL_SOF syncpt timeout! err = -11                                                                                                                                      
[   76.739316] tegra-vi4 15700000.vi: tegra_channel_error_recovery: attempting to reset the capture channel
[   76.749031] nvcsi 150c0000.nvcsi: csi4_stream_check_status (0) INTR_STATUS 0x00000008                                                                                                                     
[   76.756888] nvcsi 150c0000.nvcsi: csi4_stream_check_status (0) ERR_INTR_STATUS 0x00000008
[   77.000946] tegra-vi4 15700000.vi: PXL_SOF syncpt timeout! err = -11                                                                                                                                      
[   77.007308] tegra-vi4 15700000.vi: tegra_channel_error_recovery: attempting to reset the capture channel
[   77.265012] tegra-vi4 15700000.vi: PXL_SOF syncpt timeout! err = -11                                                                                                                                      
[   77.271375] tegra-vi4 15700000.vi: tegra_channel_error_recovery: attempting to reset the capture channel
[   77.532943] tegra-vi4 15700000.vi: PXL_SOF syncpt timeout! err = -11                                                                                                                                      
[   77.539303] tegra-vi4 15700000.vi: tegra_channel_error_recovery: attempting to reset the capture channel
[   77.800939] tegra-vi4 15700000.vi: PXL_SOF syncpt timeout! err = -11                     
[   77.807301] tegra-vi4 15700000.vi: tegra_channel_error_recovery: attempting to reset the capture channel
[   78.068978] tegra-vi4 15700000.vi: PXL_SOF syncpt timeout! err = -11                                                                                                                                      
[   78.075341] tegra-vi4 15700000.vi: tegra_channel_error_recovery: attempting to reset the capture channel
[   78.333005] tegra-vi4 15700000.vi: PXL_SOF syncpt timeout! err = -11                                                                                                                                      
[   78.339370] tegra-vi4 15700000.vi: tegra_channel_error_recovery: attempting to reset the capture channel
[   78.600924] tegra-vi4 15700000.vi: PXL_SOF syncpt timeout! err = -11                                                                                                                                      
[   78.607289] tegra-vi4 15700000.vi: tegra_channel_error_recovery: attempting to reset the capture channel
[   78.868939] tegra-vi4 15700000.vi: PXL_SOF syncpt timeout! err = -11                                                                                                                                      
[   78.875312] tegra-vi4 15700000.vi: tegra_channel_error_recovery: attempting to reset the capture channel
[   79.132937] tegra-vi4 15700000.vi: PXL_SOF syncpt timeout! err = -11                                                                                                                                      
[   79.139306] tegra-vi4 15700000.vi: tegra_channel_error_recovery: attempting to reset the capture channel
[   79.401001] tegra-vi4 15700000.vi: PXL_SOF syncpt timeout! err = -11                                                                                                                                      
[   79.407365] tegra-vi4 15700000.vi: tegra_channel_error_recovery: attempting to reset the capture channel
[   79.668923] tegra-vi4 15700000.vi: PXL_SOF syncpt timeout! err = -11                                                                                                                                      
[   79.675285] tegra-vi4 15700000.vi: tegra_channel_error_recovery: attempting to reset the capture channel
[   79.937022] tegra-vi4 15700000.vi: PXL_SOF syncpt timeout! err = -11                                                                                                                                      
[   79.943391] tegra-vi4 15700000.vi: tegra_channel_error_recovery: attempting to reset the capture channel
[   80.200946] tegra-vi4 15700000.vi: PXL_SOF syncpt timeout! err = -11                                                                                                                                      
[   80.207308] tegra-vi4 15700000.vi: tegra_channel_error_recovery: attempting to reset the capture channel
[   80.468947] tegra-vi4 15700000.vi: PXL_SOF syncpt timeout! err = -11                                                                                                                                      
[   80.475317] tegra-vi4 15700000.vi: tegra_channel_error_recovery: attempting to reset the capture channel
[   80.736951] tegra-vi4 15700000.vi: PXL_SOF syncpt timeout! err = -11
[   80.743323] tegra-vi4 15700000.vi: tegra_channel_error_recovery: attempting to reset the capture channel
[   81.004962] tegra-vi4 15700000.vi: PXL_SOF syncpt timeout! err = -11
[   81.011331] tegra-vi4 15700000.vi: tegra_channel_error_recovery: attempting to reset the capture channel
[   81.268998] tegra-vi4 15700000.vi: PXL_SOF syncpt timeout! err = -11
[   81.275364] tegra-vi4 15700000.vi: tegra_channel_error_recovery: attempting to reset the capture channel
...
[   80.743323] tegra-vi4 15700000.vi: tegra_channel_error_recovery: attempting to reset the capture channel
[   81.004962] tegra-vi4 15700000.vi: PXL_SOF syncpt timeout! err = -11
[   81.011331] tegra-vi4 15700000.vi: tegra_channel_error_recovery: attempting to reset the capture channel
[   81.268998] tegra-vi4 15700000.vi: PXL_SOF syncpt timeout! err = -11
[   81.275364] tegra-vi4 15700000.vi: tegra_channel_error_recovery: attempting to reset the capture channel
[   81.536945] tegra-vi4 15700000.vi: PXL_SOF syncpt timeout! err = -11
[   81.543303] tegra-vi4 15700000.vi: tegra_channel_error_recovery: attempting to reset the capture channel
[   81.804925] tegra-vi4 15700000.vi: PXL_SOF syncpt timeout! err = -11
[   81.811297] tegra-vi4 15700000.vi: tegra_channel_error_recovery: attempting to reset the capture channel
[   82.068967] tegra-vi4 15700000.vi: PXL_SOF syncpt timeout! err = -11
[   82.075340] tegra-vi4 15700000.vi: tegra_channel_error_recovery: attempting to reset the capture channel
[   82.151726] tegra-vi4 15700000.vi: Status:  4 channel:00 frame:00D0
[   82.158008] tegra-vi4 15700000.vi:      timestamp sof 86499603328 eof 86515766272 data 0x00010800
[   82.166877] tegra-vi4 15700000.vi:      capture_id 53 stream  0 vchan  0
10

hello HnilND,

just for a quick try, could you please remove bypass_mode settings?
i.e. v4l2-ctl -d /dev/video0 --set-fmt-video=width=3856,height=2180,pixelformat=RG12 --stream-mmap --stream-count=100

11

Hi Jerry,

I removed bypass_mode but the result is still the same as above.

12

hello HnilND,

may I know how many embedded data lines of this IMX585 camera driver.
FYI, Spurious data that means VI sees some other packets before FS packet, as VI always expect that 1st packet to be frame start.

13

Hi Jerry,

The embedded data line is one line height.

Screenshot from 2023-03-29 10-00-19
Screenshot from 2023-03-29 10-00-19903×625 54.8 KB

The device tree is:

mode0 { //
					mclk_khz = "37125";
					num_lanes = "4";
					tegra_sinterface = "serial_a";
					phy_mode = "DPHY";
					discontinuous_clk = "no";
					dpcm_enable = "false";
					cil_settletime = "0";
					active_w = "3856";
					active_h = "2180";

					dynamic_pixel_bit_depth = "12";
					csi_pixel_bit_depth = "12";
					mode_type = "bayer";
					pixel_phase = "rggb";

					readout_orientation = "0";
					line_length = "6600";
					inherent_gain = "1";
					mclk_multiplier = "20.48";
					pix_clk_hz = "760000000";

					gain_factor = "10";
					min_gain_val = "0"; /* 0dB */
					max_gain_val = "720"; /* 72dB */
					step_gain_val = "3"; /* 0.3 */
					default_gain = "0";
					min_hdr_ratio = "1";
					max_hdr_ratio = "64";
					framerate_factor = "1000000";
					min_framerate = "1500000"; /* 1.5 */
					max_framerate = "60000000"; /* 60 */
					step_framerate = "1";
					default_framerate= "60000000";
					exposure_factor = "1000000";
					min_exp_time = "27";  /* us */
					max_exp_time = "660000"; /* us */
					step_exp_time = "1";
					default_exp_time = "10000";/* us */
					embedded_metadata_height = "1";
				};

I use the same device tree and same driver code for JP 4.5 and JP 4.6. ( I did check the difference between JP 4.5 & JP 4.6 kernel code drivers/media/i2c & device tree and I don’t see changes regarding camera driver & device tree). But it works flawlessly on JP 4.5, and have problem in JP 4.6.

So, I think the JP 4.6 has some changes in lower level and that cause the problem with my driver.

14

hello HnilND,

so, you’re now based-on JP-4.6.3 / l4t-r32.7.3, right?
JetPack 4.6.3 is already the latest Jetpack-4.x release version,

the failure PXL_SOF syncpt timeout! means VI cannot wait start-of-frame.
the strange things is that you claim argus_camera app works normally. so, this should indicate those device tree settings were all correct.

so…
can it works by running below commands to boost clocks?

sudo su
echo 1 > /sys/kernel/debug/bpmp/debug/clk/vi/mrq_rate_locked
echo 1 > /sys/kernel/debug/bpmp/debug/clk/isp/mrq_rate_locked
echo 1 > /sys/kernel/debug/bpmp/debug/clk/nvcsi/mrq_rate_locked
echo 1 > /sys/kernel/debug/bpmp/debug/clk/emc/mrq_rate_locked
cat /sys/kernel/debug/bpmp/debug/clk/vi/max_rate |tee /sys/kernel/debug/bpmp/debug/clk/vi/rate
cat /sys/kernel/debug/bpmp/debug/clk/isp/max_rate | tee /sys/kernel/debug/bpmp/debug/clk/isp/rate
cat /sys/kernel/debug/bpmp/debug/clk/nvcsi/max_rate | tee /sys/kernel/debug/bpmp/debug/clk/nvcsi/rate
cat /sys/kernel/debug/bpmp/debug/clk/emc/max_rate | tee /sys/kernel/debug/bpmp/debug/clk/emc/rate
15

Hi Jerry,

It looks like the bpmp debug firmware is missing on my system.

user@host:/sys/kernel/debug/bpmp# ls -l
total 0
--w------- 1 root root 0 Jan  1  1970 clk_init
drwxr-xr-x 2 root root 0 Mar 29 15:42 module
-r--r--r-- 1 root root 0 Mar 29 15:41 mount
-rw-r--r-- 1 root root 0 Jan  1  1970 mrq
-r--r--r-- 1 root root 0 Jan  1  1970 ping
-r--r--r-- 1 root root 0 Jan  1  1970 tag
-rw-r--r-- 1 root root 0 Mar 29 15:42 trace
--w------- 1 root root 0 Jan  1  1970 trace_disable
-rw-r--r-- 1 root root 0 Mar 29 15:41 trace_enable
-r--r--r-- 1 root root 0 Jan  1  1970 unmount
user@host:/sys/kernel/debug/bpmp# dmesg | grep -i bpmp
[    0.373819] bpmp: waiting for handshake
[    0.373823] bpmp: handshake completed
[    0.373840] bpmp: synchronizing channels
[    0.373848] bpmp: channels synchronized
[    0.373851] bpmp: mail init ok
[    0.437077] Registering BPMP clocks...
[    0.437141] tegra_bpmp_clk_init: clock init ok (638 clks)
[    0.463139] iommu: Adding device d000000.bpmp to group 43
[    0.463342] bpmp: ping status is 0
[    0.463420] bpmp d000000.bpmp: firmware tag is 91572a54614f84d0fd0c270beec2c56f
[    0.465069] bpmp d000000.bpmp: probe ok
[609778.895954] bpmp d000000.bpmp: Direct firmware load for tracing failed with error -2
[609778.903845] bpmp d000000.bpmp: request_firmware() failed: -2

Do you know which firmware file in /lib/firmware/ provides bpmp ‘debug’ module?

16

Hi Jerry,

When saying JP 4.6, it is actually JP 4.6.3 (L4T 32.7.3).

From this post Jetson TX2 bpmp uart console - #6 by Bibek , it looks like I don’t have access to bpmp debug right now, since all my boards are production fused. So bpmp debug is not available.
I will have to wait some days to get another brand new TX2 NX board for clock boost check. But in the mean time, if you have any other ideas, please let me know.

18

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.