How do I display test pattern output from Ultra96 on Jetson Xavier NX?

toshi_ka · June 9, 2021, 5:47am

Hello.
I’m trying to get Jetson Xavier NX to display the test patterns generated by Ultra96 via MIPI CSI-2.
The generated test patterns can be viewed on the SoC FPGA board, but for some reason not on the Jetson Xavier NX.
I want to find out the reason for not being able to display test patterns on Jetson Xavier NX via MIPI CSI-2, implement some countermeasures, and then display the test pattern.
Can someone please help?

Trial content

I created the design of Ultra96 with reference to the following page.
https://www.hackster.io/344011/ultra96-csi-2-video-output-to-raspberry-pi-camera-input-e6dfa0
I changed the MIPI output data type of the above design from RGB888 to RAW10.
This change was due to a desire to have the Ultra 96 mimic the Raspberry Pi camera.
I also changed the output resolution from 1280x720 to 1920x1080.
This design can then be viewed on the SoC FPGA board from the Ultra96 via MIPI CSI-2.
I loaded the above design into Ultra96, and ran I2C communication response processing software that imitates the Raspberry Pi camera.
When I start the Jetson Xavier NX, Ultra96 is recognized as a Raspberry Pi camera and a “/dev/video0” file is created.
I used JetPack 4.5.1 for the Jetson Xavier NX.
To check the operation I execulted the following command, but it didn’t work.

Execution command

v4l2-ctl -d /dev/video0 --set-fmt-video=width=1920,height=1080,pixelformat=RG10 --set-ctrl bypass_mode=0,sensor_mode=2 --stream-mmap

Kernel log

Jun  7 11:34:14 jetson-xavier-nx kernel: [  652.374157] tegra194-vi5 15c10000.vi: no reply from camera processor
Jun  7 11:34:14 jetson-xavier-nx kernel: [  652.374322] tegra194-vi5 15c10000.vi: uncorr_err: request timed out after 2500 ms
Jun  7 11:34:14 jetson-xavier-nx kernel: [  652.374536] tegra194-vi5 15c10000.vi: err_rec: attempting to reset the capture channel
Jun  7 11:34:14 jetson-xavier-nx kernel: [  652.377593] tegra194-vi5 15c10000.vi: err_rec: successfully reset the capture channel
Jun  7 11:34:17 jetson-xavier-nx kernel: [  654.934149] tegra194-vi5 15c10000.vi: no reply from camera processor
Jun  7 11:34:17 jetson-xavier-nx kernel: [  654.934342] tegra194-vi5 15c10000.vi: uncorr_err: request timed out after 2500 ms
Jun  7 11:34:17 jetson-xavier-nx kernel: [  654.934633] tegra194-vi5 15c10000.vi: err_rec: attempting to reset the capture channel
Jun  7 11:34:17 jetson-xavier-nx kernel: [  654.940236] tegra194-vi5 15c10000.vi: err_rec: successfully reset the capture channel
Jun  7 11:34:19 jetson-xavier-nx kernel: [  657.494140] tegra194-vi5 15c10000.vi: no reply from camera processor
Jun  7 11:34:19 jetson-xavier-nx kernel: [  657.494305] tegra194-vi5 15c10000.vi: uncorr_err: request timed out after 2500 ms
Jun  7 11:34:19 jetson-xavier-nx kernel: [  657.494592] tegra194-vi5 15c10000.vi: err_rec: attempting to reset the capture channel
Jun  7 11:34:19 jetson-xavier-nx kernel: [  657.497617] tegra194-vi5 15c10000.vi: err_rec: successfully reset the capture channel
....

I wanted to know the operating status, so I executed the following command to get the trace information, but I don’t understand the contents.

Execution command

echo 1 > /sys/kernel/debug/tracing/tracing_on
echo 30720 > /sys/kernel/debug/tracing/buffer_size_kb
echo 1 > /sys/kernel/debug/tracing/events/tegra_rtcpu/enable
echo 1 > /sys/kernel/debug/tracing/events/freertos/enable
echo 2 > /sys/kernel/debug/camrtc/log-level
echo 1 > /sys/kernel/debug/tracing/events/camera_common/enable
echo > /sys/kernel/debug/tracing/trace

Trace information

# tracer: nop
#
# entries-in-buffer/entries-written: 3395/3395   #P:6
#
#                              _-----=> irqs-off
#                             / _----=> need-resched
#                            | / _---=> hardirq/softirq
#                            || / _--=> preempt-depth
#                            ||| /     delay
#           TASK-PID   CPU#  ||||    TIMESTAMP  FUNCTION
#              | |       |   ||||       |         |
        v4l2-ctl-9325  [001] ....   649.733378: tegra_channel_open: vi-output, imx219 9-0010
        v4l2-ctl-9325  [003] ....   649.735618: tegra_channel_set_power: imx219 9-0010 : 0x1
        v4l2-ctl-9325  [003] ....   649.735638: camera_common_s_power: status : 0x1
        v4l2-ctl-9325  [003] ....   649.758835: tegra_channel_set_power: 15a00000.nvcsi--2 : 0x1
        v4l2-ctl-9325  [003] ....   649.758841: csi_s_power: enable : 0x1
        v4l2-ctl-9325  [005] ....   649.767522: tegra_channel_capture_setup: vnc_id 0 W 1920 H 1080 fmt c4
        v4l2-ctl-9325  [003] ....   649.776644: tegra_channel_set_stream: enable : 0x1
        v4l2-ctl-9325  [004] ....   649.780124: tegra_channel_set_stream: 15a00000.nvcsi--2 : 0x1
        v4l2-ctl-9325  [004] ....   649.780129: csi_s_stream: enable : 0x1
        v4l2-ctl-9325  [004] ....   649.780168: tegra_channel_set_stream: imx219 9-0010 : 0x1
     kworker/0:0-4     [000] ....   649.786218: rtos_queue_peek_from_isr_failed: tstamp:20719029409 queue:0x0bcbcf78
     kworker/0:0-4     [000] ....   649.786223: rtcpu_start: tstamp:20719032354
     kworker/0:0-4     [000] ....   649.786226: rtos_queue_send_from_isr_failed: tstamp:20719046486 queue:0x0bcb41f8
     kworker/0:0-4     [000] ....   649.786227: rtos_queue_send_from_isr_failed: tstamp:20719046639 queue:0x0bcb8a60
     kworker/0:0-4     [000] ....   649.786228: rtos_queue_send_from_isr_failed: tstamp:20719046789 queue:0x0bcba5e0
     kworker/0:0-4     [000] ....   649.786229: rtos_queue_send_from_isr_failed: tstamp:20719046935 queue:0x0bcbb3a0
     kworker/0:0-4     [000] ....   649.786230: rtos_queue_send_from_isr_failed: tstamp:20719047084 queue:0x0bcbc160
     kworker/0:0-4     [000] ....   649.786232: rtcpu_string: tstamp:20719047517 id:0x04010000 str:"Configuring VI GoS.

     kworker/0:0-4     [000] ....   649.786248: rtcpu_string: tstamp:20719047695 id:0x04010000 str:"VM GOS[#0] addr=0xc2100000

     kworker/0:0-4     [000] ....   649.786253: rtcpu_string: tstamp:20719047952 id:0x04010000 str:"VM GOS[#1] addr=0xc2101000

     kworker/0:0-4     [000] ....   649.786258: rtcpu_string: tstamp:20719048224 id:0x04010000 str:"VM GOS[#2] addr=0xc2102000

     kworker/0:0-4     [000] ....   649.786263: rtcpu_string: tstamp:20719048456 id:0x04010000 str:"VM GOS[#3] addr=0xc2103000

     kworker/0:0-4     [000] ....   649.786268: rtcpu_string: tstamp:20719048688 id:0x04010000 str:"VM GOS[#4] addr=0xc2104000

     kworker/0:0-4     [000] ....   649.786272: rtcpu_string: tstamp:20719048920 id:0x04010000 str:"VM GOS[#5] addr=0xc2105000

     kworker/0:0-4     [000] ....   649.786277: rtcpu_string: tstamp:20719057698 id:0x04010000 str:"vi5_hwinit: firmware CL2018101701 protocol vers"
     kworker/0:0-4     [000] ....   649.786279: rtcpu_string: tstamp:20719057817 id:0x04010000 str:"on 2.2

     kworker/0:0-4     [000] ....   649.786284: rtos_queue_send_from_isr_failed: tstamp:20719183076 queue:0x0bcb41f8
     kworker/0:0-4     [000] ....   649.786285: rtos_queue_send_from_isr_failed: tstamp:20719183246 queue:0x0bcb8a60
     kworker/0:0-4     [000] ....   649.786286: rtos_queue_send_from_isr_failed: tstamp:20719183400 queue:0x0bcba5e0
     kworker/0:0-4     [000] ....   649.786287: rtos_queue_send_from_isr_failed: tstamp:20719183548 queue:0x0bcbb3a0
     kworker/0:0-4     [000] ....   649.786288: rtos_queue_send_from_isr_failed: tstamp:20719183695 queue:0x0bcbc160
     kworker/0:0-4     [000] ....   649.786289: rtcpu_string: tstamp:20719184567 id:0x04010000 str:"VI GOS[#0] set to VM GOS[4] base 0xc2104000

     kworker/0:0-4     [000] ....   649.786294: rtos_queue_send_from_isr_failed: tstamp:20719294522 queue:0x0bcb41f8
     kworker/0:0-4     [000] ....   649.786295: rtos_queue_send_from_isr_failed: tstamp:20719294671 queue:0x0bcb8a60
     kworker/0:0-4     [000] ....   649.786296: rtos_queue_send_from_isr_failed: tstamp:20719294823 queue:0x0bcba5e0
     kworker/0:0-4     [000] ....   649.786297: rtos_queue_send_from_isr_failed: tstamp:20719294969 queue:0x0bcbb3a0
     kworker/0:0-4     [000] ....   649.786298: rtos_queue_send_from_isr_failed: tstamp:20719295116 queue:0x0bcbc160
     kworker/0:0-4     [000] ....   649.842195: rtcpu_vinotify_event: tstamp:20719512969 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:18768852128 data:0x10000000
     kworker/0:0-4     [000] ....   649.842200: rtcpu_vinotify_event: tstamp:20719513136 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:18768860512 data:0x31000001
     kworker/0:0-4     [000] ....   649.842201: rtcpu_vinotify_event: tstamp:20719513298 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:18768862688 data:0x07020001
     kworker/0:0-4     [000] ....   649.842202: rtcpu_vinotify_event: tstamp:20719513435 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:18768896576 data:0x10000000
     kworker/0:0-4     [000] ....   649.842203: rtcpu_vinotify_event: tstamp:20719513596 tag:RESERVED_18 channel:0x23 frame:0 vi_tstamp:18768904992 data:0x31000002
     kworker/0:0-4     [000] ....   649.842211: rtcpu_vinotify_event: tstamp:20720598303 tag:FS channel:0x00 frame:0 vi_tstamp:20720164827 data:0x00000010
     kworker/0:0-4     [000] ....   649.842212: rtcpu_vinotify_event: tstamp:20720598469 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:20720164830 data:0x00000000
     kworker/0:0-4     [000] ....   649.842213: rtcpu_vinotify_event: tstamp:20720598609 tag:CHANSEL_PXL_SOF channel:0x23 frame:0 vi_tstamp:20720164910 data:0x00000001
     kworker/0:0-4     [000] ....   649.842214: rtcpu_vinotify_event: tstamp:20720598767 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:18800197088 data:0x08020001
     kworker/0:0-4     [000] ....   649.842215: rtcpu_vinotify_event: tstamp:20720819842 tag:CHANSEL_PXL_EOF channel:0x23 frame:0 vi_tstamp:20720814577 data:0x04370002
     kworker/0:0-4     [000] ....   649.842216: rtcpu_vinotify_event: tstamp:20720820000 tag:ATOMP_FRAME_DONE channel:0x23 frame:0 vi_tstamp:20720814604 data:0x00000000
     kworker/0:0-4     [000] ....   649.842217: rtcpu_vinotify_event: tstamp:20720820139 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:18820979936 data:0x02020001
     kworker/0:0-4     [000] ....   649.842218: rtcpu_vinotify_event: tstamp:20720820296 tag:FE channel:0x00 frame:0 vi_tstamp:20720814657 data:0x00000020
     kworker/0:0-4     [000] ....   649.842218: rtcpu_vinotify_event: tstamp:20720820436 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:20720814660 data:0x00000000
     kworker/0:0-4     [000] ....   649.842219: rtcpu_vinotify_event: tstamp:20720820590 tag:FS channel:0x00 frame:0 vi_tstamp:20720814697 data:0x00000010
     kworker/0:0-4     [000] ....   649.842220: rtcpu_vinotify_event: tstamp:20720820730 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:20720814701 data:0x00000000
     kworker/0:0-4     [000] ....   649.898154: rtcpu_vinotify_event: tstamp:20721357670 tag:CHANSEL_PXL_SOF channel:0x23 frame:0 vi_tstamp:20720814854 data:0x00000001
     kworker/0:0-4     [000] ....   649.898159: rtcpu_vinotify_event: tstamp:20721357808 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:18821026912 data:0x08020001
     kworker/0:0-4     [000] ....   649.898161: rtcpu_vinotify_error: tstamp:20721469942 tag:CHANSEL_NOMATCH channel:0x01 frame:0 vi_tstamp:20721466250 data:0x00000569
     kworker/0:0-4     [000] ....   649.898163: rtcpu_vinotify_event: tstamp:20721900064 tag:CHANSEL_PXL_EOF channel:0x23 frame:0 vi_tstamp:20721465973 data:0x04370002
     kworker/0:0-4     [000] ....   649.898164: rtcpu_vinotify_event: tstamp:20721900218 tag:ATOMP_FRAME_DONE channel:0x23 frame:0 vi_tstamp:20721466001 data:0x00000000
     kworker/0:0-4     [000] ....   649.898165: rtcpu_vinotify_event: tstamp:20721900376 tag:RESERVED_19 channel:0x23 frame:0 vi_tstamp:18841824672 data:0x02020001
     kworker/0:0-4     [000] ....   649.898166: rtcpu_vinotify_event: tstamp:20721900513 tag:FE channel:0x00 frame:0 vi_tstamp:20721466052 data:0x00000020
     kworker/0:0-4     [000] ....   649.898167: rtcpu_vinotify_event: tstamp:20721900676 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:20721466055 data:0x00000000
     kworker/0:0-4     [000] ....   649.898168: rtcpu_vinotify_event: tstamp:20721900812 tag:FS channel:0x00 frame:0 vi_tstamp:20721466093 data:0x00000010
     kworker/0:0-4     [000] ....   649.898170: rtcpu_vinotify_event: tstamp:20721900968 tag:CHANSEL_NOMATCH channel:0x01 frame:0 vi_tstamp:20721466250 data:0x00000569
     kworker/0:0-4     [000] ....   649.898171: rtcpu_vinotify_error: tstamp:20722120467 tag:CHANSEL_NOMATCH channel:0x01 frame:0 vi_tstamp:20722117646 data:0x00000569
     kworker/0:0-4     [000] ....   649.898172: rtcpu_vinotify_event: tstamp:20722443051 tag:FE channel:0x00 frame:0 vi_tstamp:20722117448 data:0x00000020
     kworker/0:0-4     [000] ....   649.898173: rtcpu_vinotify_event: tstamp:20722443211 tag:FS channel:0x00 frame:0 vi_tstamp:20722117488 data:0x00000010
     kworker/0:0-4     [000] ....   649.898174: rtcpu_vinotify_event: tstamp:20722443347 tag:CHANSEL_NOMATCH channel:0x01 frame:0 vi_tstamp:20722117646 data:0x00000569
     kworker/0:0-4     [000] ....   649.898175: rtcpu_vinotify_error: tstamp:20722771865 tag:CHANSEL_NOMATCH channel:0x01 frame:0 vi_tstamp:20722769041 data:0x00000569
     kworker/0:0-4     [000] ....   649.954152: rtcpu_vinotify_event: tstamp:20722985240 tag:FE channel:0x00 frame:0 vi_tstamp:20722768843 data:0x00000020
     kworker/0:0-4     [000] ....   649.954155: rtcpu_vinotify_event: tstamp:20722985382 tag:FS channel:0x00 frame:0 vi_tstamp:20722768883 data:0x00000010
     kworker/0:0-4     [000] ....   649.954157: rtcpu_vinotify_event: tstamp:20722985541 tag:CHANSEL_NOMATCH channel:0x01 frame:0 vi_tstamp:20722769041 data:0x00000569
     kworker/0:0-4     [000] ....   649.954158: rtcpu_vinotify_error: tstamp:20723423299 tag:CHANSEL_NOMATCH channel:0x01 frame:0 vi_tstamp:20723420436 data:0x00000569
     kworker/0:0-4     [000] ....   649.954160: rtcpu_vinotify_event: tstamp:20723423686 tag:FE channel:0x00 frame:0 vi_tstamp:20723420238 data:0x00000020
     kworker/0:0-4     [000] ....   649.954161: rtcpu_vinotify_event: tstamp:20723962012 tag:FS channel:0x00 frame:0 vi_tstamp:20723420279 data:0x00000010
     kworker/0:0-4     [000] ....   649.954162: rtcpu_vinotify_event: tstamp:20723962149 tag:CHANSEL_NOMATCH channel:0x01 frame:0 vi_tstamp:20723420436 data:0x00000569
     kworker/0:0-4     [000] ....   649.954165: rtos_queue_peek_from_isr_failed: tstamp:20724029763 queue:0x0bcbcf78
     kworker/0:0-4     [000] ....   649.954166: rtcpu_vinotify_error: tstamp:20724074661 tag:CHANSEL_NOMATCH channel:0x01 frame:0 vi_tstamp:20724071831 data:0x00000569
     kworker/0:0-4     [000] ....   649.954168: rtcpu_vinotify_event: tstamp:20724504199 tag:FE channel:0x00 frame:0 vi_tstamp:20724071633 data:0x00000020
     kworker/0:0-4     [000] ....   649.954169: rtcpu_vinotify_event: tstamp:20724504335 tag:FS channel:0x00 frame:0 vi_tstamp:20724071674 data:0x00000010
     kworker/0:0-4     [000] ....   649.954170: rtcpu_vinotify_event: tstamp:20724504496 tag:CHANSEL_NOMATCH channel:0x01 frame:0 vi_tstamp:20724071831 data:0x00000569
     kworker/0:0-4     [000] ....   649.954171: rtcpu_vinotify_error: tstamp:20724726039 tag:CHANSEL_NOMATCH channel:0x01 frame:0 vi_tstamp:20724723227 data:0x00000569
     kworker/0:0-4     [000] ....   650.010155: rtcpu_vinotify_event: tstamp:20725047181 tag:FE channel:0x00 frame:0 vi_tstamp:20724723029 data:0x00000020
     kworker/0:0-4     [000] ....   650.010158: rtcpu_vinotify_event: tstamp:20725047341 tag:FS channel:0x00 frame:0 vi_tstamp:20724723068 data:0x00000010
     kworker/0:0-4     [000] ....   650.010159: rtcpu_vinotify_event: tstamp:20725047476 tag:CHANSEL_NOMATCH channel:0x01 frame:0 vi_tstamp:20724723227 data:0x00000569
     kworker/0:0-4     [000] ....   650.010161: rtcpu_vinotify_error: tstamp:20725377438 tag:CHANSEL_NOMATCH channel:0x01 frame:0 vi_tstamp:20725374622 data:0x00000569
     kworker/0:0-4     [000] ....   650.010162: rtcpu_vinotify_event: tstamp:20725589370 tag:FE channel:0x00 frame:0 vi_tstamp:20725374424 data:0x00000020
     kworker/0:0-4     [000] ....   650.010163: rtcpu_vinotify_event: tstamp:20725589505 tag:FS channel:0x00 frame:0 vi_tstamp:20725374465 data:0x00000010
     kworker/0:0-4     [000] ....   650.010164: rtcpu_vinotify_event: tstamp:20725589659 tag:CHANSEL_NOMATCH channel:0x01 frame:0 vi_tstamp:20725374622 data:0x00000569
     kworker/0:0-4     [000] ....   650.010165: rtcpu_vinotify_error: tstamp:20726028832 tag:CHANSEL_NOMATCH channel:0x01 frame:0 vi_tstamp:20726026017 data:0x00000569
     kworker/0:0-4     [000] ....   650.010167: rtcpu_vinotify_event: tstamp:20726132360 tag:FE channel:0x00 frame:0 vi_tstamp:20726025819 data:0x00000020
     kworker/0:0-4     [000] ....   650.010168: rtcpu_vinotify_event: tstamp:20726132517 tag:FS channel:0x00 frame:0 vi_tstamp:20726025859 data:0x00000010
     kworker/0:0-4     [000] ....   650.010169: rtcpu_vinotify_event: tstamp:20726132652 tag:CHANSEL_NOMATCH channel:0x01 frame:0 vi_tstamp:20726026017 data:0x00000569
     kworker/0:0-4     [000] ....   650.066133: rtcpu_vinotify_error: tstamp:20726680270 tag:CHANSEL_NOMATCH channel:0x01 frame:0 vi_tstamp:20726677412 data:0x00000569
     kworker/0:0-4     [000] ....   650.066136: rtcpu_vinotify_event: tstamp:20726680662 tag:FE channel:0x00 frame:0 vi_tstamp:20726677215 data:0x00000020
     kworker/0:0-4     [000] ....   650.066138: rtcpu_vinotify_event: tstamp:20726680802 tag:FS channel:0x00 frame:0 vi_tstamp:20726677255 data:0x00000010
     kworker/0:0-4     [000] ....   650.066139: rtcpu_vinotify_event: tstamp:20727216774 tag:CHANSEL_NOMATCH channel:0x01 frame:0 vi_tstamp:20726677412 data:0x00000569
     kworker/0:0-4     [000] ....   650.066140: rtcpu_vinotify_error: tstamp:20727331626 tag:CHANSEL_NOMATCH channel:0x01 frame:0 vi_tstamp:20727328808 data:0x00000569
     kworker/0:0-4     [000] ....   650.066141: rtcpu_vinotify_event: tstamp:20727759753 tag:FE channel:0x00 frame:0 vi_tstamp:20727328610 data:0x00000020
     kworker/0:0-4     [000] ....   650.066142: rtcpu_vinotify_event: tstamp:20727759908 tag:FS channel:0x00 frame:0 vi_tstamp:20727328651 data:0x00000010
     kworker/0:0-4     [000] ....   650.066143: rtcpu_vinotify_event: tstamp:20727760044 tag:CHANSEL_NOMATCH channel:0x01 frame:0 vi_tstamp:20727328808 data:0x00000569
     kworker/0:0-4     [000] ....   650.066145: rtcpu_vinotify_error: tstamp:20727983019 tag:CHANSEL_NOMATCH channel:0x01 frame:0 vi_tstamp:20727980203 data:0x00000569
     kworker/0:0-4     [000] ....   650.122170: rtcpu_vinotify_event: tstamp:20728301939 tag:FE channel:0x00 frame:0 vi_tstamp:20727980006 data:0x00000020
     kworker/0:0-4     [000] ....   650.122174: rtcpu_vinotify_event: tstamp:20728302078 tag:FS channel:0x00 frame:0 vi_tstamp:20727980046 data:0x00000010
     kworker/0:0-4     [000] ....   650.122175: rtcpu_vinotify_event: tstamp:20728302237 tag:CHANSEL_NOMATCH channel:0x01 frame:0 vi_tstamp:20727980203 data:0x00000569
     kworker/0:0-4     [000] ....   650.122177: rtcpu_vinotify_error: tstamp:20728634414 tag:CHANSEL_NOMATCH channel:0x01 frame:0 vi_tstamp:20728631598 data:0x00000569
     kworker/0:0-4     [000] ....   650.122178: rtcpu_vinotify_event: tstamp:20728844929 tag:FE channel:0x00 frame:0 vi_tstamp:20728631401 data:0x00000020
     kworker/0:0-4     [000] ....   650.122179: rtcpu_vinotify_event: tstamp:20728845086 tag:FS channel:0x00 frame:0 vi_tstamp:20728631441 data:0x00000010
     kworker/0:0-4     [000] ....   650.122180: rtcpu_vinotify_event: tstamp:20728845222 tag:CHANSEL_NOMATCH channel:0x01 frame:0 vi_tstamp:20728631598 data:0x00000569
     kworker/0:0-4     [000] ....   650.122183: rtos_queue_peek_from_isr_failed: tstamp:20729029766 queue:0x0bcbcf78
     kworker/0:0-4     [000] ....   650.122184: rtcpu_vinotify_error: tstamp:20729285810 tag:CHANSEL_NOMATCH channel:0x01 frame:0 vi_tstamp:20729282993 data:0x00000569
     kworker/0:0-4     [000] ....   650.122186: rtcpu_vinotify_event: tstamp:20729387115 tag:FE channel:0x00 frame:0 vi_tstamp:20729282796 data:0x00000020
     kworker/0:0-4     [000] ....   650.122187: rtcpu_vinotify_event: tstamp:20729387250 tag:FS channel:0x00 frame:0 vi_tstamp:20729282837 data:0x00000010
     kworker/0:0-4     [000] ....   650.122188: rtcpu_vinotify_event: tstamp:20729387406 tag:CHANSEL_NOMATCH channel:0x01 frame:0 vi_tstamp:20729282993 data:0x00000569
     kworker/0:0-4     [000] ....   650.122189: rtcpu_vinotify_error: tstamp:20729937395 tag:CHANSEL_NOMATCH channel:0x01 frame:0 vi_tstamp:20729934389 data:0x00000569
     kworker/0:0-4     [000] ....   650.122190: rtcpu_vinotify_event: tstamp:20729937783 tag:FE channel:0x00 frame:0 vi_tstamp:20729934191 data:0x00000020
     kworker/0:0-4     [000] ....   650.122191: rtcpu_vinotify_event: tstamp:20729937941 tag:FS channel:0x00 frame:0 vi_tstamp:20729934232 data:0x00000010
     kworker/0:0-4     [000] ....   650.122192: rtcpu_vinotify_event: tstamp:20729938077 tag:CHANSEL_NOMATCH channel:0x01 frame:0 vi_tstamp:20729934389 data:0x00000569
     kworker/0:0-4     [000] ....   650.178150: rtcpu_vinotify_error: tstamp:20730588601 tag:CHANSEL_NOMATCH channel:0x01 frame:0 vi_tstamp:20730585785 data:0x00000569
     kworker/0:0-4     [000] ....   650.178153: rtcpu_vinotify_event: tstamp:20730634715 tag:FE channel:0x00 frame:0 vi_tstamp:20730585587 data:0x00000020
     kworker/0:0-4     [000] ....   650.178155: rtcpu_vinotify_event: tstamp:20730634851 tag:FS channel:0x00 frame:0 vi_tstamp:20730585627 data:0x00000010
     kworker/0:0-4     [000] ....   650.178156: rtcpu_vinotify_event: tstamp:20730635008 tag:CHANSEL_NOMATCH channel:0x01 frame:0 vi_tstamp:20730585785 data:0x00000569
     kworker/0:0-4     [000] ....   650.178158: rtcpu_vinotify_error: tstamp:20731239999 tag:CHANSEL_NOMATCH channel:0x01 frame:0 vi_tstamp:20731237179 data:0x00000569
     kworker/0:0-4     [000] ....   650.178159: rtcpu_vinotify_event: tstamp:20731720408 tag:FE channel:0x00 frame:0 vi_tstamp:20731236982 data:0x00000020
     kworker/0:0-4     [000] ....   650.178160: rtcpu_vinotify_event: tstamp:20731720568 tag:FS channel:0x00 frame:0 vi_tstamp:20731237021 data:0x00000010
     kworker/0:0-4     [000] ....   650.178161: rtcpu_vinotify_event: tstamp:20731720708 tag:CHANSEL_NOMATCH channel:0x01 frame:0 vi_tstamp:20731237179 data:0x00000569
     kworker/0:0-4     [000] ....   650.234141: rtcpu_vinotify_error: tstamp:20731891394 tag:CHANSEL_NOMATCH channel:0x01 frame:0 vi_tstamp:20731888575 data:0x00000569
     kworker/0:0-4     [000] ....   650.234144: rtcpu_vinotify_event: tstamp:20732262599 tag:FE channel:0x00 frame:0 vi_tstamp:20731888377 data:0x00000020
     kworker/0:0-4     [000] ....   650.234145: rtcpu_vinotify_event: tstamp:20732262734 tag:FS channel:0x00 frame:0 vi_tstamp:20731888418 data:0x00000010
     kworker/0:0-4     [000] ....   650.234147: rtcpu_vinotify_event: tstamp:20732262889 tag:CHANSEL_NOMATCH channel:0x01 frame:0 vi_tstamp:20731888575 data:0x00000569
     kworker/0:0-4     [000] ....   650.234148: rtcpu_vinotify_error: tstamp:20732542784 tag:CHANSEL_NOMATCH channel:0x01 frame:0 vi_tstamp:20732539970 data:0x00000569
     kworker/0:0-4     [000] ....   650.234149: rtcpu_vinotify_event: tstamp:20732805593 tag:FE channel:0x00 frame:0 vi_tstamp:20732539773 data:0x00000020
     kworker/0:0-4     [000] ....   650.234150: rtcpu_vinotify_event: tstamp:20732805749 tag:FS channel:0x00 frame:0 vi_tstamp:20732539812 data:0x00000010
     kworker/0:0-4     [000] ....   650.234151: rtcpu_vinotify_event: tstamp:20732805886 tag:CHANSEL_NOMATCH channel:0x01 frame:0 vi_tstamp:20732539970 data:0x00000569
     kworker/0:0-4     [000] ....   650.234152: rtcpu_vinotify_error: tstamp:20733194182 tag:CHANSEL_NOMATCH channel:0x01 frame:0 vi_tstamp:20733191366 data:0x00000569
     kworker/0:0-4     [000] ....   650.234153: rtcpu_vinotify_event: tstamp:20733347783 tag:FE channel:0x00 frame:0 vi_tstamp:20733191168 data:0x00000020
     kworker/0:0-4     [000] ....   650.234155: rtcpu_vinotify_event: tstamp:20733347919 tag:FS channel:0x00 frame:0 vi_tstamp:20733191208 data:0x00000010
     kworker/0:0-4     [000] ....   650.234156: rtcpu_vinotify_event: tstamp:20733348076 tag:CHANSEL_NOMATCH channel:0x01 frame:0 vi_tstamp:20733191366 data:0x00000569
     kworker/0:0-4     [000] ....   650.290163: rtcpu_vinotify_error: tstamp:20733845623 tag:CHANSEL_NOMATCH channel:0x01 frame:0 vi_tstamp:20733842760 data:0x00000569
     kworker/0:0-4     [000] ....   650.290166: rtcpu_vinotify_event: tstamp:20733846013 tag:FE channel:0x00 frame:0 vi_tstamp:20733842563 data:0x00000020
     kworker/0:0-4     [000] ....   650.290194: rtos_queue_peek_from_isr_failed: tstamp:20734029762 queue:0x0bcbcf78
     kworker/0:0-4     [000] ....   650.290196: rtcpu_vinotify_event: tstamp:20734378543 tag:FS channel:0x00 frame:0 vi_tstamp:20733842603 data:0x00000010
     kworker/0:0-4     [000] ....   650.290197: rtcpu_vinotify_event: tstamp:20734378683 tag:CHANSEL_NOMATCH channel:0x01 frame:0 vi_tstamp:20733842760 data:0x00000569
     kworker/0:0-4     [000] ....   650.290199: rtcpu_vinotify_error: tstamp:20734496974 tag:CHANSEL_NOMATCH channel:0x01 frame:0 vi_tstamp:20734494156 data:0x00000569
     kworker/0:0-4     [000] ....   650.290200: rtcpu_vinotify_event: tstamp:20734921524 tag:FE channel:0x00 frame:0 vi_tstamp:20734493958 data:0x00000020
     kworker/0:0-4     [000] ....   650.290201: rtcpu_vinotify_event: tstamp:20734921660 tag:FS channel:0x00 frame:0 vi_tstamp:20734493999 data:0x00000010
     kworker/0:0-4     [000] ....   650.290202: rtcpu_vinotify_event: tstamp:20734921817 tag:CHANSEL_NOMATCH channel:0x01 frame:0 vi_tstamp:20734494156 data:0x00000569
     kworker/0:0-4     [000] ....   650.290203: rtcpu_vinotify_error: tstamp:20735148369 tag:CHANSEL_NOMATCH channel:0x01 frame:0 vi_tstamp:20735145552 data:0x00000569
     kworker/0:0-4     [000] ....   650.346145: rtcpu_vinotify_event: tstamp:20735463709 tag:FE channel:0x00 frame:0 vi_tstamp:20735145354 data:0x00000020
     kworker/0:0-4     [000] ....   650.346156: rtcpu_vinotify_event: tstamp:20735463866 tag:FS channel:0x00 frame:0 vi_tstamp:20735145394 data:0x00000010
     kworker/0:0-4     [000] ....   650.346157: rtcpu_vinotify_event: tstamp:20735464002 tag:CHANSEL_NOMATCH channel:0x01 frame:0 vi_tstamp:20735145552 data:0x00000569
     kworker/0:0-4     [000] ....   650.346159: rtcpu_vinotify_error: tstamp:20735799763 tag:CHANSEL_NOMATCH channel:0x01 frame:0 vi_tstamp:20735796947 data:0x00000569
     kworker/0:0-4     [000] ....   650.346160: rtcpu_vinotify_event: tstamp:20736005900 tag:FE channel:0x00 frame:0 vi_tstamp:20735796749 data:0x00000020
     kworker/0:0-4     [000] ....   650.346161: rtcpu_vinotify_event: tstamp:20736006035 tag:FS channel:0x00 frame:0 vi_tstamp:20735796790 data:0x00000010
     kworker/0:0-4     [000] ....   650.346162: rtcpu_vinotify_event: tstamp:20736006192 tag:CHANSEL_NOMATCH channel:0x01 frame:0 vi_tstamp:20735796947 data:0x00000569
     kworker/0:0-4     [000] ....   650.346164: rtcpu_vinotify_error: tstamp:20736451160 tag:CHANSEL_NOMATCH channel:0x01 frame:0 vi_tstamp:20736448342 data:0x00000569
     kworker/0:0-4     [000] ....   650.346165: rtcpu_vinotify_event: tstamp:20736548888 tag:FE channel:0x00 frame:0 vi_tstamp:20736448144 data:0x00000020
     kworker/0:0-4     [000] ....   650.346166: rtcpu_vinotify_event: tstamp:20736549043 tag:FS channel:0x00 frame:0 vi_tstamp:20736448186 data:0x00000010
     kworker/0:0-4     [000] ....   650.346200: rtcpu_vinotify_event: tstamp:20736549180 tag:CHANSEL_NOMATCH channel:0x01 frame:0 vi_tstamp:20736448342 data:0x00000569
     kworker/0:0-4     [000] ....   650.402239: rtcpu_vinotify_error: tstamp:20737102603 tag:CHANSEL_NOMATCH channel:0x01 frame:0 vi_tstamp:20737099737 data:0x00000569
     kworker/0:0-4     [000] ....   650.402244: rtcpu_vinotify_event: tstamp:20737102992 tag:FE channel:0x00 frame:0 vi_tstamp:20737099539 data:0x00000020
     kworker/0:0-4     [000] ....   650.402246: rtcpu_vinotify_event: tstamp:20737103129 tag:FS channel:0x00 frame:0 vi_tstamp:20737099580 data:0x00000010
     kworker/0:0-4     [000] ....   650.402247: rtcpu_vinotify_event: tstamp:20737634103 tag:CHANSEL_NOMATCH channel:0x01 frame:0 vi_tstamp:20737099737 data:0x00000569
     kworker/0:0-4     [000] ....   650.402248: rtcpu_vinotify_error: tstamp:20737753950 tag:CHANSEL_NOMATCH channel:0x01 frame:0 vi_tstamp:20737751133 data:0x00000569
     kworker/0:0-4     [000] ....   650.402249: rtcpu_vinotify_event: tstamp:20738176284 tag:FE channel:0x00 frame:0 vi_tstamp:20737750935 data:0x00000020
     kworker/0:0-4     [000] ....   650.402250: rtcpu_vinotify_event: tstamp:20738176440 tag:FS channel:0x00 frame:0 vi_tstamp:20737750974 data:0x00000010
     kworker/0:0-4     [000] ....   650.402251: rtcpu_vinotify_event: tstamp:20738176575 tag:CHANSEL_NOMATCH channel:0x01 frame:0 vi_tstamp:20737751133 data:0x00000569
     kworker/0:0-4     [000] ....   650.402252: rtcpu_vinotify_error: tstamp:20738405392 tag:CHANSEL_NOMATCH channel:0x01 frame:0 vi_tstamp:20738402528 data:0x00000569
     kworker/0:0-4     [000] ....   650.402253: rtcpu_vinotify_event: tstamp:20738719274 tag:FE channel:0x00 frame:0 vi_tstamp:20738402330 data:0x00000020
     kworker/0:0-4     [000] ....   650.402254: rtcpu_vinotify_event: tstamp:20738719409 tag:FS channel:0x00 frame:0 vi_tstamp:20738402371 data:0x00000010
     kworker/0:0-4     [000] ....   650.402255: rtcpu_vinotify_event: tstamp:20738719566 tag:CHANSEL_NOMATCH channel:0x01 frame:0 vi_tstamp:20738402528 data:0x00000569
     kworker/0:0-4     [000] ....   650.458140: rtos_queue_peek_from_isr_failed: tstamp:20739029763 queue:0x0bcbcf78
...

If you need more information, please tell me how to obtain it.

Thanks very much!

ShaneCCC · June 9, 2021, 8:30am

Have a check sensor output metadata lines to modify the embedded_metadata_height in device tree.

toshi_ka · June 9, 2021, 9:48am

Dear ShaneCCC,

Thanks you for your reply!

I checked the embedded_metadata_height setting.
The setting value was “embedded_metadata_height = [32 00];”.
Do I have to change the embedded_metadata_height setting?

I use the device-tree as it is without changing it.
The result of extracting the embedded_metadata_height setting from “/sys/firmware/fdt” is shown below.

Execution command

sudo dtc /sys/firmware/fdt

Execution result

/dts-v1/;

/ {
	serial-number = "1423920018932";
	compatible = "nvidia,p3449-0000+p3668-0000", "nvidia,p3449-0000+p3668-0001", "nvidia,p3509-0000+p3668-0000", "nvidia,p3509-0000+p3668-0001", "nvidia,tegra194";
	interrupt-parent = <0x1>;
	#address-cells = <0x2>;
	#size-cells = <0x2>;
	nvidia,fastboot-usb-vid = <0x955>;
	nvidia,fastboot-usb-pid = <0xee1e>;
	model = "NVIDIA Jetson Xavier NX Developer Kit";
	nvidia,dtsfilename = "/dvs/git/dirty/git-master_linux/kernel/kernel-4.9/arch/arm64/boot/dts/../../../../../../hardware/nvidia/platform/t19x/jakku/kernel-dts/tegra194-p3668-all-p3509-0000.dts";
	nvidia,dtbbuildtime = "Mar  2 2021", "19:56:08";

....

	cam_i2cmux {
		compatible = "i2c-mux-gpio";
		#address-cells = <0x1>;
		#size-cells = <0x0>;
		i2c-parent = <0xd3>;
		mux-gpios = <0x25 0x13 0x0>;

		i2c@0 {
			reg = <0x0>;
			#address-cells = <0x1>;
			#size-cells = <0x0>;
			linux,phandle = <0x174>;
			phandle = <0x174>;

			rbpcv2_imx219_a@10 {
				compatible = "nvidia,imx219";
				reg = <0x10>;
				devnode = "video0";
				physical_w = "3.680";
				physical_h = "2.760";
				sensor_model = "imx219";
				use_sensor_mode_id = "true";
				reset-gpios = <0x13 0x7c 0x0>;
				linux,phandle = <0x175>;
				phandle = <0x175>;

				mode0 {
					mclk_khz = "24000";
					num_lanes = [32 00];
					tegra_sinterface = "serial_a";
					phy_mode = "DPHY";
					discontinuous_clk = "yes";
					dpcm_enable = "false";
					cil_settletime = [30 00];
					active_w = "3264";
					active_h = "2464";
					pixel_t = "bayer_rggb";
					readout_orientation = "90";
					line_length = "3448";
					inherent_gain = [31 00];
					mclk_multiplier = "9.33";
					pix_clk_hz = "182400000";
					gain_factor = "16";
					framerate_factor = "1000000";
					exposure_factor = "1000000";
					min_gain_val = "16";
					max_gain_val = "170";
					step_gain_val = [31 00];
					default_gain = "16";
					min_hdr_ratio = [31 00];
					max_hdr_ratio = [31 00];
					min_framerate = "2000000";
					max_framerate = "21000000";
					step_framerate = [31 00];
					default_framerate = "21000000";
					min_exp_time = "13";
					max_exp_time = "683709";
					step_exp_time = [31 00];
					default_exp_time = "2495";
					embedded_metadata_height = [32 00];
				};

				mode1 {
					mclk_khz = "24000";
					num_lanes = [32 00];
					tegra_sinterface = "serial_a";
					phy_mode = "DPHY";
					discontinuous_clk = "yes";
					dpcm_enable = "false";
					cil_settletime = [30 00];
					active_w = "3264";
					active_h = "1848";
					pixel_t = "bayer_rggb";
					readout_orientation = "90";
					line_length = "3448";
					inherent_gain = [31 00];
					mclk_multiplier = "9.33";
					pix_clk_hz = "182400000";
					gain_factor = "16";
					framerate_factor = "1000000";
					exposure_factor = "1000000";
					min_gain_val = "16";
					max_gain_val = "170";
					step_gain_val = [31 00];
					default_gain = "16";
					min_hdr_ratio = [31 00];
					max_hdr_ratio = [31 00];
					min_framerate = "2000000";
					max_framerate = "28000000";
					step_framerate = [31 00];
					default_framerate = "28000000";
					min_exp_time = "13";
					max_exp_time = "683709";
					step_exp_time = [31 00];
					default_exp_time = "2495";
					embedded_metadata_height = [32 00];
				};

				mode2 {
					mclk_khz = "24000";
					num_lanes = [32 00];
					tegra_sinterface = "serial_a";
					phy_mode = "DPHY";
					discontinuous_clk = "yes";
					dpcm_enable = "false";
					cil_settletime = [30 00];
					active_w = "1920";
					active_h = "1080";
					pixel_t = "bayer_rggb";
					readout_orientation = "90";
					line_length = "3448";
					inherent_gain = [31 00];
					mclk_multiplier = "9.33";
					pix_clk_hz = "182400000";
					gain_factor = "16";
					framerate_factor = "1000000";
					exposure_factor = "1000000";
					min_gain_val = "16";
					max_gain_val = "170";
					step_gain_val = [31 00];
					default_gain = "16";
					min_hdr_ratio = [31 00];
					max_hdr_ratio = [31 00];
					min_framerate = "2000000";
					max_framerate = "30000000";
					step_framerate = [31 00];
					default_framerate = "30000000";
					min_exp_time = "13";
					max_exp_time = "683709";
					step_exp_time = [31 00];
					default_exp_time = "2495";
					embedded_metadata_height = [32 00];
				};

				mode3 {
					mclk_khz = "24000";
					num_lanes = [32 00];
					tegra_sinterface = "serial_a";
					phy_mode = "DPHY";
					discontinuous_clk = "yes";
					dpcm_enable = "false";
					cil_settletime = [30 00];
					active_w = "1640";
					active_h = "1232";
					pixel_t = "bayer_rggb";
					readout_orientation = "90";
					line_length = "3448";
					inherent_gain = [31 00];
					mclk_multiplier = "9.33";
					pix_clk_hz = "182400000";
					gain_factor = "16";
					framerate_factor = "1000000";
					exposure_factor = "1000000";
					min_gain_val = "16";
					max_gain_val = "170";
					step_gain_val = [31 00];
					default_gain = "16";
					min_hdr_ratio = [31 00];
					max_hdr_ratio = [31 00];
					min_framerate = "2000000";
					max_framerate = "30000000";
					step_framerate = [31 00];
					default_framerate = "30000000";
					min_exp_time = "13";
					max_exp_time = "683709";
					step_exp_time = [31 00];
					default_exp_time = "2495";
					embedded_metadata_height = [32 00];
				};

				mode4 {
					mclk_khz = "24000";
					num_lanes = [32 00];
					tegra_sinterface = "serial_a";
					phy_mode = "DPHY";
					discontinuous_clk = "yes";
					dpcm_enable = "false";
					cil_settletime = [30 00];
					active_w = "1280";
					active_h = "720";
					pixel_t = "bayer_rggb";
					readout_orientation = "90";
					line_length = "3448";
					inherent_gain = [31 00];
					mclk_multiplier = "9.33";
					pix_clk_hz = "182400000";
					gain_factor = "16";
					framerate_factor = "1000000";
					exposure_factor = "1000000";
					min_gain_val = "16";
					max_gain_val = "170";
					step_gain_val = [31 00];
					default_gain = "16";
					min_hdr_ratio = [31 00];
					max_hdr_ratio = [31 00];
					min_framerate = "2000000";
					max_framerate = "60000000";
					step_framerate = [31 00];
					default_framerate = "60000000";
					min_exp_time = "13";
					max_exp_time = "683709";
					step_exp_time = [31 00];
					default_exp_time = "2495";
					embedded_metadata_height = [32 00];
				};

				ports {
					#address-cells = <0x1>;
					#size-cells = <0x0>;

					port@0 {
						reg = <0x0>;

						endpoint {
							port-index = <0x0>;
							bus-width = <0x2>;
							remote-endpoint = <0xd4>;
							linux,phandle = <0x70>;
							phandle = <0x70>;
						};
					};
				};
			};
		};

		i2c@1 {
			reg = <0x1>;
			#address-cells = <0x1>;
			#size-cells = <0x0>;
			linux,phandle = <0x176>;
			phandle = <0x176>;

			rbpcv2_imx219_c@10 {
				compatible = "nvidia,imx219";
				reg = <0x10>;
				devnode = "video1";
				physical_w = "3.680";
				physical_h = "2.760";
				sensor_model = "imx219";
				use_sensor_mode_id = "true";
				reset-gpios = <0x13 0x7d 0x0>;
				linux,phandle = <0x177>;
				phandle = <0x177>;

				mode0 {
					mclk_khz = "24000";
					num_lanes = [32 00];
					tegra_sinterface = "serial_c";
					phy_mode = "DPHY";
					discontinuous_clk = "yes";
					dpcm_enable = "false";
					cil_settletime = [30 00];
					active_w = "3264";
					active_h = "2464";
					pixel_t = "bayer_rggb";
					readout_orientation = "90";
					line_length = "3448";
					inherent_gain = [31 00];
					mclk_multiplier = "9.33";
					pix_clk_hz = "182400000";
					gain_factor = "16";
					framerate_factor = "1000000";
					exposure_factor = "1000000";
					min_gain_val = "16";
					max_gain_val = "170";
					step_gain_val = [31 00];
					default_gain = "16";
					min_hdr_ratio = [31 00];
					max_hdr_ratio = [31 00];
					min_framerate = "2000000";
					max_framerate = "21000000";
					step_framerate = [31 00];
					default_framerate = "21000000";
					min_exp_time = "13";
					max_exp_time = "683709";
					step_exp_time = [31 00];
					default_exp_time = "2495";
					embedded_metadata_height = [32 00];
				};

				mode1 {
					mclk_khz = "24000";
					num_lanes = [32 00];
					tegra_sinterface = "serial_c";
					phy_mode = "DPHY";
					discontinuous_clk = "yes";
					dpcm_enable = "false";
					cil_settletime = [30 00];
					active_w = "3264";
					active_h = "1848";
					pixel_t = "bayer_rggb";
					readout_orientation = "90";
					line_length = "3448";
					inherent_gain = [31 00];
					mclk_multiplier = "9.33";
					pix_clk_hz = "182400000";
					gain_factor = "16";
					framerate_factor = "1000000";
					exposure_factor = "1000000";
					min_gain_val = "16";
					max_gain_val = "170";
					step_gain_val = [31 00];
					default_gain = "16";
					min_hdr_ratio = [31 00];
					max_hdr_ratio = [31 00];
					min_framerate = "2000000";
					max_framerate = "28000000";
					step_framerate = [31 00];
					default_framerate = "28000000";
					min_exp_time = "13";
					max_exp_time = "683709";
					step_exp_time = [31 00];
					default_exp_time = "2495";
					embedded_metadata_height = [32 00];
				};

				mode2 {
					mclk_khz = "24000";
					num_lanes = [32 00];
					tegra_sinterface = "serial_c";
					phy_mode = "DPHY";
					discontinuous_clk = "yes";
					dpcm_enable = "false";
					cil_settletime = [30 00];
					active_w = "1920";
					active_h = "1080";
					pixel_t = "bayer_rggb";
					readout_orientation = "90";
					line_length = "3448";
					inherent_gain = [31 00];
					mclk_multiplier = "9.33";
					pix_clk_hz = "182400000";
					gain_factor = "16";
					framerate_factor = "1000000";
					exposure_factor = "1000000";
					min_gain_val = "16";
					max_gain_val = "170";
					step_gain_val = [31 00];
					default_gain = "16";
					min_hdr_ratio = [31 00];
					max_hdr_ratio = [31 00];
					min_framerate = "2000000";
					max_framerate = "30000000";
					step_framerate = [31 00];
					default_framerate = "30000000";
					min_exp_time = "13";
					max_exp_time = "683709";
					step_exp_time = [31 00];
					default_exp_time = "2495";
					embedded_metadata_height = [32 00];
				};

				mode3 {
					mclk_khz = "24000";
					num_lanes = [32 00];
					tegra_sinterface = "serial_c";
					phy_mode = "DPHY";
					discontinuous_clk = "yes";
					dpcm_enable = "false";
					cil_settletime = [30 00];
					active_w = "1640";
					active_h = "1232";
					pixel_t = "bayer_rggb";
					readout_orientation = "90";
					line_length = "3448";
					inherent_gain = [31 00];
					mclk_multiplier = "9.33";
					pix_clk_hz = "182400000";
					gain_factor = "16";
					framerate_factor = "1000000";
					exposure_factor = "1000000";
					min_gain_val = "16";
					max_gain_val = "170";
					step_gain_val = [31 00];
					default_gain = "16";
					min_hdr_ratio = [31 00];
					max_hdr_ratio = [31 00];
					min_framerate = "2000000";
					max_framerate = "30000000";
					step_framerate = [31 00];
					default_framerate = "30000000";
					min_exp_time = "13";
					max_exp_time = "683709";
					step_exp_time = [31 00];
					default_exp_time = "2495";
					embedded_metadata_height = [32 00];
				};

				mode4 {
					mclk_khz = "24000";
					num_lanes = [32 00];
					tegra_sinterface = "serial_c";
					phy_mode = "DPHY";
					discontinuous_clk = "yes";
					dpcm_enable = "false";
					cil_settletime = [30 00];
					active_w = "1280";
					active_h = "720";
					pixel_t = "bayer_rggb";
					readout_orientation = "90";
					line_length = "3448";
					inherent_gain = [31 00];
					mclk_multiplier = "9.33";
					pix_clk_hz = "182400000";
					gain_factor = "16";
					framerate_factor = "1000000";
					exposure_factor = "1000000";
					min_gain_val = "16";
					max_gain_val = "170";
					step_gain_val = [31 00];
					default_gain = "16";
					min_hdr_ratio = [31 00];
					max_hdr_ratio = [31 00];
					min_framerate = "2000000";
					max_framerate = "60000000";
					step_framerate = [31 00];
					default_framerate = "60000000";
					min_exp_time = "13";
					max_exp_time = "683709";
					step_exp_time = [31 00];
					default_exp_time = "2495";
					embedded_metadata_height = [32 00];
				};

				ports {
					#address-cells = <0x1>;
					#size-cells = <0x0>;

					port@0 {
						reg = <0x0>;

						endpoint {
							status = "okay";
							port-index = <0x2>;
							bus-width = <0x2>;
							remote-endpoint = <0xd5>;
							linux,phandle = <0x72>;
							phandle = <0x72>;
						};
					};
				};
			};
		};
	};

....

};

ShaneCCC · June 9, 2021, 10:25am

You need to make sure how many metadata lines output from sensor to set embedded_metadata_height to correct value.

toshi_ka · June 14, 2021, 9:56am

Dear ShaneCCC,

Thanks you for your reply!

Thanks to you, I was able to change the embedded_metadata_height setting and I was able to display the Ultra96 test pattern on Jetson Xavier NX.

Trial content

I checked the embedded_metadata_height setting again.
The setting was embedded_metadata_height = “2”.
I was extracting the embedded_metadata_height setting in the wrong way.
The result of extracting the embedded_metadata_height setting from “/sys/firmware/fdt” is shown below.

Execution command

sudo fdtdump /sys/firmware/fdt

Execution result

/dts-v1/;
// magic:		0xd00dfeed
// totalsize:		0x32c2e (207918)
// off_dt_struct:	0x38
// off_dt_strings:	0x2d814
// off_mem_rsvmap:	0x28
// version:		17
// last_comp_version:	16
// boot_cpuid_phys:	0x0
// size_dt_strings:	0x3e4a
// size_dt_struct:	0x2d7dc

/ {
    serial-number = "1423920018932";
    compatible = "nvidia,p3449-0000+p3668-0000", "nvidia,p3449-0000+p3668-0001", "nvidia,p3509-0000+p3668-0000", "nvidia,p3509-0000+p3668-0001", "nvidia,tegra194";
    interrupt-parent = <0x00000001>;
    #address-cells = <0x00000002>;
    #size-cells = <0x00000002>;
    nvidia,fastboot-usb-vid = <0x00000955>;
    nvidia,fastboot-usb-pid = <0x0000ee1e>;
    model = "NVIDIA Jetson Xavier NX Developer Kit";
    nvidia,dtsfilename = "/dvs/git/dirty/git-master_linux/kernel/kernel-4.9/arch/arm64/boot/dts/../../../../../../hardware/nvidia/platform/t19x/jakku/kernel-dts/tegra194-p3668-all-p3509-0000.dts";
    nvidia,dtbbuildtime = "Mar  2 2021", "19:56:08";

....

    cam_i2cmux {
        compatible = "i2c-mux-gpio";
        #address-cells = <0x00000001>;
        #size-cells = <0x00000000>;
        i2c-parent = <0x000000d3>;
        mux-gpios = <0x00000025 0x00000013 0x00000000>;
        i2c@0 {
            reg = <0x00000000>;
            #address-cells = <0x00000001>;
            #size-cells = <0x00000000>;
            linux,phandle = <0x00000174>;
            phandle = <0x00000174>;
            rbpcv2_imx219_a@10 {
                compatible = "nvidia,imx219";
                reg = <0x00000010>;
                devnode = "video0";
                physical_w = "3.680";
                physical_h = "2.760";
                sensor_model = "imx219";
                use_sensor_mode_id = "true";
                reset-gpios = <0x00000013 0x0000007c 0x00000000>;
                linux,phandle = <0x00000175>;
                phandle = <0x00000175>;
                mode0 {
                    mclk_khz = "24000";
                    num_lanes = "2";
                    tegra_sinterface = "serial_a";
                    phy_mode = "DPHY";
                    discontinuous_clk = "yes";
                    dpcm_enable = "false";
                    cil_settletime = "0";
                    active_w = "3264";
                    active_h = "2464";
                    pixel_t = "bayer_rggb";
                    readout_orientation = "90";
                    line_length = "3448";
                    inherent_gain = "1";
                    mclk_multiplier = "9.33";
                    pix_clk_hz = "182400000";
                    gain_factor = "16";
                    framerate_factor = "1000000";
                    exposure_factor = "1000000";
                    min_gain_val = "16";
                    max_gain_val = "170";
                    step_gain_val = "1";
                    default_gain = "16";
                    min_hdr_ratio = "1";
                    max_hdr_ratio = "1";
                    min_framerate = "2000000";
                    max_framerate = "21000000";
                    step_framerate = "1";
                    default_framerate = "21000000";
                    min_exp_time = "13";
                    max_exp_time = "683709";
                    step_exp_time = "1";
                    default_exp_time = "2495";
                    embedded_metadata_height = "2";
                };
                mode1 {
                    mclk_khz = "24000";
                    num_lanes = "2";
                    tegra_sinterface = "serial_a";
                    phy_mode = "DPHY";
                    discontinuous_clk = "yes";
                    dpcm_enable = "false";
                    cil_settletime = "0";
                    active_w = "3264";
                    active_h = "1848";
                    pixel_t = "bayer_rggb";
                    readout_orientation = "90";
                    line_length = "3448";
                    inherent_gain = "1";
                    mclk_multiplier = "9.33";
                    pix_clk_hz = "182400000";
                    gain_factor = "16";
                    framerate_factor = "1000000";
                    exposure_factor = "1000000";
                    min_gain_val = "16";
                    max_gain_val = "170";
                    step_gain_val = "1";
                    default_gain = "16";
                    min_hdr_ratio = "1";
                    max_hdr_ratio = "1";
                    min_framerate = "2000000";
                    max_framerate = "28000000";
                    step_framerate = "1";
                    default_framerate = "28000000";
                    min_exp_time = "13";
                    max_exp_time = "683709";
                    step_exp_time = "1";
                    default_exp_time = "2495";
                    embedded_metadata_height = "2";
                };
                mode2 {
                    mclk_khz = "24000";
                    num_lanes = "2";
                    tegra_sinterface = "serial_a";
                    phy_mode = "DPHY";
                    discontinuous_clk = "yes";
                    dpcm_enable = "false";
                    cil_settletime = "0";
                    active_w = "1920";
                    active_h = "1080";
                    pixel_t = "bayer_rggb";
                    readout_orientation = "90";
                    line_length = "3448";
                    inherent_gain = "1";
                    mclk_multiplier = "9.33";
                    pix_clk_hz = "182400000";
                    gain_factor = "16";
                    framerate_factor = "1000000";
                    exposure_factor = "1000000";
                    min_gain_val = "16";
                    max_gain_val = "170";
                    step_gain_val = "1";
                    default_gain = "16";
                    min_hdr_ratio = "1";
                    max_hdr_ratio = "1";
                    min_framerate = "2000000";
                    max_framerate = "30000000";
                    step_framerate = "1";
                    default_framerate = "30000000";
                    min_exp_time = "13";
                    max_exp_time = "683709";
                    step_exp_time = "1";
                    default_exp_time = "2495";
                    embedded_metadata_height = "2";
                };
                mode3 {
                    mclk_khz = "24000";
                    num_lanes = "2";
                    tegra_sinterface = "serial_a";
                    phy_mode = "DPHY";
                    discontinuous_clk = "yes";
                    dpcm_enable = "false";
                    cil_settletime = "0";
                    active_w = "1640";
                    active_h = "1232";
                    pixel_t = "bayer_rggb";
                    readout_orientation = "90";
                    line_length = "3448";
                    inherent_gain = "1";
                    mclk_multiplier = "9.33";
                    pix_clk_hz = "182400000";
                    gain_factor = "16";
                    framerate_factor = "1000000";
                    exposure_factor = "1000000";
                    min_gain_val = "16";
                    max_gain_val = "170";
                    step_gain_val = "1";
                    default_gain = "16";
                    min_hdr_ratio = "1";
                    max_hdr_ratio = "1";
                    min_framerate = "2000000";
                    max_framerate = "30000000";
                    step_framerate = "1";
                    default_framerate = "30000000";
                    min_exp_time = "13";
                    max_exp_time = "683709";
                    step_exp_time = "1";
                    default_exp_time = "2495";
                    embedded_metadata_height = "2";
                };
                mode4 {
                    mclk_khz = "24000";
                    num_lanes = "2";
                    tegra_sinterface = "serial_a";
                    phy_mode = "DPHY";
                    discontinuous_clk = "yes";
                    dpcm_enable = "false";
                    cil_settletime = "0";
                    active_w = "1280";
                    active_h = "720";
                    pixel_t = "bayer_rggb";
                    readout_orientation = "90";
                    line_length = "3448";
                    inherent_gain = "1";
                    mclk_multiplier = "9.33";
                    pix_clk_hz = "182400000";
                    gain_factor = "16";
                    framerate_factor = "1000000";
                    exposure_factor = "1000000";
                    min_gain_val = "16";
                    max_gain_val = "170";
                    step_gain_val = "1";
                    default_gain = "16";
                    min_hdr_ratio = "1";
                    max_hdr_ratio = "1";
                    min_framerate = "2000000";
                    max_framerate = "60000000";
                    step_framerate = "1";
                    default_framerate = "60000000";
                    min_exp_time = "13";
                    max_exp_time = "683709";
                    step_exp_time = "1";
                    default_exp_time = "2495";
                    embedded_metadata_height = "2";
                };
                ports {
                    #address-cells = <0x00000001>;
                    #size-cells = <0x00000000>;
                    port@0 {
                        reg = <0x00000000>;
                        endpoint {
                            port-index = <0x00000000>;
                            bus-width = <0x00000002>;
                            remote-endpoint = <0x000000d4>;
                            linux,phandle = <0x00000070>;
                            phandle = <0x00000070>;
                        };
                    };
                };
            };
        };
        i2c@1 {
            reg = <0x00000001>;
            #address-cells = <0x00000001>;
            #size-cells = <0x00000000>;
            linux,phandle = <0x00000176>;
            phandle = <0x00000176>;
            rbpcv2_imx219_c@10 {
                compatible = "nvidia,imx219";
                reg = <0x00000010>;
                devnode = "video1";
                physical_w = "3.680";
                physical_h = "2.760";
                sensor_model = "imx219";
                use_sensor_mode_id = "true";
                reset-gpios = <0x00000013 0x0000007d 0x00000000>;
                linux,phandle = <0x00000177>;
                phandle = <0x00000177>;
                mode0 {
                    mclk_khz = "24000";
                    num_lanes = "2";
                    tegra_sinterface = "serial_c";
                    phy_mode = "DPHY";
                    discontinuous_clk = "yes";
                    dpcm_enable = "false";
                    cil_settletime = "0";
                    active_w = "3264";
                    active_h = "2464";
                    pixel_t = "bayer_rggb";
                    readout_orientation = "90";
                    line_length = "3448";
                    inherent_gain = "1";
                    mclk_multiplier = "9.33";
                    pix_clk_hz = "182400000";
                    gain_factor = "16";
                    framerate_factor = "1000000";
                    exposure_factor = "1000000";
                    min_gain_val = "16";
                    max_gain_val = "170";
                    step_gain_val = "1";
                    default_gain = "16";
                    min_hdr_ratio = "1";
                    max_hdr_ratio = "1";
                    min_framerate = "2000000";
                    max_framerate = "21000000";
                    step_framerate = "1";
                    default_framerate = "21000000";
                    min_exp_time = "13";
                    max_exp_time = "683709";
                    step_exp_time = "1";
                    default_exp_time = "2495";
                    embedded_metadata_height = "2";
                };
                mode1 {
                    mclk_khz = "24000";
                    num_lanes = "2";
                    tegra_sinterface = "serial_c";
                    phy_mode = "DPHY";
                    discontinuous_clk = "yes";
                    dpcm_enable = "false";
                    cil_settletime = "0";
                    active_w = "3264";
                    active_h = "1848";
                    pixel_t = "bayer_rggb";
                    readout_orientation = "90";
                    line_length = "3448";
                    inherent_gain = "1";
                    mclk_multiplier = "9.33";
                    pix_clk_hz = "182400000";
                    gain_factor = "16";
                    framerate_factor = "1000000";
                    exposure_factor = "1000000";
                    min_gain_val = "16";
                    max_gain_val = "170";
                    step_gain_val = "1";
                    default_gain = "16";
                    min_hdr_ratio = "1";
                    max_hdr_ratio = "1";
                    min_framerate = "2000000";
                    max_framerate = "28000000";
                    step_framerate = "1";
                    default_framerate = "28000000";
                    min_exp_time = "13";
                    max_exp_time = "683709";
                    step_exp_time = "1";
                    default_exp_time = "2495";
                    embedded_metadata_height = "2";
                };
                mode2 {
                    mclk_khz = "24000";
                    num_lanes = "2";
                    tegra_sinterface = "serial_c";
                    phy_mode = "DPHY";
                    discontinuous_clk = "yes";
                    dpcm_enable = "false";
                    cil_settletime = "0";
                    active_w = "1920";
                    active_h = "1080";
                    pixel_t = "bayer_rggb";
                    readout_orientation = "90";
                    line_length = "3448";
                    inherent_gain = "1";
                    mclk_multiplier = "9.33";
                    pix_clk_hz = "182400000";
                    gain_factor = "16";
                    framerate_factor = "1000000";
                    exposure_factor = "1000000";
                    min_gain_val = "16";
                    max_gain_val = "170";
                    step_gain_val = "1";
                    default_gain = "16";
                    min_hdr_ratio = "1";
                    max_hdr_ratio = "1";
                    min_framerate = "2000000";
                    max_framerate = "30000000";
                    step_framerate = "1";
                    default_framerate = "30000000";
                    min_exp_time = "13";
                    max_exp_time = "683709";
                    step_exp_time = "1";
                    default_exp_time = "2495";
                    embedded_metadata_height = "2";
                };
                mode3 {
                    mclk_khz = "24000";
                    num_lanes = "2";
                    tegra_sinterface = "serial_c";
                    phy_mode = "DPHY";
                    discontinuous_clk = "yes";
                    dpcm_enable = "false";
                    cil_settletime = "0";
                    active_w = "1640";
                    active_h = "1232";
                    pixel_t = "bayer_rggb";
                    readout_orientation = "90";
                    line_length = "3448";
                    inherent_gain = "1";
                    mclk_multiplier = "9.33";
                    pix_clk_hz = "182400000";
                    gain_factor = "16";
                    framerate_factor = "1000000";
                    exposure_factor = "1000000";
                    min_gain_val = "16";
                    max_gain_val = "170";
                    step_gain_val = "1";
                    default_gain = "16";
                    min_hdr_ratio = "1";
                    max_hdr_ratio = "1";
                    min_framerate = "2000000";
                    max_framerate = "30000000";
                    step_framerate = "1";
                    default_framerate = "30000000";
                    min_exp_time = "13";
                    max_exp_time = "683709";
                    step_exp_time = "1";
                    default_exp_time = "2495";
                    embedded_metadata_height = "2";
                };
                mode4 {
                    mclk_khz = "24000";
                    num_lanes = "2";
                    tegra_sinterface = "serial_c";
                    phy_mode = "DPHY";
                    discontinuous_clk = "yes";
                    dpcm_enable = "false";
                    cil_settletime = "0";
                    active_w = "1280";
                    active_h = "720";
                    pixel_t = "bayer_rggb";
                    readout_orientation = "90";
                    line_length = "3448";
                    inherent_gain = "1";
                    mclk_multiplier = "9.33";
                    pix_clk_hz = "182400000";
                    gain_factor = "16";
                    framerate_factor = "1000000";
                    exposure_factor = "1000000";
                    min_gain_val = "16";
                    max_gain_val = "170";
                    step_gain_val = "1";
                    default_gain = "16";
                    min_hdr_ratio = "1";
                    max_hdr_ratio = "1";
                    min_framerate = "2000000";
                    max_framerate = "60000000";
                    step_framerate = "1";
                    default_framerate = "60000000";
                    min_exp_time = "13";
                    max_exp_time = "683709";
                    step_exp_time = "1";
                    default_exp_time = "2495";
                    embedded_metadata_height = "2";
                };
                ports {
                    #address-cells = <0x00000001>;
                    #size-cells = <0x00000000>;
                    port@0 {
                        reg = <0x00000000>;
                        endpoint {
                            status = "okay";
                            port-index = <0x00000002>;
                            bus-width = <0x00000002>;
                            remote-endpoint = <0x000000d5>;
                            linux,phandle = <0x00000072>;
                            phandle = <0x00000072>;
                        };
                    };
                };
            };
        };
    };

....

};

I was able to display the Ultra96 test pattern on Jetson Xavier NX by changing it to “embedded_metadata_height =” 0 “;”.

Thanks very much!