Continuing the discussion from Fail to recevie v4l2 with new sensor :
Had to open new topic since mine was closed. I updated to Jetpack 5.1.3.
Now I get other errors. Can you hint me on whats wrong?
command:v4l2-ctl --set-fmt-video=width=2688,height=2080,pixelformat=RG10 --stream-mmap
dmesg error:tegra-camrtc-capture-vi tegra-capture-vi: corr_err: discarding frame 0, flags: 0, err_data 16384
Trace Log using these commands:
echo 1 > /sys/kernel/debug/tracing/tracing_on
echo 30720 > /sys/kernel/debug/tracing/buffer_size_kb
echo 1 > /sys/kernel/debug/tracing/events/tegra_rtcpu/enable
echo 1 > /sys/kernel/debug/tracing/events/freertos/enable
echo 2 > /sys/kernel/debug/camrtc/log-level
echo > /sys/kernel/debug/tracing/trace
cat /sys/kernel/debug/tracing/trace
kworker/2:3-107 [002] … 1097.063208: rtcpu_vinotify_event: tstamp:34995119114 cch:0 vi:0 tag:VIFALC_TDSTATE channel:0x23 frame:0 vi_tstamp:1119827075904 data:0xcd9ce50010000000
Hi busch.johannes,
Could you share more information about your setup? What is your device tree configuration? Are you using embedded metadata? You can find more information here on how to interpret CHANSEL_NOMATCH errors, but this could be a misconfiguration that is causing a mismatch between the expected incoming stream and what it is actually receiving.
hello busch.johannes,
first of all,class:GLOBAL type:PHY_INTR0 phy:2 cil:0 st:0 vc:0 status:0x01c00000class:GLOBAL type:PHY_INTR0 phy:2 cil:1 st:0 vc:0 status:0x00c00000
however, there’s CHANSEL_FAULT reported with error code 0x04004. this is failure related the embedded data. please confirm whether you’re outputting embedded metadata. you may also review your device tree property, embedded_metadata_height.
This is my device tree for the sensor:
#include <dt-bindings/media/camera.h>
/ {
tegra-capture-vi {
num-channels = <2>;
ports {
#address-cells = <1>;
#size-cells = <0>;
vi_port0: port@0 {
reg = <0>;
IMX000_vi_in0: endpoint {
port-index = <0>;
bus-width = <4>;
remote-endpoint = <&IMX000_csi_out0>;
};
};
vi_port1: port@1 {
reg = <1>;
IMX000_vi_in1: endpoint {
port-index = <4>;
bus-width = <4>;
remote-endpoint = <&IMX000_csi_out1>;
};
};
};
};
host1x@13e00000 {
nvcsi@15a00000 {
num-channels = <2>;
#address-cells = <1>;
#size-cells = <0>;
csi_chan0: channel@0 {
reg = <0>;
ports {
#address-cells = <1>;
#size-cells = <0>;
csi_chan0_port0: port@0 {
reg = <0>;
IMX000_csi_in0: endpoint@0 {
port-index = <0>;
bus-width = <4>;
remote-endpoint = <&IMX000_dual_out0>;
};
};
csi_chan0_port1: port@1 {
reg = <1>;
IMX000_csi_out0: endpoint@1 {
remote-endpoint = <&IMX000_vi_in0>;
};
};
};
};
csi_chan1: channel@1 {
reg = <1>;
ports {
#address-cells = <1>;
#size-cells = <0>;
csi_chan1_port0: port@0 {
reg = <0>;
IMX000_csi_in1: endpoint@2 {
port-index = <4>;
bus-width = <4>;
remote-endpoint = <&IMX000_dual_out1>;
};
};
csi_chan1_port1: port@1 {
reg = <1>;
IMX000_csi_out1: endpoint@3 {
remote-endpoint = <&IMX000_vi_in1>;
};
};
};
};
};
};
i2c@3180000 {
#address-cells = <1>;
#size-cells = <0>;
IMX000_cam0: IMX000_a@36 {
compatible = "nvidia,IMX000";
reg = <0x36>;
devnode = "video1";
/* Physical dimensions of sensor */
physical_w = "15.1";
physical_h = "12.5";
sensor_model ="IMX000";
/* Define any required hw resources needed by driver */
/* ie. clocks, io pins, power sources */
/* Defines number of frames to be dropped by driver internally after applying */
/* sensor crop settings. Some sensors send corrupt frames after applying */
/* crop co-ordinates */
post_crop_frame_drop = "0";
/* Convert Gain to unit of dB (decibel) befor passing to kernel driver */
use_decibel_gain = "false";
/* if true, delay gain setting by one frame to be in sync with exposure */
delayed_gain = "false";
/* enable CID_SENSOR_MODE_ID for sensor modes selection */
use_sensor_mode_id = "true";
mode0 {
mclk_khz = "74250";
num_lanes = "4";
tegra_sinterface = "serial_a";
phy_mode = "DPHY";
discontinuous_clk = "no";
dpcm_enable = "false";
cil_settletime = "0";
dynamic_pixel_bit_depth = "10";
csi_pixel_bit_depth = "10";
mode_type = "bayer";
pixel_phase = "rggb";
active_w = "2688";
active_h = "2080";
readout_orientation = "0";
line_length = "2688";
inherent_gain = "1";
pix_clk_hz = "712800000";
gain_factor = "16";
min_gain_val = "16";
max_gain_val = "248";
step_gain_val = "1";
default_gain = "16";
min_hdr_ratio = "1";
max_hdr_ratio = "1";
framerate_factor = "1000000";
min_framerate = "1000000";
max_framerate = "540000000";
step_framerate = "1";
default_framerate= "20000000";
exposure_factor = "1000000";
min_exp_time = "100";
max_exp_time = "1000000";
step_exp_time = "1";
default_exp_time = "9000";
embedded_metadata_height = "0";
};
ports {
#address-cells = <1>;
#size-cells = <0>;
port@0 {
reg = <0>;
IMX000_dual_out0: endpoint {
status = "okay";
port-index = <0>;
bus-width = <4>;
remote-endpoint = <&IMX000_csi_in0>;
};
};
};
};
};
i2c@c240000 {
#address-cells = <1>;
#size-cells = <0>;
IMX000_cam1: IMX000_e@36 {
compatible = "nvidia,IMX000";
reg = <0x36>;
devnode = "video1";
/* Physical dimensions of sensor */
physical_w = "15.0";
physical_h = "12.5";
sensor_model ="IMX000";
/* Define any required hw resources needed by driver */
/* ie. clocks, io pins, power sources */
/* Defines number of frames to be dropped by driver internally after applying */
/* sensor crop settings. Some sensors send corrupt frames after applying */
/* crop co-ordinates */
post_crop_frame_drop = "0";
/* Convert Gain to unit of dB (decibel) befor passing to kernel driver */
use_decibel_gain = "false";
/* if true, delay gain setting by one frame to be in sync with exposure */
delayed_gain = "false";
/* enable CID_SENSOR_MODE_ID for sensor modes selection */
use_sensor_mode_id = "true";
mode0 {
mclk_khz = "74250";
num_lanes = "4";
tegra_sinterface = "serial_e";
phy_mode = "DPHY";
discontinuous_clk = "no";
dpcm_enable = "false";
cil_settletime = "0";
dynamic_pixel_bit_depth = "10";
csi_pixel_bit_depth = "10";
mode_type = "bayer";
pixel_phase = "rggb";
active_w = "2688";
active_h = "2080";
readout_orientation = "0";
line_length = "2688";
inherent_gain = "1";
pix_clk_hz = "712800000";
gain_factor = "16";
min_gain_val = "16";
max_gain_val = "248";
step_gain_val = "1";
default_gain = "16";
min_hdr_ratio = "1";
max_hdr_ratio = "1";
framerate_factor = "1000000";
min_framerate = "1000000";
max_framerate = "540000000";
step_framerate = "1";
default_framerate= "20000000";
exposure_factor = "1000000";
min_exp_time = "100";
max_exp_time = "1000000";
step_exp_time = "1";
default_exp_time = "9000";
embedded_metadata_height = "0";
};
ports {
#address-cells = <1>;
#size-cells = <0>;
port@0 {
reg = <0>;
IMX000_dual_out1: endpoint {
status = "okay";
port-index = <4>;
bus-width = <4>;
remote-endpoint = <&IMX000_csi_in1>;
};
};
};
};
};
};
/ {
tcp: tegra-camera-platform {
compatible = "nvidia, tegra-camera-platform";
/**
* Physical settings to calculate max ISO BW
*
* num_csi_lanes = <>;
* Total number of CSI lanes when all cameras are active
*
* max_lane_speed = <>;
* Max lane speed in Kbit/s
*
* min_bits_per_pixel = <>;
* Min bits per pixel
*
* vi_peak_byte_per_pixel = <>;
* Max byte per pixel for the VI ISO case
*
* vi_bw_margin_pct = <>;
* Vi bandwidth margin in percentage
*
* max_pixel_rate = <>;
* Max pixel rate in Kpixel/s for the ISP ISO case
*
* isp_peak_byte_per_pixel = <>;
* Max byte per pixel for the ISP ISO case
*
* isp_bw_margin_pct = <>;
* Isp bandwidth margin in percentage
*/
num_csi_lanes = <8>;
max_lane_speed = <1500000>;
min_bits_per_pixel = <10>;
vi_peak_byte_per_pixel = <2>;
vi_bw_margin_pct = <25>;
max_pixel_rate = <240000>;
isp_peak_byte_per_pixel = <5>;
isp_bw_margin_pct = <25>;
/**
* The general guideline for naming badge_info contains 3 parts, and is as follows,
* The first part is the camera_board_id for the module; if the module is in a FFD
* platform, then use the platform name for this part.
* The second part contains the position of the module, ex. "rear" or "front".
* The third part contains the last 6 characters of a part number which is found
* in the module's specsheet from the vendor.
*/
modules {
cam_module0: module0 {
badge = "jakku_rear_IMX000";
position = "rear";
orientation = "0";
cam_module0_drivernode0: drivernode0 {
pcl_id = "v4l2_sensor";
devname = "IMX000 1-0036";
proc-device-tree = "/proc/device-tree/i2c@c240000/IMX000_e@36";
};
};
cam_module1: module1 {
badge = "jakku_front_IMX000";
position = "front";
orientation = "0";
cam_module1_drivernode0: drivernode0 {
pcl_id = "v4l2_sensor";
devname = "IMX000 2-0036";
proc-device-tree = "/proc/device-tree/i2c@3180000/IMX000_a@36";
};
};
};
};
};
I switched from JP4.6 to JP5 but tried to make it like the other example sensors.
I’ll post the media links in a bit.
Device topology
- entity 1: 13e10000.host1x:nvcsi@15a00000- (2 pads, 0 link)
type V4L2 subdev subtype Unknown flags 0
device node name /dev/v4l-subdev0
pad0: Sink
pad1: Source
- entity 4: 13e10000.host1x:nvcsi@15a00000- (2 pads, 2 links)
type V4L2 subdev subtype Unknown flags 0
device node name /dev/v4l-subdev1
pad0: Sink
<- "IMX000 1-0036":0 [ENABLED]
pad1: Source
-> "vi-output, IMX000 1-0036":0 [ENABLED]
- entity 7: IMX000 1-0036 (1 pad, 1 link)
type V4L2 subdev subtype Sensor flags 0
device node name /dev/v4l-subdev2
pad0: Source
[fmt:SRGGB10_1X10/2688x2080 field:none colorspace:srgb]
-> "13e10000.host1x:nvcsi@15a00000-":0 [ENABLED]
- entity 9: vi-output, IMX000 1-0036 (1 pad, 1 link)
type Node subtype V4L flags 0
device node name /dev/video0
pad0: Sink
<- "13e10000.host1x:nvcsi@15a00000-":1 [ENABLED]
My sensor outputs embedded metadata in the first lines. But how does Jetson make a difference between just pixels and embedded metadata?
hello busch.johannes,
please refer to Camera Driver Porting since you’re moving from JP-4 to JP-5.
it’s pixel parser hardware to distinguish embedded metadata and active pixels, so, you must set the correct embedded_metadata_height in device tree.
I will try!
When the lines transferred are for example 2000, but 2 of them are metadata. Do I have to set active_h to 1998 and embedded_metadata_height to 2, or should active_h stay at 2000?
Which value should I use for height in drivers mode_table.
Best,
hello busch.johannes,
in such example, you should configure active_h = "1998" and embedded_metadata_height = "2" in sensor device tree.
I added 1 line of embedded metadata, that should be output by sensor. Now I get this error in dmesg and following trace:
[ 101.800637] tegra-camrtc-capture-vi tegra-capture-vi: corr_err: discarding frame 1, flags: 0, err_data 131072
[ 101.810083] tegra-camrtc-capture-vi tegra-capture-vi: corr_err: discarding frame 2, flags: 0, err_data 131072
kworker/0:2-84 [000] .... 101.775439: rtcpu_vinotify_event: tstamp:3887629403 cch:0 vi:0 tag:VIFALC_TDSTATE channel:0x23 frame:0 vi_tstamp:124388015648 data:0xcd9ce50010000000
kworker/0:2-84 [000] .... 101.775443: rtcpu_vinotify_event: tstamp:3887629578 cch:0 vi:0 tag:VIFALC_TDSTATE channel:0x23 frame:0 vi_tstamp:124388027424 data:0x0000000031000001
kworker/0:2-84 [000] .... 101.775445: rtcpu_vinotify_event: tstamp:3887629754 cch:0 vi:0 tag:VIFALC_TDSTATE channel:0x23 frame:0 vi_tstamp:124388083200 data:0xcd9ce20010000000
kworker/0:2-84 [000] .... 101.775446: rtcpu_vinotify_event: tstamp:3887629903 cch:0 vi:0 tag:VIFALC_TDSTATE channel:0x23 frame:0 vi_tstamp:124388095168 data:0x0000000031000002
kworker/0:2-84 [000] .... 101.831484: rtcpu_nvcsi_intr: tstamp:3889455855 class:GLOBAL type:PHY_INTR0 phy:2 cil:0 st:0 vc:0 status:0x01c00000
kworker/0:2-84 [000] .... 101.831488: rtcpu_nvcsi_intr: tstamp:3889455855 class:GLOBAL type:PHY_INTR0 phy:2 cil:1 st:0 vc:0 status:0x00c00000
kworker/0:2-84 [000] .... 101.831495: rtcpu_vinotify_event: tstamp:3889799802 cch:0 vi:0 tag:FS channel:0x00 frame:1 vi_tstamp:124466629920 data:0x0000000000000014
kworker/0:2-84 [000] .... 101.831523: rtcpu_vinotify_event: tstamp:3889799959 cch:0 vi:0 tag:ATOMP_FS channel:0x00 frame:1 vi_tstamp:124466630016 data:0x0000000800000000
kworker/0:2-84 [000] .... 101.831524: rtcpu_vinotify_event: tstamp:3889800133 cch:0 vi:0 tag:CHANSEL_EMBED_SOF channel:0x23 frame:1 vi_tstamp:124466634080 data:0x0000000000000004
kworker/0:2-84 [000] .... 101.831525: rtcpu_vinotify_event: tstamp:3889800283 cch:0 vi:0 tag:CHANSEL_EMBED_EOF channel:0x23 frame:1 vi_tstamp:124466637856 data:0x0000000000000008
kworker/0:2-84 [000] .... 101.831526: rtcpu_vinotify_event: tstamp:3889800458 cch:0 vi:0 tag:CHANSEL_NOMATCH channel:0x10 frame:1 vi_tstamp:124466638496 data:0x00000000000006e9
kworker/0:2-84 [000] .... 101.831527: rtcpu_vinotify_event: tstamp:3889800609 cch:0 vi:0 tag:ATOMP_EMB_DATA_DONE channel:0x23 frame:1 vi_tstamp:124466638592 data:0x0000000000000000
kworker/0:2-84 [000] .... 101.831528: rtcpu_vinotify_event: tstamp:3889800781 cch:0 vi:0 tag:VIFALC_ACTIONLST channel:0x23 frame:1 vi_tstamp:124466720608 data:0x0000000003020001
kworker/0:2-84 [000] .... 101.831529: rtcpu_vinotify_event: tstamp:3889800931 cch:0 vi:0 tag:CHANSEL_PXL_SOF channel:0x23 frame:1 vi_tstamp:124466744192 data:0x0000000000000001
kworker/0:2-84 [000] .... 101.831530: rtcpu_vinotify_event: tstamp:3889801101 cch:0 vi:0 tag:VIFALC_ACTIONLST channel:0x23 frame:1 vi_tstamp:124466785280 data:0x0000000008020001
kworker/0:2-84 [000] .... 101.831531: rtcpu_vinotify_event: tstamp:3889879077 cch:0 vi:0 tag:FE channel:0x00 frame:1 vi_tstamp:124475798816 data:0x0000000000000024
kworker/0:2-84 [000] .... 101.831533: rtcpu_vinotify_event: tstamp:3889879252 cch:0 vi:0 tag:CHANSEL_SHORT_FRAME channel:0x10 frame:1 vi_tstamp:124475798848 data:0x0000200001000000
kworker/0:2-84 [000] .... 101.831534: rtcpu_vinotify_event: tstamp:3889879404 cch:0 vi:0 tag:VIFALC_ACTIONLST channel:0x23 frame:1 vi_tstamp:124475864576 data:0x0000000001020001
kworker/0:2-84 [000] .... 101.831536: rtcpu_vinotify_event: tstamp:3890174066 cch:0 vi:0 tag:ATOMP_FE channel:0x00 frame:1 vi_tstamp:124475798944 data:0x0000000800000000
kworker/0:2-84 [000] .... 101.831537: rtcpu_vinotify_event: tstamp:3890174255 cch:0 vi:0 tag:FS channel:0x00 frame:2 vi_tstamp:124476054592 data:0x0000000000000014
kworker/0:2-84 [000] .... 101.831538: rtcpu_vinotify_event: tstamp:3890174434 cch:0 vi:0 tag:ATOMP_FS channel:0x00 frame:2 vi_tstamp:124476054656 data:0x0000000800000000
kworker/0:2-84 [000] .... 101.831539: rtcpu_vinotify_event: tstamp:3890174586 cch:0 vi:0 tag:CHANSEL_EMBED_SOF channel:0x23 frame:2 vi_tstamp:124476058752 data:0x0000000000000004
kworker/0:2-84 [000] .... 101.831540: rtcpu_vinotify_event: tstamp:3890174758 cch:0 vi:0 tag:CHANSEL_EMBED_EOF channel:0x23 frame:2 vi_tstamp:124476062496 data:0x0000000000000008
kworker/0:2-84 [000] .... 101.831541: rtcpu_vinotify_event: tstamp:3890174907 cch:0 vi:0 tag:CHANSEL_NOMATCH channel:0x10 frame:2 vi_tstamp:124476063136 data:0x00000000000006e9
kworker/0:2-84 [000] .... 101.831542: rtcpu_vinotify_event: tstamp:3890175077 cch:0 vi:0 tag:ATOMP_EMB_DATA_DONE channel:0x23 frame:2 vi_tstamp:124476063296 data:0x0000000000000000
kworker/0:2-84 [000] .... 101.831543: rtcpu_vinotify_event: tstamp:3890175226 cch:0 vi:0 tag:VIFALC_ACTIONLST channel:0x23 frame:2 vi_tstamp:124476180544 data:0x0000000003020002
kworker/0:2-84 [000] .... 101.831545: rtcpu_vinotify_event: tstamp:3890183295 cch:0 vi:0 tag:CHANSEL_PXL_SOF channel:0x23 frame:2 vi_tstamp:124476168864 data:0x0000000000000001
kworker/0:2-84 [000] .... 101.831546: rtcpu_vinotify_event: tstamp:3890183451 cch:0 vi:0 tag:VIFALC_ACTIONLST channel:0x23 frame:2 vi_tstamp:124476206048 data:0x0000000008020002
kworker/0:2-84 [000] .... 101.831547: rtcpu_vinotify_event: tstamp:3890183622 cch:0 vi:0 tag:VIFALC_TDSTATE channel:0x23 frame:0 vi_tstamp:124476499520 data:0xcd9ce50010000000
kworker/0:2-84 [000] .... 101.831548: rtcpu_vinotify_event: tstamp:3890183772 cch:0 vi:0 tag:VIFALC_TDSTATE channel:0x23 frame:0 vi_tstamp:124476542944 data:0x0000000031000003
kworker/0:2-84 [000] .... 101.831549: rtcpu_vinotify_event: tstamp:3890183945 cch:0 vi:0 tag:FE channel:0x00 frame:2 vi_tstamp:124485223488 data:0x0000000000000024
kworker/0:2-84 [000] .... 101.831550: rtcpu_vinotify_event: tstamp:3890184101 cch:0 vi:0 tag:CHANSEL_SHORT_FRAME channel:0x10 frame:2 vi_tstamp:124485223520 data:0x0000200001000000
kworker/0:2-84 [000] .... 101.831551: rtcpu_vinotify_event: tstamp:3890184276 cch:0 vi:0 tag:VIFALC_ACTIONLST channel:0x23 frame:2 vi_tstamp:124485289184 data:0x0000000001020002
kworker/0:2-84 [000] .... 101.831552: rtcpu_vinotify_event: tstamp:3890184430 cch:0 vi:0 tag:ATOMP_FE channel:0x00 frame:2 vi_tstamp:124485223552 data:0x0000000800000000
kworker/0:2-84 [000] .... 101.831554: rtcpu_vinotify_event: tstamp:3890480061 cch:0 vi:0 tag:FS channel:0x00 frame:3 vi_tstamp:124485479232 data:0x0000000000000014
kworker/0:2-84 [000] .... 101.831555: rtcpu_vinotify_event: tstamp:3890480222 cch:0 vi:0 tag:ATOMP_FS channel:0x00 frame:3 vi_tstamp:124485479328 data:0x0000000800000000
kworker/0:2-84 [000] .... 101.831581: rtcpu_vinotify_event: tstamp:3890480396 cch:0 vi:0 tag:CHANSEL_EMBED_SOF channel:0x23 frame:3 vi_tstamp:124485483424 data:0x0000000000000004
kworker/0:2-84 [000] .... 101.831582: rtcpu_vinotify_event: tstamp:3890480546 cch:0 vi:0 tag:CHANSEL_EMBED_EOF channel:0x23 frame:3 vi_tstamp:124485487168 data:0x0000000000000008
kworker/0:2-84 [000] .... 101.831583: rtcpu_vinotify_event: tstamp:3890480719 cch:0 vi:0 tag:CHANSEL_NOMATCH channel:0x10 frame:3 vi_tstamp:124485487808 data:0x00000000000006e9
kworker/0:2-84 [000] .... 101.831584: rtcpu_vinotify_event: tstamp:3890480869 cch:0 vi:0 tag:ATOMP_EMB_DATA_DONE channel:0x23 frame:3 vi_tstamp:124485487904 data:0x0000000000000000
But I notice that using GStreamer I can actually receive frames, while v4l2 is still not working.
hello busch.johannes,
it’s reporting discarding frames, which meant it’s VI dropping current capture buffers due to unsuccessfully capture state.CHANSEL_SHORT_FRAME, it means the coming frame-heigh is less than the expectation.
hence…
It should be correct, but I found in another thread that it also reports frames that are too long, so I guess I will just try and error to find the right size.
I missed something from the data sheet, that changed the number of lines being transferred compared to the older generation.
After setting the correct number of lines I can receive images with V4L2 and GStreamer.
Actually it helped me a lot to use GStreamer, save the image and count the pixels that are not correctly filled with data. GStreamer seems to ignore short frame and just fill up with empty pixels.
Thanks for your support. It helped me a lot!
system
June 18, 2024, 8:19am
16
This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.