JiaZW
May 29, 2019, 8:36am
#1
my dear ，
finish ov4689 sensor driver refer to ov5693
modify ov4689 dts refer to ov5693
Now:
question:
[b] can not get VIDEO data through v4l2-ctl cmd[/b]
cmd:
v4l2-ctl --set-fmt-video=width=1920,height=1080,pixelformat=BG10 --stream-mmap=1 --stream-count=10000
--stream-to=/tmp/stream.raw -d /dev/video0 &
Can you tell me what the problem is ???? thanks
JiaZW
May 29, 2019, 8:39am
#2
debug1 :
echo 1 > /sys/kernel/debug/tracing/tracing_on
echo 30720 > /sys/kernel/debug/tracing/buffer_size_kb
echo 1 > /sys/kernel/debug/tracing/events/tegra_rtcpu/enable
echo 1 > /sys/kernel/debug/tracing/events/freertos/enable
echo 2 > /sys/kernel/debug/camrtc/log-level
echo > /sys/kernel/debug/tracing/trace
cat /sys/kernel/debug/tracing/trace
ries-in-buffer/entries-written: 240/240 #P:4
_-----=> irqs-off
/ _----=> need-resched
| / _—=> hardirq/softirq
|| / _–=> preempt-depth
||| / delay
TASK-PID CPU# |||| TIMESTAMP FUNCTION
| | | |||| | |
debug2 :
v4l2-ctl --all:
Driver Info:
Camera Controls
frame_length 0x009a2000 (int) : min=0 max=32767 step=1 default=1984 value=1984 flags=slider
coarse_time 0x009a2001 (int) : min=2 max=32761 step=1 default=1978 value=1978 flags=slider
coarse_time_short 0x009a2002 (int) : min=2 max=32761 step=1 default=1978 value=1978 flags=slider
group_hold 0x009a2003 (intmenu): min=0 max=1 default=0 value=0
hdr_enable 0x009a2004 (intmenu): min=0 max=1 default=0 value=0
eeprom_data 0x009a2005 (str) : min=0 max=2048 step=2 value='' flags=read-only, has-payload
otp_data 0x009a2006 (str) : min=0 max=1024 step=2 value='' flags=read-only, has-payload
fuse_id 0x009a2007 (str) : min=0 max=16 step=2 value='' flags=read-only, has-payload
gain 0x009a2009 (int) : min=256 max=4096 step=1 default=256 value=256 flags=slider
bypass_mode 0x009a2064 (intmenu): min=0 max=1 default=0 value=0
override_enable 0x009a2065 (intmenu): min=0 max=1 default=0 value=0
height_align 0x009a2066 (int) : min=1 max=16 step=1 default=1 value=1
size_align 0x009a2067 (intmenu): min=0 max=2 default=0 value=0
write_isp_format 0x009a2068 (int) : min=1 max=1 step=1 default=1 value=1
sensor_signal_properties 0x009a2069 (u32) : min=0 max=4294967295 step=1 default=0 [30][18] flags=read-only, has-payload
sensor_image_properties 0x009a206a (u32) : min=0 max=4294967295 step=1 default=0 [30][16] flags=read-only, has-payload
sensor_control_properties 0x009a206b (u32) : min=0 max=4294967295 step=1 default=0 [30][34] flags=read-only, has-payload
sensor_dv_timings 0x009a206c (u32) : min=0 max=4294967295 step=1 default=0 [30][16] flags=read-only, has-payload
low_latency_mode 0x009a206d (bool) : default=0 value=0
JiaZW
May 29, 2019, 8:46am
#3
err:
[ 44.213313] tegra194-vi5 15c10000.vi: no reply from camera processor
Hello JiaZW,
You’re trying to capture RAW10 1080p. Does the driver supports that video capture format? You can try running other v4l-ctl option, like –list-formats-ext to get a list of all supported video formats for that device and try to capture video in other formats.
JiaZW
May 30, 2019, 1:23am
#5
hello jchaves,
root@jetson-0423718017712:/home/nvidia# v4l2-ctl --list-formats-ext
ioctl: VIDIOC_ENUM_FMT
[0]: 'BG10' (10-bit Bayer BGBG/GRGR)
Size: Discrete 2688x1520
Interval: Discrete 0.033s (30.000 fps)
capture cmd:
v4l2-ctl --set-fmt-video=width=1920,height=1080,pixelformat=BG10 --stream-mmap=1
–stream-count=10000 --stream-to=/tmp/stream.raw -d /dev/video0 &
or v4l2-ctl --set-fmt-video=width=2688,height=1520,pixelformat=BG10 --stream-mmap=1
all err:
err:
[ 44.213313] tegra194-vi5 15c10000.vi: no reply from camera processor
JiaZW
May 30, 2019, 1:57am
#6
hello jchaves, This is the pipeline configuration
root@jetson-0423718017712:/home/nvidia# media-ctl -p -d /dev/media0
Media device information
driver tegra194-vi5
Device topology
entity 1: ov4689 2-0036 (1 pad, 1 link)
entity 3: 15a00000.nvcsi–1 (2 pads, 2 links)
entity 6: vi-output, ov4689 2-0036 (1 pad, 1 link)
hello JiaZW,
according to your comment #2 , there’s nothing shown in your VI tracing logs. but you had already probe the signaling to check through oscilloscope.
$ gst-launch-1.0 nvarguscamerasrc sensor-id=0 ! 'video/x-raw(memory:NVMM),width=1920, height=1080, framerate=30/1, format=NV12' ! nvoverlaysink -ev
JiaZW
May 30, 2019, 4:00am
#8
hello JerryChang，
cmd ： gst-launch-1.0 nvarguscamerasrc num-buffers=200 ! ‘video/x-raw(memory:NVMM),width=1920, height=1080, framerate=30/1, format=NV12’ ! omxh264enc ! qtmux ! filesink location=test.mp4 -e
：
root@jetson-0423718017712:/home/nvidia# gst-launch-1.0 nvarguscamerasrc num-buffers=200 ! 'video/x-raw(memory:NVMM),width=1920, height=1080, framerate=30/1, format=NV12' ! omxh264enc ! qtmux ! filesink location=test.mp4 -e
Setting pipeline to PAUSED ...
Pipeline is live and does not need PREROLL ...
Setting pipeline to PLAYING ...
New clock: GstSystemClock
Framerate set to : 30 at NvxVideoEncoderSetParameterNvMMLiteOpen : Block : BlockType = 4
===== NVMEDIA: NVENC =====
NvMMLiteBlockCreate : Block : BlockType = 4
H264: Profile = 66, Level = 40
Error generated. /dvs/git/dirty/git-master_linux/multimedia/nvgstreamer/gst-nvarguscamera/gstnvarguscamerasrc.cpp, execute:379 No cameras available
cmd： gst-launch-1.0 nvarguscamerasrc sensor-id=0 ! ‘video/x-raw(memory:NVMM),width=1920, height=1080, framerate=30/1, format=NV12’ ! nvoverlaysink -ev
root@jetson-0423718017712:/home/nvidia# gst-launch-1.0 nvarguscamerasrc sensor-id=0 ! 'video/x-raw(memory:NVMM),width=1920, height=1080, framerate=30/1, format=NV12' ! nvoverlaysink -ev
Setting pipeline to PAUSED ...
Pipeline is live and does not need PREROLL ...
Setting pipeline to PLAYING ...
New clock: GstSystemClock
/GstPipeline:pipeline0/GstNvArgusCameraSrc:nvarguscamerasrc0.GstPad:src: caps = video/x-raw(memory:NVMM), width=(int)1920, height=(int)1080, format=(string)NV12, framerate=(fraction)30/1
/GstPipeline:pipeline0/GstCapsFilter:capsfilter0.GstPad:src: caps = video/x-raw(memory:NVMM), width=(int)1920, height=(int)1080, format=(string)NV12, framerate=(fraction)30/1
/GstPipeline:pipeline0/GstNvOverlaySink-nvoverlaysink:nvoverlaysink-nvoverlaysink0.GstPad:sink: caps = video/x-raw(memory:NVMM), width=(int)1920, height=(int)1080, format=(string)NV12, framerate=(fraction)30/1
/GstPipeline:pipeline0/GstCapsFilter:capsfilter0.GstPad:sink: caps = video/x-raw(memory:NVMM), width=(int)1920, height=(int)1080, format=(string)NV12, framerate=(fraction)30/1
Error generated. /dvs/git/dirty/git-master_linux/multimedia/nvgstreamer/gst-nvarguscamera/gstnvarguscamerasrc.cpp, execute:379 No cameras available
JiaZW
May 30, 2019, 6:03am
#9
hello JerryChang，
JetPack release is 4.1
root@jetson-0423718017712:/home/nvidia# echo 1 > /sys/kernel/debug/tracing/tracing_on
root@jetson-0423718017712:/home/nvidia# echo 30720 > /sys/kernel/debug/tracing/buffer_size_kb
root@jetson-0423718017712:/home/nvidia# echo 1 > /sys/kernel/debug/tracing/events/tegra_rtcpu/enable
root@jetson-0423718017712:/home/nvidia# echo 1 > /sys/kernel/debug/tracing/events/freertos/enable
root@jetson-0423718017712:/home/nvidia# echo 2 > /sys/kernel/debug/camrtc/log-level
root@jetson-0423718017712:/home/nvidia# echo > /sys/kernel/debug/tracing/trace
cat /sys/kernel/debug/tracing/trace
root@jetson-0423718017712:/home/nvidia# cat /sys/kernel/debug/tracing/trace
# tracer: nop
#
# entries-in-buffer/entries-written: 0/0 #P:4
#
# _-----=> irqs-off
# / _----=> need-resched
# | / _---=> hardirq/softirq
# || / _--=> preempt-depth
# ||| / delay
# TASK-PID CPU# |||| TIMESTAMP FUNCTION
# | | | |||| | |
root@jetson-0423718017712:/home/nvidia#
JiaZW
May 30, 2019, 6:43am
#10
hello JerryChang，
this is ov4689 dts config
#include "dt-bindings/clock/tegra194-clock.h"
#define CAM0_RST_L TEGRA194_MAIN_GPIO(H, 3)
#define CAM0_PWDN TEGRA194_MAIN_GPIO(H, 6)
/ {
host1x {
vi@15c10000 {
num-channels = <1>;
ports {
#address-cells = <1>;
#size-cells = <0>;
port@0 {
reg = <0>;
liimx274_vi_in0: endpoint {
port-index = <0>;
//port-index = <2>;
//bus-width = <4>; //CSU
bus-width = <2>; //Xavier demo
remote-endpoint = <&liimx274_csi_out0>;
};
};
};
};
nvcsi@15a00000 {
num-channels = <1>;
#address-cells = <1>;
#size-cells = <0>;
channel@0 {
reg = <0>;
ports {
#address-cells = <1>;
#size-cells = <0>;
port@0 {
reg = <0>;
liimx274_csi_in0: endpoint@0 {
port-index = <0>; //CSU
//port-index = <2>;
//bus-width = <4>; //CSU
bus-width = <2>; //Xavier demo
remote-endpoint = <&liimx274_imx274_out0>;
};
};
port@1 {
reg = <1>;
liimx274_csi_out0: endpoint@1 {
remote-endpoint = <&liimx274_vi_in0>;
};
};
};
};
};
};
i2c@3180000 { // xavier demo
// i2c@c240000 { //csu
// tca9546@70 {
// i2c@0 {
imx274_a@1a {
//compatible = "nvidia,imx274";
compatible = "nvidia,ov4689";
/* I2C device address */
//reg = <0x1a>;
reg = <0x36>;
/* V4L2 device node location */
devnode = "video0";
/* Physical dimensions of sensor */
//physical_w = "3.674";
//physical_h = "2.738";
physical_w = "5.440"; //refer to datasheet
physical_h = "3.072";
clocks = <&bpmp_clks TEGRA194_CLK_EXTPERIPH1>,
<&bpmp_clks TEGRA194_CLK_PLLP_OUT0>;
clock-names = "extperiph1", "pllp_grtba";
mclk = "extperiph1";
reset-gpios = <&tegra_main_gpio CAM0_RST_L GPIO_ACTIVE_HIGH>;
pwdn-gpios = <&tegra_main_gpio CAM0_RST_L GPIO_ACTIVE_HIGH>;
sensor_model = "ov4689";
avdd-reg = "vana";
iovdd-reg = "vif";
delayed_gain = "true";
mode0 { /* OV2775_MODE_1920X1080_30FPS */
mclk_khz = "24000";
num_lanes = "2";
//num_lanes = "4";
//add
phy_mode = "DPHY";
tegra_sinterface = "serial_a";
//tegra_sinterface = "serial_c";
//modify
//discontinuous_clk = "no";
discontinuous_clk = "yes";
dpcm_enable = "false";
cil_settletime = "0";
//active_w = "1920";
//active_h = "1080";
active_w = "2688";
active_h = "1520";
pixel_t = "bayer_bggr";
//pixel_t = "bayer_rggb10";
//pixel_t = "bayer_grbg";
//pixel_t = "bayer_bggr12";
//modify
//mode_type="bayer";
//pixel_phase = "rggb";
//dynamic_pixel_bit_depth = "10";
//csi_pixel_bit_depth = "10";
readout_orientation = "0";
line_length = "2720";//check datasheet
inherent_gain = "1";
mclk_multiplier = "6.67";
pix_clk_hz = "160000000";
min_gain_val = "1.0";
max_gain_val = "16";
min_hdr_ratio = "1";
max_hdr_ratio = "64";
min_framerate = "2.787078";
max_framerate = "120";
min_exp_time = "22";
max_exp_time = "358733";
//embedded_metadata_height = "2";
};
ports {
#address-cells = <1>;
#size-cells = <0>;
port@0 {
reg = <0>;
liimx274_imx274_out0: endpoint {
port-index = <0>;
//port-index = <2>;
//bus-width = <4>; //CSU
bus-width = <2>; //Xavier
remote-endpoint = <&liimx274_csi_in0>;
};
};
//};
//};
};
};
};
};
/ {
tegra-camera-platform {
compatible = "nvidia, tegra-camera-platform";
num_csi_lanes = <2>;
max_lane_speed = <1500000>;
min_bits_per_pixel = <10>;
vi_peak_byte_per_pixel = <2>;
vi_bw_margin_pct = <25>;
max_pixel_rate = <160000>;
isp_peak_byte_per_pixel = <5>;
isp_bw_margin_pct = <25>;
modules {
module0 {
badge = "imx274_bottom_A6V26";
position = "bottom";
orientation = "1";
drivernode0 {
/* Declare PCL support driver (classically known as guid) */
pcl_id = "v4l2_sensor";
/* Driver v4l2 device name */
devname = "imx274 30-001a";
/* Declare the device-tree hierarchy to driver instance */
proc-device-tree = "/proc/device-tree/i2c@c240000/tca9546@70/i2c@0/imx274_a@1a";
};
drivernode1 {
/* Declare PCL support driver (classically known as guid) */
pcl_id = "v4l2_lens";
proc-device-tree = "/proc/device-tree/lens_imx274@A6V26/";
};
};
};
};
};
JiaZW
May 30, 2019, 6:56am
#11
hardware connect ：
ov4689（2lane mipi）->pinboard->Xavier board(2lane mipi data input CSI 0)
hello JiaZW,
several suggestions as below for your reference,
please do not mark embedded metadata height property, given the values of your sensor streaming.
mode0 { /* OV2775_MODE_1920X1080_30FPS */
...
//embedded_metadata_height = "2";
};
please update the badge naming as your unique board name, since software side will also recognize this property.
modules {
module0 {
badge = "imx274_bottom_A6V26";
please refer to [Sensor Driver Programming Guide] for the Debugging Tips .
JiaZW
May 30, 2019, 7:57am
#13
hello JerryChang，
modify1：
cmd：
err：
Doesn’t seem to help
Would like to ask what are some debugging means?For example: check which registers and so on
hello JiaZW,
could you please confirm your sensor actually has 2-line embedded metadata, please confirm this with your sensor specification and setting correct values to this property.
JiaZW
May 30, 2019, 9:30am
#15
hello JerryChang，
i only find “EMB_DT_SEL” register in ov4689 datasheet
default value： 0x52 (010[b]1 0010[/b])
bit【5： 0】 emb_dt Manul set embedded data type
embedded metadata set 18???????
hello JiaZW,
you may also check the pixel array diagram, it usually shows the pixel layout.
JiaZW
May 31, 2019, 3:33am
#17
hello JerryChang，
I would like to confirm whether the excessively long mipi array（10cm） will affect the pathway
I modified DTS of ov5693 as follows, which can normally capture images
#include "dt-bindings/clock/tegra194-clock.h"
//Xavier demo
#define CAM0_RST_L TEGRA194_MAIN_GPIO(H, 3)
#define CAM0_PWDN TEGRA194_MAIN_GPIO(H, 6)
/ {
host1x {
vi@15c10000 {
num-channels = <1>;
ports {
#address-cells = <1>;
#size-cells = <0>;
port@0 {
reg = <0>;
liimx274_vi_in0: endpoint {
//port-index = <0>; //CSU
port-index = <2>;
//bus-width = <4>; //CSU
bus-width = <2>; //Xavier demo
remote-endpoint = <&liimx274_csi_out0>;
};
};
};
};
nvcsi@15a00000 {
num-channels = <1>;
#address-cells = <1>;
#size-cells = <0>;
channel@0 {
reg = <0>;
ports {
#address-cells = <1>;
#size-cells = <0>;
port@0 {
reg = <0>;
liimx274_csi_in0: endpoint@0 {
//port-index = <0>; //CSU
port-index = <2>;
//bus-width = <4>; //CSU
bus-width = <2>; //Xavier demo
remote-endpoint = <&liimx274_imx274_out0>;
};
};
port@1 {
reg = <1>;
liimx274_csi_out0: endpoint@1 {
remote-endpoint = <&liimx274_vi_in0>;
};
};
};
};
};
};
i2c@3180000 {
// i2c@c240000 {
// tca9546@70 {
// i2c@0 {
imx274_a@1a {
//compatible = "nvidia,imx274";
compatible = "nvidia,ov5693";
/* I2C device address */
//reg = <0x1a>;
reg = <0x36>;
/* V4L2 device node location */
devnode = "video0";
/* Physical dimensions of sensor */
//physical_w = "3.674";
//physical_h = "2.738";
physical_w = "5.482";
physical_h = "3.202";
/* Define any required hw resources needed by driver */
/* ie. clocks, io pins, power sources */
clocks = <&bpmp_clks TEGRA194_CLK_EXTPERIPH1>,
<&bpmp_clks TEGRA194_CLK_PLLP_OUT0>;
clock-names = "extperiph1", "pllp_grtba";
mclk = "extperiph1";
reset-gpios = <&tegra_main_gpio CAM0_RST_L GPIO_ACTIVE_HIGH>;
pwdn-gpios = <&tegra_main_gpio CAM0_PWDN GPIO_ACTIVE_HIGH>;
sensor_model = "ov5693";
//add
vana-supply = <&p2822_avdd_cam_2v8>;
vif-supply = <&p2822_vdd_1v8_cvb>;
avdd-reg = "vana";
iovdd-reg = "vif";
/* if true, delay gain setting by one frame to be in sync with exposure */
delayed_gain = "true";
mode0 { /* OV2775_MODE_1920X1080_30FPS */
mclk_khz = "24000";
num_lanes = "2";
//tegra_sinterface = "serial_a";
phy_mode = "DPHY";
tegra_sinterface = "serial_c";
//discontinuous_clk = "yes";
discontinuous_clk = "no";
dpcm_enable = "false";
cil_settletime = "0";
active_w = "1280";
active_h = "720";
pixel_t = "bayer_bggr";
//pixel_t = "bayer_rggb10";
//modify
//mode_type="bayer";
//pixel_phase = "rggb";
//dynamic_pixel_bit_depth = "12";
//csi_pixel_bit_depth = "12";
readout_orientation = "0";
line_length = "1752";
inherent_gain = "1";
mclk_multiplier = "6.67";
pix_clk_hz = "160000000";
min_gain_val = "1.0";
max_gain_val = "16";
min_hdr_ratio = "1";
max_hdr_ratio = "64";
min_framerate = "2.787078";
max_framerate = "120";
min_exp_time = "22";
max_exp_time = "358733";
//embedded_metadata_height = "2";
};
ports {
#address-cells = <1>;
#size-cells = <0>;
port@0 {
reg = <0>;
liimx274_imx274_out0: endpoint {
//port-index = <0>;
port-index = <2>;
//bus-width = <4>; //CSU
bus-width = <2>; //Xavier
remote-endpoint = <&liimx274_csi_in0>;
};
};
//};
//};
};
};
};
};
/ {
tegra-camera-platform {
compatible = "nvidia, tegra-camera-platform";
num_csi_lanes = <2>;
max_lane_speed = <1500000>;
min_bits_per_pixel = <10>;
vi_peak_byte_per_pixel = <2>;
vi_bw_margin_pct = <25>;
max_pixel_rate = <160000>;
isp_peak_byte_per_pixel = <5>;
isp_bw_margin_pct = <25>;
modules {
module0 {
badge = "imx274_bottom_A6V26";
position = "bottom";
orientation = "1";
drivernode0 {
/* Declare PCL support driver (classically known as guid) */
pcl_id = "v4l2_sensor";
/* Driver v4l2 device name */
devname = "imx274 30-001a";
/* Declare the device-tree hierarchy to driver instance */
proc-device-tree = "/proc/device-tree/i2c@c240000/tca9546@70/i2c@0/imx274_a@1a";
};
drivernode1 {
/* Declare PCL support driver (classically known as guid) */
pcl_id = "v4l2_lens";
proc-device-tree = "/proc/device-tree/lens_imx274@A6V26/";
};
};
};
};
};
Ov5693, your two Suggestions, has not been used, and it can also capture video normally
hello JiaZW,
please check the MIPI CSI-2 specification for the effective transmit distance.Jetson Preferred Partner for your camera solutions.
Hi JiaZW,
RidgeRun has proven effectively one solution for transmitting video data between two endpoints in relatively large distances (even in the orders of meters). This solution basically consists of using a pair of GSML Ser/Des ICs.
RidgeRun has developed the Linux device drivers for the MAX96705 MAX9286 GMSL SERDES. We currently support up to the newest JetPack release (4.2), other older versions like 3.2 and 3.2.1 are also supported.
You can read more about this solution in our developers wiki:
https://developer.ridgerun.com/wiki/index.php?title=MAX96705_MAX9286_GMSL_SERDES_Linux_Drivers
Feel free to contact to us!
JiaZW
June 1, 2019, 2:02am
#20
dear JerryChang，jchaves
sudo sh -c ‘echo 1 > /sys/kernel/debug/bpmp/debug/clk/nvcsi/mrq_rate_locked’
Using this command, I can capture images;But not every time
I would like to know the general reason for this situation,
thanks