issue to capture and display using FPD Link Camera

Hi,
I used IMX219 camera module.I could capture and display images if connecting IMX219 with Jetson Nano Develop kit through CSI-2 interface and I used the command:
gst-launch-1.0 nvarguscamerasrc ! ‘video/x-raw(memory:NVMM),width=3280, height=2464, framerate=21/1, format=NV12’ ! nvvidconv flip-method=0 ! ‘video/x-raw,width=960, height=616’ ! nvvidconv ! nvegltransform ! nveglglessink -e. I tested IMX219 with TI's FPD Link chipset DS90UB953/DS90UB954 where DS90UB954 was connecting with the Kit through CSI-2 interace.If I used the command: " gst-launch-1.0 nvarguscamerasrc ! ‘video/x-raw(memory:NVMM),width=1280, height=720, framerate=60/1, format=NV12’ ! nvvidconv flip-method=0 ! ‘video/x-raw,width=960, height=640’ ! nvvidconv ! nvegltransform ! nveglglessink -e.".Images could display!
But if the command used was:
“$ gst-launch-1.0 nvarguscamerasrc ! ‘video/x-raw(memory:NVMM),width=1920, height=1080, framerate=30/1, format=NV12’ ! nvvidconv flip-method=0 ! ‘video/x-raw,width=960, height=616’ ! nvvidconv ! nvegltransform ! nveglglessink -e.”.Images couldn’t display although the display window poped out.As if the command execution was suspend.
The Jetson Nano Develop kit was flashed with nv-jetson-nano-sd-card-image-r32.3.1 and without any change.
Could I get your kind help?

hello fangbin,

could you please list all the sensor available sensor modes?
please ensure you choose the available sensor mode to initial with the gstreamer commands.

you should also gather the failure messages about the errors.
please gather kernel messages with $ dmesg
and you’ll also need to check system logs, $ cat /var/log/syslog
thanks

Hi Jerry,
The following is all the sensor available sensor modes:
3264x2464@21fps,3264x1848@28fps,1920x1080@30fps,1280x720@60fps and 1280x720@120fps.
Only in 1280x720@60fps images could display for the FPD-Link Camera(IMX219 connects DS90UB953 through CSI,DS90UB953 to DS90UB954 by cable and DS90UB954 connects the CSI on the kit).
All modes worked if IMX219 connected directly with the kit through CSI interface.
Thanks!

hello fangbin,

that’s Serializer/Deserializer which reprocess the signaling. you should check what’s the error messages.
besides, you might contact with your sensor vendor, did they included in Jetson Preferred Partners.
thanks

Hi Jerry,
After running the command:
“$ gst-launch-1.0 nvarguscamerasrc ! ‘video/x-raw(memory:NVMM),width=1920, height=1080, framerate=30/1, format=NV12’ ! nvvidconv flip-method=0 ! ‘video/x-raw,width=960, height=616’ ! nvvidconv ! nvegltransform ! nveglglessink -e”,the message stopped at “…CONSUMER:Producer has connected;continuing.” in UXTERM window.And a “gst-launch-1.0” window popped out with no image but the screen snapshot.
Regards,
Fang Bin

Hi Jerry,
The sensor is Raspberry Pi V2 camera.And the FPD-Link cable with CSI-Rx/CSI-Tx is designed by myself.The cable shoud be in transparent-through.
Thanks,
Fang Bin

hello fangbin,

I would suggest you exclude nvarguscamerasrc and using v4l2 standard controls to access cameras.
it’s standard commands to verify the basic functionality.
for example,
please check Applications Using V4L2 IOCTL Directly for the sample commands.

you should also monitor if there’s suspect failures.
please check either kernel ($ dmesg) and user-space ($ cat /var/log/syslog) for details.
thanks

Hello Jerry,
Would you pls. help to confirm the bandwidth requirement of each CSI lane based on the configuration mode 1920x1080,30fps in the IMX219 driver?
Thanks,
Fang Bin

hello fangbin,

please refer to Technical Reference Manual, the maximum bandwidth is 1.5 Gbps per lane.
thanks

Hello Jerry,
Sorry my statement wasn’t precise.
What’s the output bandwidth/lane of Raspberry Pi camera( IMX219 here) which Nano supports once the camera is configured as in 1920x1080,30fps mode?I thought the bandwidth is related with the configured mode.
Thanks,
Fang Bin

hello fangbin,

since Raspberry PI camera v2 were based-on Sony IMX219,
you should contact with your sensor vendor for the sensor datasheet to check the sensor output data rate.
or,
you could have some calculation to check the sensor data rates. please refer to Sensor Pixel Clock.
according to the formula, and also checking with reference driver.
$l4t-r32.3.1/public_src/kernel_src/hardware/nvidia/platform/t210/porg/kernel-dts/porg-platforms/tegra210-camera-rbpcv2-imx219.dtsi

pixel clock (182400000) = sensor data rate per lane (Mbps) * number of lanes (2) / bits per pixel (10)
sensor data rate per lane is shown 912-Mbps.
thanks

Hi Jerry,
In fact I didn’t know how to find the …/tegra210-camera-rbpcv2-imx219.dtsi file.So I couldn’t calculate the bandwidth according to the driver setting.
I flashed the official Nano image in the SD card.And I installed the package using “sudo apt-get install nvidia-jetpack”.I didn’t find the directory “$l4t-r32.3.1/public_src/kernel_src/hardware/nvidia/platform…”.
Thanks,
Fang Bin

please check Jetson download center for L4T Sources packages.
thanks

Hello Jerry,
I had thought Jetpack include L4T package.Let me study it.
Thanks very much!
Fang Bin