Dual camera IMX477 with Jetson Orin NX 16 Gb

Robotics & Edge Computing Jetson & Embedded Systems Jetson Orin NX
1

Hi

I have a Jetson Orin NX 16 Gb with a recomputer J401 carrier board, and I would like to use it with two Arducam IMX477 cameras. After flashing the Jetpack 6.0 rev. 2 using SDK manager, I configured the CSI connector using jetson-io selecting the option “Camera IMX477 Dual”.

Both cameras are listed:

NVIDIA Tegra Video Input Device (platform:tegra-camrtc-ca):
	/dev/media0

vi-output, imx477 10-001a (platform:tegra-capture-vi:1):
	/dev/video1

vi-output, imx477 9-001a (platform:tegra-capture-vi:2):
	/dev/video0

Using Gstreamer, the camera attached to the CSI port CAM0 works (sensor_id=1):

gst-launch-1.0 nvarguscamerasrc sensor-id=1 ! "video/x-raw(memory:NVMM),width=1920,height=1080,framerate=60/1" ! nvvidconv ! autovideosink

but the other one just show a black screen during a couple of seconds, and the throws and error (sensor_id=0):

Setting pipeline to PAUSED ...
Pipeline is live and does not need PREROLL ...
Pipeline is PREROLLED ...
Setting pipeline to PLAYING ...
New clock: GstSystemClock
GST_ARGUS: Creating output stream
CONSUMER: Waiting until producer is connected...
GST_ARGUS: Available Sensor modes :
GST_ARGUS: 3840 x 2160 FR = 29.999999 fps Duration = 33333334 ; Analog Gain range min 1.000000, max 22.250000; Exposure Range min 13000, max 683709000;

GST_ARGUS: 1920 x 1080 FR = 59.999999 fps Duration = 16666667 ; Analog Gain range min 1.000000, max 22.250000; Exposure Range min 13000, max 683709000;

GST_ARGUS: Running with following settings:
   Camera index = 0 
   Camera mode  = 1 
   Output Stream W = 1920 H = 1080 
   seconds to Run    = 0 
   Frame Rate = 59.999999 
GST_ARGUS: Setup Complete, Starting captures for 0 seconds
GST_ARGUS: Starting repeat capture requests.
CONSUMER: Producer has connected; continuing.
nvbuf_utils: dmabuf_fd -1 mapped entry NOT found
Error generated. /dvs/git/dirty/git-master_linux/multimedia/nvgstreamer/gst-nvarguscamera/gstnvarguscamerasrc.cpp, threadExecute:732 NvBufSurfaceFromFd Failed.
Error generated. /dvs/git/dirty/git-master_linux/multimedia/nvgstreamer/gst-nvarguscamera/gstnvarguscamerasrc.cpp, threadFunction:243 (propagating)
Redistribute latency...
WARNING: from element /GstPipeline:pipeline0/GstAutoVideoSink:autovideosink0/GstXvImageSink:autovideosink0-actual-sink-xvimage: Pipeline construction is invalid, please add queues.
Additional debug info:
../libs/gst/base/gstbasesink.c(1249): gst_base_sink_query_latency (): /GstPipeline:pipeline0/GstAutoVideoSink:autovideosink0/GstXvImageSink:autovideosink0-actual-sink-xvimage:
Not enough buffering available for  the processing deadline of 0:00:00.015000000, add enough queues to buffer  0:00:00.015000000 additional data. Shortening processing latency to 0:00:00.000000000.
WARNING: from element /GstPipeline:pipeline0/GstAutoVideoSink:autovideosink0/GstXvImageSink:autovideosink0-actual-sink-xvimage: Pipeline construction is invalid, please add queues.
Additional debug info:
../libs/gst/base/gstbasesink.c(1249): gst_base_sink_query_latency (): /GstPipeline:pipeline0/GstAutoVideoSink:autovideosink0/GstXvImageSink:autovideosink0-actual-sink-xvimage:
Not enough buffering available for  the processing deadline of 0:00:00.015000000, add enough queues to buffer  0:00:00.015000000 additional data. Shortening processing latency to 0:00:00.000000000.
Got EOS from element "pipeline0".
Execution ended after 0:00:04.011293900
Setting pipeline to NULL ...
GST_ARGUS: Cleaning up
GST_ARGUS: Done Success
Freeing pipeline ...

I have also tried with the “Camera IMX477 Dual 4 lane” configuration, with the same result.

Thanks for the support,
Pablo

3

Do you switch the camera to verify?

5

Hi Shane,

Yes, I have exchanged them, both camera and csi cable. Shame behavior.

Thanks

6

What’s the JP6.0 REV2?

cat /etc/nv_tegra_release
7

Hi

# R36 (release), REVISION: 3.0, GCID: 36191598, BOARD: generic, EABI: aarch64, DATE: Mon May  6 17:34:21 UTC 2024
# KERNEL_VARIANT: oot
TARGET_USERSPACE_LIB_DIR=nvidia
TARGET_USERSPACE_LIB_DIR_PATH=usr/lib/aarch64-linux-gnu/nvidia
9

Do you enable dual IMX477 by jetson-io?

10

Yes, I did. I have tried both options: “Camera IMX477 Dual” and “Camera IMX477 Dual 4 lane”

11

Don’t know “Arducam IMX477 cameras” have any HW different with Raspberry Pi High Quality Camera
Current release image support dual Raspberry Pi High Quality Camera and working well.

Thanks

12

Going back to Jetpack 5.1.2 solved the problem

14

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.