Save RAW image and video of IMX477 image sensor

[riul5627k]

Hi all,

I am trying to save raw images or videos with a 10 or 12 bit depth using the IMX477 image sensor (The sensor supports 10 or 12 bit depth). However, I have encountered some errors with the pipeline I am using. It seems that the sensor does not support the format r210 and I have also tried other 10 bit depth formats listed here with no success.

Does the nvarguscamerasrc support saving raw images of the IMX477 sensor?
If so, can anyone suggest a way to save raw images or videos with a 10 or 12 bit depth?
Any help would be greatly appreciated.

Here is my pipleline

def pip_video(exp):
return “nvarguscamerasrc wbmode=0 aelock=true awblock=true sensor-id=0 exposuretimerange = "”+ str(exp)+" “+str(exp)+”" ispdigitalgainrange="1 1" gainrange="10.625 10.625" ! video/x-raw(memory:NVMM), width=(int)4032, height=(int)3040,format=(string)r210, framerate=(fraction)30/1, exposurecompensation=0 ! tee name=t t. ! queue ! nvvidconv ! videobalance brightness=0 saturation=1 contrast=1 ! video/x-raw, format=(string)I420, width=4032, height=3040 ! appsink sync=0 ";

Error:

Error opening bin: could not link nvarguscamerasrc0 to t, nvarguscamerasrc0 can’t handle caps video/x-raw(memory:NVMM), width=(int)4032, height=(int)3040, format=(string)r210, framerate=(fraction)30/1, exposurecompensation=(int)0

[JerryChang]

@riul5627k

Does the nvarguscamerasrc support saving raw images of the IMX477 sensor?

no, it’s not supported.
please use v4l commands for saving Raw files.
for example,
$ v4l2-ctl -d /dev/video0 --set-fmt-video=width=4032,height=3040,pixelformat=RG10 --set-ctrl bypass_mode=0 --stream-mmap --stream-count=1 --stream-to=test.raw

[riul5627k]

Thank you Jerry.

But I need to capture the image with 4032 x 3040 @ 30fps.
I saw the v4l2 do not support this resolution

V4L2 vs. Argus MIPI CSI performance differences with IMX477 camera

I’m testing on two Jetson Nano 2GB Dev Kits running L4T 32.6.1 - For some reason, only one of them is able to run v4l2-ctl (see here for more info). With the one that does work with v4l2-ctl I’ve been testing both the stock Nvidia and Arducam drivers, the latter which provides support for the full resolution mode 4032x3040 at 30fps. The Nvidia driver only provides 3840x2160 at 30fps and 1920x1080 at 60fps. Here’s a breakdown of the functionality between Argus and v4l2 when running the Arducam dr…

Is there any other options that I can follow?

[JerryChang]

@riul5627k

the v4l2 do not support this resolution

hello riul5627k,

please check $ v4l2-ctl -d /dev/video0 --list-formats-ext for available sensor modes.

[riul5627k]

Hi, Thank you

Now I checked v4l2 supports 4032 x 3040 @30 fps.
But it still returns empty test.raw file.
The command did not end or return any warnings or errors.

Here, is my code

b@b-desktop:~/Desktop$ v4l2-ctl --list-devices
vi-output, imx477 7-001a (platform:54080000.vi:0):
/dev/video0

b@b-desktop:~/Desktop$ v4l2-ctl -d /dev/video0 --list-formats-ex
ioctl: VIDIOC_ENUM_FMT
Index : 0
Type : Video Capture
Pixel Format: ‘RG10’
Name : 10-bit Bayer RGRG/GBGB
Size: Discrete 4032x3040
Interval: Discrete 0.033s (30.000 fps)
Size: Discrete 1920x1080
Interval: Discrete 0.017s (60.000 fps)

b@b-desktop:~/Desktop$ v4l2-ctl -d /dev/video0 --set-fmt-video=width=4032,height=3040,pixelformat=RG10 --set-ctrl bypass_mode=0 --stream-mmap=4 --stream-count=1 --stream-to=test.raw

[JerryChang]

@riul5627k

–stream-mmap=4

this looks incorrect. please try again as following.
$ v4l2-ctl -d /dev/video0 --set-fmt-video=width=4032,height=3040,pixelformat=RG10 --set-ctrl bypass_mode=0 --stream-mmap --stream-count=1 --stream-to=test.raw

[riul5627k]

Thank you but --stream-mmap with out “=4” also returns same results.

[JerryChang]

hello riul5627k,

can you access to the camera stream correctly?
can this v4l pipeline executed to test the camera stream. $ v4l2-ctl -d /dev/video0 --set-fmt-video=width=4032,height=3040,pixelformat=RG10 --set-ctrl bypass_mode=0 --stream-mmap --stream-count=100
please also share kernel logs for reference if you’re seeing failures. i.e. $ dmesg > logs.txt

[riul5627k]

@JerryChang

dmesg > logs.txt

Hello JerryChang.
The camera still doesn’t work
The kernel logs is below.

[520684.000869] misc tegra_camera_ctrl: tegra_camera_update_isobw: Warning, Requested ISO BW 1640625 has been capped to VI’s max BW 1500000
[520684.290629] video4linux video0: frame start syncpt timeout!0
[520684.498614] video4linux video0: frame start syncpt timeout!0
[520684.706724] video4linux video0: frame start syncpt timeout!0
[520684.915240] video4linux video0: frame start syncpt timeout!0

I found some way to solve this issue, but I don’t know how to patch. There is no imx477_mode_tbls.h file in my jetson (my jetpack version is 4.4). Could you give me some advice?

Nano Dev Kit B01 + Raspi HQ cam doesn't work with v4l2-ctl (JetPack 4.6)

Quick update - I was able to swap a different IMX477 module (and cable) to the broken Nano, and now I am able to get v4l2-ctl working on this Nano. So for at least my issue (not sure if it’s related to @zhuda’s issue) I have narrowed it down either to a particular IMX477 sensor module or CSI cable. Still it’s rather surprising that Gstreamer has no issues regardless. Does Argus/Gstreamer somehow use different MIPI CSI bandwidth parameters?

[JerryChang]

@riul5627k

my jetson (my jetpack version is 4.4).

hello riul5627k,

that’s because JP-4.4 did not support IMX477 by default.