Xavier about the camera raw data format setting

Robotics & Edge Computing Jetson & Embedded Systems Jetson Xavier NX
1

Hi teams

We are working on the AGX Xavier platform.
When we light up the camera sensor, we find that the original data has a reverse color difference.
The raw data of our camera is yuyv422.Our code modify as below:
dtsi:

12
121245×232 6.46 KB

driver file tegracam_v4l2.c
12
121666×324 26 KB

When I use command “v4l2-ctl --set-fmt-video=width=1920,height=1080,pixelformat=YUYV --stream-mmap --stream-count=1 -d /dev/video4 --stream-to=ov5693.raw” get the raw data…

Open the raw data file with YUYV is abnormal,but UYVY is ok.
YUYV:

12
121422×793 328 KB

UYVY:
12
121427×685 284 KB

Why I change the data format from UYVY to YUYV,it didn’t work ?

BRs
thanks

3

Could you print the format(img_fmt) in the vi5_fops.c in below function to confirm the setting.

static void vi5_setup_surface(struct tegra_channel *chan,
  	struct tegra_channel_buffer *buf, unsigned int descr_index)
  {
  	dma_addr_t offset = buf->addr + chan->buffer_offset[0];
  	u32 height = chan->format.height;
  	u32 width = chan->format.width;
  	u32 format = chan->fmtinfo->img_fmt;
4

Hi ShaneCCC

thanks for your reply.
I print the format[img_fmt],the result as below:

12
121487×685 691 KB

5

The setting is correct to set as YUYV, not sure what happened for it.
Could you try to configure the sensor output UYVY and VI configure as YUYV for experiment.

6

Hi ShaneCCC

I use the command of “v4l2-ctl --set-fmt-video=width=1920,height=1080,pixelformat=YUYV --stream-mmap --stream-count=1 -d /dev/video4 --stream-to=ov5693.raw” to get the image data.
1 ) Does it get the raw data ?
2) Does this command( v4l2-ctl ) do data format conversion or not ?

7

OK, Let make the problem clear.
Do you set the YUYV by the v4l2-ctl command line but didn’t modify the sensor REG to output YUYV data format? If yes that could be the problem. You need to configure the sensor REG to output pixel format match the dt setting instead of use the command to configure it.

8

Hi ShaneCCC

  1. First, Our image sensor supplier said that the default output of the original data format is yuyv. Secondly, I modified the data image format to yuyv in dtsi file to match the image sensor consistency.Then,I use the above command to get a frame of image data. So I use yuv tool to preview the photo.:
    When I set the data format of yuyv to preview the image data, it does not display properly
    When I set the data format of uyvy to preview the image data, it displays normally
    But the original image data is yuyv, and I have set it to yuyv. I don’t know why it doesn’t work ?

  2. I asked the supplier to change the sensor register to uyvy. No matter whether my device tree is changed to uyvy or yuyv, it will display normally.,I have a little confused.

9

What’s tools to check the raw data? Could you attached the raw data to check.

10

Hi ShaneCCC

I used 7yuv to check the raw data.
Attached is the image data captured with the command of v4l2-ctl
The imager sensor output YUYV and I set to YUYV,But it can not display normal.

953.zip (2.3 MB)

11

I change to BIg Endian byte order to show the correct color of this raw file.

image
image3191×1275 905 KB

12

Hi ShaneCCC

I use Xavier platform,it is arm architecture.
How to fix it ?

13

It’s the 7yuv setting problem doesn’t matter with Xavier.
I set BIg Endian byte order in 7yuv get get the normal color as early comment.

On Xavier you can run below command to check the preview.

gst-launch-1.0 v4l2src device=/dev/video0 ! 'video/x-raw,width=1920,height=1080,format=(string)YUYV' ! nvvidconv ! 'video/x-raw(memory:NVMM),format=(string)NV12' ! queue ! nvvidconv ! nvoverlaysink -e
14

Hi ShaneCCC

When I execute above command,it shows below error…

12
121857×172 14.8 KB

15

Try below two.

export DISPLAY=:0
gst-launch-1.0 v4l2src device=/dev/video0 ! "video/x-raw, width=1920, height=1080, format=YUYV" ! nvvidconv ! "video/x-raw, width=1920, height=1080, format=YUYV" ! xvimagesink sync=false -e
gst-launch-1.0 v4l2src ! 'video/x-raw, width=1920, height=1080, framerate=60/1, format=YUYV' ! nvvidconv ! 'video/x-raw(memory:NVMM), width=1920, height=1080, framerate=60/1, format=I420' ! nvoverlaysink sync=false
16

Hi ShaneCCC

it still error

12
121651×370 946 KB

17

Does your system connect HDMI display?

18
  • YUYV is usually referred as YUY2 in gstreamer framework.
  • nvvidconv expects at least one among its input or output to be in NVMM memory.

You don’t need nvvidconv for displaying to xvimagesink as it accepts YUY2:

gst-launch-1.0 -v v4l2src device=/dev/video0 ! video/x-raw, width=1920, height=1080, format=YUY2 ! xvimagesink

You would use nvvidconv for copying into NVMM memory for nvoverlaysink, for example (need a local monitor):

gst-launch-1.0 -v v4l2src device=/dev/video0 ! video/x-raw, width=1920, height=1080, format=YUY2 ! nvvidconv ! nvoverlaysink
19

Hi ShaneCCC

Our board connect to HDMI display

21

hello JCap,

may I know what’s the format types reported via v4l2 standard controls.

$ v4l2-ctl -d /dev/video0 --list-formats-ext
22

Hi JerryChang

The result is below:

12
121920×1080 1.06 MB

23
231920×1080 1.02 MB