imagenet-camera gets reverse orientation image on TX2 with TR2.1

HuiW · August 25, 2017, 8:32am

Hi,

imagenet-camera (detectnet-camera) gets 180 degree reverse orientation image on TX2 after the TX2 is installed the newest TR2.1 and jetpack3.1.

Is there a way to change back the image orientation?

Thanks

dusty_nv · August 25, 2017, 3:10pm

Hellow HuiW, can you try changing the nvvidconv flip-method=2 parameter from gstCamera.cpp:313 and recompiling? This is the line:

ss << "nvcamerasrc fpsRange=\"30.0 30.0\" ! video/x-raw(memory:NVMM), width=(int)" << mWidth << ", height=(int)" << mHeight << ", format=(string)NV12 ! nvvidconv flip-method=2 ! ";

Can you report if flip-method=0 aligns the image correctly for you, or if not, which value is correct in your case?

HuiW · August 28, 2017, 8:24am

Hi dusty_nv,

Thank you for your prompt support.
Yes. flip-method=0 aligns the image correctly.
May we know what causes the different?
Due to Tx2 R27.1 with JP 3.0, flip-method=2 aligns the image correctly.

Thanks

dusty_nv · August 28, 2017, 3:19pm

It appears the flip-method parameter value causes different alignments between R27 and R28. I’ve checked in a fix to master here, an #ifdef based on if JetPack 3.1 is detected or not:

[url]jetson-inference/gstCamera.cpp at 29b7c6828f8ca6d6a81e5b1e23b3b5847e1a9877 · dusty-nv/jetson-inference · GitHub

If the onboard camera image is still incorrectly flipped or aligned for you, please let me know.

snarky · August 29, 2017, 1:55am

Wouldn’t it be better to fix whatever the underlying cause of the flipping is?
Patching it up only in gstreamer doesn’t seem like the right place to fix it to me.

Honey_Patouceul · August 29, 2017, 8:03am

In fact it has been fixed in the right place in R28.1. Now nvcamerasrc sends the camera image upside up, while previously it was upside down. Thus it was previously requiring to rotate 180 degrees, and this was done by nvvidconv flip-method=2.
From R28.1, it is no longer required, and using flip-method=2 would make the image upside down again. So, flip-method=0 (no image transform) is now correct.

[EDIT: Sorry I misunderstoood your question. I don’t know yet about image orientation on R28.1 with other way than gstreamer, but having this is fine for gstreamer at least. I agree however fixing the root cause is usually better.]

dusty_nv · August 29, 2017, 1:47pm

Yes, technically the flip-method enumeration is now ‘correct’ in L4T/gstreamer, in that flip-method=0 aligns the image in the natural way and doesn’t need further specification. It was in older releases that flip-method=2 was required to get the correct alignment. So technically it is fixed in L4T now…

snarky · August 29, 2017, 8:09pm

Gotcha! Appreciate the answer.

viraj.deshwal · April 12, 2019, 6:50pm

Hi,
Just wanted to update that for me the below setting made my camera upright.

if( onboardCamera() && src != GST_SOURCE_V4L2 )
{
mSource = src; // store camera source method

#if NV_TENSORRT_MAJOR > 1 && NV_TENSORRT_MAJOR < 5	// if JetPack 3.1-3.3 (different flip-method)
	const int flipMethod = 0;					// Xavier (w/TRT5) camera is mounted inverted
#else
	const int flipMethod = 0;

Kraggle · May 1, 2019, 7:56pm

Hello,

the camera feed on my TX2 comes in flipped upside-down when I run:

./imagenet-camera googlenet

I checked gstCamera.cpp lines 314-317 which read:

#if NV_TENSORRT_MAJOR > 1 && NV_TENSORRT_MAJOR < 5	// if JetPack 3.1-3.3 (different flip-method)
	const int flipMethod = 0;					// Xavier (w/TRT5) camera is mounted inverted
#else
	const int flipMethod = 2;
#endif

I tried to change the flipMethod from “= 2” to “= 0” but no luck. Attempted change read:

#if NV_TENSORRT_MAJOR > 1 && NV_TENSORRT_MAJOR < 5	// if JetPack 3.1-3.3 (different flip-method)
	const int flipMethod = 0;					// Xavier (w/TRT5) camera is mounted inverted
#else
	const int flipMethod = 0;
#endif

Appreciate your help.
Thanks.

dusty_nv · May 2, 2019, 1:09am

Hi Kraggle, if you are using JetPack 4.2, please try changing both flipMethod to =2 to see if that helps please.

The camera module is mounted upright on TX2 devkit and upside down on Xavier Xavier devkit.

Kraggle · May 2, 2019, 1:49pm

Hi Dusty, thanks. I tried, but no luck.

dusty_nv · May 2, 2019, 4:27pm

Are you using MIPI CSI camera or a USB webcam (V4L2)? The flip-method parameter is only relevant to MIPI CSI camera.

If you’re using MIPI CSI, are you sure you tried changing both flipMethod variables between lines 314-317 and recompiled? You need to compile from the build directory because the camera stuff is in a utility library:

$ cd jetson-inference/build
$ make

Or if no joy, make clean and then make.

You can try different values of flipMethod until you see a change.

Kraggle · May 2, 2019, 6:54pm

dusty_nv:

Hi Dusty, thanks. I tried, but no luck.

Are you using MIPI CSI camera or a USB webcam (V4L2)? The flip-method parameter is only relevant to MIPI CSI camera.

If you’re using MIPI CSI, are you sure you tried changing both flipMethod variables between lines 314-317 and recompiled? You need to compile from the build directory because the camera stuff is in a utility library:
$ cd jetson-inference/build
$ make
Or if no joy, make clean and then make.

You can try different values of flipMethod until you see a change.

Thanks…yeah, using the on board MIPI CSI camera.

I went to build and compile gstCamera.cpp in jetson-inference/utils/camera after making the “flipMethod = 2” on lines 345 and 347

get the error:

In file included from gstCamer.cpp:23:0:
gstCamera.h:26:10: fatal error: gst/gst.h: No such file or directory
include <gst/gst.h>
^~~~~~~~~~~
compilation terminated.
Compilation failed.

dusty_nv · May 7, 2019, 6:12pm

Since you were able to build the repo before, that is strange that you are getting this error about finding GStreamer header now. Were you trying to just build gstCamera.cpp, or the top-level jetson-inference project? You should build from jetson-inference, because it’s CMakeLists sets up the compiler with the correct include directories:

cd jetson-inference/build
cmake ../
make

Kraggle · May 7, 2019, 8:30pm

Thanks Dusty…I built the top-level jetson-inference project, using:

cd jetson-inference/build
cmake../
make

Then, working through the tutorial: https://github.com/dusty-nv/jetson-inference/blob/master/docs/imagenet-camera.md
while in:

/jetson-inference/build/aarch64/bin

ran:

./imagenet-camera googlenet

Video feed comes in upside down.

Then, used Geany to change the “flipMethod = 2” on lines 345 and 347 in gstCamera.cpp located in:

/jetson-inference/utils/camera

When attempting to build and compile gstCamera.cpp in Geany, get the error:

In file included from gstCamer.cpp:23:0:
gstCamera.h:26:10: fatal error: gst/gst.h: No such file or directory
#include <gst/gst.h>
^~~~~~~~~~~
compilation terminated.
Compilation failed.

Kraggle · May 7, 2019, 8:42pm

Thanks Dusty…I built the top-level jetson-inference project, using:

cd jetson-inference/build
cmake../
make

Then, working through the tutorial: https://github.com/dusty-nv/jetson-inference/blob/master/docs/imagenet-camera.md
while in:

/jetson-inference/build/aarch64/bin

ran:

./imagenet-camera googlenet

Video feed comes in upside down.

Then, used Geany to change the “flipMethod = 2” on lines 345 and 347 in gstCamera.cpp located in:

/jetson-inference/utils/camera

When attempting to build and compile gstCamera.cpp in Geany, get the error:

In file included from gstCamer.cpp:23:0:
gstCamera.h:26:10: fatal error: gst/gst.h: No such file or directory
#include <gst/gst.h>
^~~~~~~~~~~
compilation terminated.
Compilation failed.

mtbsteve · May 19, 2019, 10:01am

@Kraggle its working fine for me with Jetpack 4.2 installed on a Jetson TX2.

set flipMethod to 0 in the file utils/camera/gstCamera.cpp:

#if NV_TENSORRT_MAJOR > 1 && NV_TENSORRT_MAJOR < 5      // if JetPack 3.1-3.3 (different flip-method)
                const int flipMethod = 0;                                       // Xavier (w/TRT5) camera is mounted inverted
        #else
                const int flipMethod = 0;
        #endif

go to:

cd jetson-inference/build
make clean
make
sudo make install

run imagenet-camera and you should see the video feed in the right orientation.

adebiyi.abdurrahman · September 1, 2019, 6:59am

I had similar issues of inverted images with the CSI camera on-board my jetson TX2 while working with jetson-inference using JetPack 4.2.1. Definitely my TensorRT version is >= 5.1. To fix it I went to loc 413-417 file (jetson-inference/utils/camera/gstCamera.cpp

409         if( csiCamera() && src != GST_SOURCE_V4L2 )
410         {
411                 mSource = src;   // store camera source method
412 
413         #if NV_TENSORRT_MAJOR > 1 && NV_TENSORRT_MAJOR < 5      // if JetPack 3.1-3.3 (different flip-method)
414                 const int flipMethod = 0;                                       // Xavier (w/TRT5) camera is mounted inverted
415         #else
416                <b> const int flipMethod = 2;</b>
417         #endif

And changed line 416
from

const int flipMethod = 2;

to

const int flipMethod = 0;

After that I recompiled and installed
[i]

cd jetson-inference/build
cd cmake ..
cd make
cd sudo make install #Update the programs like imagenet-camera to be available from anywhere

[/i]

Voila!! my Camera images were upright and expected. No need for turning my head round again.

It seems flipMethod needs to be “0” for TX2.

@dusty-nv In feature can we have a FLIP_METHOD or FLIP_ORIENTATION macro (or something like that) in the gstCamera.h for flexibility. or probabaly an enum for most of the boards e.g {FLIP_METHOD_TX2 , FLIP_METHOD_TX1,…}

Hope this helps someone

dangerduncan · May 23, 2020, 2:58am

Hi Dusty_NV

Embarrassed to admit but I have this same issue (my onboard camera image is upside down when trying things like ( ./imagenet-camera.py) using my TX2 dev kit.

I am so new and clueless even reading your instructions on how to address the issue I am still at a loss. Just trying to make my way through Hello AI World.

Can you please direct me on how to change the nvvidcon flip-method=2 parameter from gst.Camera.cpp:313 and recompile?

No clue. Thanks to anyone to can assist or even point me <in right direction.

Topic		Replies	Views
CSi hello camera is up side down-out image inverted Jetson TX2 camera	13	2004	October 18, 2021
Vision Recognition Neural Network ("Hello AI World") installation Jetson TX2	10	714	October 18, 2021
Jetson Nano CSI Raspberry Pi Camera V2 upside down video when run an example with deepstream-app Jetson Nano	14	5858	October 14, 2021
Typical approaches to test camera functionality for L4T R23.2 on Jetson TX1 Jetson TX1	19	14362	March 7, 2019
TX2 Camera convert/encode using Multimedia API issue Jetson TX2 camera , encoder	16	2035	October 18, 2021
Issue using camera Jetson Xavier NX camera	26	1808	November 21, 2022
Imagenet-camera.cpp libraries not working on jetson nano Jetson Nano	40	4473	October 14, 2021
Unable to rotate video stream in Jetson Inference Jetson Nano camera	8	98	August 13, 2024
X264 and TensorRT sudden reboot (MJPG encoder not affected, but not fast enough) on Jetson Orin Nano Jetson Orin Nano tensorrt , jetson-inference , gstreamer , jetson	52	834	June 18, 2024
CSI camera I2C readout orientation Jetson Nano camera	4	43	October 21, 2024

imagenet-camera gets reverse orientation image on TX2 with TR2.1

Related topics