IP camera connection with jetson.utils.gstCamera

terry.l.lee · September 23, 2020, 12:41am

I’m having some issue with the jetson.utils.gstCamera command. The same IP camera is working with gst-launch-1.0 command on the terminal.

Not working comment:
camera = jetson.utils.gstCamera(640, 480, “rtspsrc location=rtsp://192.168.3.162:554/media/video1 latency=0 ! rtph264depay ! h264parse ! nvv4l2decoder ! nvvidconv ! video/x-raw, format=BGRx, width=640, height=480”)

Error message:
[gstreamer] gstCamera failed to create pipeline
[gstreamer] (could not parse caps “video/x-raw, format=(string) , width=(int)640, height=(int)480”)
[gstreamer] gstCamera – failed to create device rtspsrc location=rtsp://192.168.3.162:554/media/video1 latency=0 ! rtph264depay ! h264parse ! nvv4l2decoder ! nvvidconv ! video/x-raw, format=BGRx, width=640, height=480

Working command:
gst-launch-1.0 rtspsrc location=rtsp://192.168.3.162:554/media/video1 ! rtph264depay ! h264parse ! avdec_h264 ! videoconvert ! gtksink

I went through a lot of blogs and was not able to find a solution. Did I missed simple ?
Thanks,
Terry

DaneLLL · September 23, 2020, 2:47am

Hi,
Please check the source code:

github.com

dusty-nv/jetson-utils/blob/916023814a1ac1401380c5d4313454c78c0a5f40/camera/gstCamera.cpp

/*
 * Copyright (c) 2017, NVIDIA CORPORATION. All rights reserved.
 *
 * Permission is hereby granted, free of charge, to any person obtaining a
 * copy of this software and associated documentation files (the "Software"),
 * to deal in the Software without restriction, including without limitation
 * the rights to use, copy, modify, merge, publish, distribute, sublicense,
 * and/or sell copies of the Software, and to permit persons to whom the
 * Software is furnished to do so, subject to the following conditions:
 *
 * The above copyright notice and this permission notice shall be included in
 * all copies or substantial portions of the Software.
 *
 * THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
 * IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
 * FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT.  IN NO EVENT SHALL
 * THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
 * LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING
 * FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER
 * DEALINGS IN THE SOFTWARE.

This file has been truncated. show original

The default implementation supports nvarguscamerasrc and v4l2src. Your case is rtsprc and you may need to customize the code.

dusty_nv · September 23, 2020, 2:48pm

As @DaneLLL mentioned, gstCamera does not support RTP/RTSP - however, the newer videoSource interface in jetson.utils does. It has a similar API:

terry.l.lee · September 23, 2020, 9:15pm

Thanks a lot for the information. I would not have figure it out that the “jetson.utils.gstCamera” does not support IP camera without your helps.

I tried out the new jetson.utils with:
input = jetson.utils.videoSource(“rtsp://0000:0000aaaa@192.168.3.162:554”, “my_video.mp4” )

It return error of : [gstreamer] gstDecoder – failed to create decoder for rtsp://192.168.3.162:554

Did you miss anything ?

My goal is to run object detection with IP camera.
I’m currently able to do so by the following steps.

using opencv to acquire images
convert to rgba with: frame_rgba = cv2.cvtColor(frame, cv2.COLOR_BGR2RGBA)
convert to cuda with: image = JTUils.cudaFromNumpy(frame_rgba)
object detection with :detections = self.net.Detect(image, image.width, image.height)

While this work, i’m concerning that the process is not efficient. The process of converting image could take a lot of time then needed. Could you comment on the best way to accomplish this task?
Thanks,

dusty_nv · September 24, 2020, 2:02pm

It is not expecting the second argument of “my_video.mp4”. What I would try running first, is the video-viewer sample, which you can see being used for RTSP input here:

https://github.com/dusty-nv/jetson-inference/blob/master/docs/aux-streaming.md#rtsp

Then if you can view the stream, you can modify your application to use similar code to video-viewer.py.

terry.l.lee · September 24, 2020, 7:43pm

I’m not having much luck with video-viewer.

video-viewer rtsp://0000:0000aaaa@192.168.3.162:554
return message of:
[gstreamer] gstDecoder – Could not open resource for reading.
[gstreamer] gstDecoder – try manually setting the codec with the --input-codec option
[gstreamer] gstDecoder – failed to create decoder for rtsp://0000:0000aaaa@192.168.3.162:554
video-viewer: failed to create input stream

It does work in openCV with:
cap = cv2.VideoCapture(“rtsp://0000:0000aaaa@192.168.3.162:554/cam/realmonitor?channel=1&subtype=0”)

Anything else that I can try? Did I miss some installation?
Thanks,

dusty_nv · September 24, 2020, 7:48pm

Can you try running it as video-viewer --input-codec=h264 rtsp://0000:0000aaaa@192.168.3.162:554 (assuming your RTSP is encoded with H.264)

terry.l.lee · September 25, 2020, 6:37pm

It’s working. Thanks a lot.
I need to add "/media/video1 " at the end.
video-viewer --input-codec=h264 rtsp://0000:0000aaaa@192.168.3.162:554/media/video1

Could you give me some idea on the processing time efficiency if openCV is used to capture images (detail at previous blog ) for object detection ?

Honey_Patouceul · September 25, 2020, 7:07pm

Not sure what you mean.
If you use jetson-utils for receiving/decoding the RTSP stream, what do you mean with ‘openCV is used to capture images’ ?
Jetson-utils would use gstreamer for providing a RGB image than can be used instead of opencv_video BGR.
Opencv videoio may not be so efficient on jetson. Jetson-utils might be faster for providing frames.

terry.l.lee · September 25, 2020, 7:36pm

Since I will do some image manipulation such as selected an area, rotate resize add display… before sending it to network. I wanted to see if using opencv to capture images is an feasible option or not.
If I understand correctly, it will work. However, there will be extra processing time.
Thanks a lot for your help,
Terry

Honey_Patouceul · September 25, 2020, 7:53pm

I see.
For C++ processing with opencv CUDA, you might check this example.
However, for further opencv python processing, you may also check:

…someone else may better advise.

terry.l.lee · September 25, 2020, 9:30pm

Very helpful links. I did not know that you can use cuda to speed up the processing.
The current openCV in the default install for me is: 4.1.1
Would you need if openCV 4.4.0 version is needed for CUDA to work on openCV?

Honey_Patouceul · September 26, 2020, 11:37am

The opencv lib provided by JetPack doesn’t support CUDA. You have to build your own version enabling CUDA.
Many opencv versions would work, but I’d suggest to use 4.4.
You may try one of these scripts for downloading/building:

terry.l.lee · September 27, 2020, 1:34am

Thanks for sharing. It will save me a lot of time trying to find out.

Topic		Replies	Views
Nano not using GPU with gstreamer/python. Slow FPS, dropped frames Jetson Nano	22	15877	October 14, 2021
IP camera streaming on Jetson TX2 Jetson TX2	15	6856	October 18, 2021
RTSP Jetson nano Jetson Nano rtsp	12	2760	October 18, 2021
OpenCV camera w/TX1 works with C++ but not Python Jetson TX1	17	4457	October 18, 2021
Jetson nano development kit – h264 IP camera live streaming with gstreamer for video analytics is not working Jetson Nano gstreamer	6	665	September 15, 2022
VideoCapture fails to open onboard camera L4T 24.2.1 OpenCV 3.1 Jetson TX1	28	23489	October 18, 2021
Can not use OpenCV to display image from jetson.utils.gstCamera Jetson Nano	15	5549	April 15, 2020
Python opencv gstreamer RTSP stream error Jetson Nano gstreamer	18	6191	April 6, 2022
jetson nano raspberry pi camera not working Jetson Nano	18	19261	October 14, 2021
CSI-Camera Raspberry Pi v2 not work on Jetson Nano Jetson Nano	11	13604	October 14, 2021

IP camera connection with jetson.utils.gstCamera

Related topics