Real time streaming of video to PC

[lowellm]

Hello, how easy is it to get real time streaming over wifi to a PC working? I’m interested in having my desktop do image processing with openCV and pytorch while the jetson nano acts as the host.

In addition, has anyone set up PC control of the nano? In particular I’m interested in having the nano act as a link and the PC act as a controller for an autonomous robot. The nano would need to transmit sensor information and run commands issued by the desktop. I’m not sure if the lag would be too much for things like SLAM - ideas?

[DaneLLL]

Hi,
A general usecase is to use test-launch to lauhcn RTSP server in gstreamer. You can refer to

VLC playing gstreamer flow

Please also try test-launch.c @ gst-rtsp-server/test-launch.c at master · GStreamer/gst-rtsp-server · GitHub Target sudo apt-get install libgstrtspserver-1.0 libgstreamer1.0-dev gcc test-launch.c -o test-launch $(pkg-config --cflags --libs gstreamer-1.0 gstreamer-rtsp-server-1.0) ./test-launch “videotestsrc ! omxh265enc ! rtph265pay name=pay0 pt=96” Host Open network stream rtsp://<TARGET_IP_ADDRESS>:8554/test via VLC

The omx plugins are deprecated and you can run

“videotestsrc ! nvvidconv ! nvv4l2h265enc ! h265parse ! rtph265pay name=pay0 pt=96”

For running with OpenCV, you can refer to

OpenCv Mat to RTSP stream

Hello, I have a Jetson Nano with a Camera, and I have implemented a face detection program. I am streaming the results of the face detection to a connected screen using OpenCV, but I would also like to send it to a webpage. I am using rtmpsink (using gstreamer) to create the stream, and using OpenCV Videowriter to write image frames (Opencv Mats) on the stream. The problem is the delay (about 4 seconds) between the video on the screen and the video on the webpage. Is this due to encoding or vi…

For advanced usecases, please look at

Jetson Community Projects

These are contributions from community. You can check if any project can be used as a reference of developing your usecase.

[lowellm]

Thanks,

What do you think the delay would be from the camera to my desktop over a wifi connection?

More generally, do you think it’s possible to control the jetson through the PC in real time? Either through socket programming or some other means.

Last, is there instructions to transfer a learned deep learning model from PC to jetson?

[DaneLLL]

Hi,

@lowellm

What do you think the delay would be from the camera to my desktop over a wifi connection?

We don’t try the case. We have tried local streaming in this post. Please refer to it and try streaming through wifi.

@lowellm

More generally, do you think it’s possible to control the jetson through the PC in real time? Either through socket programming or some other means.

We don’t verify the case of controlling Jetson Nano through PC in realtime. Please refer to the projects from community contribution. See if you can apply either one to your usecase.

@lowellm

Last, is there instructions to transfer a learned deep learning model from PC to jetson?

For running deep learning inference on Jetson platforms, we would suggest use DeepStream SDK. Please check the documents:

NVIDIA Metropolis Documentation

For training/applying a model, please look at
https://docs.nvidia.com/metropolis/deepstream/dev-guide/index.html#page/DeepStream_Development_Guide/deepstream_TLT_Integration.html#