Use gmsl camera with python

Autonomous Vehicles DRIVE PX 2 DRIVE Hardware
1

Hi!

As we want to use a ready trained tensorflow dnn we like to simple feed the images from the camera?
What is the best way or typical way to get this done?

My first intention was a simple python script feeding the gmsl camera stream but i am not able to read the images out. I tried to get a gstream pipline working but no luck so far.

I was inspired by this post:
https://devtalk.nvidia.com/default/topic/907780/-python-how-to-use-tx1-camera-with-opencv/

gstream problem for now is this:
No element: nvcamerasrc

got a little confused by this post:
https://devtalk.nvidia.com/default/topic/976224/jetson-tx1/-pyhon-and-opencv-how-to-use-the-camera-on-tx1/

We use the drive px 2 with the latest firmware and ubuntu 16.04.

Some help would be appreciated thanks!

1 Like
2

Hello tinokl,

JetsonTX1 and DrivePX2 are different.
Could you please refer to below link? Thanks.
NVIDIA DRIVE Downloads | NVIDIA Developer.

3

Hello Steve,

I searched through the docs but I could only find some cpp related examples.
For that reason i searched the web and got some hints from jetson related projects.
(I know they are different but some tips worked for me)

For quick science driven development python has some benefits as i like to use tensorflow and keras.

By now i am searching for a simple solution to get the camera stream to my python script but
for future purposes i need them within ROS. Actually i would prefer a ROS ready solution, so we can grab the images wherever we need them.

In this post: https://devtalk.nvidia.com/default/topic/995880/?comment=5093714
a guideline doc was mention, any new information on that?

ROS is working pretty out of the box except for the cameras.

Thanks

4

Hello tinokl,

A upcoming PDK will be released in May. Thanks.

5

Hi tinokl,

There’s an update of ROS in https://devtalk.nvidia.com/default/topic/1011002/general/cross-compiling-driveworks-on-the-px2-with-ros/

just wondering have you figured out how to get gmsl camera stream in python? If you did, can you please share some instructions? Thanks!

1 Like
6

Hi WZhouuuu,

thanks for the update on ROS I already joined the conversation.

Unfortunaly i did not found a way to get the cameras working in python but i am still very interessted in a solution (thats why i am asking for a gstreamer pipeline or something similar).

If anybody has a working solution please give us some information.

Thanks in advance!

7

Has anyone figured this out? I’m having the same problem.

8

From reading through the forums it seems noone has had any success getting data from GMSL cameras into Python on Jetson devices. I wish I knew this earlier – we will probably go completely IP cameras and use only the GBE connections as a result.

If you discover anything, please share here!