Low-latency camera for Jetson TX2

Thank you, I appreciate your approach!

Well, I didn’t mean development of device driver from scratch for a new product. Specifically, Auvidea B102/B110 HDMI-2-CSI converter boards do have existing drivers for linux kernel 3.x (from old LT4L releases) and in case of B110 (when it will be released), there’s already a driver written by ZHAW folks for this chipset that works on linux 4.4 kernel. I don’t think it would even take a full month for a qualified person (like ZHAW or RidgeRun) to adapt the driver to make it work on the latest release of LT4L kernel? For both TX1 & TX2.

-albertr

First of, i need to brag a little about Ridgerun,
i have never dealt with a company that is so helpful and corporate as them,
the last few days (weeks ?) i have send the email asking for help and info regarding the J20 and IMx219 driver’s and they have help me / given me info always within 2-24 hours, this is a company i would never hesitate to use if i was something other that just a hobbyist :)

With there help i am getting closer to get this working on my TX2 but i am a novice programmer so it’s baby steps :)

What you should do Ridgerun is to setup a new product in your shop for the J20 / 106 etc and the IMX219 driver, set the price to 100usd for none commercial hobbyist and change the Gpl to none commercial use.

I know you more or less just deal with companies and hobbyist would probably generate a lot of support requests, so set up a forum as well so we can help ishoder :)

You probably would have filled 24x100 usd very quick, i know the files could be copied, but i feel we are a bunch of trustworthy and serious users in here, if it fails, lesson learned and will not be done again :)

And again, thanks @DavidSoto an the rest of the Ridgerun team ;)

At the end of the day, i really cant understand why Auvidea haven’t gotten Ridgerun to update this, it should have been started the day 28.2 came out, they would sell a lot more carrier boards immediately, 2400usd is nothing for a company… :)

/Morten

Hi,

Is there any possible to shared the modified nvcamerasrc binary, to the realtime streaming the buffer could be avoidable.

Thank you very much.

PLease check https://devtalk.nvidia.com/default/topic/1023668/jetson-tx1/nvcamerasrc-queue-size-property-limitation/post/5254366/#5254366

Hi Everyone,

just to add to this thread as I just couldn’t figure this out (and I looked through all threads and talked to various camera vendors):

We want to add probably 3 cameras to our jetson tx 2 board. That board is on a mobile robot that I then want to remotely control via a wireless network based on camera images. For that to work I need very low latency in the camera capture stack (in parallel I’m working on some optimization in the networking…)

Does anybody have any recommendations for the camera setup?

Requirements:

  • Very low latency, needs to include encoding so we can stream it via wireless networks. (target around 10-40 ms if possible prior of sending it over network)
    → so likely high fps desirable (I guess 60 fps or even higher)
  • Wide angular field of view of combined cameras (~ 210 degrees).
  • VGA resolution sufficient, 720p is nice to have. Ideally adjustable for testing.

So far I looked at for example the following two (but didn’t find any confirmed latency numbers…)

  1. Three Synchronized 4K Cameras for NVIDIA Jetson TX2
  2. https://leopardimaging.com/product/li-jetson-kit-imx377m12-x/

Do you have any recommendations/thoughts? Thanks so much!!

Does anyone know if there has been an update to the state of Auvidea drivers?

I’m looking to use an IMX219 with TX2 and Auvidea J120.

Hi @j_mcker

We offer the IMX219 driver for Jetson TX1. The following link may be interesting for you:

[url]https://developer.ridgerun.com/wiki/index.php?title=Sony_IMX219_Linux_driver_for_Jetson_TX1[/url]

We can port our actual driver to Jetson TX2 with Auvidea J120 support for the JetPack version that you require. Feel free to contact us if you are interested in this support.

Best regards,
-Daniel