Can I feed image data to ISP?

Autonomous Machines Jetson & Embedded Systems Jetson AGX Orin
1

All examples I can find are using Libargus to capture images from cameras. I am wondering if I can feed image data to ISP pipeline instead of getting from cameras?

The use case is that I have another component to get image data from the camera and pass the data to AGX Orin board through GMSL. There is no camera control available, such as FPS, gain and exposure. I am wondering if I can utilize the hardware ISP to perform debayering, color controlling, noise reduction and etc.

4

Hello @suchao,

Could you describe a bit better your setup ?

I image you have something like the following:

Camera <—> Serializer <—> Deserializer <—> Jetson

Or do you have something different ?

regards,
Andrew
Embedded Software Engineer

5

hello suchao,

please refer to Camera Architecture Stack, we don’t support memory → ISP at the moment.

6

How about from CSI port to ISP?

The simplified use case is as follows.

Camera ↔ One board (non Jetson) → Jetson AGX Orin

  • Between Camera and One board: One board controls the camera including FPS, gain, exposure and etc. The image data goes from Camera to One board. One board will consume the image data as well as pass the image data to Jetson AGX Orin.
  • Between One board and Jetson AGX Orin: Jetson AGX Orin doesn’t send any control signal to One board. It only receives image data from One board through GMSL. The physical connection should go through CSI port of Jetson AGX Orin.
7

Hello,

Yes, this is possible, basically the Jetson AGX Orin will see your One board board as a normal camera.

You are going to need to create a camera driver where is defined the resolution, pixel clock, etc in order to capture the video stream from the CSI provided by the One board.

Since there is not a control signal, when you are going to start the video stream capture you have make sure that the One board already started the stream.

Manuel Leiva
Embedded SW Engineer at RidgeRun
Contact us: support@ridgerun.com
Developers wiki: https://developer.ridgerun.com
Website: www.ridgerun.com

8

hello suchao,

you may refer to Jetson Virtual Channel with GMSL Camera Framework.
it’s possible via virtual channel supports.