Vision Accelerator — 7-way VLIW processor

Autonomous Machines Jetson & Embedded Systems Jetson AGX Xavier
1

Hi Nvidia Team

support of this Vision Accelerator in the current version of the drivers is implemented, can it work together with the ISP? description of this module can be found in the documentation? is the code development available for this module (DSP)?

2

Hi visiondev, the Vision Accelerator isn’t yet supported in the JetPack 4.0 Developer Preview EA software, it will be enabled in a future release. See the Release Notes for more info. The ISP is used with the CSI/SLVS camera stack, however you could use ISP on your camera stream(s) and then pass the frames off to the Vision Accelerator engine.

3

hi dusty_nv

thank you, about the Vision Accelerator block is understandable.

" The ISP is used with the CSI/SLVS camera stack, however you could use ISP on your camera stream(s) and then pass the frames off to the Vision Accelerator engine"

“access” to ISP is still closed to developers?

4

The ISP is a fixed-function processing block which can be configured through the Argus API, Linux drivers, or the Technical Reference Manual which contains register information similar to TX1/TX2. You may also wish to consult with Jetson Ecosystem camera partners that are familiar with it.

5

So the the vision accelerator including optical flow and stereo matching engine is not supported also on Jetpack 4.2, I read that the vision works supports those 2 functions (SOFE), can you explain?

1 Like