We are developing a product that currently runs over the usual Nvidia APIs (cuda and the nvidia-encoder). We’re trying to adapt it to run on the PX2 platform, but I ran into a few problems:
By far, the greatest time consuming obstacle is that the SDK is running on Ubuntu 16.04. Our code was developed on Ubuntu 18.04, and to get it to compile on 16.04 I’ll need to back port gcc, libavcodec and, likely, other libraries as well.
We are currently using USB 3 cameras. Switching to the Drive platform would mean rewriting the camera capture code. It would be highly useful to get the source code for the demo apps that come with the SDK (the camera pass-through to screen and the AI parsing).
Last, but not least, we are currently relying on the nvidia-encode library. It seems this library is not available for the ARM platform. The Drive API has its own encoder, and we could adapt our code to use that instead, but we are missing a feature that is very important to us. The nvidia-encode API has an option to invalidate specific frames, so that the encoder produced p-frames don’t reference them. This is a feature we rely on heavily, and which the new API (as far as I could tell) does not have.