Accessing CSI data on CUDA

Hi Team,

  1. Is it possible to access the CSI data from the Camera sensor using CUDA?
  2. If yes Do I need to create a sensor driver using CUDA c/c++ programming or I can do it from the existing sensor driver?
  3. Is the entire RAM space is sharable to the CUDA memory?

Regards,
Ajith.

Yes. That can be done in at least 2 ways:

  • With gstreamer, you would access your CSI cam with nvarguscamerasrc, and you would be able to use CUDA processing on frames in NVMM memory with nvivafilter plugin that allows to build a custom library for your processing.

  • With jeston MMAPI. You may install it (sudo apt install nvidia-l4t-jetson-multimedia-api) and chek the examples installed into /usr/src/jetson_multimedia_api/samples and /usr/src/jetson_multimedia_api/argus/samples.

No, above ways would be much easier.

It is the same physical memory. What has already been allocated before for Linux,X,Ubuntu… would of course not be available.
In older L4T releases there may have been some limitations to the amout of memory that could be allocated for CUDA/GPU, but I think that now most of it is available. Someone more skilled may correct me if wrong.

1 Like