Camera data pipeline from FPGA to GPU

Healthcare & Life Sciences Holoscan SDK
1

We are using a real time video processing system:

  1. The system collects 2 channels of video ( from cameras with 8M pixels, 60fps each) through a customized FPGA board (Xilinx Zynq UltraScale+ MPSoc).
  2. The collected MIPI data is converted into RAW data to GPU on Jetson AGX Xavier via PCIE for further processing.
  3. We want to use GPUDirect RDMA to transfer the data to GPU
    Currently, we have run the code of GitHub - NVIDIA/jetson-rdma-picoevb: Minimal HW-based demo of GPUDirect RDMA on NVIDIA Jetson AGX Xavier running L4T
    Our questions are:
  4. how can GPU be noticed when the data transfer is started and stopped
  5. with what scheme can we achieve lowest latency and fastest speed data transfer (how to set buffer etc)

Thanks in advances

2

Hi there, could you give more context and details to your questions? That way we can better aim at finding the answers. Thank you