Transfer camera data stream from FPGA to AGX via PCIe

Healthcare & Life Sciences Holoscan SDK
1

We are using a real time video processing system:

  1. The system collects 2 channels of video ( from cameras with 8M pixels, 60fps each) through a customized FPGA board (Xilinx Zynq UltraScale+ MPSoc).
  2. The collected MIPI data is converted into RAW data to GPU on Jetson AGX Xavier via PCIE for further processing.
  3. We want to use GPUDirect RDMA to transfer the data to GPU
  4. Currently, we have run the code of GitHub - NVIDIA/jetson-rdma-picoevb: Minimal HW-based demo of GPUDirect RDMA on NVIDIA Jetson AGX Xavier running L4T
    Our questions are:
    1. how can GPU be noticed when the data transfer is started and stopped
  6. with what scheme, can we achieve lowest lantency and fastest speed data transfer
  7. how to transfer the RAW data from FPGA to GPU while keeping its integrity
  8. does Nvidia provide API / functions to deal such video stream transfer issue
2

Hi there! Could you please elaborate on the 4 questions a bit more and give more context to them? Happy new year!

3

We are using a real time video processing system:

  1. The system collects 2 channels of video ( from cameras with 8M pixels, 60fps each) through a customized FPGA board (Xilinx Zynq UltraScale+ MPSoc).
  2. The collected MIPI data is converted into RAW data to GPU on Jetson AGX Xavier via PCIE for further processing.
  3. We want to use GPUDirect RDMA to transfer the data to GPU
    Currently, we have run the code of GitHub - NVIDIA/jetson-rdma-picoevb: Minimal HW-based demo of GPUDirect RDMA on NVIDIA Jetson AGX Xavier running L4T
    Our questions are:
  4. how can GPU be noticed when the data transfer is started and stopped
  5. with what scheme, can we achieve lowest latency and fastest speed data transfer
  6. does Nvidia provide API / functions to deal such video stream transfer issue

Thanks in advances