Hi, Is there any sample code (git, open source etc.) available for enabling RDMA from Xilinx Ultrascale FPGA (e.g. XCKU085) to RTX 4000? Initially, we are transferring 2.5 GB (GigaBytes) / second and will eventually need to get to 10 GB/s. Has anybody tested such large transfers, and what are some of the issues one need to watch out for? Our current implementation transfers the data to a circular buffer on server and reads it back into the GPU. The obvious issues we are facing are CPU interrupts and packet drops. This was done purely to get the application working. But, the next step is to optimize the flow. Thanks.
Related topics
Topic | Replies | Views | Activity | |
---|---|---|---|---|
First step | 3 | 218 | July 10, 2024 | |
Low performance on V100 to/from RDMA device | 4 | 733 | September 28, 2020 | |
GPU2FPGA transfer rate is lower than FPGA2GPU when using GPUDirect RDMA | 6 | 1404 | May 27, 2022 | |
RTX A4000 support GPUDirect RDMA? | 6 | 2338 | June 25, 2024 | |
RDMA GPU Direct Slow | 10 | 2581 | February 13, 2019 | |
Transfer camera data stream from FPGA to AGX via PCIe | 2 | 878 | January 8, 2024 | |
Camera data pipeline from FPGA to GPU | 1 | 789 | February 13, 2024 | |
Example codes and reffrence for Rdma GPUDirect | 1 | 965 | March 1, 2024 | |
FPGA cannot communicate with A100 through XDMA Using RDMA | 5 | 415 | June 12, 2024 | |
GPUDirect rdma | 1 | 543 | March 12, 2024 |