I am running some RDMA traffic between 2 Ubuntu hosts with ConnectX-4 LX cards. The end-to-end 1-way latency is of particular interest to us and the number is not good. So I am trying to identify the latency bottleneck by measuring the latency of each component along the path, I am wondering if there is any tool that measures the latency introduced by ConnectX-4 (basically the time the packet is generated by the host software and the time the packet egress from the rNIC). Thanks.
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| ConnectX-4 LX RoCE does not like latency | 1 | 478 | March 7, 2017 | |
| RDMA/RoCE traffic between Linux and Windows | 1 | 1190 | April 4, 2017 | |
| Mellanox NIC + Real time performance monitoring | 1 | 1434 | November 3, 2022 | |
| GPU Direct RDMA latency for Jetson Orin NX | 1 | 374 | October 16, 2023 | |
| How does ib_send_lat measure the latency? | 3 | 1700 | October 25, 2023 | |
| ConnectX-4 RoCE speed less than expected | 6 | 2020 | July 14, 2023 | |
| What is the correct driver for ConnectX-4 LX and ConnectX-6 LX Cards? | 3 | 1423 | September 18, 2023 | |
| HDR Infiniband and ConnectX-6 VPI interfaces | 1 | 815 | January 11, 2022 | |
| Rdma_get_send_comp takes very long time 150 us with only simple request and reply workload | 1 | 91 | August 25, 2025 | |
| Mellanox ConnectX-6 is ignoring RDMA_WRITEs sent by proprietary hardware | 1 | 651 | May 1, 2024 |