Mellanox ConnectX-5 adapter speed 650MB/s only

Infrastructure & Networking Adapters and Cables Ethernet Adapter Cards
1

Helllo,

I have two Mellanox Connectx-5 adapters connected back to back. Link speed shows 40Gbps. I am using widows server 2016. Tried with different PCIe slots and tested with iperf3. But in case of TCP speed reaches up to 650 MB/s only and in UDP it only achieves nearby 450 MB/s.

I am sure I am missing out some setting but can not figure out what.

Can anybody help me in this case?

2

Could you try this:

  • Install WinOF-2 v.1.70

  • Try the Microsoft tool TechNet NTttcp Utility: Profile and Measure Windows Networking Performance Browse code samples | Microsoft Docs

  • Verify RDMA performance by running nd_read_bw/nd_write_bw ( check WinOF user manual)

3

Thank you. I tried NTttcp with different send buffer size and datagram size. I was able to get 4.8 GBytes speed on 40Gbps link.