Using a Mellanox DAC cable and two CX311A cards to directly connect two Ubuntu 18.04 desktops. My RAID array can handle writing at over 500MB/s but on file transfers between the PCs, I’m seeing about 150 to 170MB/s when I should be getting about 500MB/s. Cards are installed in PCI x16 slots. Any idea what could be wrong?
Only seeing about 160MB/s on file transfers between two Ubuntu desktops with Mellanox DAC cables and Mellanox cards.
Can you validate that your servers and cards are tuned as per our tuning guide —> https://community.mellanox.com/s/article/performance-tuning-for-mellanox-adapters
Can you please provide following information:
- What is type of traffic? (TCP,UDP etc)
- P/N of cable?
- #[ofed_info -s]