Hi I’m experiencing slow speed using100g connectX 5 between Mac to Proxmox TrueNAS VM.
My setup is as follows:
MAC PRO 2019 computer with Mellanox MCX516A-CCAT installed on a x6 lane PCIe gen3
Supermicro server with Mellanox MCX516A-CDAT installed on a x16 lane PCIe gen3
MIkrotik CRS504-4XQ-IN 100G switch connected to both Mellanox adaptors using DAC MCP1600 Mellanox cables.
on the Supermicro server i installed proxmox 7 hypervisor and TrueNAS VM. both mellanox firmware is on the latest version to date and on the same network (no VLANS). both adaptors show 100G link however when i use a iperf & iperf3 test i get only 9G speed between the MAC PRO to the TrueNAS and 27G between VM to VM. i also tried MTU 9000 and PTP bypassing the mikrotik switch but no change.
after upgrading to macOS Ventura i get bit better speed 13G Mac > VM when using iperf2 however i’m unable to setup jambo frames, only max frame size available is 2034! even through terminal get an error that 2034 is the max i can go.
Thank you for contacting us!
At this moment NVIDIA ConnectX Adapters are not supported on the Mac OS platform.
This hardware has not been tested on a Mac OS system and driver it self is an Apple driver.
As we have no knowledge of how this driver has been written and what features or test it has gone through we cannot offer any support on this issue.