I have setup a small Infiniband network to do some testing and am running into an issue I could use some help with. I can run ib_write_bw without using -z and it completes successfully. But if I try to add the -z switch, then it fails to run with the following:
[root@016514 ~]# ib_write_bw 10.255.1.2 --report_gbits -F -a -d mlx5_0 -i 1 -z
Received 10 times ADDR_ERROR
Unable to perform rdma_client function
Unable to init the socket connection
I was asked to not install the official OFED drivers from Nvidia and to just use the RHEL drivers.
Running RHEL 7.9
Any ideas? This is running on 7800 switches that are no longer under entitlement, so having a tough time getting any official support.