I have a setup of two nodes each with a ConnectX-5 NIC and these NICs are directly connected to each other. One node has kernel version 4.17.0 and other has 4.19.10 and both run Fedora 28. Both of the nodes have MLNX OFED 18.104.22.168.1.0 installed on them which was built using the mlnx_add_kernel_support.sh. I am following this mellanox post
to verify the connectivity between the nodes. The udaddy, rdma_server/rdma_client, rping, ucmatose commands work as expected. However running the ib_send_bw (ib_send_bw -d mlx5_0 -i 1 -F --report_gbits 22.214.171.124) fails with the following error
Couldn’t connect to 126.96.36.199:18515
Unable to open file descriptor for socket connection Unable to init the socket connection
Similar output is observed for ib_write_lat and ibv_rc_pingpong. What can be the reasons behind this and how to resolve it ???