ConnectX-5 adapter, always PORT_DOWN

Infrastructure & Networking Adapters And Cables
#1

Hi,

I’m newbie to ConnectX-5 adapter.

I have two server equipped with ConnectX-5 and Dell S6100-ON switch between them.

I installed OFED files and checked that the modules are loaded.

However, when i check the device status with ‘ibv_devinfo’ command, the device is always in the ‘PORT_DOWN’ status.

Is there additional procedure to UP the port?

Thanks,

#2

Hi,

Which adapters/switch are you using ? Infiniband/Ethernet ?

  • If it’s Infiniband, make sure to run the subnet manager (OpenSM)
  • If it’s Ethernet, make sure to set the IP address

Thanks,

Samer

#3

Hi, @Samer Kayouf​

Thanks for your quick reply. I solved this problem by running the OpenSM in one of the servers(When i set the ethernet, then it does not work even i assign the IP).

I’m using Mellanox ConnectX-5 with Infiniband and the switch model was dell s6100-on.

How can i set the RDMA? I could not find the document for enabling the RDMA-capability.

Thanks,

Wonsik

#4

Hi ,

Please refer to :

https://community.mellanox.com/s/article/what-is-rdma-x

https://community.mellanox.com/s/article/How-To-Enable-Verify-and-Troubleshoot-RDMA

Thanks,

Samer