ibportstate disable port and unrecoverable

Infrastructure & Networking Software And Drivers
#1

hello,

We have Mellanox Infiniband ConnectX-5 VPI adapter card to test rdma, now i am in trouble.

1 i find when use command ifdown, the IP disappeared, but the connection eastablished will have no affect, still have IO throgh port.

Is there a solution to archive the effect like ifdown/ifup on Ethernet (easily disconnect the network and rdma IO)?

2 well, i find a solution, use command ibportstate lid port disable ，it is really works, at lease no IO anymore.

Unfortunately, this port can not recover to link-up, even after reboot.

ibportstate lid port enable not work and mlxlink not work yet.

How to make port link-up again?

best regards

thanks

Catch1.jpg
Catch1.jpg807×99 52.5 KB

Catch2.jpg
Catch2.jpg1109×495 63.6 KB

#2

Hi ,

You can use the mlxlink command for that :

  • Mlxlink -d -a DN

  • Mlxlink -d -a UP

And also for toggling the link

  • Mlxlink -d -a TG

Thanks,

Samer

#3

2 well, i find a solution, use command ibportstate lid port disable ，it is really works, at lease no IO anymore.

Unfortunately, this port can not recover to link-up, even after reboot.

ibportstate lid port enable not work and mlxlink not work yet.

How to make port link-up again?

I had exactly the same problem and this worked for me:

mlxfwreset -d -l 3 reset