We have a cluster with one Head node, one Storage node and 4 computing nodes. All are connected through ConnectX-3 Infiniband interfaces onto a Infiniband switch. Recently, one ConnectX-3 card on Head node failed and we have replaced the same. It is not working as expected. I am giving the details here:
[ root ] sunya01:~ # lspci | grep Mellanox
07:00.0 Network controller: Mellanox Technologies MT27520 Family [ConnectX-3 Pro
[ root ] sunya01:~ # mstflint -d 07:00.0 q
Image type: FS2
FW Version: 2.36.5000
FW Release Date: 26.1.2016
Product Version: 02.36.50.00
Rom Info: type=PXE version=3.4.718 devid=4103
devid=4103 version_id=8025 type=CLP
type=UEFI version=14.9.46
Device ID: 4103
Description: Node Port1 Port2 Sys image
GUIDs: 9cdc71ffff41a0f0 9cdc71ffff41a0f1 9cdc71ffff41a0f2 9cdc71ffff41a0f3
MACs: 9cdc7141a0f1 9cdc7141a0f2
VSD:
PSID: HP_1380110017
[ root ] sunya01:~ # mst status
MST modules:
MST PCI module loaded
MST PCI configuration module loaded
MST devices:
/dev/mst/mt4103_pciconf0 - PCI configuration cycles access.
domain:bus:dev.fn=0000:07:00.0 addr.reg=88 data.reg=92
Chip revision is: 00
/dev/mst/mt4103_pci_cr0 - PCI direct access.
domain:bus:dev.fn=0000:07:00.0 bar=0x96000000 size=0x100000
Chip revision is: 00
[ root ] sunya01:~/MLNX_OFED_LINUX-4.0-2.0.0.1 # mlxfwmanager
Querying Mellanox devices firmware …
Device #1:
Device Type: ConnectX3Pro
Part Number: 764285-B21_Ax
Description: HP InfiniBand FDR/Ethernet 10Gb/40Gb 2-port 544+FLR-QSFP Adapter
PSID: HP_1380110017
PCI Device Name: /dev/mst/mt4103_pci_cr0
Port1 MAC: b883038319e1
Port2 MAC: b883038319e2
Versions: Current Available
FW 2.32.5290 N/A
CLP 8025 N/A
PXE 3.4.0306 N/A
UEFI 13.5.0040 N/A
Status: No matching image found
[ root ] sunya01:~/MLNX_OFED_LINUX-4.0-2.0.0.1 # ibv_devinfo
No IB devices found
Why no IB devices are found? How am I able to create IB devices so that I can assign IP address on this device?
Regards,
Biju Abraham.