ConnectX-3 firmware update

Hello,

I’m installing MLNX_OFED_LINUX-3.1-1.0.3-rhel7.2-x86_64 on CentOS 7.2 machine.

Initially I used MLNX_OFED_LINUX-3.3-1.0.4.0-rhel7.2-x86_64 but it’s conflicted with current kernel (3.10.0-327.22.2.el7.x86_64), so I’m using 3.1-1.0.3 version.

(1)

As you can see the following log ((e)&(f)), current firmware version is v2.33.5000 and v2.35.5100 is required.

How can I upgrade firmware of this ConnectX-3 card?

Using “PSID: HP_0280210019”, I can’t find the proper firmware from the Mellanox website.

Is there any way to get the right firmware for CentOS7.2 (3.10.0-327.22.2.el7.x86_64)?

(2)

I’m installing same OFED on two machines with same environments (same ConnectX-3 card, cables, and OS).

In the (e) log, at least, each VPI is recognized as “UP 1X QDR (Ethernet)”.

But, in the (f) log, all VPI are shown as “DOWN (Ethernet)”.

Is there anything I should check?

Thank you in advance for any help!


(a)

cat /etc/redhat-release

CentOS Linux release 7.2.1511 (Core)

uname -a

Linux xxx 3.10.0-327.22.2.el7.x86_64 #1 SMP Thu Jun 23 17:05:11 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux

(b)

// I’m using only the first port among 2 ports.

cat /etc/modprobe.d/mlx4_core.conf

options mlx4_core port_type_array=2,2 num_vfs=8,0,0 probe_vf=8,0,0 log_num_mgm_entry_size=-1

(c)

./mlnxofedinstall --enable-sriov

The 3.10.0-327.22.2.el7.x86_64 kernel is installed, MLNX_OFED does not have drivers available for this kernel.

You can run mlnx_add_kernel_support.sh in order to to generate an MLNX_OFED package with drivers for this kernel.

Installation finished successfully.

Preparing… ################################# [100%]

Updating / installing…

1:mlnx-fw-updater-3.1-1.0.3 ################################# [100%]

Added 'RUN_FW_UPDATER_ONBOOT=no to /etc/infiniband/openib.conf

continued…

Attempting to perform Firmware update…

Note: Will burn SR-IOV enabled firmware only for ConnctX3 devices.

To configure SR-IOV for other devices, please use the ‘mlxconfig’ or ‘mstconfig’ utility.

The firmware for this device is not distributed inside Mellanox driver: 21:00.0 (PSID: HP_0280210019)

To obtain firmware for this device, please contact your HW vendor.

Failed to update Firmware.

See /tmp/MLNX_OFED_LINUX-3.1-1.0.3.23105.logs/fw_update.log

WARNING: Original /etc/infiniband/openib.conf saved as /etc/infiniband/openib.conf.rpmsave

To load the new driver, run:

/etc/init.d/openibd restart

(d)

lspci -nn | grep Mella

21:00.0 Network controller [0280]: Mellanox Technologies MT27500 Family [ConnectX-3] [15b3:1003]

21:00.1 Network controller [0280]: Mellanox Technologies MT27500/MT27520 Family [ConnectX-3/ConnectX-3 Pro Virtual Function] [15b3:1004]

21:00.2 Network controller [0280]: Mellanox Technologies MT27500/MT27520 Family [ConnectX-3/ConnectX-3 Pro Virtual Function] [15b3:1004]

21:00.3 Network controller [0280]: Mellanox Technologies MT27500/MT27520 Family [ConnectX-3/ConnectX-3 Pro Virtual Function] [15b3:1004]

21:00.4 Network controller [0280]: Mellanox Technologies MT27500/MT27520 Family [ConnectX-3/ConnectX-3 Pro Virtual Function] [15b3:1004]

21:00.5 Network controller [0280]: Mellanox Technologies MT27500/MT27520 Family [ConnectX-3/ConnectX-3 Pro Virtual Function] [15b3:1004]

21:00.6 Network controller [0280]: Mellanox Technologies MT27500/MT27520 Family [ConnectX-3/ConnectX-3 Pro Virtual Function] [15b3:1004]

21:00.7 Network controller [0280]: Mellanox Technologies MT27500/MT27520 Family [ConnectX-3/ConnectX-3 Pro Virtual Function] [15b3:1004]

21:01.0 Network controller [0280]: Mellanox Technologies MT27500/MT27520 Family [ConnectX-3/ConnectX-3 Pro Virtual Function] [15b3:1004]

(e)

hca_self_test.ofed

---- Performing Adapter Device Self Test ----

Number of CAs Detected … 9

PCI Device Check … PASS

Kernel Arch … x86_64

Host Driver Version … MLNX_OFED_LINUX-3.1-1.0.3 (OFED-3.1-1.0.3): modules

Host Driver RPM Check … PASS

Firmware on CA #0 VPI … v2.33.5000

Firmware Check on CA #0 (VPI) … FAIL

REASON: mismatch CA #0 firmware detected (found v2.33.5000, required v2.35.5100)

Firmware on CA #1 VPI … v2.33.5000

Firmware Check on CA #1 (VPI) … NA

REASON: NO required fw version

Firmware on CA #2 VPI … v2.33.5000

Firmware Check on CA #2 (VPI) … NA

REASON: NO required fw version

Firmware on CA #3 VPI … v2.33.5000

Firmware Check on CA #3 (VPI) … NA

REASON: NO required fw version

Firmware on CA #4 VPI … v2.33.5000

Firmware Check on CA #4 (VPI) … NA

REASON: NO required fw version

Firmware on CA #5 VPI … v2.33.5000

Firmware Check on CA #5 (VPI) … NA

REASON: NO required fw version

Firmware on CA #6 VPI … v2.33.5000

Firmware Check on CA #6 (VPI) … NA

REASON: NO required fw version

Firmware on CA #7 VPI … v2.33.5000

Firmware Check on CA #7 (VPI) … NA

REASON: NO required fw version

Firmware on CA #8 VPI … v2.33.5000

Firmware Check on CA #8 (VPI) … NA

REASON: NO required fw version

continued…

Host Driver Initialization … PASS

Number of CA Ports Active … 9

Port State of Port #1 on CA #0 (VPI)… UP 1X QDR (Ethernet)

Port State of Port #2 on CA #0 (VPI)… DOWN (Ethernet)

Port State of Port #1 on CA #1 (VPI)… UP 1X QDR (Ethernet)

Port State of Port #1 on CA #2 (VPI)… UP 1X QDR (Ethernet)

Port State of Port #1 on CA #3 (VPI)… UP 1X QDR (Ethernet)

Port State of Port #1 on CA #4 (VPI)… UP 1X QDR (Ethernet)

Port State of Port #1 on CA #5 (VPI)… UP 1X QDR (Ethernet)

Port State of Port #1 on CA #6 (VPI)… UP 1X QDR (Ethernet)

Port State of Port #1 on CA #7 (VPI)… UP 1X QDR (Ethernet)

Port State of Port #1 on CA #8 (VPI)… UP 1X QDR (Ethernet)

Error Counter Check on CA #0 (VPI)… NA (Eth ports)

Error Counter Check on CA #1 (VPI)… PASS

Error Counter Check on CA #2 (VPI)… PASS

Error Counter Check on CA #3 (VPI)… PASS

Error Counter Check on CA #4 (VPI)… PASS

Error Counter Check on CA #5 (VPI)… PASS

Error Counter Check on CA #6 (VPI)… PASS

Error Counter Check on CA #7 (VPI)… PASS

Error Counter Check on CA #8 (VPI)… PASS

Kernel Syslog Check … PASS

Node GUID on CA #0 (VPI) … 00:02:c9:03:00:f6:ef:f0

Node GUID on CA #1 (VPI) … 00:14:05:00:d3:a2:8c:35

Node GUID on CA #2 (VPI) … 00:14:05:00:e5:c0:e2:a1

Node GUID on CA #3 (VPI) … 00:14:05:00:d5:e0:c2:1a

Node GUID on CA #4 (VPI) … 00:14:05:00:ca:34:61:56

Node GUID on CA #5 (VPI) … 00:14:05:00:08:0d:34:72

Node GUID on CA #6 (VPI) … 00:14:05:00:ba:43:bd:b4

Node GUID on CA #7 (VPI) … 00:14:05:00:d6:4f:7f:80

Node GUID on CA #8 (VPI) … 00:14:05:00:2a:aa:5f:08

------------------ DONE ---------------------

(f)

hca_self_test.ofed

---- Performing Adapter Device Self Test ----

Number of CAs Detected … 9

PCI Device Check … PASS

Kernel Arch … x86_64

Host Driver Version … MLNX_OFED_LINUX-3.1-1.0.3 (OFED-3.1-1.0.3): modules

Host Driver RPM Check … PASS

Firmware on CA #0 VPI … v2.33.5000

Firmware Check on CA #0 (VPI) … FAIL

REASON: mismatch CA #0 firmware detected (found v2.33.5000, required v2.35.5100)

Firmware on CA #1 VPI … v2.33.5000

Firmware Check on CA #1 (VPI) … NA

REASON: NO required fw version

Firmware on CA #2 VPI … v2.33.5000

Firmware Check on CA #2 (VPI) … NA

REASON: NO required fw version

Firmware on CA #3 VPI … v2.33.5000

Firmware Check on CA #3 (VPI) … NA

REASON: NO required fw version

Firmware on CA #4 VPI … v2.33.5000

Firmware Check on CA #4 (VPI) … NA

REASON: NO required fw version

Firmware on CA #5 VPI … v2.33.5000

Firmware Check on CA #5 (VPI) … NA

REASON: NO required fw version

Firmware on CA #6 VPI … v2.33.5000

Firmware Check on CA #6 (VPI) … NA

REASON: NO required fw version

Firmware on CA #7 VPI … v2.33.5000

Firmware Check on CA #7 (VPI) … NA

REASON: NO required fw version

Firmware on CA #8 VPI … v2.33.5000

Firmware Check on CA #8 (VPI) … NA

continued…

REASON: NO required fw version

Host Driver Initialization … PASS

Number of CA Ports Active … 1

Port State of Port #1 on CA #0 (VPI)… UP 1X QDR (Ethernet)

Port State of Port #2 on CA #0 (VPI)… DOWN (Ethernet)

Port State of Port #1 on CA #1 (VPI)… DOWN (Ethernet)

Port State of Port #1 on CA #2 (VPI)… DOWN (Ethernet)

Port State of Port #1 on CA #3 (VPI)… DOWN (Ethernet)

Port State of Port #1 on CA #4 (VPI)… DOWN (Ethernet)

Port State of Port #1 on CA #5 (VPI)… DOWN (Ethernet)

Port State of Port #1 on CA #6 (VPI)… DOWN (Ethernet)

Port State of Port #1 on CA #7 (VPI)… DOWN (Ethernet)

Port State of Port #1 on CA #8 (VPI)… DOWN (Ethernet)

Error Counter Check on CA #0 (VPI)… NA (Eth ports)

Error Counter Check on CA #1 (VPI)… PASS

Error Counter Check on CA #2 (VPI)… PASS

Error Counter Check on CA #3 (VPI)… PASS

Error Counter Check on CA #4 (VPI)… PASS

Error Counter Check on CA #5 (VPI)… PASS

Error Counter Check on CA #6 (VPI)… PASS

Error Counter Check on CA #7 (VPI)… PASS

Error Counter Check on CA #8 (VPI)… PASS

Kernel Syslog Check … PASS

Node GUID on CA #0 (VPI) … 24:be:05:ff:ff:82:04:70

Node GUID on CA #1 (VPI) … 00:14:05:00:74:9d:d3:e8

Node GUID on CA #2 (VPI) … 00:14:05:00:5b:d6:c8:5c

Node GUID on CA #3 (VPI) … 00:14:05:00:91:15:4c:6f

Node GUID on CA #4 (VPI) … 00:14:05:00:f4:f1:03:95

Node GUID on CA #5 (VPI) … 00:14:05:00:01:b5:af:22

Node GUID on CA #6 (VPI) … 00:14:05:00:d4:12:58:1e

Node GUID on CA #7 (VPI) … 00:14:05:00:d4:4c:ca:e8

Node GUID on CA #8 (VPI) … 00:14:05:00:72:14:6c:52

------------------ DONE ---------------------

reply

Thanks a lot, Viki!

  1. Right. PSID is shown as HP’s one. I wanted to check whether there is any compatible OFED with this Mellanox Technologies MT27500/MT27520 Family [ConnectX-3/ConnectX-3 Pro Virtual Function] [15b3:1004]. If no, let me contact to HP.

  2. Actually I tried ibstat also but it didn’t show the needed firmware version, so I wanted to show that information using hca_self_test. This ibstat result doesn’t complain the firmware version even though hca_self_test described “(found v2.33.5000, required v2.35.5100)”. Is there no problem with v2.33.5000?

ibstat

CA ‘mlx4_0’

CA type: MT4099

Number of ports: 2

Firmware version: 2.33.5000

Hardware version: 1

Node GUID: 0x0002c90300f6eff0

System image GUID: 0x0002c90300f6eff3

Port 1:

State: Active

Physical state: LinkUp

Rate: 10

Base lid: 0

LMC: 0

SM lid: 0

Capability mask: 0x0c010000

Port GUID: 0x0202c9fffef6eff0

Link layer: Ethernet

Port 2:

State: Down

Physical state: Disabled

Rate: 10

Base lid: 0

LMC: 0

SM lid: 0

Capability mask: 0x0c010000

Port GUID: 0x0202c9fffef6eff1

Link layer: Ethernet

CA ‘mlx4_1’

CA type: MT4100

Number of ports: 1

Firmware version: 2.33.5000

Hardware version: 1

Node GUID: 0x00140500d3a28c35

System image GUID: 0x0002c90300f6eff3

Port 1:

State: Active

reply…

hca_id: mlx4_0

transport: InfiniBand (0)

fw_ver: 2.33.5000

node_guid: 0002:c903:00f6:eff0

sys_image_guid: 0002:c903:00f6:eff3

vendor_id: 0x02c9

vendor_part_id: 4099

hw_ver: 0x1

board_id: HP_0280210019

phys_port_cnt: 2

port: 1

state: PORT_ACTIVE (4)

max_mtu: 4096 (5)

active_mtu: 4096 (5)

sm_lid: 0

port_lid: 0

port_lmc: 0x00

link_layer: Ethernet

port: 2

state: PORT_DOWN (1)

max_mtu: 4096 (5)

active_mtu: 1024 (3)

sm_lid: 0

port_lid: 0

port_lmc: 0x00

link_layer: Ethernet

reply…

Physical state: LinkUp

Rate: 10

Base lid: 0

LMC: 0

SM lid: 0

Capability mask: 0x0c010000

Port GUID: 0xcc0567fffed08d89

Link layer: Ethernet

CA ‘mlx4_2’

CA type: MT4100

Number of ports: 1

Firmware version: 2.33.5000

Hardware version: 1

Node GUID: 0x00140500e5c0e2a1

System image GUID: 0x0002c90300f6eff3

Port 1:

State: Active

Physical state: LinkUp

Rate: 10

Base lid: 0

LMC: 0

SM lid: 0

Capability mask: 0x0c010000

Port GUID: 0x04a4dffffe9554b4

Link layer: Ethernet

CA ‘mlx4_3’

CA type: MT4100

Number of ports: 1

Firmware version: 2.33.5000

Hardware version: 1

Node GUID: 0x00140500d5e0c21a

System image GUID: 0x0002c90300f6eff3

Port 1:

State: Active

Physical state: LinkUp

Rate: 10

Base lid: 0

LMC: 0

SM lid: 0

Capability mask: 0x0c010000

Port GUID: 0x78a965fffe2cd6c6

Link layer: Ethernet

CA ‘mlx4_4’

CA type: MT4100

Number of ports: 1

Firmware version: 2.33.5000

Hardware version: 1

Node GUID: 0x00140500ca346156

System image GUID: 0x0002c90300f6eff3

Port 1:

State: Active

Physical state: LinkUp

Rate: 10

Base lid: 0

LMC: 0

SM lid: 0

Capability mask: 0x0c010000

Port GUID: 0xa0550afffeeb939f

Link layer: Ethernet

CA ‘mlx4_5’

CA type: MT4100

Number of ports: 1

Firmware version: 2.33.5000

Hardware version: 1

Node GUID: 0x00140500080d3472

System image GUID: 0x0002c90300f6eff3

Port 1:

State: Active

Physical state: LinkUp

Rate: 10

Base lid: 0

LMC: 0

SM lid: 0

Capability mask: 0x0c010000

Port GUID: 0x70e0bffffe624948

reply…

Link layer: Ethernet

CA ‘mlx4_6’

CA type: MT4100

Number of ports: 1

Firmware version: 2.33.5000

Hardware version: 1

Node GUID: 0x00140500ba43bdb4

System image GUID: 0x0002c90300f6eff3

Port 1:

State: Active

Physical state: LinkUp

Rate: 10

Base lid: 0

LMC: 0

SM lid: 0

Capability mask: 0x0c010000

Port GUID: 0xd8ff4bfffe554d38

Link layer: Ethernet

CA ‘mlx4_7’

CA type: MT4100

Number of ports: 1

Firmware version: 2.33.5000

Hardware version: 1

Node GUID: 0x00140500d64f7f80

System image GUID: 0x0002c90300f6eff3

Port 1:

State: Active

Physical state: LinkUp

Rate: 10

Base lid: 0

LMC: 0

SM lid: 0

Capability mask: 0x0c010000

Port GUID: 0x70ca2afffe3c7237

Link layer: Ethernet

CA ‘mlx4_8’

CA type: MT4100

Number of ports: 1

Firmware version: 2.33.5000

Hardware version: 1

Node GUID: 0x001405002aaa5f08

System image GUID: 0x0002c90300f6eff3

Port 1:

State: Active

Physical state: LinkUp

Rate: 10

Base lid: 0

LMC: 0

SM lid: 0

Capability mask: 0x0c010000

Port GUID: 0xa4ba1afffe657a61

Link layer: Ethernet

reply…

ibv_devinfo

hca_id: mlx4_8

transport: InfiniBand (0)

fw_ver: 2.33.5000

node_guid: 0014:0500:2aaa:5f08

sys_image_guid: 0002:c903:00f6:eff3

vendor_id: 0x02c9

vendor_part_id: 4100

hw_ver: 0x1

board_id: HP_0280210019

phys_port_cnt: 1

port: 1

state: PORT_ACTIVE (4)

max_mtu: 4096 (5)

active_mtu: 1024 (3)

sm_lid: 0

port_lid: 0

port_lmc: 0x00

link_layer: Ethernet

hca_id: mlx4_7

transport: InfiniBand (0)

fw_ver: 2.33.5000

node_guid: 0014:0500:d64f:7f80

sys_image_guid: 0002:c903:00f6:eff3

vendor_id: 0x02c9

vendor_part_id: 4100

hw_ver: 0x1

board_id: HP_0280210019

phys_port_cnt: 1

port: 1

state: PORT_ACTIVE (4)

max_mtu: 4096 (5)

active_mtu: 1024 (3)

sm_lid: 0

port_lid: 0

port_lmc: 0x00

link_layer: Ethernet

hca_id: mlx4_6

transport: InfiniBand (0)

fw_ver: 2.33.5000

node_guid: 0014:0500:ba43:bdb4

sys_image_guid: 0002:c903:00f6:eff3

vendor_id: 0x02c9

vendor_part_id: 4100

hw_ver: 0x1

board_id: HP_0280210019

phys_port_cnt: 1

port: 1

state: PORT_ACTIVE (4)

max_mtu: 4096 (5)

active_mtu: 1024 (3)

sm_lid: 0

port_lid: 0

port_lmc: 0x00

link_layer: Ethernet

hca_id: mlx4_5

transport: InfiniBand (0)

fw_ver: 2.33.5000

node_guid: 0014:0500:080d:3472

sys_image_guid: 0002:c903:00f6:eff3

vendor_id: 0x02c9

vendor_part_id: 4100

hw_ver: 0x1

board_id: HP_0280210019

phys_port_cnt: 1

port: 1

state: PORT_ACTIVE (4)

max_mtu: 4096 (5)

active_mtu: 1024 (3)

sm_lid: 0

port_lid: 0

port_lmc: 0x00

link_layer: Ethernet

hca_id: mlx4_4

transport: InfiniBand (0)

fw_ver: 2.33.5000

node_guid: 0014:0500:ca34:6156

sys_image_guid: 0002:c903:00f6:eff3

vendor_id: 0x02c9

vendor_part_id: 4100

hw_ver: 0x1

board_id: HP_0280210019

phys_port_cnt: 1

port: 1

state: PORT_ACTIVE (4)

max_mtu: 4096 (5)

active_mtu: 1024 (3)

sm_lid: 0

port_lid: 0

port_lmc: 0x00

link_layer: Ethernet

reply…

hca_id: mlx4_3

transport: InfiniBand (0)

fw_ver: 2.33.5000

node_guid: 0014:0500:d5e0:c21a

sys_image_guid: 0002:c903:00f6:eff3

vendor_id: 0x02c9

vendor_part_id: 4100

hw_ver: 0x1

board_id: HP_0280210019

phys_port_cnt: 1

port: 1

state: PORT_ACTIVE (4)

max_mtu: 4096 (5)

active_mtu: 1024 (3)

sm_lid: 0

port_lid: 0

port_lmc: 0x00

link_layer: Ethernet

hca_id: mlx4_2

transport: InfiniBand (0)

fw_ver: 2.33.5000

node_guid: 0014:0500:e5c0:e2a1

sys_image_guid: 0002:c903:00f6:eff3

vendor_id: 0x02c9

vendor_part_id: 4100

hw_ver: 0x1

board_id: HP_0280210019

phys_port_cnt: 1

port: 1

state: PORT_ACTIVE (4)

max_mtu: 4096 (5)

active_mtu: 1024 (3)

sm_lid: 0

port_lid: 0

port_lmc: 0x00

link_layer: Ethernet

hca_id: mlx4_1

transport: InfiniBand (0)

fw_ver: 2.33.5000

node_guid: 0014:0500:d3a2:8c35

sys_image_guid: 0002:c903:00f6:eff3

vendor_id: 0x02c9

vendor_part_id: 4100

hw_ver: 0x1

board_id: HP_0280210019

phys_port_cnt: 1

port: 1

state: PORT_ACTIVE (4)

max_mtu: 4096 (5)

active_mtu: 1024 (3)

sm_lid: 0

port_lid: 0

port_lmc: 0x00

link_layer: Ethernet

Hello,

  1. The firmware is per PSID and not per OS so if your PSID is HP_0280210019 you should contact HP for the firmware bin file since the card was manufactured by HP.

  2. hca_self_test is not the right tool to check the link state and speed, please use ibstat or ibv_devinfo instead.

ethtool will also work.

You can check the interfaces that were created by the driver by invoking ibdev2netdev.

Best Regards,

Viki

Thanks a lot, Viki!

  1. Right. PSID is shown as HP’s one. I wanted to check whether there is any compatible OFED with this Mellanox Technologies MT27500/MT27520 Family [ConnectX-3/ConnectX-3 Pro Virtual Function] [15b3:1004]. If no, let me contact to HP.

  2. Actually I tried ibstat also but it didn’t show the needed firmware version, so I wanted to show that information using hca_self_test. This ibstat result doesn’t complain the firmware version even though hca_self_test described “(found v2.33.5000, required v2.35.5100)”. Is there no problem with v2.33.5000?

ibstat

CA ‘mlx4_0’

CA type: MT4099

Number of ports: 2

Firmware version: 2.33.5000

Hardware version: 1

Node GUID: 0x0002c90300f6eff0

System image GUID: 0x0002c90300f6eff3

Port 1:

State: Active

Physical state: LinkUp

Rate: 10

Base lid: 0

LMC: 0

SM lid: 0

Capability mask: 0x0c010000

Port GUID: 0x0202c9fffef6eff0

Link layer: Ethernet

Port 2:

State: Down

Physical state: Disabled

Rate: 10

Base lid: 0

LMC: 0

SM lid: 0

Capability mask: 0x0c010000

Port GUID: 0x0202c9fffef6eff1

Link layer: Ethernet

CA ‘mlx4_1’

CA type: MT4100

Number of ports: 1

Firmware version: 2.33.5000

Hardware version: 1

Node GUID: 0x00140500d3a28c35

System image GUID: 0x0002c90300f6eff3

Port 1:

State: Active

Physical state: LinkUp

Rate: 10

Base lid: 0

LMC: 0

SM lid: 0

Capability mask: 0x0c010000

Port GUID: 0xcc0567fffed08d89

Link layer: Ethernet

CA ‘mlx4_2’

CA type: MT4100

Number of ports: 1

Firmware version: 2.33.5000

Hardware version: 1

Node GUID: 0x00140500e5c0e2a1

System image GUID: 0x0002c90300f6eff3

Port 1:

State: Active

Physical state: LinkUp

Rate: 10

Base lid: 0

LMC: 0

SM lid: 0

Capability mask: 0x0c010000

Port GUID: 0x04a4dffffe9554b4

Link layer: Ethernet

CA ‘mlx4_3’

CA type: MT4100

Number of ports: 1

Firmware version: 2.33.5000

Hardware version: 1

Node GUID: 0x00140500d5e0c21a

System image GUID: 0x0002c90300f6eff3

Port 1:

State: Active

Physical state: LinkUp

Rate: 10

Base lid: 0

LMC: 0

SM lid: 0

Capability mask: 0x0c010000

Port GUID: 0x78a965fffe2cd6c6

Link layer: Ethernet

CA ‘mlx4_4’

CA type: MT4100

Number of ports: 1

Firmware version: 2.33.5000

Hardware version: 1

Node GUID: 0x00140500ca346156

System image GUID: 0x0002c90300f6eff3

Port 1:

State: Active

Physical state: LinkUp

Rate: 10

Base lid: 0

LMC: 0

SM lid: 0

Capability mask: 0x0c010000

Port GUID: 0xa0550afffeeb939f

Link layer: Ethernet

CA ‘mlx4_5’

CA type: MT4100

Number of ports: 1

Firmware version: 2.33.5000

Hardware version: 1

Node GUID: 0x00140500080d3472

System image GUID: 0x0002c90300f6eff3

Port 1:

State: Active

Physical state: LinkUp

Rate: 10

Base lid: 0

LMC: 0

SM lid: 0

Capability mask: 0x0c010000

Port GUID: 0x70e0bffffe624948

Link layer: Ethernet

CA ‘mlx4_6’

CA type: MT4100

Number of ports: 1

Firmware version: 2.33.5000

Hardware version: 1

Node GUID: 0x00140500ba43bdb4

System image GUID: 0x0002c90300f6eff3

Port 1:

State: Active

Physical state: LinkUp

Rate: 10

Base lid: 0

LMC: 0

SM lid: 0

Capability mask: 0x0c010000

Port GUID: 0xd8ff4bfffe554d38

Link layer: Ethernet

CA ‘mlx4_7’

CA type: MT4100

Number of ports: 1

Firmware version: 2.33.5000

Hardware version: 1

Node GUID: 0x00140500d64f7f80

System image GUID: 0x0002c90300f6eff3

Port 1:

State: Active

Physical state: LinkUp

Rate: 10

Base lid: 0

LMC: 0

SM lid: 0

Capability mask: 0x0c010000

Port GUID: 0x70ca2afffe3c7237

Link layer: Ethernet

CA ‘mlx4_8’

CA type: MT4100

Number of ports: 1

Firmware version: 2.33.5000

Hardware version: 1

Node GUID: 0x001405002aaa5f08

System image GUID: 0x0002c90300f6eff3

Port 1:

State: Active

Physical state: LinkUp

Rate: 10

Base lid: 0

LMC: 0

SM lid: 0

Capability mask: 0x0c010000

Port GUID: 0xa4ba1afffe657a61

Link layer: Ethernet

ibv_devinfo

hca_id: mlx4_8

transport: InfiniBand (0)

fw_ver: 2.33.5000

node_guid: 0014:0500:2aaa:5f08

sys_image_guid: 0002:c903:00f6:eff3

vendor_id: 0x02c9

vendor_part_id: 4100

hw_ver: 0x1

board_id: HP_0280210019

phys_port_cnt: 1

port: 1

state: PORT_ACTIVE (4)

max_mtu: 4096 (5)

active_mtu: 1024 (3)

sm_lid: 0

port_lid: 0

port_lmc: 0x00

link_layer: Ethernet

hca_id: mlx4_7

transport: InfiniBand (0)

fw_ver: 2.33.5000

node_guid: 0014:0500:d64f:7f80

sys_image_guid: 0002:c903:00f6:eff3

vendor_id: 0x02c9

vendor_part_id: 4100

hw_ver: 0x1

board_id: HP_0280210019

phys_port_cnt: 1

port: 1

state: PORT_ACTIVE (4)

max_mtu: 4096 (5)

active_mtu: 1024 (3)

sm_lid: 0

port_lid: 0

port_lmc: 0x00

link_layer: Ethernet

hca_id: mlx4_6

transport: InfiniBand (0)

fw_ver: 2.33.5000

node_guid: 0014:0500:ba43:bdb4

sys_image_guid: 0002:c903:00f6:eff3

vendor_id: 0x02c9

vendor_part_id: 4100

hw_ver: 0x1

board_id: HP_0280210019

phys_port_cnt: 1

port: 1

state: PORT_ACTIVE (4)

max_mtu: 4096 (5)

active_mtu: 1024 (3)

sm_lid: 0

port_lid: 0

port_lmc: 0x00

link_layer: Ethernet

hca_id: mlx4_5

transport: InfiniBand (0)

fw_ver: 2.33.5000

node_guid: 0014:0500:080d:3472

sys_image_guid: 0002:c903:00f6:eff3

vendor_id: 0x02c9

vendor_part_id: 4100

hw_ver: 0x1

board_id: HP_0280210019

phys_port_cnt: 1

port: 1

state: PORT_ACTIVE (4)

max_mtu: 4096 (5)

active_mtu: 1024 (3)

sm_lid: 0

port_lid: 0

port_lmc: 0x00

link_layer: Ethernet

hca_id: mlx4_4

transport: InfiniBand (0)

fw_ver: 2.33.5000

node_guid: 0014:0500:ca34:6156

sys_image_guid: 0002:c903:00f6:eff3

vendor_id: 0x02c9

vendor_part_id: 4100

hw_ver: 0x1

board_id: HP_0280210019

phys_port_cnt: 1

port: 1

state: PORT_ACTIVE (4)

max_mtu: 4096 (5)

active_mtu: 1024 (3)

sm_lid: 0

port_lid: 0

port_lmc: 0x00

link_layer: Ethernet

hca_id: mlx4_3

transport: InfiniBand (0)

fw_ver: 2.33.5000

node_guid: 0014:0500:d5e0:c21a

sys_image_guid: 0002:c903:00f6:eff3

vendor_id: 0x02c9

vendor_part_id: 4100

hw_ver: 0x1

board_id: HP_0280210019

phys_port_cnt: 1

port: 1

state: PORT_ACTIVE (4)

max_mtu: 4096 (5)

active_mtu: 1024 (3)

sm_lid: 0

port_lid: 0

port_lmc: 0x00

link_layer: Ethernet

hca_id: mlx4_2

transport: InfiniBand (0)

fw_ver: 2.33.5000

node_guid: 0014:0500:e5c0:e2a1

sys_image_guid: 0002:c903:00f6:eff3

vendor_id: 0x02c9

vendor_part_id: 4100

hw_ver: 0x1

board_id: HP_0280210019

phys_port_cnt: 1

port: 1

state: PORT_ACTIVE (4)

max_mtu: 4096 (5)

active_mtu: 1024 (3)

sm_lid: 0

port_lid: 0

port_lmc: 0x00

link_layer: Ethernet

hca_id: mlx4_1

transport: InfiniBand (0)

fw_ver: 2.33.5000

node_guid: 0014:0500:d3a2:8c35

sys_image_guid: 0002:c903:00f6:eff3

vendor_id: 0x02c9

vendor_part_id: 4100

hw_ver: 0x1

board_id: HP_0280210019

phys_port_cnt: 1

port: 1

state: PORT_ACTIVE (4)

max_mtu: 4096 (5)

active_mtu: 1024 (3)

sm_lid: 0

port_lid: 0

port_lmc: 0x00

link_layer: Ethernet

hca_id: mlx4_0

transport: InfiniBand (0)

fw_ver: 2.33.5000

node_guid: 0002:c903:00f6:eff0

sys_image_guid: 0002:c903:00f6:eff3

vendor_id: 0x02c9

vendor_part_id: 4099

hw_ver: 0x1

board_id: HP_0280210019

phys_port_cnt: 2

port: 1

state: PORT_ACTIVE (4)

max_mtu: 4096 (5)

active_mtu: 4096 (5)

sm_lid: 0

port_lid: 0

port_lmc: 0x00

link_layer: Ethernet

port: 2

state: PORT_DOWN (1)

max_mtu: 4096 (5)

active_mtu: 1024 (3)

sm_lid: 0

port_lid: 0

port_lmc: 0x00

link_layer: Ethernet