Hello-
I am used to working with ConnectX-3 cards and the mlx4 driver. In that case, our two-port IB cards show up as a single IB device, with two ports. I recently got ahold of a ConnectX-5 card and now that dual-port card shows up as two separate devices, each with one port, using mlx5 driver on Ubuntu 18.04:
$ ofed_info | head -1
MLNX_OFED_LINUX-4.4-2.0.7.0 (OFED-4.4-2.0.7):
$ lspci | grep Mellanox
5e:00.0 Infiniband controller: Mellanox Technologies MT27800 Family [ConnectX-5]
5e:00.1 Infiniband controller: Mellanox Technologies MT27800 Family [ConnectX-5]
$ ibv_devinfo
hca_id: mlx5_1
transport: InfiniBand (0)
fw_ver: 16.25.1020
node_guid: 9803:9b03:00b0:ee2b
sys_image_guid: 9803:9b03:00b0:ee2a
vendor_id: 0x02c9
vendor_part_id: 4119
hw_ver: 0x0
board_id: MT_0000000008
phys_port_cnt: 1
Device ports:
port: 1
state: PORT_DOWN (1)
max_mtu: 4096 (5)
active_mtu: 4096 (5)
sm_lid: 0
port_lid: 65535
port_lmc: 0x00
link_layer: InfiniBand
hca_id: mlx5_0
transport: InfiniBand (0)
fw_ver: 16.25.1020
node_guid: 9803:9b03:00b0:ee2a
sys_image_guid: 9803:9b03:00b0:ee2a
vendor_id: 0x02c9
vendor_part_id: 4119
hw_ver: 0x0
board_id: MT_0000000008
phys_port_cnt: 1
Device ports:
port: 1
state: PORT_DOWN (1)
max_mtu: 4096 (5)
active_mtu: 4096 (5)
sm_lid: 0
port_lid: 65535
port_lmc: 0x00
link_layer: InfiniBand
(Never mind the PORT_DOWN, it is not connected yet, but I am trying to resolve this question in the meantime)… Is it possible to configure it so that it looks like one device with 2 ports instead? I have a large amount of software that’s expecting a 2-port setup, so it would be helpful if I could preserve that, but I am not sure what’s going on here. Thanks for any help!
-Lewis