I have 2 RDMA nics installed on this server. Ideally two netdevs per port for mlx5_0, example: ens224, ens225 each with their own mac addresses, but they both show up under a single “ens224”.
topology is :
mlx5_0_port 1-----rdma(server) -----mlx5_0_port 2
ibdev2netdev
mlx5_0 port 1 ==> ens224 (Down)
mlx5_0 port 2 ==> ens224 (Down)
ibstat
CA ‘mlx5_0’
CA type: MT4119
Number of ports: 2
Firmware version: 16.28.2006
Hardware version: 0
Node GUID: 0x98039b030067c63a
System image GUID: 0x98039b030067c63a
Port 1:
State: Active
Physical state: LinkUp
Rate: 100
Base lid: 0
LMC: 0
SM lid: 0
Capability mask: 0x00010000
Port GUID: 0x9a039bfffe67c63a
Link layer: Ethernet
Port 2:
State: Down
Physical state: Disabled
Rate: 100
Base lid: 0
LMC: 0
SM lid: 0
Capability mask: 0x00010000
Port GUID: 0x0000000000000000
Link layer: Ethernet
ibdev2netdev -v
mlx5_0 (MT4119 - MCX516A-CCAT) CX516A - ConnectX-5 QSFP28 fw 16.28.2006 port 1 (ACTIVE) ==> ens224 (Up)
0000:13:00.0 mlx5_0 (MT4119 - MCX516A-CCAT) CX516A - ConnectX-5 QSFP28 fw 16.28.2006 port 2 (DOWN ) ==> ens224 (Up)
0000:13:00.0 mlx5_1 (MT4119 - MCX516A-CCAT) CX516A - ConnectX-5 QSFP28 fw 16.28.2006 port 1 (DOWN ) ==> ens256 (Down)
0000:1b:00.0 mlx5_1 (MT4119 - MCX516A-CCAT) CX516A - ConnectX-5 QSFP28 fw 16.28.2006 port 2 (DOWN ) ==> ens256 (Down)
lspci | grep -i mellanox
13:00.0 Ethernet controller: Mellanox Technologies MT27800 Family [ConnectX-5]
1b:00.0 Ethernet controller: Mellanox Technologies MT27800 Family [ConnectX-5]