It is found that when configuring the adapter as RoCEv2 by “options mlx4_core roce_mode=0000:81:00.0-1,0000:84:00.0-1”, after OS rebooting, one MT4103 can not work well. But there is nothing wrong for another one with the same firmware.
The port state always shows “Disabled" as below:
ibstat mlx4_1
CA ‘mlx4_1’
CA type: MT4103
Number of ports: 1
Firmware version: 2.42.5000
Hardware version: 0
Node GUID: 0xe41d2d030029ecb0
System image GUID: 0xe41d2d030029ecb0
Port 1:
State: Down
Physical state: Disabled
Rate: 10
Base lid: 0
LMC: 0
SM lid: 0
Capability mask: 0x04010000
Port GUID: 0xe61d2dfffe29ecb0
Link layer: Ethernet
And related ethnet interface’s link can not be detectable, but actually the cable is connected.
ethtool ens259
Settings for ens259:
Supported ports: [ FIBRE ]
Supported link modes: 1000baseKX/Full
Supported pause frame use: Symmetric Receive-only
Supports auto-negotiation: No
Advertised link modes: 1000baseKX/Full
Advertised pause frame use: Symmetric
Advertised auto-negotiation: No
Speed: Unknown!
Duplex: Unknown! (255)
Port: FIBRE
PHYAD: 0
Transceiver: internal
Auto-negotiation: off
Supports Wake-on: d
Wake-on: d
Current message level: 0x00000014 (20)
link ifdown
Link detected: no
I have tried OFED driver of MLNX_OFED_LINUX-4.4-1.0.0.0-rhel7.4-x86_64 and MLNX_OFED_LINUX-4.4-2.0.7.0-rhel7.4-x86_64. Neither can work.
The switch is Dell 4048-on.
So, what is the problem with one MT4103? How can I enable the physical port?