ConnectX-4 Lx EN are unable to configure the port UP and Active state

I am using Ubuntu 18.04.6, Kernel 5.4.0-150-generic, x86_64 system. Below are the commands I used, results I got:

lspci -v | grep Mellanox

01:00.0 Ethernet controller: Mellanox Technologies MT27710 Family [ConnectX-4 Lx]
Subsystem: Mellanox Technologies Stand-up ConnectX-4 Lx EN, 25GbE dual-port SFP28, PCIe3.0 x8, MCX4121A-ACAT
01:00.1 Ethernet controller: Mellanox Technologies MT27710 Family [ConnectX-4 Lx]
Subsystem: Mellanox Technologies Stand-up ConnectX-4 Lx EN, 25GbE dual-port SFP28, PCIe3.0 x8, MCX4121A-ACAT

mst start

Starting MST (Mellanox Software Tools) driver set
Loading MST PCI module - Success
[warn] mst_pciconf is already loaded, skipping
Create devices
Unloading MST PCI module (unused) - Success

mst status

MST modules:

MST PCI module is not loaded
MST PCI configuration module loaded

MST devices:

/dev/mst/mt4117_pciconf0 - PCI configuration cycles access.
domain:bus:dev.fn=0000:01:00.0 addr.reg=88 data.reg=92 cr_bar.gw_offset=-1
Chip revision is: 00

ibstat

CA ‘mlx5_0’
CA type: MT4117
Number of ports: 1
Firmware version: 14.32.1010
Hardware version: 0
Node GUID: 0x1c34da0300729372
System image GUID: 0x1c34da0300729372
Port 1:
State: Down
Physical state: Disabled
Rate: 40
Base lid: 0
LMC: 0
SM lid: 0
Capability mask: 0x00010000
Port GUID: 0x1e34dafffe729372
Link layer: Ethernet
CA ‘mlx5_1’
CA type: MT4117
Number of ports: 1
Firmware version: 14.32.1010
Hardware version: 0
Node GUID: 0x1c34da0300729373
System image GUID: 0x1c34da0300729372
Port 1:
State: Down
Physical state: Disabled
Rate: 40
Base lid: 0
LMC: 0
SM lid: 0
Capability mask: 0x00010000
Port GUID: 0x1e34dafffe729373
Link layer: Ethernet

mlxlink -d /dev/mst/mt4117_pciconf0 --port_state UP

Operational Info

State : Disable
Physical state : ETH_AN_FSM_ENABLE
Speed : N/A
Width : N/A
FEC : N/A
Loopback Mode : N/A
Auto Negotiation : ON

Supported Info

Enabled Link Speed : 0x38007013 (25G,10G,1G)
Supported Cable Speed : 0x00000000 ()

Troubleshooting Info

Status Opcode : 1024
Group Opcode : MNG FW
Recommendation : Cable is unplugged.

Tool Information

Firmware Version : 14.32.1010
MFT Version : mft 4.22.1-406

Configuring Port State (Up)…

mlxlink -d /dev/mst/mt4117_pciconf0.1 --port_state UP

Operational Info

State : Polling
Physical state : ETH_AN_FSM_ABILITY_DETECT
Speed : N/A
Width : N/A
FEC : N/A
Loopback Mode : No Loopback
Auto Negotiation : ON

Supported Info

Enabled Link Speed : 0x38007013 (25G,10G,1G)
Supported Cable Speed : 0x00001001 (10G,1G)

Troubleshooting Info

Status Opcode : 2
Group Opcode : PHY FW
Recommendation : Negotiation failure

Tool Information

Firmware Version : 14.32.1010
MFT Version : mft 4.22.1-406

Configuring Port State (Up)…

ibstat

CA ‘mlx5_0’
CA type: MT4117
Number of ports: 1
Firmware version: 14.32.1010
Hardware version: 0
Node GUID: 0x1c34da0300729372
System image GUID: 0x1c34da0300729372
Port 1:
State: Down
Physical state: Disabled
Rate: 40
Base lid: 0
LMC: 0
SM lid: 0
Capability mask: 0x00010000
Port GUID: 0x1e34dafffe729372
Link layer: Ethernet
CA ‘mlx5_1’
CA type: MT4117
Number of ports: 1
Firmware version: 14.32.1010
Hardware version: 0
Node GUID: 0x1c34da0300729373
System image GUID: 0x1c34da0300729372
Port 1:
State: Down
Physical state: Disabled
Rate: 40
Base lid: 0
LMC: 0
SM lid: 0
Capability mask: 0x00010000
Port GUID: 0x1e34dafffe729373
Link layer: Ethernet

ifconfig

enp1s0f0np0: flags=4099<UP,BROADCAST,MULTICAST> mtu 1500
ether 1c:34:da:72:93:72 txqueuelen 1000 (Ethernet)
RX packets 0 bytes 0 (0.0 B)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 0 bytes 0 (0.0 B)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0

enp1s0f1np1: flags=4099<UP,BROADCAST,MULTICAST> mtu 1500
ether 1c:34:da:72:93:73 txqueuelen 1000 (Ethernet)
RX packets 0 bytes 0 (0.0 B)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 0 bytes 0 (0.0 B)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0

I tried using mlxlink to configure the device to turn up the port, but it is showing Negotiation failure. I tried connecting using a different still the result is same.

Does anyone know on how to configure the Mellanox cards “Active” state and Physical state “Enabled”?

If need any additional info, please let me know.

Hello

This might point to a physical issue, with the cable itself.
Please try to use a different cable, one that you’re sure works on different setups, and see if that solves the issue.
If not, please open a case at enterprisesupport@nvidia.com and it will be handled according to entitlement.

Thanks,
Jonathan.