Communicate between CX-5 and CX-7 in 100G

Infrastructure & Networking Software And Drivers Network Management Products
,
1

Hi Team,

I am testing between Mellanox CX-5 (MCX516A-CDAT) and CX-7 (MCX75310AAC-NEAT)
I have connected QSFP module to CX-5 and OSFP to CX-7.
(A) Both the card are working as Standalone Loopback module.
(B) When I connect QSFP (CX-5) to OSFP (CX-7) using MTP cable, the link is down.

At CX-7, mode changed to LINK_TYPE_P1 changed to ETH.
What changes to be made to link gets UP.

In CX-5:

 
$ sudo mlxlink -d /dev/mst/mt4121_pciconf0
Operational Info

State                              : Polling
Physical state                     : ETH_AN_FSM_ABILITY_DETECT
Speed                              : N/A
Width                              : N/A
FEC                                : N/A
Loopback Mode                      : No Loopback
Auto Negotiation                   : ON

Supported Info

Enabled Link Speed                 : 0xfefdf0df (100G,50G,40G,25G,10G,1G)
Supported Cable Speed              : 0x2024a101 (100G,56G,50G,40G,25G,10G,1G)

Troubleshooting Info

Status Opcode                      : 2
Group Opcode                       : PHY FW
Recommendation                     : Negotiation failure

Tool Information

Firmware Version                   : 16.35.4030
MFT Version                        : mft 4.30.1-1210

In Cx-7,

$ sudo mlxlink -d /dev/mst/mt4129_pciconf0 -p 1 -m

Operational Info

State                              : Polling
Physical state                     : ETH_AN_FSM_ENABLE
Speed                              : N/A
Width                              : N/A
FEC                                : N/A
Loopback Mode                      : No Loopback
Auto Negotiation                   : ON

Supported Info

Enabled Link Speed (Ext.)          : 0x0001bff2 (400G_4X,400G_8X,200G_2X,200G_4X,100G_1X,100G_2X,100G_4X,50G_1X,50G_2X,40G,25G,10G,1G)
Supported Cable Speed (Ext.)       : 0x00012800 (400G_4X,200G_2X,100G_1X)

Troubleshooting Info

Status Opcode                      : 57
Group Opcode                       : PHY FW
Recommendation                     : signal not detected

Tool Information

Firmware Version                   : 28.45.1200
amBER Version                      : 3.6
MFT Version                        : mft 4.30.1-1210


The modules are detected using mlxlink -d <PCI B:D.F> -m.

I want to data rate in 100G. I could see the data rate is 100G_1X is available in CX-7 and doesnot have 100G. Can this be the cause?
If so, as per the CX-7 datasheet, the firmware should support 100G

@michaelbe @ipavis Please direct to correct support person. Since the query is of high priority

2

Hi @attdone
This could be a unsupported cable for CX-5 or CX-7
But to debug this we would need a case to be opened with Enterprise Support.
To Create a New Enterprise Support Case Please Use One of the Following Methods

  1. Log in and Create a Case in the Enterprise Support Portal
  2. This is recommended and will provide the fastest response
  3. Call your Regional Enterprise Support Number
  4. Find your regional phone numbers
  5. Create a Case Without a Login
  6. Can be used to check warranty status
  7. Recommended to reset login passwords
3

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.