How to accelerate 10GE(SR or LR) linkup speed on MCX4121A-XCAT?

Hello Admin,

There is an application that need quick linkup on MCX4121A-XCAT to transmit data.

It will be 3 second later to linkup when compare Intel_82599_NIC+Finisar_Optical_Module with MCX4121A-XCAT+Finisar_Optical_Module.

Configuration:

  1. OpenPower(RHEL7.2) server with both Intel_82599_NIC+Finisar_Optical_Module and MCX4121A-XCAT+Finisar_Optical_Module.

  2. The 2 Finisar_Optical_Modules on Intel_NIC and Mellanox_NIC is connecting with one optical splitter to remote transmit point via optical cables.

  3. When remote transmit point laser open to ready to transmit data, Mellanox MCX4121A-XCAT linkup slower 3 seconds than Intel_82599_NIC.

BTW: OFED4.0 and EN3.4 on MCX4121A-XCAT have the same behave. Firmware updated by the driver installation.

The question is: How to accelerate 10GE(SR or LR) linkup speed on MCX4121A-XCAT?

Thanks for help in advance~

BR/Wei


  1. used mlxconfig to configure the following paramter, no improvement to reduce linkup speed.

KEEP_ETH_LINK_UP_P1 True(1)

KEEP_IB_LINK_UP_P1 False(0)

KEEP_LINK_UP_ON_BOOT_P1 True(1)

KEEP_LINK_UP_ON_STANDBY_P1 True(1)

KEEP_ETH_LINK_UP_P2 True(1)

KEEP_IB_LINK_UP_P2 False(0)

KEEP_LINK_UP_ON_BOOT_P2 True(1)

KEEP_LINK_UP_ON_STANDBY_P2 True(1)

  1. mlxreg , time_to_link_up seems relative to linkup speed , but it is RO Access.

[root@zoom ~]# mlxreg -d 0003:01:00.0 --show_reg SLRG

Field Name | Address (Bytes) | Offset (Bits) | Size (Bits) | Access

=============================================================================

lane | 0x00000000 | 8 | 4 | INDEX

pnat | 0x00000000 | 14 | 2 | INDEX

local_port | 0x00000000 | 16 | 8 | INDEX

version | 0x00000000 | 24 | 4 | RO

status | 0x00000000 | 28 | 4 | RO

grade_lane_speed | 0x00000004 | 0 | 4 | RO

time_to_link_up | 0x00000004 | 16 | 16 | RO

grade | 0x00000008 | 0 | 24 | RO

grade_version | 0x00000008 | 24 | 8 | RO

height_eo_neg | 0x00000018 | 0 | 16 | RO

height_eo_pos | 0x00000018 | 16 | 16 | RO

phase_eo_neg | 0x00000020 | 0 | 8 | RO

phase_eo_pos | 0x00000020 | 16 | 8 | RO

=============================================================================

  1. try to use mlxreg to modify admin_status in PAOS, but don’t know what is the value of swid. -------- Please help.

[root@zoom ~]# mlxreg -d 0003:01:00.0 --show_reg PAOS

Field Name | Address (Bytes) | Offset (Bits) | Size (Bits) | Access

=========================================================================

oper_status | 0x00000000 | 0 | 4 | RO

admin_status | 0x00000000 | 8 | 4 | RW

local_port | 0x00000000 | 16 | 8 | INDEX

swid | 0x00000000 | 24 | 8 | INDEX

e | 0x00000004 | 0 | 2 | RW

ee | 0x00000004 | 30 | 1 | WO

ase | 0x00000004 | 31 | 1 | WO

=========================================================================

Hi Wei

Like we discussed , suggest use the latest FW

Thanks