Non-Standard ConnectX-6 Dx Firmware

Infrastructure & Networking Adapters and Cables Ethernet Adapter Cards
1

We purchased some ConnectX-6 Dx NICs (CX623106A) from a vendor on eBay. They look legit and appear to operate as the dual 100 GbE NICs they should be. But when we went to update the firmware, the firmware would not update as the cards have a non-standard PSID of CIS0000000008.

Is there a way to flash a standard NVIDIA firmware over this load?

Here is what we see currently:

shep@ar-9901k:~$ sudo flint -d /dev/mst/mt4125_pciconf0 query
Image type:            FS4
FW Version:            22.30.1004
FW Release Date:       29.3.2021
Product Version:       22.30.1004
Rom Info:              type=UEFI version=14.23.17 cpu=AMD64,AARCH64
                       type=PXE version=3.6.301 cpu=AMD64
Description:           UID                GuidsNumber
Base GUID:             1070fd030058XXXX        4
Base MAC:              1070fd58XXXX            4
Image VSD:             N/A
Device VSD:            N/A
PSID:                  CIS0000000008
Security Attributes:   secure-fw

Thanks in advance for any guidance.
Shep

2

These seem like Cisco/MLNX branded cards.

Upgrade versions should arrive from Cisco.

I think their latest release for this card is under:

https://www.cisco.com/c/en/us/td/docs/unified_computing/ucs/release/firmware_files/4_2/b_ucs_c-series-firmware-files_4_2/m_firmware_files_4_2_3.html

Cisco-MLNX MCX623106AS-CDAT 2x100GbE QSFP56 PCIe NIC

1 Like
3

Thank you for that @dwaxman ! I would have guessed CIS ~= “cisco”, but wouldn’t have found the link you provided.

I grabbed the iso from the Cisco site and blew out the file system to see what is in the /firmware/Common/Mellanox_Technologies directories. I found three ConnectX6Dx firmwares as such:

-rw-r--r-- 1 shep shep 3578512 Jun  4 10:38 fw-ConnectX6Dx-rel-22_36_1010-30-100256-01_Ax-UEFI-14.29.14-FlexBoot-3.6.901.signed.bin
-rw-r--r-- 1 shep shep 3578496 Jun  4 10:38 fw-ConnectX6Dx-rel-22_36_1010-30-100260-01_Ax-UEFI-14.29.14-FlexBoot-3.6.901.signed.bin
-rw-r--r-- 1 shep shep 3579024 Jun  4 10:38 fw-ConnectX6Dx-rel-22_36_1010-30-100309-01_Ax-UEFI-14.29.14-FlexBoot-3.6.901.signed.bin

But when I try flint on any of these, I get a “Invalid Image signature” error.
Drats! I really dont want to recreate the whole Cisco update universe.

These boards seem to work fine; just a little uncomfortable not having the mainline Nvidia firmware (or even the latest Cisco-branded fw). Morale of the story - stick with Nvidia NICs bought as Nvidia NICs; as even a legit-looking board from eBay may have other firmware.

4

It looks like a secured FW image. So I’m not sure it’ll allow you to burn any other image onto the card’s flash.

1 Like
5

Hello, I have the same card also from ebay. I’m unable to make it work at 100Gb. It is able to connect at 40Gbps and the strangest thing is the switch shows the port as 100Gb.
lshw shows this:

product: MT2892 Family [ConnectX-6 Dx]
       vendor: Mellanox Technologies
       capacity: 40Gbit/s
       capabilities: pciexpress vpd msix pm bus_master cap_list rom ethernet physical 1000bt-fd 10000bt-fd 25000bt-fd 40000bt-fd autonegotiation
       configuration: autonegotiation=on broadcast=yes driver=mlx5_core driverversion=23.04-1.1.3 duplex=full firmware=22.30.1004 (CIS0000000008) ip=x.x.x. latency=0 link=yes multicast=yes

From ethtool i can see it also shows speed 40Gbps.
I installed the latest driver 23.04-1.1.3 Any advice on why the card is not able to do 100G?