ConnectX-3 not going up in Centos 6.4 (and SL6.4)

Supermicro AOC-CIBF-M1 card… I looked for and didn’t find newer firmware already (nor running mlxburn worked, it asks for a .ini) …

Same switch SX6025, same cables, same firmware (2.10.4700) same system image (the nodes are stateless) and 4 are in FDR10 and two in FDR…

ohh… (Sorry), forgot to ask - what SW/FW level the switch is running with?

Just remembered… with flint you can query a card to extract the .ini file settings it already has:

$ flint -d [PCI_bus_address_of_card] dc > somefile.ini

For example, with an older card in a test box here I get its PCI bus address first:

$ lscpi | grep Mell

01:00.0 InfiniBand: Mellanox Technologies MT25418 [ConnectX VPI PCIe 2.0 2.5GT/s - IB DDR / 10GigE] (rev a0)

The 01.00.0 is the PCI address of the card in the test box. Then I use flint to extract the .ini file settings from the card:

$ sudo flint -d 01:00.0 dc > somefile.ini

The .ini file is just a normal text file:

$ cat somefile.ini

;; Generated automatically by iniprep tool on Sun Jun 05 11:50:37 IDT 2011 from ./eagle_ddr.prs

;;

;; PRS FILE FOR Eagle

;; $Id: eagle_ddr.prs,v 1.4 2008-12-03 16:49:24 yarong Exp $

[PS_INFO]

Name = MHGH28-XTC_A2-A3

Description = Eagle DDR R5 with tall bracket

[ADAPTER]

PSID = MT_04A0120002

adapter_dev_id = 0x634a

[HCA]

hca_header_device_id = 0x634a

hca_header_subsystem_id = 0x0006

[IB]

mellanox_ddr_ib_support = true

[PLL]

core_f = 63

core_r = 24

core_od = 1

lbist_en = 1

lbist_shift_freq = 3

pll_stabilize = 0x13

lbist_array_bypass = 1

lbist_pat_cnt_lsb = 0x2

[FW]

Hope that’s useful.

(note - edited for typo fixes)