Need help installing OFED 2.1 on Centos 6.5

Script started on Wed 12 Feb 2014 09:03:20 AM MST

This program will install the MLNX_OFED_LINUX package on your machine.

Note that all other Mellanox, OEM, OFED, or Distribution IB packages will be removed.

Do you want to continue?[y/N]:y

Uninstalling the previous version of MLNX_OFED_LINUX

Starting MLNX_OFED_LINUX-2.1-1.0.0 installation …

… [ list of RPMs being installed ]

Device (03:00.0):

03:00.0 InfiniBand: Mellanox Technologies MT27600 [Connect-IB]

Link Width: 8x

PCI Link Speed: Unknown

Device (03:00.0):

03:00.0 InfiniBand: Mellanox Technologies MT27600 [Connect-IB]

WARNING - device 03:00.0 The MaxReadRequest size is set too low (512 bytes) and will affect performance.

Please consult your server’s vendor and if possible change BIOS settings or use setpci to configure MaxReadReq to 4096 bytes.

/sbin/setpci -s 03:00.0 68.W

2xxx

Change to 4096 bytes:

/sbin/setpci -s 03:00.0 68.W=5xxx

Installation finished successfully.

Attempting to perform Firmware update…

Querying Mellanox devices firmware …

Device #1:


Device: 0000:03:00.0

Part Number: –

Description:

PSID:

Versions: Current Available

FW –

Status: Failed to open device


Failed to query 1 device(s).

Log File: /tmp/MLNX_OFED_LINUX-2.1-1.0.0.4277.logs/fw_update.log

Failed to update Firmware.

See /tmp/MLNX_OFED_LINUX-2.1-1.0.0.4277.logs/fw_update.log

Please reboot your system for the changes to take effect.

root@karma01:/home/bill.mcbee/infiniband# cat /tmp/MLNX_OFED_LINUX-2.1-1.0.0.4277.logs/fw_update.log

CMD: /tmp/sfxter_Wr77SN/mlxfwmanager_sriov_dis_x86_64/mlxfwmanager_pci -u --log-on-update -L /tmp/MLNX_OFED_LINUX-2.1-1.0.0.4277.logs/fw_update.log -y

Querying Mellanox devices firmware …

Device #1:


Device: 0000:03:00.0

Part Number: –

Description:

PSID:

Versions: Current Available

FW –

Status: Failed to open device


Failed to query 1 device(s).

root@karma01:/home/bill.mcbee/infiniband# hca_self_test.ofed

---- Performing Adapter Device Self Test ----

Number of CAs Detected … 1

PCI Device Check … PASS

/usr/bin/hca_self_test.ofed: line 165: [: too many arguments

Host Driver RPM Check … FAIL

REASON: no RPMs found for currently booted kernel 2.6.32-431.3.1.el6.x86_64

Kernel Arch … x86_64

Host Driver Version … NA

Firmware Check on CA #0 (HCA) … NA

Host Driver Initialization … NA

Number of CA Ports Active … NA

Error Counter Check … NA

Kernel Syslog Check … NA

Node GUID on CA #0 (HCA) … NA

------------------ DONE ---------------------

Script done on Wed 12 Feb 2014 09:26:42 AM MST

Problem solved.

Had selinux enabled in enforcing mode. Simply changing it to permissive mode allowed infiniband software to start working.

Hi there,

Did you up the maxReadReq size too?