Got a ConnectX-5 EDR +100GbE card, try to install the driver at Ubuntu 16.04 with core version 4.4.0-141-generic.
I just followed the instruction from the handbook, but always has problem to install the driver.
The following is the detail for the installation. Anyone can help ?
merry@LotR3-PC:~/Downloads/MLNX_OFED_LINUX-4.5-1.0.1.0-ubuntu16.04-x86_64$ sudo ./mlnxofedinstall --without-dkms --add-kernel-support --kernel 4.4.0-141-generic --without-fw-update --force
[sudo] password for merry:
Note: This program will create MLNX_OFED_LINUX TGZ for ubuntu16.04 under /tmp/MLNX_OFED_LINUX-4.5-1.0.1.0-4.4.0-141-generic directory.
See log file /tmp/MLNX_OFED_LINUX-4.5-1.0.1.0-4.4.0-141-generic/mlnx_iso.22427_logs/mlnx_ofed_iso.22427.log
Checking if all needed packages are installed…
Building MLNX_OFED_LINUX DEBS . Please wait…
Creating metadata-rpms for 4.4.0-141-generic …
WARNING: If you are going to configure this package as a repository, then please note
WARNING: that it is not signed, therefore, you need to set ‘trusted=yes’ in the sources.list file.
WARNING: Example: deb [trusted=yes] file:/ ./
Created /tmp/MLNX_OFED_LINUX-4.5-1.0.1.0-4.4.0-141-generic/MLNX_OFED_LINUX-4.5-1.0.1.0-ubuntu16.04-ext.tgz
Removing old packages…
Installing /tmp/MLNX_OFED_LINUX-4.5-1.0.1.0-4.4.0-141-generic/MLNX_OFED_LINUX-4.5-1.0.1.0-ubuntu16.04-ext
/tmp/MLNX_OFED_LINUX-4.5-1.0.1.0-4.4.0-141-generic/MLNX_OFED_LINUX-4.5-1.0.1.0-ubuntu16.04-ext/mlnxofedinstall --force --without-dkms --without-dkms --kernel 4.4.0-141-generic --without-fw-update --force
Logs dir: /tmp/MLNX_OFED_LINUX.61840.logs
General log file: /tmp/MLNX_OFED_LINUX.61840.logs/general.log
Below is the list of MLNX_OFED_LINUX packages that you have chosen
(some may have been added by the installer due to package dependencies):
ofed-scripts
mlnx-ofed-kernel-utils
mlnx-ofed-kernel-modules
iser-modules
isert-modules
srp-modules
libibverbs1
ibverbs-utils
libibverbs-dev
libibverbs1-dbg
libmlx4-1
libmlx4-dev
libmlx4-1-dbg
libmlx5-1
libmlx5-dev
libmlx5-1-dbg
librxe-1
librxe-dev
librxe-1-dbg
libibumad
libibumad-static
libibumad-devel
ibacm
ibacm-dev
librdmacm1
librdmacm-utils
librdmacm-dev
mstflint
ibdump
libibmad
libibmad-static
libibmad-devel
libopensm
opensm
opensm-doc
libopensm-devel
infiniband-diags
infiniband-diags-compat
mft
kernel-mft-modules
libibcm1
libibcm-dev
perftest
ibutils2
libibdm1
ibutils
cc-mgr
ar-mgr
dump-pr
ibsim
ibsim-doc
knem-modules
mxm
ucx
sharp
hcoll
openmpi
mpitests
libdapl2
dapl2-utils
libdapl-dev
srptools
mlnx-ethtool
mlnx-iproute2
This program will install the MLNX_OFED_LINUX package on your machine.
Note that all other Mellanox, OEM, OFED, RDMA or Distribution IB packages will be removed.
Those packages are removed due to conflicts with MLNX_OFED_LINUX, do not reinstall them.
Checking SW Requirements…
Removing old packages…
Installing new packages
Installing ofed-scripts-4.5…
Installing mlnx-ofed-kernel-utils-4.5…
Installing mlnx-ofed-kernel-modules-4.5…
Installing iser-modules-4.5…
Installing isert-modules-4.5…
Installing srp-modules-4.5…
Installing libibverbs1-41mlnx1…
Installing ibverbs-utils-41mlnx1…
Installing libibverbs-dev-41mlnx1…
Installing libibverbs1-dbg-41mlnx1…
Installing libmlx4-1-41mlnx1…
Installing libmlx4-dev-41mlnx1…
Installing libmlx4-1-dbg-41mlnx1…
Installing libmlx5-1-41mlnx1…
Installing libmlx5-dev-41mlnx1…
Installing libmlx5-1-dbg-41mlnx1…
Installing librxe-1-41mlnx1…
Installing librxe-dev-41mlnx1…
Installing librxe-1-dbg-41mlnx1…
Installing libibumad-43.1.1.MLNX20180612.87b4d9b…
Installing libibumad-static-43.1.1.MLNX20180612.87b4d9b…
Installing libibumad-devel-43.1.1.MLNX20180612.87b4d9b…
Installing ibacm-41mlnx1…
Installing ibacm-dev-41mlnx1…
Installing librdmacm1-41mlnx1…
Installing librdmacm-utils-41mlnx1…
Installing librdmacm-dev-41mlnx1…
Installing mstflint-4.11.0…
Installing ibdump-5.0.0…
Installing libibmad-5.0.0.MLNX20181022.0361c15…
Installing libibmad-static-5.0.0.MLNX20181022.0361c15…
Installing libibmad-devel-5.0.0.MLNX20181022.0361c15…
Installing libopensm-5.3.0.MLNX20181108.33944a2…
Installing opensm-5.3.0.MLNX20181108.33944a2…
Installing opensm-doc-5.3.0.MLNX20181108.33944a2…
Installing libopensm-devel-5.3.0.MLNX20181108.33944a2…
Installing infiniband-diags-5.0.0.MLNX20181101.2a96f26…
Installing infiniband-diags-compat-5.0.0.MLNX20181101.2a96f26…
Installing mft-4.11.0…
Installing kernel-mft-modules-4.11.0…
Installing libibcm1-41mlnx1…
Installing libibcm-dev-41mlnx1…
Installing perftest-4.4…
Installing ibutils2-2.1.1…
Installing libibdm1-1.5.7.1…
Installing ibutils-1.5.7.1…
Installing cc-mgr-1.0…
Installing ar-mgr-1.0…
Installing dump-pr-1.0…
Installing ibsim-0.7mlnx1…
Installing ibsim-doc-0.7mlnx1…
Installing knem-modules-1.1.3.90mlnx1…
Installing mxm-3.7.3111…
Installing ucx-1.5.0…
Installing sharp-1.7.2.MLNX20181122.e5da787…
Installing hcoll-4.2.2543…
Installing openmpi-4.0.0rc5…
Installing mpitests-3.2.20…
Installing libdapl2-2.1.10mlnx…
Installing dapl2-utils-2.1.10mlnx…
Installing libdapl-dev-2.1.10mlnx…
Installing srptools-41mlnx1…
Installing mlnx-ethtool-4.2…
Installing mlnx-iproute2-4.7.0…
Selecting previously unselected package mlnx-fw-updater.
(Reading database … 253096 files and directories currently installed.)
Preparing to unpack …/mlnx-fw-updater_4.5-1.0.1.0_amd64.deb …
Unpacking mlnx-fw-updater (4.5-1.0.1.0) …
Setting up mlnx-fw-updater (4.5-1.0.1.0) …
Added 'RUN_FW_UPDATER_ONBOOT=no to /etc/infiniband/openib.conf
Skipping FW update.
Device (04:00.0):
04:00.0 Infiniband controller: Mellanox Technologies MT28800 Family [ConnectX-5]
Link Width: x16
PCI Link Speed: 8GT/s
Device (09:00.0):
09:00.0 Infiniband controller: Mellanox Technologies MT28800 Family [ConnectX-5]
Link Width: x4 ( WARNING - device supports x16 )
PCI Link Speed: 5GT/s
Installation passed successfully
To load the new driver, run:
/etc/init.d/openibd restart
merry@LotR3-PC:~/Downloads/MLNX_OFED_LINUX-4.5-1.0.1.0-ubuntu16.04-x86_64$ sudo /etc/init.d/openibd restart
[sudo] password for merry:
Unloading HCA driver: [ OK ]
Loading Mellanox MLX4 HCA driver: [FAILED]
Loading Mellanox MLX4_IB HCA driver: [FAILED]
Loading Mellanox MLX4_EN HCA driver: [FAILED]
Loading Mellanox MLX5 HCA driver: [FAILED]
Loading Mellanox MLX5_IB HCA driver: [FAILED]
Loading Mellanox MLX5 FPGA Tools driver: [FAILED]
Loading HCA driver and Access Layer: [FAILED]
Please run /usr/sbin/sysinfo-snapshot.py to collect the debug information
and open an issue in the http://support.mellanox.com/SupportWeb/service_center/SelfService