DPDK ports not getting detected on CX-5 EX.. What did i miss here..? net_mlx5: mlx5.c:1740: mlx5_glue_init(): cannot load glue library: librte_pmd_mlx5_glue.so.18.11.0: cannot open shared object file: No such file or directory

pnallimelli · June 25, 2020, 7:32pm

8.827966] Compat-mlnx-ofed backport release: 5f67178

[ 8.827967] Backport based on mlnx_ofed/mlnx-ofa_kernel-4.0.git 5f67178

[ 8.827967] compat.git: mlnx_ofed/mlnx-ofa_kernel-4.0.git

[ 8.859145] VFIO - User Level meta-driver version: 0.3

[ 8.866907] mlx5_core 0000:67:00.0: firmware version: 16.27.2008

[ 8.866939] mlx5_core 0000:67:00.0: 126.016 Gb/s available PCIe bandwidth, limited by 8 GT/s x16 link at 0000:64:00.0 (capable of 252.048 Gb/s with 16 GT/s x16 link)

[ 9.110752] mlx5_core 0000:67:00.0: Rate limit: 127 rates are supported, range: 0Mbps to 97656Mbps

[ 9.110887] mlx5_core 0000:67:00.0: E-Switch: Total vports 2, per vport: max uc(1024) max mc(16384)

[ 9.113009] port_module: 16 callbacks suppressed

[ 9.113013] mlx5_core 0000:67:00.0: Port module event: module 0, Cable plugged

[ 9.113389] mlx5_core 0000:67:00.0: mlx5_pcie_event:303:(pid 127): PCIe slot advertised sufficient power (27W).

[ 9.117849] mlx5_core 0000:67:00.0: mlx5_fw_tracer_start:810:(pid 176): FWTracer: Ownership granted and active

[ 9.122969] mlx5_core 0000:67:00.1: firmware version: 16.27.2008

[ 9.123009] mlx5_core 0000:67:00.1: 126.016 Gb/s available PCIe bandwidth, limited by 8 GT/s x16 link at 0000:64:00.0 (capable of 252.048 Gb/s with 16 GT/s x16 link)

[ 9.373672] mlx5_core 0000:67:00.1: Rate limit: 127 rates are supported, range: 0Mbps to 97656Mbps

[ 9.373869] mlx5_core 0000:67:00.1: E-Switch: Total vports 2, per vport: max uc(1024) max mc(16384)

[ 9.376332] mlx5_core 0000:67:00.1: Port module event: module 1, Cable plugged

[ 9.376587] mlx5_core 0000:67:00.1: mlx5_pcie_event:303:(pid 296): PCIe slot advertised sufficient power (27W).

[ 9.386598] mlx5_core 0000:67:00.0: MLX5E: StrdRq(1) RqSz(8) StrdSz(2048) RxCqeCmprss(0)

[ 9.617153] mlx5_core 0000:67:00.1: MLX5E: StrdRq(1) RqSz(8) StrdSz(2048) RxCqeCmprss(0)

[ 9.617361] mlx5_core 0000:67:00.0 enp103s0f0: renamed from eth0

[ 9.657377] IPv6: ADDRCONF(NETDEV_UP): enp103s0f0: link is not ready

[ 9.993216] mlx5_core 0000:67:00.0 enp103s0f0: Link down

[ 9.994309] IPv6: ADDRCONF(NETDEV_UP): enp103s0f0: link is not ready

[ 10.082331] mlx5_ib: Mellanox Connect-IB Infiniband driver v5.0-2.1.8

[ 10.142307] mlx5_core 0000:67:00.1 enp103s0f1: renamed from eth0

[ 10.177593] IPv6: ADDRCONF(NETDEV_UP): enp103s0f1: link is not ready

[ 10.408386] mlx5_core 0000:67:00.1 enp103s0f1: Link down

[ 10.414962] IPv6: ADDRCONF(NETDEV_UP): enp103s0f1: link is not ready

user@rat:~/dpdk/dpdk-stable-18.11.8/usertools$ ./dpdk-devbind.py -s

Network devices using kernel driver

===================================

0000:00:1f.6 ‘Ethernet Connection (2) I219-LM 15b7’ if=eno1 drv=e1000e unused=

0000:04:00.0 ‘I210 Gigabit Network Connection 1533’ if=enp4s0 drv=igb unused= Active

0000:67:00.0 ‘MT28800 Family [ConnectX-5 Ex] 1019’ if=enp103s0f0 drv=mlx5_core unused=

0000:67:00.1 ‘MT28800 Family [ConnectX-5 Ex] 1019’ if=enp103s0f1 drv=mlx5_core unused=

root@rat:/home/user/dpdk/pktgen-dpdk-pktgen-3.6.1/app/x86_64-native-linuxapp-gcc# ./pktgen -l 0-4 -n 3 – -P -m “[1:3].0, [2:4].1”

net_mlx5: mlx5.c:1740: mlx5_glue_init(): cannot load glue library: librte_pmd_mlx5_glue.so.18.11.0: cannot open shared object file: No such file or directory

net_mlx5: mlx5.c:1758: mlx5_glue_init(): cannot initialize PMD due to missing run-time dependency on rdma-core libraries (libibverbs, libmlx5)

EAL: Detected 16 lcore(s)

EAL: Detected 1 NUMA nodes

EAL: Multi-process socket /var/run/dpdk/rte/mp_socket

EAL: No free hugepages reported in hugepages-2048kB

EAL: Probing VFIO support…

EAL: VFIO support initialized

EAL: PCI device 0000:00:1f.6 on NUMA socket 0

EAL: probe driver: 8086:15b7 net_e1000_em

EAL: PCI device 0000:04:00.0 on NUMA socket 0

EAL: probe driver: 8086:1533 net_e1000_igb

*** Pktgen created by: Keith Wiles – >>> Powered by DPDK <<<

!PANIC!: *** Did not find any ports to use ***

PANIC in pktgen_config_ports():

*** Did not find any ports to use ***6: [./pktgen(_start+0x29) [0x480629]]

5: [/lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf0) [0x7f17db67b830]]

4: [./pktgen(main+0x58a) [0x475e2a]]

3: [./pktgen(pktgen_config_ports+0x1332) [0x4a5b72]]

2: [./pktgen(__rte_panic+0xc3) [0x466ea6]]

1: [./pktgen(rte_dump_stack+0x2b) [0x5963bb]]

Aborted (core dumped)

pnallimelli · June 25, 2020, 7:33pm

Ubuntu 16.04

root@rat:/home/user/dpdk/pktgen-dpdk-pktgen-3.6.1/app/x86_64-native-linuxapp-gcc# uname -a

Linux rat 4.15.0-106-generic #107~16.04.1-Ubuntu SMP Thu Jun 4 15:40:05 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux

root@rat:/home/user/dpdk/pktgen-dpdk-pktgen-3.6.1/app/x86_64-native-linuxapp-gcc# lsb_release -a

No LSB modules are available.

Distributor ID: Ubuntu

Description: Ubuntu 16.04.6 LTS

Release: 16.04

Codename: xenial

root@rat:/home/user/dpdk/pktgen-dpdk-pktgen-3.6.1/app/x86_64-native-linuxapp-gcc# cd

root@rat:~# cd /home/user/

root@rat:/home/user# cd OFED/

root@rat:/home/user/OFED# ls

MLNX_OFED_LINUX-5.0-2.1.8.0-ubuntu16.04-x86_64 MLNX_OFED_LINUX-5.0-2.1.8.0-ubuntu16.04-x86_64-ext MLNX_OFED_LINUX-5.0-2.1.8.0-ubuntu16.04-x86_64.tgz

root@rat:/home/user/OFED# cd MLNX_OFED_LINUX-5.0-2.1.8.0-ubuntu16.04-x86_64-ext/

root@rat:/home/user/OFED/MLNX_OFED_LINUX-5.0-2.1.8.0-ubuntu16.04-x86_64-ext#

chenh1 · June 30, 2020, 7:09am

Hi Pradeep,

MLX5 poll mode driver is disabled by default, it must be enabled manually by setting CONFIG_RTE_LIBRTE_MLX5_PMD=y in config/common_base file and recompiling DPDK.

Please refer to: https://dpdk.readthedocs.io/en/v16.04/nics/mlx5.html

Regards,

Chen

pnallimelli · June 30, 2020, 2:35pm

Hi Chen,

It enabled… I dont think it will come to this point with out that… Check my recent updates.

I have moved to 18.04.

Regards,

Pradeep

pnallimelli · June 30, 2020, 6:18pm

I resolved the issue by myself by upgrading the DPDK and PKTGEN to the latest.

For the community facing related issues (I have many updates transitioning from the problem description) :

Issue fixed after using the latest OFED (5.0-2), DPDK 19 (LTS), master version of pktgen.

Running on ubuntu 18.04. with 4.15 kernel version.

Lot of lessons learnt in this exercise.

Topic		Replies	Views
DPDK-Pktgen: Did not find any ports to use with ConnectX-5 VF Application Accelerator Software dpdk	3	910	April 7, 2024
DPDK APIs rte_eth_dev_count_avail() returns 0 with the MLX5 NIC card Software And Drivers mst	8	1881	November 29, 2019
dpdk and connectx3 problem Application Accelerator Software	8	871	December 6, 2018
DPDK Reports No Regex Devices Detected BlueField kb	1	774	October 3, 2023
Mlx5_net: Failed to allocate Tx DevX UAR (BF/NC) Virtualization For Infiniband And Ethernet dpdk	2	1649	March 18, 2024
MLNX5 NIC: testpmd: No probed ethernet devices Software And Drivers	8	2110	August 28, 2020
[MCX415A-CCAT] DPDK (l2fwd) cant start port: Cause: rte_eth_dev_start:err=-12, port=0 Software And Drivers	2	497	January 16, 2020
ConnectX4-LX - Passthrough issues Ethernet Adapter Cards	3	324	July 24, 2024
DPDK DevX register failed Ethernet Adapter Cards dpdk	1	2072	August 1, 2022
DPDK not working with ConnectX-3 card on Openstack virtual setup Software And Drivers openstack , port	8	973	May 10, 2019

DPDK ports not getting detected on CX-5 EX.. What did i miss here..? net_mlx5: mlx5.c:1740: mlx5_glue_init(): cannot load glue library: librte_pmd_mlx5_glue.so.18.11.0: cannot open shared object file: No such file or directory

Related topics