DPDK can't probe ConnectX-4 card (Operation not supported)

Hello Mellanox community,

I have an debian-server with an ConnectX-4 card (MCX415A-CCAT, firmware version 12.12.1100, there is also an ConnectX-3 card and 2x10G Intel card). Im using DPDK 19.11 and libibverbs 24.0-2~bpo10+1 and no OEFD.

I try to start a custom written DPDK-app and get the following log output:

sudo build/pixelflut_v6_client

EAL: Detected 40 lcore(s)

EAL: Detected 2 NUMA nodes

EAL: Multi-process socket /var/run/dpdk/rte/mp_socket

EAL: Selected IOVA mode ‘PA’

EAL: No available hugepages reported in hugepages-1048576kB

EAL: Probing VFIO support…

EAL: VFIO support initialized

EAL: PCI device 0000:01:00.0 on NUMA socket 0

EAL: probe driver: 8086:10fb net_ixgbe

EAL: PCI device 0000:01:00.1 on NUMA socket 0

EAL: probe driver: 8086:10fb net_ixgbe

EAL: PCI device 0000:04:00.0 on NUMA socket 0

EAL: probe driver: 15b3:1013 net_mlx5

net_mlx5: port 2 verbs maximum priority: 0 expected 8/16 <<< THIS IS THE ERROR

net_mlx5: probe of PCI device 0000:04:00.0 aborted after encountering an error: Operation not supported <<< THIS IS THE ERROR

EAL: Requested device 0000:04:00.0 cannot be used

EAL: PCI device 0000:07:00.0 on NUMA socket 0

EAL: probe driver: 8086:1521 net_e1000_igb

EAL: PCI device 0000:07:00.1 on NUMA socket 0

EAL: probe driver: 8086:1521 net_e1000_igb

EAL: PCI device 0000:42:00.0 on NUMA socket 1

EAL: probe driver: 15b3:1003 net_mlx4

Skipping disabled port 0

Skipping disabled port 1

Skipping disabled port 2

Skipping disabled port 3

EAL: Error - exiting with code: 1

Cause: All available ports are disabled. Please set portmask. <<< This message is expected

I would appreciate any help! Thanks a lot!

Here are some Information about my system:


$RTE_SDK/usertools/dpdk-devbind.py --status

Network devices using DPDK-compatible driver

============================================

0000:01:00.0 ‘82599ES 10-Gigabit SFI/SFP+ Network Connection 10fb’ drv=uio_pci_generic unused=ixgbe,vfio-pci

0000:01:00.1 ‘82599ES 10-Gigabit SFI/SFP+ Network Connection 10fb’ drv=uio_pci_generic unused=ixgbe,vfio-pci

Network devices using kernel driver

===================================

0000:04:00.0 ‘MT27700 Family [ConnectX-4] 1013’ if=enp4s0 drv=mlx5_core unused=vfio-pci,uio_pci_generic

0000:07:00.0 ‘I350 Gigabit Network Connection 1521’ if=eno3 drv=igb unused=vfio-pci,uio_pci_generic Active

0000:07:00.1 ‘I350 Gigabit Network Connection 1521’ if=eno4 drv=igb unused=vfio-pci,uio_pci_generic

0000:42:00.0 ‘MT27500 Family [ConnectX-3] 1003’ if=enp66s0d1,enp66s0 drv=mlx4_core unused=vfio-pci,uio_pci_generic


./ibv_devinfo

hca_id: mlx5_0

transport: InfiniBand (0)

fw_ver: 12.12.1100

node_guid: 7cfe:9003:0031:0dd2

sys_image_guid: 7cfe:9003:0031:0dd2

vendor_id: 0x02c9

vendor_part_id: 4115

hw_ver: 0x0

board_id: MT_2140110033

phys_port_cnt: 1

port: 1

state: PORT_DOWN (1)

max_mtu: 4096 (5)

active_mtu: 1024 (3)

sm_lid: 0

port_lid: 0

port_lmc: 0x00

link_layer: Ethernet


apt search libibverbs

Sorting… Done

Full Text Search… Done

ibverbs-providers/buster-backports,now 24.0-2~bpo10+1 amd64 [installed,automatic]

ibverbs-utils/buster-backports,now 24.0-2~bpo10+1 amd64 [installed]

libibverbs-dev/buster-backports,now 24.0-2~bpo10+1 amd64 [installed]

libibverbs1/buster-backports,now 24.0-2~bpo10+1 amd64 [installed,automatic]

librdmacm-dev/stable 22.1-1 amd64

librdmacm1/buster-backports,now 24.0-2~bpo10+1 amd64 [installed]

rdmacm-utils/buster-backports,now 24.0-2~bpo10+1 amd64 [installed]

Upgrading to firmware 12.26.4012 solved the problem