DPDK on CX7 with mlx5 PMD

Hi, I’m trying to compile and run the dpdk-test-flow_perf on a CX 7 card running mlx5 driver. I’m running upstream 5.4 kernel and the DPDK application is built with rdma_core v41. I can run testpmd just fine but running flow_perf gives:

sudo ./dpdk-test-flow_perf -l 0-3 -n 4 --no-shconf -- --ingress --ether --ipv4 --queue --rules-count=1000000
EAL: Detected CPU lcores: 128
EAL: Detected NUMA nodes: 2
EAL: Detected static linkage of DPDK
EAL: Selected IOVA mode 'VA'
EAL: Probe PCI driver: mlx5_pci (15b3:1021) device: 0000:a1:00.0 (socket 1)
mlx5_common: DevX create q counter set failed errno=22 status=0 syndrome=0
mlx5_net: Unexpected error in counter offset support detection
EAL: Probe PCI driver: mlx5_pci (15b3:1021) device: 0000:a1:00.1 (socket 1)
mlx5_common: DevX create q counter set failed errno=22 status=0 syndrome=0
mlx5_net: Unexpected error in counter offset support detection
TELEMETRY: No legacy callbacks, legacy socket not created
:: Flow -> ingress / ether / ipv4 / queue / end_flow
MBUF: error setting mempool handler
EAL: Error - exiting with code: 1
  Cause: Error: can't init mbuf pool

Running strace seems to suggest some unsupported ibverbs op, but I’m not sure how to pinpoint what exactly that is:

ioctl(20, RDMA_VERBS_IOCTL, 0x7ffd11710750) = 0
ioctl(20, RDMA_VERBS_IOCTL, 0x7ffd11710560) = -1 EOPNOTSUPP (Operation not supported)
ioctl(20, RDMA_VERBS_IOCTL, 0x7ffd11710a00) = -1 EINVAL (Invalid argument)
write(2, "mlx5_common: DevX create q count"..., 75mlx5_common: DevX create q counter set failed errno=22 status=0 syndrome=0
) = 75

Any help is appreciated!!

hi cuiwei

I suspect there’s may be some SW mismatch in your system.
Can you test with last OFED(version 23.04, it include the match rdma-core) with DPDK 22.11 or 23.03.

Here is the link for OFED:

Thank you
Meng, Shi

Hi Meng, thanks for the suggestion, I have some limitations on the platform I’m running to install OFED, is there a combination of upstream kernel, rdma-core and DPDK that we know works fine with mlx5 driver?

hi Weilong

We do not test DPDK without OFED.
you can try to install ofed with --dpdk option

Thank you
Meng, Shi