Mlx5_rdma_enable_roce error

Infrastructure & Networking BlueField
1

Hello,

When bluefiled2 start, It has some error in console：

[ 147.130442] mlx5_core 0000:03:00.0: mlx5_rdma_enable_roce_steering:71:(pid 729): Failed to create RDMA RX flow group err(-22)
[ 147.143057] mlx5_core 0000:03:00.0: mlx5_rdma_enable_roce:164:(pid 729): Failed to enable RoCE steering: -22
[ 147.166614] mlx5_core 0000:03:00.0: esw_compat_write:353:(pid 729): mlx5_core: Failed setting eswitch to offloads
[ 148.193291] mlx5_core 0000:03:00.0: E-Switch: Disable: mode(LEGACY), nvfs(0), necvfs(0), active vports(0)
[ 149.451158] mlx5_core 0000:03:00.0: mlx5_cmd_out_err:829:(pid 729): CREATE_FLOW_GROUP(0x933) op_mod(0x0) failed, status bad parameter(0x3), syndrome (0x201c1c), err(-22)

The card mode is
INTERNAL_CPU_MODEL EMBEDDED_CPU(1)

When Bluefield in NIC mode
INTERNAL_CPU_MODEL SEPARATED_HOST(0)

No mlx5_rdma_enable_roce error.

How can I solve this problem in DPU mode?

Please help me.

Thanks.

2

I ran into your exact issue with a older BlueField-2 with stock firmware after flashing a DOCA 2.5 image. The issue seems to be related to the firmware on the card being too old. Both openibd and mlnx_fw_updater.pl from DOCA 2.5 fail because of this.

Here’s how I managed to fix this:

  1. Flash the DOCA 1.5.2 LTS image from here using bfb-install.
  2. After installing the image, use the included /opt/mellanox/mlnx-fw-updater/mlnx_fw_updater.pl to update the firmware.
  3. Power cycle the host machine, then verify that the firmware has been updated using mlnx_fw_updater.pl on the BlueField-2
  4. Install the latest DOCA 2 BlueFieldOS image
  5. Run /opt/mellanox/mlnx-fw-updater/mlnx_fw_updater.pl on the BlueField-2 again.
  6. Power cycle the host machine again

At this point, everything should work again.

1 Like
3

Thank you so much.

4

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.