Failed to run simple_fwd_vnf DOCA application in BlueField-2

Infrastructure & Networking BlueField
1

Dear Community,

I’m new to BlueField and mlx5 driver. When I went through with the DOCA simple_fwd_vnf application instruction, I got this error in running.

root@localhost:/opt/mellanox/doca/applications/simple_fwd_vnf/bin# ./doca_simple_fwd_vnf -a auxiliary:mlx5_core.sf.2,dv_flow_en=2 -a auxiliary:mlx5_core.sf.3,dv_flow_
en=2 -- -l 60
EAL: Detected CPU lcores: 8
EAL: Detected NUMA nodes: 1
EAL: Detected shared linkage of DPDK
EAL: Multi-process socket /var/run/dpdk/rte/mp_socket
EAL: Selected IOVA mode 'PA'
TELEMETRY: No legacy callbacks, legacy socket not created
[18:14:53:376188][900825][DOCA][DBG][dpdk_utils.c:440][port_init] Port 0 MAC: 02 2c bc 75 fc 33
[18:14:53:414869][900825][DOCA][DBG][dpdk_utils.c:440][port_init] Port 1 MAC: 02 75 0b 78 80 a7
[18:14:53:420687][900825][DOCA][WRN][engine_model.c:74][adapt_queue_depth] adapting queue depth to 128.
mlx5_net: [mlx5dr_cmd_header_modify_pattern_create]: Failed to create header_modify_pattern (syndrome: 0x6c1bf)
mlx5_net: [mlx5dr_pat_get_pattern]: Failed to create pattern FW object
mlx5_net: [mlx5dr_action_create_modify_header_hws]: Failed to allocate pattern for modify header
mlx5_net: [mlx5dr_action_create_nat64_copy_state]: Failed to create copy for NAT64: action_sz: 56, flags: 0x48

mlx5_net: [mlx5dr_action_create_nat64]: Nat64 failed creating copy state
mlx5_net: Cannot create NAT64 action on port 0, please check the FW version
mlx5_net: [mlx5dr_cmd_header_modify_pattern_create]: Failed to create header_modify_pattern (syndrome: 0x6c1bf)
mlx5_net: [mlx5dr_pat_get_pattern]: Failed to create pattern FW object
mlx5_net: [mlx5dr_action_create_modify_header_hws]: Failed to allocate pattern for modify header
mlx5_net: [mlx5dr_action_create_nat64_copy_state]: Failed to create copy for NAT64: action_sz: 56, flags: 0x48

mlx5_net: [mlx5dr_action_create_nat64]: Nat64 failed creating copy state
mlx5_net: Cannot create NAT64 action on port 1, please check the FW version
mlx5_net: [mlx5dr_table_set_default_miss_not_valid]: Default miss table is not supported
[18:14:57:096347][900825][DOCA][ERR][dpdk_port.c:1139][dpdk_port_group_set_miss_actions] Could not set group miss actions - message (type 1: Failed to set group miss actions)
mlx5_net: [mlx5dr_table_set_default_miss_not_valid]: Default miss table is not supported
[18:14:57:134184][900825][DOCA][ERR][dpdk_port.c:1139][dpdk_port_group_set_miss_actions] Could not set group miss actions - message (type 1: Failed to set group miss actions)
mlx5_net: [mlx5dr_definer_conv_items_to_hl]: Failed processing item type: 20
mlx5_net: [mlx5dr_definer_calc_layout]: Failed to convert items to header layout
mlx5_net: [mlx5dr_definer_matcher_init]: Failed to calculate matcher definer layout
mlx5_net: [mlx5dr_matcher_bind_mt]: Failed to set matcher templates with match definers
mlx5_net: [mlx5dr_matcher_create]: Failed to initialise matcher: 95
mlx5_net: [mlx5dr_definer_conv_items_to_hl]: Failed processing item type: 20
mlx5_net: [mlx5dr_definer_calc_layout]: Failed to convert items to header layout
mlx5_net: [mlx5dr_definer_matcher_init]: Failed to calculate matcher definer layout
mlx5_net: [mlx5dr_matcher_bind_mt]: Failed to set matcher templates with match definers
mlx5_net: [mlx5dr_matcher_create]: Failed to initialise matcher: 95
[18:14:57:147807][900825][DOCA][ERR][dpdk_table.c:1114][flow_template_table_create] Could not create table template - message (type 1: Failed to create template table)
[18:14:57:147883][900825][DOCA][ERR][dpdk_table.c:1518][dpdk_table_create] failed to create table reference for port 0
[18:14:57:147968][900825][DOCA][ERR][dpdk_pipe_legacy.c:882][_internal_pipe_create] failed creating pipe of type 0 - submit, rc=-12
[18:14:57:148006][900825][DOCA][ERR][dpdk_pipe_legacy.c:898][_internal_pipe_create] failed to create pipe GTP_FWD, rc=-12
[18:14:57:151703][900825][DOCA][ERR][engine_pipe.c:466][engine_pipe_create] failed creating pipe - lower layer returned null handler
[18:14:57:151781][900825][DOCA][ERR][doca_flow.c:1756][doca_flow_pipe_create] engine pipe creation failed, rc = -12
[18:14:57:151823][900825][DOCA][ERR][simple_fwd.c:873][simple_fwd_init_ports_and_pipes] Failed building GTPU pipe
[18:14:57:151924][900825][DOCA][ERR][simple_fwd_vnf.c:142][main] VNF application init error
[18:14:58:946722][900825][DOCA][DBG][dpdk_utils.c:994][dpdk_fini] DPDK fini is done

My firmware version is 24.35.2000, DOCA version is 2.6.0 and BSP_4.6.0. I set up the sf as simple_fwd_vnf design figure:

ovs-vsctl show
7e2f391e-5dd8-4225-a899-6127a6ef01da
    Bridge ovsbr1
        Port en3f0pf0sf2
            Interface en3f0pf0sf2
        Port p0
            Interface p0
        Port ovsbr1
            Interface ovsbr1
                type: internal
    Bridge ovsbr2
        Port ovsbr2
            Interface ovsbr2
                type: internal
        Port pf0hpf
            Interface pf0hpf
        Port en3f1pf1sf3
            Interface en3f1pf1sf3
    ovs_version: "2.17.8+nvidia.e92ac078d"

Could anyone give hints on solving this? Thanks!

SEGFAULT on doca_flow_port_start in sample DOCA application
2

Hi,

Thanks for your question.
Please try upgrading the firmware version.
https://network.nvidia.com/support/firmware/bluefield2/

You can do it from the DPU shell (not from the host side) using the below command, it will automatically install the recommended firmware version. After the firmware upgrade, please perform a full power cycle.

/opt/mellanox/mlnx-fw-updater/mlnx_fw_updater.pl

If after upgrading firmware the issue is still present, a deeper investigation will be required, and a new support case should be opened in Nvidia portal, which will be handled according to the support entitlement.

Best Regards,
Anatoly

3

Thanks! This works for me.