create_ibv_flow() Create of QP flow ID failed

Dear Mellanox Support,

I’ve problems with OFED 2.2. Neither raw_ethernet_bw / raw_ethernet_lat nor libvma can create a QP flow / call verbs.

At some point on that machine it used to run fine but then we added more network interfaces and it seems to break it somehow.

I got all the latest MLNX software & firmware. Flow steering is disabled and there is nothing useful in dmesg. Could you please help me to figure out what’s wrong? See basic info below.

[root@aurarb01 log]# uname -a

Linux aurarb01 2.6.32-431.17.1.el6.x86_64 #1 SMP Fri Apr 11 17:27:00 EDT 2014 x86_64 x86_64 x86_64 GNU/Linux

[root@aurarb01 log]# ofed_info

MLNX_OFED_LINUX-2.2-1.0.1 (OFED-2.2-1.0.0):

[root@aurarb01 log]# raw_ethernet_bw --server

Max msg size in RawEth is MTU 1518

Changing msg size to this MTU


Send BW Test

Dual-port : OFF Device : mlx4_1

Number of qps : 1 Transport type : IB

Connection type : RawEth Using SRQ : OFF

RX depth : 512

CQ Moderation : 100

Mtu : 1518[B]

Link type : Ethernet

Gid index : 0

Max inline data : 0[B]

rdma_cm QPs : OFF

Data ex. method : Ethernet


MAC attached : 24:BE:05:81:95:90

error: Function not implemented

Couldn’t attach QP

[root@aurarb01 log]# LD_PRELOAD=libvma.so sockperf sr

VMA INFO : ---------------------------------------------------------------------------

VMA INFO : VMA_VERSION: 6.6.4-0 Release built on 2014-04-23-16:54:38

VMA INFO : Cmd Line: sockperf sr

VMA INFO : OFED Version: MLNX_OFED_LINUX-2.2-1.0.1:

VMA INFO : Log Level 3 [VMA_TRACELEVEL]

VMA INFO : ---------------------------------------------------------------------------

sockperf: == version #2.5.233 ==

VMA ERROR : rfs[0x23888f0]:188:create_ibv_flow() Create of QP flow ID failed with flow dst:172.17.38.37:11111, src:0.0.0.0:0, protocol:UDP

VMA ERROR : rfs[0x241aa70]:188:create_ibv_flow() Create of QP flow ID failed with flow dst:172.17.38.38:11111, src:0.0.0.0:0, protocol:UDP

VMA ERROR : rfs[0x243e240]:188:create_ibv_flow() Create of QP flow ID failed with flow dst:172.17.38.36:11111, src:0.0.0.0:0, protocol:UDP

sockperf: [SERVER] listen on:

[ 0] IP = 0.0.0.0 PORT = 11111 # UDP

sockperf: Warmup stage (sending a few dummy messages)…

Basically high_rate_steer=1 parameters breaks OFED, that was the reason