ib_ep.c:297  MXM  ERROR failed to create address handle: Cannot allocate memory

Infrastructure & Networking Software And Drivers Application Accelerator Software
1

Hello all;

I keep getting this MXM ERROR. Are there any MXM settings to fix this or get more information. Currently memlock is set to unlimited. Any help on this issue would be much appreciated.

[examples]$ mpirun ./cpi

Process 0 of 4 is on compute-0-21.local

Process 3 of 4 is on compute-0-22.local

Process 1 of 4 is on compute-0-21.local

Process 2 of 4 is on compute-0-21.local

libibverbs: ibv_create_ah failed to get output IF

[1418721136.681747] [compute-0-22:30331:0] ib_ep.c:297 MXM ERROR failed to create address handle: Cannot allocate memory

libibverbs: ibv_create_ah failed to get output IF

[1418721136.681200] [compute-0-21:31377:0] ib_ep.c:297 MXM ERROR failed to create address handle: Cannot allocate memory

Environment

Mellanox ofed 1.2

Redhat 6.6

Software version mpich version 3.2a2 or OpenMpi 1.8.4 rc1

[jebaluno@compute-0-21 examples]$ ibv_devinfo

hca_id: mlx4_0

transport: InfiniBand (0)

fw_ver: 2.32.5100

node_guid: f452:1403:0015:6bb0

sys_image_guid: f452:1403:0015:6bb3

vendor_id: 0x02c9

vendor_part_id: 4099

hw_ver: 0x1

board_id: MT_1090120019

phys_port_cnt: 2

port: 1

state: PORT_ACTIVE (4)

max_mtu: 4096 (5)

active_mtu: 1024 (3)

sm_lid: 0

port_lid: 0

port_lmc: 0x00

link_layer: Ethernet

port: 2

state: PORT_DOWN (1)

max_mtu: 4096 (5)

active_mtu: 4096 (5)

sm_lid: 0

port_lid: 0

port_lmc: 0x00

link_layer: InfiniBand

2

Enable IPv6 support on the hosts by running command:

echo 0 > /proc/sys/net/ipv6/conf/enp131s0/disable_ipv6

3

Hi,

Could you open a support case?

The support team will follow up from there.

Thanks,

Ophir.

4

Opir, does MXM work with ROCE? Our setup at University of Houston is ROCE. I beginning to suspect that MXM is strictly meant for infiniband protocol, any taughts before I formerly engage the support Team.

-Jerry Ebalunode

5

ipv6 is already enabled for the hosts.

6

Please, e-mail me and let’s continue via e-mail.

7

MXM use VERBS in order to transfer packets over Ethernet.

8

hi alkx, i have met the same problem , how can i contact u