Hello all;
I keep getting this MXM ERROR. Are there any MXM settings to fix this or get more information. Currently memlock is set to unlimited. Any help on this issue would be much appreciated.
[examples]$ mpirun ./cpi
Process 0 of 4 is on compute-0-21.local
Process 3 of 4 is on compute-0-22.local
Process 1 of 4 is on compute-0-21.local
Process 2 of 4 is on compute-0-21.local
libibverbs: ibv_create_ah failed to get output IF
[1418721136.681747] [compute-0-22:30331:0] ib_ep.c:297 MXM ERROR failed to create address handle: Cannot allocate memory
libibverbs: ibv_create_ah failed to get output IF
[1418721136.681200] [compute-0-21:31377:0] ib_ep.c:297 MXM ERROR failed to create address handle: Cannot allocate memory
Environment
Mellanox ofed 1.2
Redhat 6.6
Software version mpich version 3.2a2 or OpenMpi 1.8.4 rc1
[jebaluno@compute-0-21 examples]$ ibv_devinfo
hca_id: mlx4_0
transport: InfiniBand (0)
fw_ver: 2.32.5100
node_guid: f452:1403:0015:6bb0
sys_image_guid: f452:1403:0015:6bb3
vendor_id: 0x02c9
vendor_part_id: 4099
hw_ver: 0x1
board_id: MT_1090120019
phys_port_cnt: 2
port: 1
state: PORT_ACTIVE (4)
max_mtu: 4096 (5)
active_mtu: 1024 (3)
sm_lid: 0
port_lid: 0
port_lmc: 0x00
link_layer: Ethernet
port: 2
state: PORT_DOWN (1)
max_mtu: 4096 (5)
active_mtu: 4096 (5)
sm_lid: 0
port_lid: 0
port_lmc: 0x00
link_layer: InfiniBand