When using the ib_read / write_bw tool, I found the following problem:
-
All the items are zero.
-
Using the “perfquery” tool almost can not monitor the sending of data packets.
[root@localhost infiniband]# ib_read_bw -d mlx4_0 -i 1 -s 1024 1.1.1.103 --run_infinitely -D 2
get the pcpc flag 2
RDMA_Read BW Test
Dual-port : OFF Device : mlx4_0
Number of qps : 1 Transport type : IB
Connection type : RC Using SRQ : OFF
TX depth : 128
CQ Moderation : 100
Mtu : 2048[B]
Link type : IB
Outstand reads : 16
rdma_cm QPs : OFF
Data ex. method : Ethernet
local address: LID 0x01 QPN 0x021e PSN 0xc7c4fb OUT 0x10 RKey 0x30010100 VAddr 0x007f3d09c8f000
remote address: LID 0x09 QPN 0x0254 PSN 0x9a3a9e OUT 0x10 RKey 0xf001fb07 VAddr 0x007f388ecb7000
#bytes #iterations BW peak[MB/sec] BW average[MB/sec] MsgRate[Mpps]
1024 7 0.00 0.00 0.000004
1024 0 0.00 0.00 0.000000
1024 0 0.00 0.00 0.000000
1024 0 0.00 0.00 0.000000
1024 0 0.00 0.00 0.000000
1024 0 0.00 0.00 0.000000
1024 0 0.00 0.00 0.000000
1024 0 0.00 0.00 0.000000
1024 0 0.00 0.00 0.000000
1024 0 0.00 0.00 0.000000
1024 0 0.00 0.00 0.000000
1024 0 0.00 0.00 0.000000
1024 0 0.00 0.00 0.000000
1024 0 0.00 0.00 0.000000
driver version : MLNX_OFED_LINUX-4.2-1.0.0.0
FDR card firmware version:
MLNX_OFED_LINUX-4.2-1.0.0.0:
[root@localhost infiniband]# ibstat
CA ‘mlx4_0’
CA type: MT4099
Number of ports: 2
Firmware version: 2.42.5000
Hardware version: 1
Node GUID: 0x7cfe90030016c4c0
System image GUID: 0x7cfe90030016c4c3
Port 1:
State: Active
Physical state: LinkUp
Rate: 40
Base lid: 1
LMC: 0
SM lid: 1
Capability mask: 0x0251486a
Port GUID: 0x7cfe90030016c4c1
Link layer: InfiniBand
Port 2:
State: Initializing
Physical state: LinkUp
Rate: 56
Base lid: 0
LMC: 0
SM lid: 0
Capability mask: 0x02514868
Port GUID: 0x7cfe90030016c4c2
Link layer: InfiniBand