ethernet_read_keys: Couldn't read remote address / Couldn't allocate MR

Related files:

https://community.mellanox.com/s/article/Docker-RDMA-SRIOV-Networking-with-ConnectX4-ConnectX5-ConnectX6

Problem:

We have created 2 kubernete pods by using SR-IOV network device plugin, where pod1 uses mlx5_1 and pod2 uses mlx5_2. Information about mlx5_1 and mlx5_2 is shown as follows:

2-01-0

Currently we meet some problems when using “ib_write_bw [server_ip] -a”, but using “ib_write_bw” without “-a” or using “rping” is normal. When we input command “ib_write_bw [server_ip] -a” on a client, the server shows “ethernet_read_keys: Couldn’t read remote address” and the client shows “Couldn’t allocate MR”, which is shown as follows:

pod1:

pod2:

2-4

Some other normal results are given as follows:

(1) rping

pod1:

pod2:

(2) ib_write_bw without “-a”

pod1:

pod2:

pod1 (add “-s 2”):

pod2 (add “-s 2”):

Please ask why I meet this problem and what should I do next? Thank you very much!

The problem is sovled today. We can increase max locked memory in pod to 82000KB (the origin value is 16384KB).