How to run DOCA RDMA sample using connection CM

Infrastructure & Networking BlueField
1

Hello! I have two hosts and there is a DPU on each host (DPU1 and DPU2). I ssh’ed into both DPUs and tried to run the DOCA sample (RDMA receive) on DPU1 and the DOCA sample (RDMA send) on DPU2.

The samples can run successfully when RDMA CM is not used, but the samples cannot run successfully when I use the RDMA CM with DPU1 as the CM server. Could you help with that and here are the commands I have tried:

on DPU1:

169448cb87226e5745d4d2d9d199ba9f
169448cb87226e5745d4d2d9d199ba9f3530×596 294 KB

on DPU2:

bfbe3f150361de85f2ce40d2babfabea
bfbe3f150361de85f2ce40d2babfabea3118×842 395 KB

As I used DPU1 as the CM server, here are some infor mation that may to your interest:

64fc6f4b84d62ee37463835d5f9caffb
64fc6f4b84d62ee37463835d5f9caffb1956×1692 338 KB

image
image802×316 26.4 KB

ubuntu@alveo-u50d-01-bluefield:/$ ibdev2netdev
mlx5_0 port 1 ==> en3f0pf0sf0 (Up)
mlx5_0 port 10 ==> en3f0pf0sf0 (Up)
mlx5_0 port 11 ==> en3f0pf0sf0 (Up)
mlx5_0 port 12 ==> en3f0pf0sf0 (Up)
mlx5_0 port 13 ==> en3f0pf0sf0 (Up)
mlx5_0 port 14 ==> en3f0pf0sf0 (Up)
mlx5_0 port 15 ==> en3f0pf0sf0 (Up)
mlx5_0 port 16 ==> en3f0pf0sf0 (Up)
mlx5_0 port 17 ==> en3f0pf0sf0 (Up)
mlx5_0 port 18 ==> en3f0pf0sf0 (Up)
mlx5_0 port 19 ==> en3f0pf0sf0 (Up)
mlx5_0 port 2 ==> en3f0pf0sf0 (Up)
mlx5_0 port 20 ==> en3f0pf0sf0 (Up)
mlx5_0 port 21 ==> en3f0pf0sf0 (Up)
mlx5_0 port 22 ==> en3f0pf0sf0 (Up)
mlx5_0 port 23 ==> en3f0pf0sf0 (Up)
mlx5_0 port 24 ==> en3f0pf0sf0 (Up)
mlx5_0 port 25 ==> en3f0pf0sf0 (Up)
mlx5_0 port 26 ==> en3f0pf0sf0 (Up)
mlx5_0 port 27 ==> en3f0pf0sf0 (Up)
mlx5_0 port 28 ==> en3f0pf0sf0 (Up)
mlx5_0 port 29 ==> en3f0pf0sf0 (Up)
mlx5_0 port 3 ==> en3f0pf0sf0 (Up)
mlx5_0 port 30 ==> en3f0pf0sf0 (Up)
mlx5_0 port 31 ==> en3f0pf0sf0 (Up)
mlx5_0 port 32 ==> en3f0pf0sf0 (Up)
mlx5_0 port 33 ==> en3f0pf0sf0 (Up)
mlx5_0 port 34 ==> en3f0pf0sf0 (Up)
mlx5_0 port 35 ==> en3f0pf0sf0 (Up)
mlx5_0 port 36 ==> en3f0pf0sf0 (Up)
mlx5_0 port 37 ==> en3f0pf0sf0 (Up)
mlx5_0 port 38 ==> en3f0pf0sf0 (Up)
mlx5_0 port 39 ==> en3f0pf0sf0 (Up)
mlx5_0 port 4 ==> en3f0pf0sf0 (Up)
mlx5_0 port 40 ==> en3f0pf0sf0 (Up)
mlx5_0 port 41 ==> en3f0pf0sf0 (Up)
mlx5_0 port 42 ==> en3f0pf0sf0 (Up)
mlx5_0 port 43 ==> en3f0pf0sf0 (Up)
mlx5_0 port 44 ==> en3f0pf0sf0 (Up)
mlx5_0 port 45 ==> en3f0pf0sf0 (Up)
mlx5_0 port 46 ==> en3f0pf0sf0 (Up)
mlx5_0 port 47 ==> en3f0pf0sf0 (Up)
mlx5_0 port 48 ==> en3f0pf0sf0 (Up)
mlx5_0 port 49 ==> en3f0pf0sf0 (Up)
mlx5_0 port 5 ==> en3f0pf0sf0 (Up)
mlx5_0 port 50 ==> en3f0pf0sf0 (Up)
mlx5_0 port 51 ==> en3f0pf0sf0 (Up)
mlx5_0 port 52 ==> en3f0pf0sf0 (Up)
mlx5_0 port 53 ==> en3f0pf0sf0 (Up)
mlx5_0 port 54 ==> en3f0pf0sf0 (Up)
mlx5_0 port 55 ==> en3f0pf0sf0 (Up)
mlx5_0 port 56 ==> en3f0pf0sf0 (Up)
mlx5_0 port 57 ==> en3f0pf0sf0 (Up)
mlx5_0 port 58 ==> en3f0pf0sf0 (Up)
mlx5_0 port 59 ==> en3f0pf0sf0 (Up)
mlx5_0 port 6 ==> en3f0pf0sf0 (Up)
mlx5_0 port 60 ==> en3f0pf0sf0 (Up)
mlx5_0 port 61 ==> en3f0pf0sf0 (Up)
mlx5_0 port 62 ==> en3f0pf0sf0 (Up)
mlx5_0 port 63 ==> en3f0pf0sf0 (Up)
mlx5_0 port 64 ==> en3f0pf0sf0 (Up)
mlx5_0 port 65 ==> en3f0pf0sf0 (Up)
mlx5_0 port 66 ==> en3f0pf0sf0 (Up)
mlx5_0 port 67 ==> en3f0pf0sf0 (Up)
mlx5_0 port 68 ==> en3f0pf0sf0 (Up)
mlx5_0 port 69 ==> en3f0pf0sf0 (Up)
mlx5_0 port 7 ==> en3f0pf0sf0 (Up)
mlx5_0 port 70 ==> en3f0pf0sf0 (Up)
mlx5_0 port 71 ==> en3f0pf0sf0 (Up)
mlx5_0 port 72 ==> en3f0pf0sf0 (Up)
mlx5_0 port 73 ==> en3f0pf0sf0 (Up)
mlx5_0 port 74 ==> en3f0pf0sf0 (Up)
mlx5_0 port 75 ==> en3f0pf0sf0 (Up)
mlx5_0 port 76 ==> en3f0pf0sf0 (Up)
mlx5_0 port 77 ==> en3f0pf0sf0 (Up)
mlx5_0 port 78 ==> en3f0pf0sf0 (Up)
mlx5_0 port 79 ==> en3f0pf0sf0 (Up)
mlx5_0 port 8 ==> en3f0pf0sf0 (Up)
mlx5_0 port 80 ==> en3f0pf0sf0 (Up)
mlx5_0 port 81 ==> en3f0pf0sf0 (Up)
mlx5_0 port 82 ==> en3f0pf0sf0 (Up)
mlx5_0 port 83 ==> en3f0pf0sf0 (Up)
mlx5_0 port 9 ==> en3f0pf0sf0 (Up)
mlx5_1 port 1 ==> en3f1pf1sf0 (Up)
mlx5_1 port 10 ==> en3f1pf1sf0 (Up)
mlx5_1 port 11 ==> en3f1pf1sf0 (Up)
mlx5_1 port 12 ==> en3f1pf1sf0 (Up)
mlx5_1 port 13 ==> en3f1pf1sf0 (Up)
mlx5_1 port 14 ==> en3f1pf1sf0 (Up)
mlx5_1 port 15 ==> en3f1pf1sf0 (Up)
mlx5_1 port 16 ==> en3f1pf1sf0 (Up)
mlx5_1 port 17 ==> en3f1pf1sf0 (Up)
mlx5_1 port 18 ==> en3f1pf1sf0 (Up)
mlx5_1 port 19 ==> en3f1pf1sf0 (Up)
mlx5_1 port 2 ==> en3f1pf1sf0 (Up)
mlx5_1 port 20 ==> en3f1pf1sf0 (Up)
mlx5_1 port 21 ==> en3f1pf1sf0 (Up)
mlx5_1 port 22 ==> en3f1pf1sf0 (Up)
mlx5_1 port 23 ==> en3f1pf1sf0 (Up)
mlx5_1 port 24 ==> en3f1pf1sf0 (Up)
mlx5_1 port 25 ==> en3f1pf1sf0 (Up)
mlx5_1 port 26 ==> en3f1pf1sf0 (Up)
mlx5_1 port 27 ==> en3f1pf1sf0 (Up)
mlx5_1 port 28 ==> en3f1pf1sf0 (Up)
mlx5_1 port 29 ==> en3f1pf1sf0 (Up)
mlx5_1 port 3 ==> en3f1pf1sf0 (Up)
mlx5_1 port 30 ==> en3f1pf1sf0 (Up)
mlx5_1 port 31 ==> en3f1pf1sf0 (Up)
mlx5_1 port 32 ==> en3f1pf1sf0 (Up)
mlx5_1 port 33 ==> en3f1pf1sf0 (Up)
mlx5_1 port 34 ==> en3f1pf1sf0 (Up)
mlx5_1 port 35 ==> en3f1pf1sf0 (Up)
mlx5_1 port 36 ==> en3f1pf1sf0 (Up)
mlx5_1 port 37 ==> en3f1pf1sf0 (Up)
mlx5_1 port 38 ==> en3f1pf1sf0 (Up)
mlx5_1 port 39 ==> en3f1pf1sf0 (Up)
mlx5_1 port 4 ==> en3f1pf1sf0 (Up)
mlx5_1 port 40 ==> en3f1pf1sf0 (Up)
mlx5_1 port 41 ==> en3f1pf1sf0 (Up)
mlx5_1 port 42 ==> en3f1pf1sf0 (Up)
mlx5_1 port 43 ==> en3f1pf1sf0 (Up)
mlx5_1 port 44 ==> en3f1pf1sf0 (Up)
mlx5_1 port 45 ==> en3f1pf1sf0 (Up)
mlx5_1 port 46 ==> en3f1pf1sf0 (Up)
mlx5_1 port 47 ==> en3f1pf1sf0 (Up)
mlx5_1 port 48 ==> en3f1pf1sf0 (Up)
mlx5_1 port 49 ==> en3f1pf1sf0 (Up)
mlx5_1 port 5 ==> en3f1pf1sf0 (Up)
mlx5_1 port 50 ==> en3f1pf1sf0 (Up)
mlx5_1 port 51 ==> en3f1pf1sf0 (Up)
mlx5_1 port 52 ==> en3f1pf1sf0 (Up)
mlx5_1 port 53 ==> en3f1pf1sf0 (Up)
mlx5_1 port 54 ==> en3f1pf1sf0 (Up)
mlx5_1 port 55 ==> en3f1pf1sf0 (Up)
mlx5_1 port 56 ==> en3f1pf1sf0 (Up)
mlx5_1 port 57 ==> en3f1pf1sf0 (Up)
mlx5_1 port 58 ==> en3f1pf1sf0 (Up)
mlx5_1 port 59 ==> en3f1pf1sf0 (Up)
mlx5_1 port 6 ==> en3f1pf1sf0 (Up)
mlx5_1 port 60 ==> en3f1pf1sf0 (Up)
mlx5_1 port 61 ==> en3f1pf1sf0 (Up)
mlx5_1 port 62 ==> en3f1pf1sf0 (Up)
mlx5_1 port 63 ==> en3f1pf1sf0 (Up)
mlx5_1 port 64 ==> en3f1pf1sf0 (Up)
mlx5_1 port 65 ==> en3f1pf1sf0 (Up)
mlx5_1 port 66 ==> en3f1pf1sf0 (Up)
mlx5_1 port 67 ==> en3f1pf1sf0 (Up)
mlx5_1 port 68 ==> en3f1pf1sf0 (Up)
mlx5_1 port 69 ==> en3f1pf1sf0 (Up)
mlx5_1 port 7 ==> en3f1pf1sf0 (Up)
mlx5_1 port 70 ==> en3f1pf1sf0 (Up)
mlx5_1 port 71 ==> en3f1pf1sf0 (Up)
mlx5_1 port 72 ==> en3f1pf1sf0 (Up)
mlx5_1 port 73 ==> en3f1pf1sf0 (Up)
mlx5_1 port 74 ==> en3f1pf1sf0 (Up)
mlx5_1 port 75 ==> en3f1pf1sf0 (Up)
mlx5_1 port 76 ==> en3f1pf1sf0 (Up)
mlx5_1 port 77 ==> en3f1pf1sf0 (Up)
mlx5_1 port 78 ==> en3f1pf1sf0 (Up)
mlx5_1 port 79 ==> en3f1pf1sf0 (Up)
mlx5_1 port 8 ==> en3f1pf1sf0 (Up)
mlx5_1 port 80 ==> en3f1pf1sf0 (Up)
mlx5_1 port 81 ==> en3f1pf1sf0 (Up)
mlx5_1 port 82 ==> en3f1pf1sf0 (Up)
mlx5_1 port 83 ==> en3f1pf1sf0 (Up)
mlx5_1 port 9 ==> en3f1pf1sf0 (Up)
mlx5_2 port 1 ==> enp3s0f0s0 (Up)
mlx5_3 port 1 ==> enp3s0f1s0 (Up)
ubuntu@alveo-u50d-01-bluefield:/$

Thanks a lot!

2

Hello @huzhiyi1037,

Thank you for posting your query on our community.

Could you clarify whether the sample runs successfully when DPU2 acts as the server, and the issue only occurs when DPU1 is acting as the server?

Based on the screenshots you have provided, the mlx5_2 device on port 1 corresponds to the interface enp3s0f0s0, according to your ibdev2netdev output.

The IPv6 address assigned to this interface is fe80::49:a3ff:fe4b:c88a/64.
Based on the test commands you have shared, it appears that the incorrect address may be in use. Could you please verify this?

Thanks,
Bhargavi