Hi ,
Please note that we removed support for Offloaded Traffic Sniffer feature, but we can suggest using the docker-container solution to use RDMA devices, in order to capture and analyze RDMA packets using tcpdump.
Requirements
-
CentOS/RHEL 7.x / 8.x
-
Upstream Kernel must be higher than 4.9
- ConnectX-3/4/5
-
MFT 4.9 and above (You can download it from http://www.mellanox.com/page/management_tools )
-
perftest package to run ib_write_bw test
Installation instructions:
-
Install OS that is compatible with kernel 4.9 and above
-
Install Upstream kernel starting from version 4.9 support sniffing RDMA(RoCE) traffic
-
Yum install docker
-
Docker pull mellanox/tcpdump-rdma
-
Service docker start
-
Docker run -it -v /dev/infiniband:/dev/infiniband -v /tmp/traces:/tmp/traces --net=host --privileged mellanox/tcpdump-rdma bash
-
Install MFT 4.9
-
Install perftest package from MLNX_OFED RPMS directory
-
Capture RoCE packets with the following:
tcpdump -i mlx5_0 -s 0 -w /tmp/traces/capture1.pcap
or
tcpdump -i mlx4_0 -s 0 -w /tmp/traces/capture1.pcap
- Run ib_write_bw test , as below:
Server : ib_write_bw -d mlx5_0 -a -F
Client: ib_write_bw -a -F <Server_ip>
- Open the pcap through wireshark to verify
Thanks,
Samer