RoCE / RDMA traffic not passing between two Mellanox 200Gbps NIC servers despite link up

Just follow the original playbooks:

Before anything you should test with just 1 NIC on each Spark and 1 QSFP cable (connect the same port on each spark) and Give it /24 IPs on both Sparks, Verify ping works bidirectionally.

This instruction work fine for 2 cables, but it’s not really needed:

Please take a look at this thread if needed: ConnectX-7 NIC in DGX Spark