Hi, I have a cluster consisting of 3 nodes.
Each node has a dual-port infiniband 12700 card installed. Each card is connected to two others by one port (3 cables in total).
Each node runs SM, which manages 1 subnet.
The subnets have different prefixes.
During the configuration of the nodes, I was able to run Intel MPI tests only on 2 specific nodes out of 3.
I read the documentation and forum threads, but I did not get a clear answer to the question, is it possible to connect 3 or more nodes into an infiniband network without using a hardware router? How to do that? Is such a connection necessary for MPI to work?
opensm.conf file says that multiple comma separated guids are possible, but there any operational difference between n1-sm – n2 – n3-sm configuration and n1 – n2(sm x 2) – n3 for current driver?