I’m wanting to configure a set of infiniband switches to have the same behaviour as a larger 2-tier clos network. In Ethernet, I have created 4 untagged VLAN port groups within the switch to isolate them from each other. The MAC-VLAN port mapping table allows for duplicate Dest-MAC Addr across those VLAN port groups as long as they have unique VLAN IDs per VLAN port group. This allows allows an inbound message into say VLAN-11 port group of a Leaf Switch to be forwarded up to the Spine switch and back down into same physical switch but another VLAN-12 port group. I’m aware of Paritioning and Domains in IB, but they don’t seem to support this. Manipulating the LIDs looks promising, but not sure if it will work. Any suggestions?
Hi,
The only thing that I can think of is partitioning. I am not sure how you would manipulate the LIDs.
i was thinking one would change the LIDs on the IB NICs to affect/manipulate how the LID-Port table is mapped in each switch.
Found this in some documentation. Also available in UFM appendix. Could this be used for manipulate the Forwarding Database (port map) into forwarding packets out of the switch and back in even though the destination host is connected directly to the switch?
Routing Chains
(NVIDIA SM - NVIDIA Docs)
The routing chains feature is offering a solution that enables one to configure different parts of the fabric and define a different routing engine to route each of them. The routings are done in a sequence (hence the name “chains”) and any node in the fabric that is configured in more than one part is left with the routing updated by the last routing engine it was a part of.
Configuring Routing Chains
To configure routing chains:
- Define the port groups.
- Define topologies based on previously defined port groups.
I cannot find an example or tutorial on this.