I’m using my Orin as part of an edge cluster and was thinking about getting another one to support simultaneous inferencing of large models. Ethernet is good enough for most things I need, but with two dedicated AI nodes, it would be nice to be able to mesh them together into a proper network fabric, especially as that would enable inferencing even larger models. I saw that RoCE is not supported by the Orin, is Infiniband?
The Bluefield DPU system seems like it would be the perfect solution in theory. Are there any network fabric systems that would be supported?