Hi everyone! I bought 2 DGX Spark machines and want them to function well with our Mellanox Infiniband SB7800 switch. I have all cables but somehow it turns out that Spark doesn’t really “react” on being connected to the switch. The software, of course, was installed on the DGX machine. Switch is working well with other machines.
IFIK the ConnectX ports on the DGX Spark are configured in Ethernet mode. To connect the Spark to a switch like SB7800 both ends must speak IB. However, there’s no firmware option to switch the ports to IB. We use RoCE for clustering, which simply means sending IB verbs over Ethernet links. And it works fine on Sparks connected back-to-back.
Thanks for the answer! However, I am interested in the Infiniband option. The idea is to incorporate sparks in an HPC cluster. Any idea if the firmware might appear any time soon?
Hi @iner, DGX Spark does not support infinband mode and there are no plans to add support in the future.