See this for some interconnect speeds: https://forums.developer.nvidia.com/t/simplep2p-example-and-multi-gpu-network-training-causes-system-freeze-and-err-in-nvidia-smi/70225/5?u=generix