does multiple Infiniband switch adds up the latency between CPU nodes?

Hi Mei Guodong,

The answer is yes.