I would appreciate some advice in partitioning an IB network, please.
We have quite a large IB network – there are almost 800 hosts on the network. All these hosts are part of a single computation cluster. Recently, a researcher in the university bought a new system consisting of 4 hosts. This new system is completely separate for the cluster in that it does share the same private Ethernet. On the other hand to made the new system affordable we decided to allow the owner to take 4 of our spare/free IB ports.
Currently, both the new and old system share the same OpenSM partition. That is…ibhosts gives both the new/old hosts:
Ca : 0xe41d2d0300e16190 ports 2 “srv01935 mlx4_0”
Ca : 0x248a070300f052f0 ports 2 “srv01934 mlx4_0”
Ca : 0xe41d2d0300e166d0 ports 2 “srv01933 mlx4_0”
Ca : 0xe41d2d0300e16350 ports 2 “srv01932 mlx4_0”
Ca : 0xf452140300225f20 ports 1 “orange02 HCA-1”
Ca : 0xf452140300225ec0 ports 1 “orange03 HCA-1”
I’m wondering if it is best to place the old/new hosts in separate partitions. Does that make sense? If it does make sense then how do I best construct the partitions.conf file to do this? That is, placing the new (srv…) hosts in a partition is easy, but how do I ensure that the default partition is just the old hosts?