4036 IPoIB partition on vSphere 5.1U1

Infrastructure & Networking Switches and Gateways InfiniBand/VPI Switch Systems
1

I have a Mellanox 4036 QDR switch.

My QDR one doesn’t have CLI for partition management.

I make a partition.conf file and import to switch then restart SM on switch.

But Just only 2 partitions 0 and 21 possible pinging on vSphere 5.1 update 1 VM Network.

vSwitch VLAN set to below pKeys (15,16,17,18,21,31 and MTU=4096-4=4092)

(Partition Default and vMotion works…)

Below is my partition.conf.

Default= 0xffff , ipoib , mtu=5 : ALL=full ;

CSV= 0x15 , ipoib , mtu=5, defmember=full : ALL=full;

LM= 0x16 , ipoib , mtu=5, defmember=full : ALL=full;

iSCSI01= 0x17 , ipoib , mtu=5, defmember=full : ALL=full;

iSCSI02= 0x18 , ipoib , mtu=5, defmember=full : ALL=full;

vMotion= 0x21 , ipoib , mtu=5, defmember=full : ALL=full;

FT= 0x31 , ipoib , mtu=5, defmember=full : ALL=full;

Is there any problem in partition definition format?

2

the format looks OK. they should all work.

i see that you are forcing MTU=5 (4K MTU), which is fine by you need to make sure that your server’s setting is also set to 4K at the driver level.

if you look at ibv_devinfo at the server it should show the MTU as 4K.

i saw your other thread about the same issue and i am currently looking into getting some answers.