Sharing connectx IPoIB cards with windows server 2012 guest VM

Is there a trick to this? I thought you could just add it to the virtual switch, but apparently the guest VM traffic isn’t routed across the infiniband fabric. I can ping the host machine, but no other machines on the network are ping-able.

Doing some more research, this seems to be an issue with IPoIB not wanting to be bridged, only NAT’d which vmware supports but not hyper-v, and my only option is network virtualization with SCVMM. Is there another way? has anyone deal with this before?