Solaris inbox driver can support all of CX-1,2 HCAs.
What’s your Solaris VM’s storage controller?
If you configure with SAS controller with your Solaris VM then you’ll see a boot up hang.
vSphere Solaris VM can support Parallel SCSI controller only!
xlx01 Infrastructure & Networking - NVIDIA Developer Forums - Just as a data point, some people with a different model card have found that disabling vt-D can let this magically work. Might be worth a shot to try out, just to see if it makes a difference.
xlx01
October 27, 2013, 5:46am
23
So I tested with my Solaris VM and it still hangs when booting…although WS 2012 boots up fine. Not sure what’s the difference here?
BTW I didn’t find a yellow mark in WS 2012 Device Manager. It works fine and I can ping the other end (using IPoIB).
Anyway this is a big step towards a solution!
xlx01
October 27, 2013, 4:54pm
24
MB: Supermicro X9SRA
CPU: Intel E5-1650
RAM: 64GB ECC Registered
Hypervisor: ESXi 5.1.0 build 1065491
BIOS: Intel vt-D enabled, not sure about SR-IOV but I think ESXi 5.1 does not support it
IB: MELLANOX MHQH19B-XTR, Revision Id B0, FW 2.9.1200
Mellanox ConnectX (MT26428) - PCIe 2.0 5GT/s, IB QDR / 10GigE Network Adapter
Passed through with “passthru.map”:
"
15b3 673c bridge false
"
VMs: WS 2012, Solaris 11.1
xlx01
October 31, 2013, 2:37am
25
someone not me marked the correct answer??? this is a big step forward but has not solved my problem yet…
I’m provisioning a Linux VM now and see if it works.
xlx01
October 31, 2013, 10:23pm
26
so Linux (lubuntu) works fine without the maxMSIXvectors overwrite.
On the other hand I tested with an OpenIndiana 151a8 VM and it also hangs at boot, similar to the Solaris 11.1 VM.
EDIT: Tested with Solaris 10 u8 with the same problem.
xlx01
November 6, 2013, 4:03pm
27
Actually I made it working! Just need to upgrade to Solaris 11.1.12.5.0. Not sure how OpenIndiana will tackle this.
EDIT: Now come to think more of this it may be that ConnectX-2 is not supported in the original Solaris 11.1 release (and all releases before it).