Inquiry about ConnectX-6 adapter

Infrastructure & Networking Adapters and Cables
1

Hello,

I’m using the ConnectX-6 adapter included with the new Azure HBv2 vms. My question is very simple: In order to run OpenMPI either with openib (-mca btl_openib_if_include #NAME) or with UCX (-x UCX_NET_DEVICES=#NAME -x HCOLL_MAIN_IB=#NAME), would #NAME simply be mlx6 or something more sophisticated (e.g. mlx6_2:1)? I just want to make sure that I’m using the right syntax.

Thank you,

Arturo

2

Hello Arturo,

Thank you posting your question on the Mellanox Community.

Based on the information provided, the syntax you need to use, should be → mlx5_<hca_number>:<port_number>

For example:

HCOLL_MAIN_IB=mlx5_0:1

The ConnectX-6 is using the mlx5-core driver and is being advertised in the system as mlx5_<hca_number> (RDMA device)

See below output for example:

mst status -v

MST modules:

MST PCI module is not loaded

MST PCI configuration module loaded

PCI devices:

DEVICE_TYPE MST PCI RDMA NET NUMA

ConnectX6(rev:0) /dev/mst/mt4123_pciconf0.1 02:00.1 mlx5_1 net-ib1 0

ConnectX6(rev:0) /dev/mst/mt4123_pciconf0 02:00.0 mlx5_0 net-ib0 0

Thank you,

~Mellanox Technical Support

3

Hi Martijn,

Thanks,

Arturo