Configuring multi-host for ConnectX-7

Infrastructure & Networking Adapters and Cables Ethernet Adapter Cards
1

Hi,

I am evaluating connectX-7 MCX755106AS-HEAT on an HHHL Adapter Card (with standard PCIe edge connector). The card is connected to a PCIe switch that is capable of bifurcating 1x16 or 4x4. The CX7 works normally using 1x16 PCIe bifurcation while connected to a single host.

My goal is to connect 4 hosts using 4 different partitions within the PCIe switch and a 4x4 bifurcation to the CX7 to make it appear as 4 separate downstream ports. The CX7 works normally if I use the 4x4 bifurcation with a single host, the host sees the cx7 as one x4 device. In particular I can use mst* tools normally, which makes possible to configure or update the firmware.

What do I need to do to support additional hosts using the 3 others x4 ports?

2

Hi Igonzalez,

Thank you for posting your query on NVIDIA Community.

Based on the ConnectX-7 documentation, the ConnectX-7 family supports PCIe bifurcation and NVIDIA Multi-Host for up to four hosts.

For the specific card you referenced, MCX755106AS-HEAT, the public documentation describes it as an HHHL adapter with PCIe 5.0 x16 and an optional additional x16 PCIe extension / Socket-Direct-ready option.

In the current product documentation, the ConnectX-7 adapters that are explicitly identified as Multi-Host-capable are specific OCP 3.0 SKUs, including MCX753436MS-HEAB, MCX753436MC-HEAB, MCX75343AMS-NEAC, and MCX75343AMC-NEAC.

So we cannot confirm whether MCX755106AS-HEAT is supported for the 4-host topology you described.

Please verify that the test environment is using a supported software stack, including OS, kernel, driver, firmware, cable/transceiver, and switch configuration.

Relevant documentation:

If you still need deeper troubleshooting after validating the supported configuration, a valid support entitlement will be required to proceed through enterprise support.

If there an active entitlement/support contract in place, please do not hesitate to open a support ticket by logging into the ESP Portal and submitting a new case.

For contracts, please reach out to Networking-Contracts@nvidia.com

Thanks,
NVEX Networking Technical Support Team