Mellanox SB7800 and LinkX 200GbE cables (200Gb/s to 2x100Gb/s)

RHEL 8.4

lspci | grep Mellanox
a1:00.0 Infiniband controller: Mellanox Technologies MT28908 Family [ConnectX-6]

Cable part number:

Infiniband device ‘mlx5_0’ port 1 status:
default gid: fe80:0000:0000:0000:e8eb:d303:00ef:5d22
base lid: 0xe
sm lid: 0x1
state: 4: ACTIVE
phys state: 5: LinkUp
rate: 25 Gb/sec (1X EDR)
link_layer: InfiniBand

mlxlink -d mlx5_0

Operational Info

State : Active
Physical state : LinkUp
Speed : IB-EDR
Width : 1x
FEC : Standard LL RS-FEC - RS(271,257)
Loopback Mode : No Loopback
Auto Negotiation : ON

Supported Info

Enabled Link Speed : 0x00000075 (HDR,EDR,FDR,QDR,SDR)
Supported Cable Speed : 0x0000007f (HDR,EDR,FDR,FDR10,QDR,DDR,SDR)

Troubleshooting Info

Status Opcode : 0
Group Opcode : N/A
Recommendation : No issue was observed.

Tool Information

Firmware Version : 20.32.2004
amBER Version : 2.02
MFT Version : mft 4.21.0-99

How to set the speed to 100GbE with these cables? Currently they run only in 25GbE (1XEDR).

mlxlink -d mlx5_0 -p 1 --speeds edr
mlxlink -d mlx5_0 -p 1 --speeds hdr

Both gives the same results 25GbE (1xEDR)

Apparently the Mellanox SB7800 can only handle 25Gb/s lanes so 2 x 50Gb for split cables doesn’t work because of this.

1 Like

EDR switch not support split cable, you can only get 1x, 4x link.
HDR can get 1x,2x,4x link

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.