Does CX8/CX7 nic support Out-of-Order Data Placement in ROCEv2 mde?

Infrastructure & Networking Software And Drivers Mellanox OFED
1

I found the Out-of-Order Data Placement only described in Infiniband network, but not mentioned in RoCEv2 Ethernet mode. I want to know if it is supported in ROCEv2 mode for mellanox CX7 or CX8?

2

If it support, How to enable it? Thanks a lot!

3

If not use mellanox’s switch, only use the nic, is it supportted?

4

Hi 906787108,

Thank you for posting your query on NVIDIA Community.

If the question relates to the out of sequence counter found under sysfs(hardware counters), I would like to inform that although the path shows infiniband, it is also applicable to ETH interfaces as long as you are using MLNX OFED/ DOCA OFED drivers.

For example, here is an output from my internal lab system that has a ConnectX-7 ETH interface with DOCA OFED

root@hostname:~# ofed_info -s
OFED-internal-25.10-1.7.1:

root@hostname:~# mst status -v
MST modules:

MST PCI module is not loaded
MST PCI configuration module loaded

PCI devices:

DEVICE_TYPE MST PCI RDMA NET NUMA VFIO
ConnectX7(rev:0) /dev/mst/mt4129_pciconf1 c2:00.0 mlx5_1 net-ibs6 1

ConnectX7(rev:0) /dev/mst/mt4129_pciconf0 42:00.0 mlx5_0 net-ens3np0 0

root@hostname:~# cat /sys/class/infiniband/mlx5_0/ports/1/hw_counters/out_of_buffer
0
root@hostname:~# cat /sys/class/infiniband/mlx5_0/ports/1/hw_counters/out_of_sequence
0

Thanks,

NVEX Networking Technical Support.