I have a MCX515A-CCA_Ax_Bx ConnectX-5 EN network interface card 100GbE single-port QSFP28
I want to avoid using vports for incoming packets e.g. so that I can see network traffic using
tcpdump -i enp25s0
I have disabled SRIOV in the BIOS and using mstconfig. Incoming packets go to rx_vport_packets and not rx_packets.
Please can you help?? Thank you!!
I include some relevant data below:
roddy@CTSPC4:~$ sudo mlxburn -d /dev/mst/mt4119_pciconf0 -vpd
VPD-KEYWORD DESCRIPTION VALUE
Read Only Section:
PN Part Number MCX515A-CCAT
EC Revision AB
V2 N/A MCX515A-CCAT
SN Serial Number MT1952J09189
V3 N/A 0c0619441c29ea1180001c34da76420c
VA N/A MLX:MODL=CX515A:MN=MLNX:CSKU=V2:UUID=V3:PCI=V0
V0 Misc Info PCIeGen3 x16
RV Checksum Complement 0x19
IDTAG Board Id CX515A - ConnectX-5 QSFP28
roddy@CTSPC4:~$ sudo flint -d /dev/mst/mt4119_pciconf0 q
Image type: FS4
FW Version: 16.32.1010
FW Release Date: 1.12.2021
Product Version: 16.32.1010
Rom Info: type=UEFI version=14.25.17 cpu=AMD64
type=PXE version=3.6.502 cpu=AMD64
Description: UID GuidsNumber
Base GUID: 1c34da030076420c 4
Base MAC: 1c34da76420c 4
Image VSD: N/A
Device VSD: N/A
PSID: MT_0000000011
Security Attributes: N/A
roddy@CTSPC4:~$ sudo dmesg | grep -i mlx | grep 19
[ 2.919328] mlx5_core 0000:19:00.0: firmware version: 16.32.1010
[ 2.919361] mlx5_core 0000:19:00.0: 126.016 Gb/s available PCIe bandwidth (8 GT/s x16 link)
[ 2.930016] mlx5_core 0000:19:00.0: handle_hca_cap:697:(pid 436): log_max_qp value in current profile is 18, changing it to HCA capability limit (17)
[ 3.134742] mlx5_core 0000:19:00.0: Rate limit: 127 rates are supported, range: 0Mbps to 97656Mbps
[ 3.134894] mlx5_core 0000:19:00.0: E-Switch: Total vports 2, per vport: max uc(128) max mc(2048)
[ 3.138086] mlx5_core 0000:19:00.0: Port module event: module 0, Cable plugged
[ 3.138513] mlx5_core 0000:19:00.0: mlx5_pcie_event:302:(pid 5): PCIe slot advertised sufficient power (27W).
[ 3.151795] mlx5_core 0000:19:00.0: mlx5_fw_tracer_start:815:(pid 436): FWTracer: Ownership granted and active
[ 3.361970] mlx5_core 0000:65:00.0: E-Switch: Total vports 2, per vport: max uc(128) max mc(2048)
[ 3.384518] mlx5_core 0000:19:00.0: MLX5E: StrdRq(1) RqSz(8) StrdSz(2048) RxCqeCmprss(0)
[ 3.657404] mlx5_core 0000:19:00.0: Supported tc offload range - chains: 4294967294, prios: 4294967295
[ 3.917725] mlx5_core 0000:19:00.0 enp25s0: renamed from eth0
[ 6.865241] mlx5_core 0000:19:00.0 enp25s0: Link down
[ 705.635900] mlx5_core 0000:19:00.0 enp25s0: Link up
(There was delay getting the other end of the connection ready.)
roddy@CTSPC4:~$ sudo mstconfig -d 0000:19:00.0 q | grep -i sriov
SRIOV_EN False(0)
SRIOV_IB_ROUTING_MODE_P1 LID(1)
roddy@CTSPC4:~$ ethtool -S enp25s0 | grep rx_packets
rx_packets: 0
rx_packets_phy: 50000
roddy@CTSPC4$ ethtool -S enp25s0 | grep -v “: 0” | grep rx | grep -v cache
rx_vport_multicast_packets: 50000
rx_vport_multicast_bytes: 145600000
rx_packets_phy: 50000
rx_bytes_phy: 145800000
rx_multicast_phy: 50000
rx_2048_to_4095_bytes_phy: 50000
rx_prio0_bytes: 145800000
rx_prio0_packets: 50000
roddy@CTSPC4$ lspci | grep Mellanox
0000:19:00.0 Ethernet controller: Mellanox Technologies MT27800 Family [ConnectX-5]