Wake On Lan (WOL) MCX311A-XCAT - not supported?

Infrastructure & Networking Software And Drivers Mellanox OFED
1

I tried the solution posted here:

Activating Wake-On-Lan for ConnectX-3 MCX311A-XCAT

However, it says that it’s not supported by the device. Here is info about the system and output from the attempt to enable WOL.

ethtool -I enp2s0

driver: mlx4_en
version: 4.0-0
firmware-version: 2.42.5000
expansion-rom-version: 
bus-info: 0000:02:00.0
supports-statistics: yes
supports-test: yes
supports-eeprom-access: no
supports-register-dump: no
supports-priv-flags: yes


mlxup

Querying Mellanox devices firmware ...

Device #1:
----------

  Device Type:      ConnectX3
  Part Number:      MCX311A-XCA_Ax
  Description:      ConnectX-3 EN network interface card; 10GigE; single-port SFP+; PCIe3.0 x4 8GT/s; RoHS R6
  PSID:             MT_1170110023
  PCI Device Name:  /dev/mst/mt4099_pci_cr0
  Port1 MAC:        e41d-------0
  Port2 MAC:        e41d-------1
  Versions:         Current        Available     
     FW             2.42.5000      2.42.5000     
     PXE            3.4.0752       3.4.0752      

  Status:           Up to date


mst status

MST modules:
------------
    MST PCI module loaded
    MST PCI configuration module loaded

MST devices:
------------
/dev/mst/mt4099_pciconf0         - PCI configuration cycles access.
                                   domain:bus:dev.fn=0000:02:00.0 addr.reg=88 data.reg=92 cr_bar.gw_offset=-1
                                   Chip revision is: 01
/dev/mst/mt4099_pci_cr0          - PCI direct access.
                                   domain:bus:dev.fn=0000:02:00.0 bar=0xf7900000 size=0x100000
                                   Chip revision is: 01


mst status -v

MST modules:
------------
    MST PCI module loaded
    MST PCI configuration module loaded
PCI devices:
------------
DEVICE_TYPE             MST                           PCI       RDMA            NET                       NUMA  
ConnectX3(rev:1)        /dev/mst/mt4099_pciconf0      
ConnectX3(rev:1)        /dev/mst/mt4099_pci_cr0       02:00.0   mlx4_0          net-enp2s0                -1

Attempt to enable WOL:

$ sudo mlxconfig -d /dev/mst/mt4099_pci_cr0 set WOL_MAGIC_EN_P1=1

Device #1:
----------

Device type:    ConnectX3       
Device:         /dev/mst/mt4099_pci_cr0

Configurations:                              Next Boot       New
-E- Device doesn't support WOL_MAGIC_EN_P1 configuration

The same thing happens if I try WOL_MAGIC_EN_P2, but to be clear, this is a single port board.
The board itself doesn’t have any other branding on it, but it was purchased on eBay, so I can’t 100% say where it came from. It doesn’t seem to be OEM, but is there a way I can tell via software?

Also, power on by PCI-E is enabled in the BIOS.
Asus P8Z68-V LX motherboard (BIOS 4105).
Ubuntu 20.04.4, 5.4.0-110-generic x86_64
mst, mft 4.20.0-34, built on Apr 25 2022, 20:48:31. Git SHA Hash: 62bbc33

Are there other tests I can run, or versions I can try?

2

Hello,

Thanks for contacting us.
This feature is only supported on an old MFT version for ConnectX-3 (MFT 4.9)
That version is no longer supported and a case needs to be opened in the support portal to help in this issue.

Thanks,
Ilan.

3

Wow. That sounds horrible. Is there a reason that WOL isn’t included anymore? Or is there a thread I can read to catch up on the details?

I’ll open a support case, to see what happens, but I’ll probably just find another brand of card to use if there isn’t going to be support for a common feature. Especially if it existed and then was removed (but maybe that’s just because I can’t understand why it happened).

4

Hello, what do you mean by “That version is no longer supported” in the context of “an old MFT version for ConnectX-3 (MFT 4.9)”?

According to a different thread, there is still a plan of releasing support on new kernel version:

The name ‘LTS’ should also suggest a long turn support commitment, isn’t it?

However, I do wish somebody inside the company can update on a more clear release schedule.
The other thread promised a new release on June will get Debian 11.2 covered (5.10 based kernel).
And June is about to leave now :-)

5

BTW, forgive my worry on the release schedule, because of the prior record on missing the schedule for a loooooong time:

https://mymellanox.force.com/mellanoxcommunity/s/question/0D51T000088kry9SAA/connectx3-on-ubuntu-2004

Should I expect a driver release soon? Give me a YES, please!

6

Are you able to query the configuration from the NIC successfully?
It appears to be relatively common, some CX311s share the following issue:

$ sudo mlxconfig -d /dev/mst/mt4099_pci_cr0 q

Device #1:

Device type: ConnectX3
Device: /dev/mst/mt4099_pci_cr0

Configurations: Next Boot
-E- Failed to query device current configuration

I can’t trust anything coming out of the mlxconfig tool if it cannot query the card in the first place…

7

I get the same output:

$ sudo mlxconfig -d /dev/mst/mt4099_pci_cr0 q

Device #1:
----------

Device type:    ConnectX3       
Device:         /dev/mst/mt4099_pci_cr0

Configurations:                              Next Boot
-E- Failed to query device current configuration


And to clarify:

$ sudo mst status
MST modules:
------------
    MST PCI module loaded
    MST PCI configuration module loaded


I’ve tried resetting the card, etc, but always the same results.

8

I got a CX311 that shares the same problem. But another CX312 is fine.

If you really need to change the config, there seems to be a workaround that may work:
https://mymellanox.force.com/mellanoxcommunity/s/question/0D51T00006Y8pY5SAJ/connectx3-en-failed-to-query-device-current-configuration
See the accepted answer in the thread.

BTW, while I haven’t attempted the WOL config, if you really need the 4.9 driver version. This can be built on kernel 5.x with some manual fix… Most tricky part is to fix the configure script, which can be borrowed from newer release. I also see some other code change required for 5.10 kernel, but those seems to be relatively easy to work through.