How to enable wake-on-la (wol) on a mellanox InfiniBand card ?

Infrastructure & Networking Adapters and Cables InfiniBand/VPI Adapter Cards
1

Hi everyone,

I have two computer (A and B) directly connected by an InfiniBand wired.

I’m interested in sending a magicPacket from computer A thoughout the Infiniband wire to wakeup computer B.

My problem is that I’m struggling to enable wake-on-lan on computer B.

Here are steps that I’m following now

  1. Turn both InfiniBand ports in Ethernet mode

comA > connectx_port_config (followed by the choice of option 2)

comB > connectx_port_config (followed by the choice of option 2)

  1. Confirm that ports are enable

comB > ifconfig

eth1 Link encap:Ethernet HWaddr 00:02:c9:4d:58:ee adr inet6: fe80::202:c9ff:fe4d:58ee/64 Scope:LienUP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1Packets reçus:8003 erreurs:0 :0 overruns:0 frame:0TX packets:12075 errors:0 dropped:0 overruns:0 carrier:0collisions:0 lg file transmission:1000Octets reçus:1901314 (1.9 MB) Octets transmis:2818792 (2.8 MB)

  1. Observe characteristics of the Ethernet port on computer B,

comB > ethtool eth1

Settings for eth1:

Supported ports: [ TP ]

Supported link modes: 10000baseT/Full

Supported pause frame use: No

Supports auto-negotiation: No

Advertised link modes: 10000baseT/Full

Advertised pause frame use: No

Advertised auto-negotiation: No

Speed: 10000Mb/s

Duplex: Full

Port: Twisted Pair

PHYAD: 0

Transceiver: internal

Auto-negotiation: off

MDI-X: Unknown

Supports Wake-on: d

Wake-on: d

Current message level: 0x00000014 (20)

link ifdown

Link detected: yes

  1. Confirm that both port are up

comB > ibstat

CA ‘mlx4_0’

CA type: MT26428

Number of ports: 1

Firmware version: 2.8.600

Hardware version: b0

Node GUID: 0x0002c903004d58ee

System image GUID: 0x0002c903004d58f1

Port 1:

State: Active

Physical state: LinkUp

Rate: 10

Base lid: 0

LMC: 0

SM lid: 0

Capability mask: 0x00010000

Port GUID: 0x0202c9fffe4d58ee

Link layer: Ethernet

  1. Enable the wake-on-lan on computer B

comB > ethtool -s eth1 wol g

Cannot set new wake-on-lan settings: Operation not supported

not setting wol

What am I missing here ?

Any help is welcome !

I’m using Ubuntu 12.04 as operating system and here are characteristifs of both InfiniBand cards

ComA > lspci -v

01:00.0 InfiniBand: Mellanox Technologies MT26428 [ConnectX VPI PCIe 2.0 5GT/s - IB QDR / 10GigE] (rev b0)

Subsystem: Mellanox Technologies Device 0028

Physical Slot: 1

Flags: bus master, fast devsel, latency 0, IRQ 26

Memory at fb100000 (64-bit, non-prefetchable) [size=1M]

Memory at f2800000 (64-bit, prefetchable) [size=8M]

Capabilities: [40] Power Management version 3

Capabilities: [48] Vital Product Data

Capabilities: [9c] MSI-X: Enable+ Count=256 Masked-

Capabilities: [60] Express Endpoint, MSI 00

Capabilities: [100] Alternative Routing-ID Interpretation (ARI)

Capabilities: [148] Device Serial Number 00-02-c9-03-00-4d-58-ee

Kernel driver in use: mlx4_core

Kernel modules: mlx4_core

ComB > lspci -v

01:00.0 InfiniBand: Mellanox Technologies MT26428 [ConnectX VPI PCIe 2.0 5GT/s - IB QDR / 10GigE] (rev b0)

Subsystem: Mellanox Technologies Device 0028

Physical Slot: 1

Flags: bus master, fast devsel, latency 0, IRQ 26

Memory at fb100000 (64-bit, non-prefetchable) [size=1M]

Memory at f2800000 (64-bit, prefetchable) [size=8M]

Capabilities: [40] Power Management version 3

Capabilities: [48] Vital Product Data

Capabilities: [9c] MSI-X: Enable+ Count=256 Masked-

Capabilities: [60] Express Endpoint, MSI 00

Capabilities: [100] Alternative Routing-ID Interpretation (ARI)

Capabilities: [148] Device Serial Number 00-02-c9-03-00-4d-28-f0

Kernel driver in use: mlx4_core

Kernel modules: mlx4_core

2

Hi Raj,

The ini you have suggests the FW does not support WOL. Lets keep working within the case you have opened.

Thanks

3

Hi,

The WoL feature should be enabled in the .ini file of the device.

  1. What is the driver version you are using? (‘ofed_info -s’ would provide this info)

  2. What is the PSID and FW version of the card you have? (use the Mellanox Firmware Tools to get that info, by using the flint tool with query command)

  3. Once you have that we will revise the .ini and send you another binary to burn on the card (if it supports WoL).

Thanks,

Dan

4

Hello, I have ConnectX 2 card and WOL is not working either. Its running latest firmware 2.9.1200. Its not working in Linux and Windows either.

Can some one help me out on this? Thanks!