Hello,
I’ve put connectx 2 adapters into eth mode on two hosts, and connected them with a passive copper cable (QSFP). The link state comes up but I cannot get any connectivity between the hosts.
ib mode works when the hosts are connected to a switch so it seems like the cables and nics are working properly.
When I ping host A → host B in eth mode (no switch) I get no response. I do see rx_crc_errors which seems to point to a physical issue.
OS: CentOS 7
HostA:
ifconfig
eth0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500
inet 192.168.199.1 netmask 255.255.255.0 broadcast 192.168.199.255
inet6 fe80::f652:14ff:fed4:8035 prefixlen 64 scopeid 0x20
ether f4:52:14:d4:80:35 txqueuelen 1000 (Ethernet)
RX packets 0 bytes 0 (0.0 B)
RX errors 35 dropped 0 overruns 0 frame 35
TX packets 51 bytes 8429 (8.2 KiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
ethtool
rx_crc_errors: 35
Settings for eth0:
Supported ports: [ TP ]
Supported link modes: 10000baseT/Full
Supported pause frame use: No
Supports auto-negotiation: No
Advertised link modes: 10000baseT/Full
Advertised pause frame use: No
Advertised auto-negotiation: No
Speed: 10000Mb/s
Duplex: Full
Port: Twisted Pair
PHYAD: 0
Transceiver: internal
Auto-negotiation: off
MDI-X: Unknown
Supports Wake-on: d
Wake-on: d
Current message level: 0x00000014 (20)
link ifdown
Link detected: yes
driver: mlx4_en
version: 2.0 (Dec 2011)
firmware-version: 2.9.1000
bus-info: 0000:07:00.0
supports-statistics: yes
supports-test: yes
supports-eeprom-access: no
supports-register-dump: no
supports-priv-flags: no
HostB:
ifconfig
eth0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500
inet 192.168.199.2 netmask 255.255.255.0 broadcast 192.168.199.255
inet6 fe80::f652:14ff:fed4:8034 prefixlen 64 scopeid 0x20
ether f4:52:14:d4:80:34 txqueuelen 1000 (Ethernet)
RX packets 0 bytes 0 (0.0 B)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 38 bytes 6640 (6.4 KiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
ethtool
(no errors)
Settings for eth0:
Supported ports: [ TP ]
Supported link modes: 10000baseT/Full
Supported pause frame use: No
Supports auto-negotiation: No
Advertised link modes: 10000baseT/Full
Advertised pause frame use: No
Advertised auto-negotiation: No
Speed: 10000Mb/s
Duplex: Full
Port: Twisted Pair
PHYAD: 0
Transceiver: internal
Auto-negotiation: off
MDI-X: Unknown
Supports Wake-on: d
Wake-on: d
Current message level: 0x00000014 (20)
link ifdown
Link detected: yes
driver: mlx4_en
version: 2.0 (Dec 2011)
firmware-version: 2.9.1000
bus-info: 0000:06:00.0
supports-statistics: yes
supports-test: yes
supports-eeprom-access: no
supports-register-dump: no
supports-priv-flags: no