ESXi Underlying device does not support requested gid/RoCE type. Failed with status: Protocol not supported

Hello,

i have an ESXI Server with two Mellanox Cards and an iser ISCSI Target one Card is working and i can see the iser Target but the other does not see the target and i don’t know why

i have to user ROCEv1 and disabled ROCEV2 in the VMKernel Paramters with:

esxcli system settings kernel set -s rdmaRoceIPBasedGidGeneration -v FALSE

This Connection is working:

2019-07-15T12:03:06.437Z cpu20:2098576)iser: iser_EPConnect: src ipv4 172.28.224.20

2019-07-15T12:03:06.437Z cpu20:2098576)iser: iser_EPConnect: dst ipv4 172.28.224.6

2019-07-15T12:03:06.437Z cpu20:2098576)WARNING: rdmaDriver: RDMAGetValidGidType:1907: IP-based GID generation not enabledfor ROCEV2

2019-07-15T12:03:06.437Z cpu20:2098576)WARNING: rdmaDriver: RDMACM_BindLegacy:3290: Underlying device does not support requested gid/RoCE type. Failed with status: Protocol not supported

2019-07-15T12:03:06.451Z cpu45:2097942)iser: iser_RDMACMEventHandler: iser conn 0x430dfb1ee650 cm event 0

2019-07-15T12:03:06.451Z cpu17:2098070)iser: iser_RDMACMEventHandler: iser conn 0x430dfb1ee650 cm event 2

2019-07-15T12:03:06.457Z cpu17:2098070)iser: iser_ComplSlabInit: min 0 max 41048

2019-07-15T12:03:06.457Z cpu17:2098070)iser: iser_RouteResolvedHandler: iser conn: 0x430dfb1ee650 uplink: vmnic4

2019-07-15T12:03:06.457Z cpu15:2098646)iser: iser_DisconnectWorld: 0x430dfb1ee650 iser conn disconnect world init

2019-07-15T12:03:06.483Z cpu15:2098006)iser: iser_RDMACMEventHandler: iser conn 0x430dfb1ee650 cm event 9

2019-07-15T12:03:06.701Z cpu20:2098576)iser: iser_EPPoll: Polling ep/iser_conn 0x430dfb1ee650 transport 0x430dfb1d8be0 timeoutMS 1

2019-07-15T12:03:06.704Z cpu20:2098576)iser: iser_TransportBindConnection: session 0x430dfb1d9d90 iscsi_conn 0x430dfb209470 iser_conn 0x430dfb1ee650

2019-07-15T12:03:07.728Z cpu20:2098576)iser: iser_TransportStartConnection: session 0x430dfb1d9d90 conn 0x430dfb209470

and this one not:

2019-07-15T12:03:08.027Z cpu20:2098576)iser: iser_EPConnect: src ipv4 172.28.224.25

2019-07-15T12:03:08.027Z cpu20:2098576)iser: iser_EPConnect: dst ipv4 172.28.224.6

2019-07-15T12:03:08.027Z cpu20:2098576)WARNING: rdmaDriver: RDMAGetValidGidType:1907: IP-based GID generation not enabledfor ROCEV2

2019-07-15T12:03:08.027Z cpu20:2098576)WARNING: rdmaDriver: RDMACM_BindLegacy:3290: Underlying device does not support requested gid/RoCE type. Failed with status: Protocol not supported

2019-07-15T12:03:08.042Z cpu45:2097942)iser: iser_RDMACMEventHandler: iser conn 0x430dfb334070 cm event 0

2019-07-15T12:03:08.042Z cpu17:2098070)iser: iser_RDMACMEventHandler: iser conn 0x430dfb334070 cm event 2

2019-07-15T12:03:08.048Z cpu17:2098070)iser: iser_ComplSlabInit: min 0 max 41048

2019-07-15T12:03:08.048Z cpu17:2098070)iser: iser_RouteResolvedHandler: iser conn: 0x430dfb334070 uplink: vmnic6

2019-07-15T12:03:08.048Z cpu33:2098647)iser: iser_DisconnectWorld: 0x430dfb334070 iser conn disconnect world init

2019-07-15T12:03:08.054Z cpu15:2098006)iser: iser_RDMACMEventHandler: iser conn 0x430dfb334070 cm event 9

2019-07-15T12:03:08.294Z cpu20:2098576)iser: iser_EPPoll: Polling ep/iser_conn 0x430dfb334070 transport 0x430dfb1d91a0 timeoutMS 1

2019-07-15T12:03:08.297Z cpu20:2098576)iser: iser_TransportCreateSession: transport=0x430dfb1d91a0 maxCmds=128 qDepth=32 initialCmdSN=0 channelID=0 targetID=0

2019-07-15T12:03:08.297Z cpu20:2098576)iser: iser_TransportBindConnection: session 0x430dfb335300 iscsi_conn 0x430dfb34f170 iser_conn 0x430dfb334070

2019-07-15T12:03:45.645Z cpu20:2098576)iser: iser_TransportStopConnection: stopping iser_conn 0x430dfb334070, iscsi_conn 0x430dfb34f170, mode 1

2019-07-15T12:03:45.647Z cpu15:2098006)iser: iser_RDMACMEventHandler: iser conn 0x430dfb334070 cm event 10

2019-07-15T12:03:45.647Z cpu20:2098576)iser: iser_EPDisconnect: transport 0x430dfb1d91a0 ep 0x430dfb334070

2019-07-15T12:03:45.647Z cpu20:2098576)iser: iser_EPDisconnect: Waiting for QP to transition to error state …

2019-07-15T12:03:45.657Z cpu20:2098576)iser: iser_EPDisconnect: Cleaning up ep: 0x430dfb334070

2019-07-15T12:03:45.657Z cpu20:2098576)iser: iser_FreeIbConnRes: freeing iser_conn 0x430dfb334070 ib resources

2019-07-15T12:03:46.434Z cpu33:2098647)iser: iser_DisconnectWorld: 0x430dfb334070 iser conn disconnect world wake up: World is marked for death

2019-07-15T12:03:46.434Z cpu33:2098647)iser: iser_DisconnectWorld: 0x430dfb334070 disconnect world wokeup

any help would be great.

Greetings,

Peter

Hi Peter,

I will be opening a case on your behalf as you are a contracted customer and based on the description of your issue, further analysis will be needed upon relevant data collected.

Thank you,

Sophie.