vSphere 6.0 PFC configuration for Ethernet iSER with Ethernet Driver 1.9.10.5

I want to use iSER on vSphere 6.0 environment.

I was setup SX6036G to enable PFC and PFC priority 3 & all ethernet port to support it.

But iSER initiator can see iSER Target but can’t connect to LUN.

I think last step is ESXi host configuration.

mlx4_en driver have a pfc configurtaion and here is some options.

esxcli system module parameters list -m=mlx4_en

Name Type Value Description


enable_device_rss int Enable device RSS (1 - enabled, 0 - disabled, default: 0)

This mode is not compatible with NETQ RSS. Once activated, NETQ RSS is disabled and all rings are managed by RSS

heap_initial int Initial heap size allocated for the driver.

heap_max int Maximum attainable heap size for the driver.

inline_thold uint threshold for using inline data

pfcrx int Priority based Flow Control policy on RX (0x0-0xff, default: 0x0)

It’s 8 bits bit mask, each bit indicates priority [0-7]. Bit value:

1 - respect pause frames on the specified priority.

0 - ignore pause frames on the specified priority.

pfctx int Priority based Flow Control policy on TX (0x0-0xff, default: 0x0)

It’s 8 bits bit mask, each bit indicates priority [0-7]. Bit value:

1 - respect pause frames on the specified priority.

0 - ignore pause frames on the specified priority.

rx_ring_size int RX ring size (64 -8192, default: 512)

Must be power of 2

skb_mpool_initial int Driver’s minimum private socket buffer memory pool size.

skb_mpool_max int Maximum attainable private socket buffer memory pool size for the driver.

tx_ring_size int TX ring size (64 -8192, default: 512)

Must be power of 2

udp_rss int Enable RSS for incoming UDP traffic (1 - enabled, 0 - disabled, default: 1)

How can I configure pfcrx, pfctx?

I tried pfcrx = 3, pfctx = 3 and pfcrx = 0x08, pfctx = 0x08

But 0x08 value shows a error in host profile because that’s not a supported values…:(

I found link in this communities.

HowTo Run RoCE and TCP over L2 Enabled with PFC https://community.mellanox.com/s/article/howto-run-roce-and-tcp-over-l2-enabled-with-pfc

How can I configure specific VLAN acts a loseless network with PFC?

Message was edited by: Jae-Hoon Choi

I you have configured mlx4_en.conf file properly as suggested below then you should be able to use pfc properly

+++++++++++++++++++++++++++++++

/etc/modprobe.d/mlx4_en.conf:

options mlx4_en pfctx=0x08 pfcrx=0x08

++++++++++++++++++++++++++++++++++++

try also to restart the driver after configuration by using /etc/init.d/opeibd restart

Rather then this, if loging into the target lun still fails, you should be re-checking if iser parms on bith initiator & target are configured as stated in Mellanox community

This environment is VMware ESXi, not a Linux one.

mlx4_en parameter must need integer value, not a 0x08!

HowTo Run RoCE over L2 Enabled with PFC (ESXi) https://community.mellanox.com/s/article/howto-run-roce-over-l2-enabled-with-pfc--esxi-x