SX1016 trunked to a Brocade SX800

Hi Everyone,

Thought i would ask question here to see if anyone has seen this before or give me some more pointers.

So i have a SX1016 configured with a port channel trunk to a Brocade SX800

On the SX1016 end port channel is configured as hybrid so its sending both untagged and tagged vlans.

Trunk on the Brocade is configured the same.

Attached to the SX1016 are windows 2012 servers with 10g uplinks. These ports are set to hybrid as well.

The issue is i have several machines on vlan 2 and vlan 3 that are sending out requests for dhcp. The replies they are getting back are for the default vlan.

This is where it gets interesting as even though the virtual machine is on vlan 2 it has an ip from the default vlan and is communicating over the trunk as though it was in the default vlan.

What i see from the SX1016 side is the packet coming in off the trunk in vlan 2 and then appearing on the default vlan.

Any thought?

Regards, Rob

Hi Rob,

I am not sure what is causing this. I would probably suggest opening a support ticket with the support group.

mailto://support@mellanox.com mailto://support@mellanox.com

Thanks

For those watching this thread.

I believe i’m closer to sorting out what the problem is.

What we are seeing is a type of Q in Q .

I’m starting to think that this switch has some network virtualization bits enabled in it.

Will confirm more in the next few days.

Hi Yairi,

We have just purchased silver support from colfax for this switch and are currently waiting on login details for the mellanox support website.

Regards, Rob

Hi Anand,

Yes. I agree with you 100% on that one. At the moment we are using the default vlan for specific switch traffic but the plan is to move this out to a vlan.

Currently the switch is connected to a Brocade SuperX Chassis via a 2 port 10G module. This module is configured exactly the same as the SX800 and runs without fault.

I did test the SX800 with the LAG on the SX1016 configured for both trunk and hybrid mode but it made no difference.

Regards, Rob

Interface | Mode | Access vlan | Allowed vlans

-----------|------------|-------------|---------------------------

Eth1/1 hybrid 1 2, 3, 8, 9, 10, 11, 14, 15, 16

17, 18, 19, 22, 24, 27, 32, 37

38, 39, 52, 54, 100

Eth1/2 hybrid 1 2, 3, 8, 9, 10, 11, 14, 15, 16

17, 18, 19, 22, 24, 27, 32, 37

38, 39, 52, 54, 100

Eth1/3 hybrid 1 2, 3, 8, 9, 10, 11, 14, 15, 16

17, 18, 19, 22, 24, 27, 32, 37

38, 39, 52, 54, 100

Eth1/4 access-dcb 1

Eth1/5 access 1

Eth1/6 access-dcb 54

Eth1/7 access-dcb 38

Eth1/8 access-dcb 38

Eth1/9 access 54

Eth1/10 access-dcb 38

Eth1/11 access-dcb 54

Eth1/12 access 54

Eth1/13 access-dcb 54

Eth1/14 access-dcb 38

Eth1/15 access 54

Eth1/16 access-dcb 38

Eth1/17 access-dcb 54

Eth1/18 access 54

Eth1/19 access 1

Eth1/20 access 1

Eth1/21 access 1

Eth1/22 access 1

Eth1/23 access 1

Eth1/24 access 1

Eth1/25 access-dcb 54

Eth1/26 access-dcb 38

Eth1/27 access 1

Eth1/28 access 1

Eth1/29 access 1

Eth1/30 access 1

Eth1/31 hybrid 1 2, 3, 8, 9, 10, 11, 14, 15, 16

17, 18, 19, 22, 24, 27, 32, 37

38, 39, 52, 54, 100

Eth1/32 hybrid 1 2, 3, 8, 9, 10, 11, 14, 15, 16

17, 18, 19, 22, 24, 27, 32, 37

38, 39, 52, 54, 100

Eth1/33 hybrid 1 2, 3, 8, 9, 10, 11, 14, 15, 16

17, 18, 19, 22, 24, 27, 32, 37

38, 39, 52, 54, 100

Eth1/35 access 1

Eth1/36 access 1

Eth1/37 access 1

Eth1/38 access 1

Eth1/39 access 1

Eth1/40 access 1

Eth1/41 hybrid 1 2, 3, 8, 9, 10, 11, 14, 15, 16

17, 18, 19, 22, 24, 27, 32, 37

38, 39, 52, 54, 100

Eth1/42 access 54

Eth1/43 hybrid 1 2, 3, 8, 9, 10, 11, 14, 15, 16

17, 18, 19, 22, 24, 27, 32, 37

38, 39, 52, 54, 100

Eth1/44 access-dcb 38

Eth1/45 access 1

Eth1/46 access 1

Eth1/47 access-dcb 54

Eth1/48 hybrid 1 2, 3, 8, 9, 10, 11, 14, 15, 16

17, 18, 19, 22, 24, 27, 32, 37

38, 39, 52, 54, 100

Eth1/49 access-dcb 54

Eth1/50 access 1

Eth1/51 access 1

Eth1/52 access 1

Eth1/53 access 1

Eth1/54 hybrid 54 1, 2, 3, 8, 9, 10, 11, 14, 15, 16

17, 18, 19, 22, 24, 27, 32, 37

38, 39, 52, 100

Eth1/55 hybrid 1 2, 3, 8, 9, 10, 11, 14, 15, 16

17, 18, 19, 22, 24, 27, 32, 37

38, 39, 52, 54, 100

Eth1/56 access-dcb 1

Eth1/57 access 1

Eth1/58 access 1

Eth1/59 access 100

Eth1/60 access-dcb 54

Eth1/61 access-dcb 38

Eth1/62 hybrid 1 2, 3, 8, 9, 10, 11, 14, 15, 16

17, 18, 19, 22, 24, 27, 32, 37

38, 39, 52, 54, 100

Eth1/63 access 1

Eth1/64 access 1

Po1 hybrid 1 2, 3, 8, 9, 10, 11, 14, 15, 16

17, 18, 19, 22, 24, 27, 32, 37

38, 39, 52, 54, 100

switch-638a12 [standalone: master] #

Rob,

In general Untagged traffic is mapped to default vlan. My personal best practice rule is to keep all uplink ports as tagged and server ports as hybrid.

Is there a reason you are using hybrid ports on the LAG between SX1016 and the Brocade switch?

Is your server sending tagged or untagged traffic?

Could you also provide the output of show interfaces switchport on the SX1016?

Thanks

Anand

If your server sends untagged traffic, then it will be mapped to default vlan. Where is your server connected and is it sending tagged traffic?

Anand

Hi Anand,

The servers i have attached to this switch are quad node chassis. The uplinks are using connect-x 2 adapters.

The servers are running hyper-v. The connect-x 2 is configured as a vswitch with no management access. So all traffic from the vm’s is tagged. The only time a vm is untagged is if we are monitoring the network.

The error that appeared was traffic from a vm tagged for 2 recieved an ip address back thats in the default vlan only.

Looking at the switch the mac address was in vlan 2 and the untagged vlan which should not happen.

There seems to be a layer 2 issue here as the machines tagged for 3 or higher werent suffering from this problem.

Rob

Hey,

I am new user and i am not able to find “ask new question” option anywhere to writing here, I have many HP c7000 chassis and trying to find good mellanox NIC card which support DL 460c Gen9 blade because i want to run SR-IOV for high performance networking, could you please provide guidance ?