Module 12MXL DCB <Place supporting graphic here>

Module Objectives:

• Describe DCB• Describe each of the four DCB protocols• Enable Tagging on the array using one of three methods• Configure the MXL for DCB• Use The Broadcom utility to configure Network Partitioning for

Microsoft Servers

DCB

What is DCB?

• Data Center Bridging (DCB) –Is a set IEEE Ethernet enhancements that provide data centers with the ability to converged network traffic into multiple traffic types, like (LAN), server, and storage traffic.

• Instead of deploying an Ethernet network for LAN traffic, and additional network for storage only one DCB-enabled network is required in a data center.

• The MXL switch supports a unified fabric and the ability to consolidate multiple network infrastructures .

• The server in this network uses a single input/output (I/O) device called a converged network adapter (CNA) to support DCB.

• A CNA is a computer input/output device that combines the functionality of a host bus adapter (HBA) with a network interface controller (NIC). Multiple adapters on different devices for several traffic types are no longer required.

DCB Protocols

To ensure lossless delivery and latency-sensitive scheduling of storage and service traffic and I/Oconvergence of LAN, storage, and server traffic over a unified fabric, IEEE data center bridging adds thefollowing extensions to a classical Ethernet network:

• 802.1Qbb - Priority-based Flow Control (PFC)• 802.1Qaz - Enhanced Transmission Selection (ETS)• 802.1Qau - Congestion Notification• Data Center Bridging Exchange (DCBX) protocol

dot1p priority queues as virtual transmit queues

Receive buffers

802.1Qbb (Priority-based Flow Control)

10GELink

HALT an individual stream, but NOT all of them!

Priority Based Flow Control (802.1Qbb)

Each Class needs to be created and priority assigned

76543210

• PFC pauses transmission of priority4 traffic

802.1Qaz (Enhanced Transmission Selection)

t1

5G

4G

1G

3G

4G

3G

10GELink

t2

Allocated bandwidth is based on the class of the traffic. Which will provide a

guarantee of bandwidth

Enhanced Transmission Selection (802.1Qaz)

Actual usage. If not all bandwidth is used it can be shared with other pipes.

Data Center Bridging compatibility eXchange (DCBX-802.1Qaz)

Built upon LLDP (802.1AB) Neighbors can configure parameters

based on TLV exchange Switch will configure the arrays and

servers the servers via iSCSI TLV using LLDP

End-to-End Communication between end-points. Tells the end-

point to BACK OFF!

Congestion Notification (802.1Qau)

Conformance

• Dell has published list of companies which integrate iSCSI over DCB into their Switch products

• http://en.community.dell.com/techcenter/storage/w/wiki/2632.storage-infrastructure-and-solutions-team-publications.aspx

• Components must support the iSCSI TLV. Many companies do not currently support iSCSI TLV with their DCB implementations.

DCB implementation

• Use of VLAN tags– In order to identify priorities, each frame is tagged with a

802.1Q tag– VLAN ID is part of the tag hence VLAN ID is required for

DCB– One VLAN ID for the group and is used for all SAN 10GE

interfaces (i.e., not including management network)• Switch support

– CEE/DCB-trunking/converged switchport mode required (differs by vendor)

– Using DCBX, switch communicates configuration to end-stations

Installation and Setup

Welcome to Group Manager

Copyright 2001-2011 Dell, Inc.

It appears that the storage array has not been configured.Would you like to configure the array now ? (y/n) [n]

Please run setup before executing management commandsIt appears that the storage array has not been configured. Please run setup before executing management commands.CLI> setup def_dcb_vlan_id 2 <<TAB IS YOUR FRIEND>>

Group Manager Setup Utility

The setup utility establishes the initial network and storage configuration for a storage array and then configures the array as a member of a new or existing group of arrays.

NOTE: There is currently no support for setting DCB VLAN

ID with the Remote Setup Wizard.

Create vlan via CLI and GUI

• grpparams dcb default-vlan-id or

Verifying DCB Operation (GUI)

Disable 802.3x flow control

Disable 802.3x flow control on SFP+ ports FTOS#configure FTOS(conf)#interface range tengigabitethernet 0/1 – 32 FTOS(conf-if-range-te-0/1-32,te-0/41-56)#no flowcontrol rx on tx off FTOS(conf-if-range-te-0/1-32,te-0/41-56)#exit

Disable 802.3 x flow control on QSFP ports FTOS(conf)#interface range fortyGigE 0/33 , fortyGigE 0/37 FTOS(conf-if-range-fo-0/33,fo-0/37)#no flowcontrol rx on tx off FTOS(conf-if-range-fo-0/33,fo-0/37)#exit

Enable DCB and reload

Enable DCB and reload If DCB was previously disabled, it must be manually re-enabled. To verify and enable DCB, enter the following commands: Note: This example shows DCB currently disabled and the steps to enable DCB. FTOS#show dcb FTOS#configure FTOS(conf)#dcb enable FTOS(conf)#dcb stack-unit all pfc-buffering pfc-ports 56 pfc-queues 2 FTOS(conf)#exit FTOS#copy running-config startup-config FTOS#reload    Note: The switch will reboot.

Create tagged VLAN for all ports and port-channels

Create tagged VLAN for all ports and port-channels FTOS(conf)#interface vlan VLAN-id Note: You must supply a VLAN id. The valid range is 2-4093. FTOS (conf-if-vl-100)#tagged tengigabitethernet 0/1-32 FTOS (conf-if-vl-100)#tagged tengigabitethernet 0/41-56 FTOS (conf-if-vl-100)#tagged port-channel 1 FTOS (conf-if-vl-100)#exit

Configure priority groups and policies

 Configure priority groups and policies

FTOS(conf)#dcb-input pfc FTOS(conf-dcb-in)#pfc priority 4 FTOS(conf-dcb-in)#exit

FTOS(conf)#priority-group iSCSI FTOS(conf-pg)#priority-list 4 FTOS(conf-pg)#set-pgid 1 FTOS(conf-pg)#exit   FTOS(conf)#priority-group OTHER FTOS(conf-pg)#priority-list 0-3,5-7 FTOS(conf-pg)#set-pgid 2 FTOS(conf-pg)#exit

FTOS(conf)#dcb-output etsFTOS(conf-dcb-out)#priority-group iSCSI qos-policy iSCSI FTOS(conf-dcb-out)#priority-group OTHER qos-policy OTHER FTOS(conf-dcb-out)#exit

FTOS (conf)#service-class dynamic dot1p

Configure ETS values

Configure ETS values FTOS#configure FTOS(conf)#qos-policy-output iSCSI ets FTOS(conf-qos-policy-out)#bandwidth-percentage 50 FTOS(conf-qos-policy-out)#exit

FTOS(conf)#qos-policy-output OTHER ets FTOS(conf-qos-policy-out)#bandwidth-percentage 50 FTOS(conf-qos-policy-out)#exit   Note: the total of all percentages must add up to 100 percent

Apply priorities to switch ports

 Apply priorities to switch ports

FTOS(conf)#interface range tengigabitethernet 0/1 – 32 FTOS(conf-if-range-te-0/1-32,te-0/41-56)#dcb-policy input pfc FTOS(conf-if-range-te-0/1-32,te-0/41-56)#dcb-policy output ets FTOS(conf-if-range-te-0/1-32,te-0/41-56)#protocol lldp FTOS(conf-if-range-te-0/1-32,te-0/41-56-lldp)#exit FTOS(conf-if-range-te-0/1-32,te-0/41-56)#exit

FTOS(conf)#interface range fortyGigE 0/33 , fortyGigE 0/37 FTOS(conf-if-range-fo-0/33,fo-0/37)#dcb-policy input pfc FTOS(conf-if-range-fo-0/33,fo-0/37)#dcb-policy output ets FTOS(conf-if-range-fo-0/33,fo-0/37)#exit FTOS(conf)#exit

 

Broadcom Active Control Suite

Broadcom Active Control Suite

Broadcom 57810S iSCSI VLAN configuration

• Here is the VLAN configuration for iSCSI traffic on the adapter port.

Initiator VLAN ID configuration

DCBX operation state and configuration verification• The DCB parameters shown are the values advertised by the

switch peer and accepted by the NIC port. It also indicates the DCB operational state for each feature.

Module Summary

• Now that you have completed this module you should be able to:• Describe DCB• Describe each of the four DCB protocols• Enable Tagging on the array using one of the three methods• Configure the MXL for DCB• Use The Broadcom utility to configure Network Partitioning for

Microsoft Servers

LabLab 12 – Converged Infrastructure Solution

• Configure the array for DCB and VLAN tagging

• Configure the MXL switch for DCB

• Use the Broadcom Utility to configure Network Partitioning

Questions?