Data Center Best Practices


#AvayaATF

Data Center Best Practices

Randy CrossInfrastructure & Fabric Technologies


©2013 Avaya Inc. All rights reserved

February 26-28, 2013 | Orlando, FL

Data Center Trends

• Confusion• Technology Soup

• SDN, cloud, fabric• Hype• Cisco

• Disappointment• Islands• Integration• Orchestration

• Solution Focus• Simplification• Monoliths• Disaster Avoidance

• Point Trends• ToR• Fixed Core• Modular Design

3




“No Soup for you!”

4

Software-Defined Networking is a work-in-progress…

SDN

Fabrics

Which has a long way to go to prove successful

802.11ac

Video Conf Infra

DCB

Geo VM Moves

APM

FCoE

Virtual Switch

Change Management

Energy Efficient EthernetIPv6Network Access ControlTelepresenceWanOpUnified Communications and CollaborationMEFMDMNetwork Performance Monitoring802.11nSIPADCSANFault MonitoringMPLSLocation Awareness…




Where to Begin?

• The Problem• Complexity• More with Less

• Or about the same• Resource Capacity• Refresh• New Builds

• Goals• Enable Business

Growth• Ensure Agility• Maximize Assets• Simplicity

5




Enable Business Growth

• Solutions• No more Silos• User Focused• Tied to Growth Initiatives

6




Ensure Agility

• Integrate the Stack• Virtualization EVERYWHERE• Pick the Right Technologies

• Policy/Controller• Fabric• Storage• WOC, ADC, Security, etc• HVAC

• Pick the Right Devices• ToR• Fixed vs Modular Core• Open Rack vs Blade Servers

7Rack 2 Rack 3 Rack 4

Row A

Row B

Row C




Maximize Assets

• Modular Design• Greenfield• Virtual Modular

Design

• DC to DC• Disaster Avoidance• User Experience

8

SPB-mode DToRFlexible: up to 480 Switches, 15,360 x 10GbE Ports, 259.2Tbps

Data Center 1

Avaya Fabric Connect




Proposed Recommended Link Speed Metrics

Link Speed (Gbps)

“Highest Available Bandwidth”

Recommended SPB NNI Link Metric

“Most Equitable Load Sharing” Recommended

SPB NNI Link Metric

Link Type VSP 7000 Virtual Ports

1 350 350 Ethernet n/a


20 (2x 10Gig MLT) 17 17 Ethernet n/a

40 9 5 Fabric Interconnect 1 (Blue)

80 5 5 Fabric Interconnect 2 (Red)


120 3 5 Fabric Interconnect

3 (Black)(Red also in LACP

mode)

9




Example: Highest Available BW

SPB-mode DToRFlexible Interconnect: up to 200 Switches (6,400 10GbE Ports & 112 Tbps)

Row A

Row B

Row C

Row D

VSP 9000 AVRRP Master

or RSMLT

VSP 9000 BVRRP Backup

or RSMLT

Rack 1 Rack 2 Rack 3 Rack 4

Using defined SPB Path Costs

Using manually assigned SPB cost metrics, traffic is assured to always use the most effective path.

Examples:

Row A Rack 1 L2 to B3 = 17

Row B Rack 4 L2 to C2 = 17

Row D Rack 2 L2 to A4 = 35

Row A Rack 4 L2 to D1 = 32

Row A Rack 1 (L3 traffic) to VSP9K A VRRP Master = 40 (5+35)

VSP9K A (L3 traffic) to Row D Rack 4 = 35 (direct 10Gig)

VSP9K A (L3 traffic to Row D Rack 1 = 40 (35+5)

Rear Port Mode with SPBFI Port legend:• Black – 120/240 Gbps• Red – 80/160 Gbps• Blue – 40/80 Gbps (Full-Duplex/Aggregate) SBP Manually Assigned “Highest Available

Bandwidth” Cost Metrics• Black = 3• Red = 5• Blue = 9• 10Gig = 35

MLT NNI

10




Example: Most EquitableSPB-mode DToR

Flexible Interconnect: up to 200 Switches (6,400 10GbE Ports & 112 Tbps)

Row A

Row B

Row C

Row D

VSP 9000 AVRRP Master

or RSMLT

VSP 9000 BVRRP Backup

or RSMLT

Rack 1 Rack 2 Rack 3 Rack 4

Using defined SPB Path Costs

Using manually assigned SPB cost metrics, traffic is assured to always use the most effective path.

Examples:

Row A Rack 1 L2 to B3 = 25

Row B Rack 4 L2 to C2 = 15

Row D Rack 2 L2 to A4 = 25

Row A Rack 4 L2 to D1 = 30

Row A Rack 1 (L3 traffic) to VSP9K A VRRP Master = 50 (15+35)

VSP9K A (L3 traffic) to Row D Rack 4 = 35 (direct 10Gig)

VSP9K A (L3 traffic to Row D Rack 1 = 50 (35+15)

Rear Port Mode with SPBFI Port legend:• Black – 120/240 Gbps• Red – 80/160 Gbps• Blue – 40/80 Gbps (Full-Duplex/Aggregate) SBP Manually Assigned “Most Equitable

Load Sharing” Cost Metrics• Black = 5• Red = 5• Blue = 5• 10Gig = 35

MLT NNI

11




Multi Data Center Optimization

Data Center A Data Center B

IST/NNIIST/NNI

NNI

NNI NNI NNI

NNINNI

VLAN 10

ISID 10

VLAN 10 ISID 10

VLAN 10

ISID 10

VLAN 10ISID 10

10.10.10.2

10.10.10.3

10.10.10.4

10.10.10.5

VM

Gateway is 10.10.10.1

ESXHost

ESXHost

BCB or BEBs BCB or BEB’sBEB’s w/ L2 VSN

for servers+ L3 VSN for

network access

VLAN 200 L3 ISID

500L3 ISID

500

L3 ISID500

VLAN400

VLAN300

VLAN500

VLAN 100

L3 VSN I-SID 500 supporting VRF routing to multiple

locationsVLAN600

BEB’s w/ L2 VSN for servers

+ L3 VSN for network access

Client

VRRP-BM

VRRP VR 10.10.10.1

12




Simplicity

• Automation• Orchestration• SDN

• Solutions• Full Stack• Monolithic vs Best-of-

Breed• Support• Trust

13




Summary

• Don’t get sucked into the drama!• K.I.S.S.• Be Farsighted• Get Your Money’s Worth• Be a Hero: Grow the Business

14

Simplicity is the ultimate

sophistication.- Leonardo Da Vinci


Thank you!#AvayaATF

15

Data Center Best Practices

Documents

Transcript of Data Center Best Practices