NEXT INFRASTRUCTURE IN A FUTURE Infra in future KU.pdf · NEXT INFRASTRUCTURE IN A FUTURE ... 3G/...

NEXT INFRASTRUCTURE IN A FUTUREYingyot Malawilas

Technical Consultant

Dec 2,2010

© 2010 Brocade Communications Systems, Inc. Company Proprietary Information 1

Data Center Challenges & Industry Trends

12/2/2010© 2010 Brocade Communications Systems, Inc. Company Proprietary Information 2

Today the Compute Model Is Reversed


The Customer Experience Comes First

Amazon.com

Hulu

GoogleSAP

Business Intelligence

Exchange

Outlook

Oracle

Business Objects

OCS

SharePoint

Salesforce.com

CNN.com

Facebook

Online Training

Unified Communications

Virtual Desktops

Netflix

iTunes

YouTube eTradePayPal

LinkedIn

Mint

Quicken

RSS

CRM

HR

Intranet E-commerce

COMPUTE

STORAGE

iApp

IM

Online Banking

FinancialReporting

OnlineGaming ERP

NETWORK


MARKET TRENDS

Skyrocketing Data Growth and Network Complexity

1. Search Storage, May 2010

Digital Data Createdby Individuals in 20101

Digital Data Forecastedby 20201

Growth in Virtual Machines by 20121

>900 EB

> 35 ZB

10X12/2/2010© 2010 Brocade Communications Systems, Inc. Company Proprietary Information 6

Internet Usage Growth 2013

2008 ACTUAL ONLINE POPULATION

2013 PROJECTED ONLINE POPULATION

482.1M

937.7M

224.6M

287.3M

238.8M

246.1M

157.1M

380.7M

111.1M

560.2M

Source: Forrester Research Internet Population Forecast, 4/09 (Global)


1010101000000111111101010101001010010011111111110011010001010101011111010000100010101010000101010101010101010101000000111111101010101001010010011111111110011010001010101011111010000100010101010000

35 ZB

(ZETTABYTES)

2020Source: IDC and EMC, May 10, 2010

MARKET TRENDS

The Dawn of the Virtual Enterprise

15 BDEVICES

2015Source: CIOL.com, November 2008


Major Trends

TRAFFIC GROWTH


TRAFFIC GROWTH VIRTUALIZATION

Major Trends


TRAFFIC GROWTH VIRTUALIZATION SIMPLIFICATION

Major Trends


TRAFFIC GROWTH BORDERLESS COMPUTINGVIRTUALIZATION SIMPLIFICATION

Major Trends


Impact on the Data Center


Unabated Traffic Growth In Core Networks

40-60% annual growth in most core networks

Traffic growth at world’s largest Internet exchange point over the last decade

800 Gbps (Oct 2009)

400 Gbps (Jul 2008)

Continued traffic growth even through recession


Explosion in Mobile Networks

Broadband growth

Source: Infonetics

2G/2.5G Node B

BTST1/E1

T1/E1

SONET/SDHNetwork

Wireless OperatorBase Stations

Backhaul Provider

BTS

3G/4G Node B

T1/E1

Ethernet

MPLSor

Ethernet

Impact: Massive mobile trafficNeed: Metro backhaul transitions from T1 to Ethernet


The perfect Storm is brewing

The network is experiencing massive growth in data and traffic, and will need to evolve


THE ENTIRE NETWORKIS YOUR DATA CENTER


Application Performance Drives Business Success

A 100 ms delay in Amazon.com’s

e-commerce site costs them

1% in sales

Healthcare manufacturer gains employee productivity via 4x improvement in SAP performance


Data Center & Network Evolution


Blade Chassis

High Density Rack

Server Consolidation Enabled by blade server and dense rack systems

• Increasing the compute power through density

• Optimize power and cooling by design

• Modularize deployment methods

• Access gateway to simplify management

Server Blade and Rack solutions enabling the Green Data Center

c 7 0 00

B CH T

PhysicalServers


50% switch utilization

40% storage utilization

30% tape utilization

ERP

CRM

E-mail

90% switch utilization

85% storage utilization

80% tapeutilization

Consolidated SANShared access to data for efficient resource useCentralized managementOptimal utilizationCost-effective for high ROI

SAN IslandsComplex, expensive to manageVarying availabilityExpensive to scalePoor resource utilization (captive storage, switch ports,

tape)

SAN Consolidation Benefits

Fab A

Fab BFabric A

Fabric B

E-mail, CRM & ERP

40%30%50%

85% 80%80%


Take Cost out with Storage Consolidation

Network

Application Servers Exchange Databases

Protocol Connectivity – iSCSI, Fibre Channel, NAS (CIFS, NFS)File Servers - FS1, FS2, FS3, FS4Tiered Storage – Flash, Fibre Channel, SATA, LP-SATABackup/Archive – Archive, Backup, DeduplicationBusiness Continuity / DR – Snaps, Clones, Remote Replication


Data Center Construction

COMPUTE

NETWORK

STORAGE

App

Past

Traditional ConstructionManual

ReplicationRigid

Inflexible

70%Operating Cost

15%Utilization


COMPUTE

NETWORK

STORAGE


COMPUTE

NETWORK

STORAGE

App

Past Present

Early VMs

Escalating

Complexity50%

Virtual Apps (2012)1

1 Source: Gartner, March 201012/2/2010© 2010 Brocade Communications Systems, Inc. Company Proprietary Information 27

COMPUTE

NETWORK

STORAGE


COMPUTE

NETWORK

STORAGE

App VMs

Past FuturePresent

Early VMs

Simplify Automate Scale


Cloud ComputingWhat is it?

VIRTUALIZED

DATACENTER

BUSINESS POLICY

CLOUD COMPUTIN

G


Cloud ImplicationsThe Dawn of the Virtual Enterprise

Public Cloud

Acme Corp. Data Center

Software as a Service (SaaS)Infrastructure as a Service

Platform as a Service

Infrastructure as a Service (IaaS)

Platform as a Service (PaaS)

Private Cloud

Acme Corp.


Virtual

Private

Cloud

Virtual Data Centers Are Key

Physical

Community

Cloud

Public

Cloud

Storage

Cloud

Hybrid

Cloud


MARKET TRENDS: DATA CENTER

The Dawn of the Virtual Enterprise

Centralized Distributed

Mainframe

Mini Computers

Client/Server

Tra

ffic

V

olu

me

Internet, Web 2.0

PAST FUTURE

Virtual Enterprise


Storage

Network

Compute

The Network Is Central to the CloudVirtualization Brings New Requirements and Challenges

APPOS

VM

APPOS

VM

APPOS

VM

APPOS

VM

MobilityChallenges

•Network performance/scalability constraints

•Application resiliency and performance under load

•VM mobility limits

•Infrastructure complexity

•Management silos


Why can’t we get there ?


Challenges of Current Data Center Networks

• Layer 2 performance, scalability, reliability• Limitations of Spanning Tree Protocol (STP)

• Scaling virtual server environments

• Virtual machine mobility• Must run in Layer 2; IP address stays the

same• Enforce the same policies and permissions

• Infrastructure complexity• Lots of switches to manage• Layer 3 protocols to the edge

• Management overhead• High operational costs

Must Be Solved for Virtualized Data Centers

Challenges


Scaling Virtual Server EnvironmentsChallenges Today

Layer 2: Only one active path

• STP disables other paths

• Not “virtualization-optimized”

Add virtual machines

• Add 1 GbE connections

• Move to 10 GbE for simplicity and higher performance

• Uplinks are stressed; need more connections in LAG

Increase utilization using MSTP (spanning tree per VLAN)

• Increases complexity

• Creates multiple single-path networks; limits sphere of mobility

Link failure

• STP reconvergence; network is down

• Broadcast storms stress network

Layer 3 as an alternative

• Greater complexity; higher cost

• VM mobility limited to rack


Cumbersome Virtual Machine MobilityChallenges Today

Limited sphere of mobility

• STP limits flexibility to a minimized, defined tree of switches

• Layer 3 limits mobility to a single rack

VM migration can break network/application access

• Port setting information must be identical at destination

Map services (VLANs, QoS, security) to all physical ports

• Eases mobility but undermines network and security best practices

Distributed Virtual Switch

• Addresses configuration needs but consumes server resources and is still restricted by physical limits

Limited insight into where VMs are running

• VMs exist anywhere in the cluster

L2STP

L3 toAgg. Layer

! ! ! !Distributed

vSwitch

? ? ? ?


NIC

Management

HBA

Management

Blade Switch

Management

LAN

Mgmt.

Complex Management

• Too many network layers and protocols

• Number of managed switches at the edge

• Configuration time when deploying new switches

• Separate management tools for LAN, SAN, and NICs/HBAs

Challenges Today

CoreLayer 3

BGP, EIGRP,

OSPF, PIM

Aggregation/

DistributionLayer 2/3

IS-IS, OSPF,

PIM, RIP

Access

(fixed,

bladed)Layer 2/3

STP, OSPF,

PLD, UDLD

SAN

Management

SAN


The impact of Network Convergence


Convergence 2.0

STORAGENETWORK

DATANETWORK

CONVERGED

NETWORK12/2/2010© 2010 Brocade Communications Systems, Inc. Company Proprietary Information 41


Today: Before Unified I/OToday:

Parallel SAN and LAN Potentially less optimal use of

networks Four or more connections per server:

– Higher adapter and cabling costs– Adds cap-ex and op-ex– Each connection adds potential points

of failure in the fabric

Slower server provisioning Additional redundancy due to

separate physical infrastructures Separate management realms Ethernet

FC

LAN SAN A SAN B

FC HBAs(FC Traffic)

NICs(Ethernet Traffic)


Unified I/O Use Case

Unified I/O

One fabric infrastructure Fibre Channel and DCB L2/L3

multipathing end-to-end Fewer components to deploy

Lower TCO (future) Disk arrays, FICON, and tape will

require Fibre Channel for years to come

FCoE Switch

Top-of-the-RackSwitches

Converged HBAs(CEE/FCoE Traffic)

Storage

SAN

FCoE Switch

CorporateLAN

Ethernet

FC

CEE and FCoE


Fibre Channel over Ethernet (FCoE)

Encapsulates FC frames over DCB

Leverages the rich set of FC fabric services for storage connectivity

A mechanism to carry the Fibre Channel protocol on top of Data Center Bridging

Preserves investment in Fibre Channel SAN infrastructure

Converged server connectivity through one physical connection

Application

Middleware

ConvergedEnhanced Ethernet

10 GigE Physical

EthernetLink

FCoE Traffic

HPCIP

Name services, zoning, WWN structure, management, multipathing

HPCStack

FCoEStack

IPStack


Enhancement through StandardsConverged Enhanced Ethernet

FC-2

FC-3

FC-4

Layer 2

Layer 1

FCoE

Use of IEEE 802.1p:Multiple logical lanes

Use of Per-Priority PauseClass-Based Flow Control

+IEEE 802.1au:

Congestion Notification

Converged EnhancedEthernet

BrocadeDifferentiation

Rack Design Before DCB

• 88 Total connections (2 each)

• 44 Ethernet connections• access layer distribution layer link ratio of

11:1 typical (22 to 2)

• Minimal oversubscription (22x1GbE to 2x10GbE)

• 44 FC SAN connections (2 each)

• access layer distribution layer link ratio of 3:1 typical (22 to 8)

• Typically 1.5-3:1 oversubscribed (4 or 8Gb FC links to 8Gb ISLs)

10 GbE SFP+

8 Gbps FC SFP+

2

22 1U servers2 Ethernet

switches• 24 1000BaseT,

4 10 GbE ports2 Fibre Channel

switches • 16-32 8 Gbps FC

ports

1000 BaseT RJ454 or 8 Gbps FC SFP+ LAN

SAN A

SAN B

8

8

2

FC LinkEthernet Link


Rack Design with DCB

• 44 Server connections with CEE/FCoE• Half the links from previous slide

• Leverages 10Gb CEE & 8GB FC for uplinks

• Ratios are similar as 10Gb CEE shared between network and storage (assuming similar traffic)• If network traffic increase Ethernet ratio

can increase• Blade servers with integrated switch

cards go straight to distribution or core

22 1U servers2 FCoE switches• 24 10 Gb CEE

SFP+ ports and 8 8 Gbps FC SFP+ ports

10 Gb CEE Links via SFP+ interface, mostly Twinax to 1, 3, or 5 meters

8 Gbps FC SFP+

2

LAN

SAN A

SAN B

8

8

2

10 GbE SFP+

FC LinkEthernet Link


ConvergenceEnabling more than just simplification – breaking down the walls


The solution unveiled


Imagine if…

• There was no requirement for STP in Layer 2 networks• All paths in the networks were utilized with traffic automatically

distributed• Link failure did not result in a temporary outage and paths were

always deterministic• The network provided low latency, lossless transmission and

could carry both IP and storage traffic, without compromise

1st Ethernet FabricEthernet

Fabric


Imagine if…

• You could move a VM personality with the VM• Your network was aware of all VMs at all times• Mobility did not come with a cost in compute resources• You could leverage your entire server environment to maximize

application performance and availability

1st Intelligent

Layer 2 NetworkDistributed

Intelligence

Ethernet

Fabric


Imagine if…

• You could logically eliminate a layer of the network• You could connect 10, 20… edge switches and manage them as

one• You could scale the network without added complexity• There was a common tool to manage all components of the SAN

and LAN

1st 1000 Port

Logical ChassisEthernet

Fabric

Distributed

IntelligenceLogical

Chassis


Intelligent Services

• Complex to engineer, deploy, and manage

• Static and rigid

• Leads to reconfiguration and connectivity interruption

Challenges Today

1 GbE

ToR Stack 1/10 GbE

ToR

1 GbE

MVRF/MPLS ToR

1/10 GbE

Modular MoR

10 GbE

L2-3

Core Routing

10, 40, 100 GbE

L3, Adv

10, 40, 100 GbE

L2-3, Adv

Service InsertionPoints

WAN

Optimization

Service InsertionPoints

L4-7 Aggregation

Layer

10, 40, L2-3FCoE

VCS

Dynamic Services Insertion

Ethernet

Fabric

Distributed

Intelligence

Logical

Chassis


Dynamic Services

Add services into the VCS fabric• Extends the capabilities of VCS

• Fabric extension, native Fibre Channel, security services, Layer 4–7, and more

Purpose-designed hardware• Switches with unique functionality

can be added to the VCS fabric

• Like service modules in a chassis

• Functionality available to the entire VCS fabric

Native Fibre

Channel

Fabric

Extension

Security

Services

Layer 4–7

Brocade Solution

VCS

Dynamic Services Insertion

Ethernet

Fabric

Distributed

Intelligence

Logical

Chassis


Virtual Cluster Switching (VCS) – a new reality

Logically flattens and collapses network layersScale edge and manage as if single switchAuto-configuration Centralized or distributed mgmt; end-to-end

Self-formingArbitrary topologyNetwork aware of all members, devices, VMsMasterless control, no reconfigurationVAL interaction

No Spanning Tree ProtocolMulti-path, deterministicAuto-healing, non-disruptiveLossless, low latencyConvergence-ready

Ethernet

FabricDistributed

Intelligence

Logical

Chassis

Connectivity over Distance, Native Fibre Channel,

Security Services, Layer 4-7, etc.

Dynamic Services


CORE TECHNOLOGY

Virtual Access Layer (VAL) FunctionalityApplication-aware networking

VALLogical construct that extends network connectivity to VMs

Optimizes application service levels and scalability

Allows per-VM QoS, connectivity persistence, and visibility

Supports emerging IEEE Edge Virtual Bridging standards


Further innovation in a Virtualized world


15

10

5

0Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec

Application Delivery in Virtualized Server EnvironmentsCapacity Planning Challenges

• Resource planning is increasingly difficult

• Server consolidation decreases historic capacity buffers

• Virtualization does not recapture unused resources

Resources idle 66% of the time

Missed SLA

• Over-provisioning leaves costly resources idle

• Under-provisioning results in missed application SLAs Predicted Load: Financial Reporting App

Resources Provisioned (125% of Peak)

Actual Load Seen: Load Accurately PredictedActual Load Seen: Load Greater than Predicted

ExampleFinancial Reporting Application

Resource Requirements


Ecosystem AdvantageIntegrated Solutions for Server Virtualization

Application Resource Broker (ARB) Monitoring, Analysis and Provisioning Engine

ARB monitors response time and number of client connections to application servers

ARB plug-in for VMware vCenter (tab in vSphere client) monitors CPU utilization

ARB intelligently recommends and automates provisioning and de-provisioning of application resources (VMs)

Avoids costly over-provisioning and broken SLAs

WAN

BrocadeVisionChallengeEvolutionGap

VM VM VM VMVM VM

VM MGMT

SAN

LAN

!

!!


Choice without compromise and Investment Protection


Ecosystem PlatformProviding investment protection and best-of-class choice for highly virtualized networks

NETWORK

SERVER

HYPERVISOR

SECURITY

STORAGE

Hyper-V

VCS


http://www.mcafee.com/common/redirectgeneric.asp?rurl=/us/default.asp

SOLUTIONS PORTFOLIO

Open Virtual Compute Blocks

16 TB

50

1000 VMs

VCS

EqualLogic

NETWORK

STORAGE

HYPERVISOR

SERVER

VCS

$5

00

$1000

$5

00

0

iSCSI

Cost estimates based on North American Manufacturer published list prices as of 5/15/2010


SOLUTIONS PORTFOLIO


30 TB

50

1000 VMs

FCoE

VCSNETWORK

STORAGE

HYPERVISOR

SERVER

VCS

$5

00

$1000

$5

00

0



SOLUTIONS PORTFOLIO


30 TB

200

4000 VMs

VCS

Hyper-V

NETWORK

STORAGE

HYPERVISOR

SERVER

VCS

$5

00

$1000

$5

00

0

FCoE



SOLUTIONS PORTFOLIO

Brocade Open Virtual Compute Blocks

20 TB

200

5000 VMs

NAS

VCSNETWORK

STORAGE

HYPERVISOR

SERVER

VCS

$5

00

$1000

$5

00

0



SOLUTIONS PORTFOLIO

Brocade Open Virtual Compute Blocks

200 TB

400

10,000 VMs

iSCSI, NAS, FCoE, FC

VCSNETWORK

STORAGE

HYPERVISOR

SERVER

VCS

$5

00

$1000



NEXT INFRASTRUCTURE IN A FUTURE Infra in future KU.pdf · NEXT INFRASTRUCTURE IN A FUTURE ... 3G/...

Documents

Transcript of NEXT INFRASTRUCTURE IN A FUTURE Infra in future KU.pdf · NEXT INFRASTRUCTURE IN A FUTURE ... 3G/...