Green Networking With Blade

© BLADE Network Technologies, 2009 www.bladenetwork.net©2009 www.bladenetwork.net VIRTUAL COOLER EASIER

Optimizing Data Centre Networking for Energy-Efficient Datacenters

November 2009

VIRTUAL COOLER EASIER

Key Points

• Datacenter networking energy consumption and efficiency

• Virtualization-aware networking

• Converged datacenter switching fabrics on to 10 Gigabit Ethernet

Apr 13, 2023www.bladenetwork.net 2


BLADE Background

• Products– Switches for Blade Servers– Top-of-Rack switches– Virtualization & management

• Achievements– 7M datacenter ports shipped – 16,000+ switches at one customer– 54% unit growth in 2008– 50+% blade switch market share– Firsts

• 1st CEE, Layer 2-3 & Layer 2-7 for blades• 1st 10G for blade servers• 1st to provide blade network virtualization• 1st Green Networking company

• Customers– Over 300 of the Fortune 500; 9000+ customers

worldwide– 26+ industries– Key partnerships:

• Facts– Independent, private company since

February 2006

– Santa Clara, CA Headquarters

– Offices in Canada, Europe, Middle East,

Japan, China, Korea

– According to the Dell’Oro group, BLADE

holds 5th place for the fix 1 Gigabit Ethernet

market share and 3rd for 10 Gigabit

Ethernet


http://www.alwayson.goingon.com/permalink/post/18632

VIRTUAL COOLER EASIER Apr 13, 2023www.bladenetwork.net 4

Growing Pressures on Datacenters

Busier servers• Virtualization• Multicore CPUs• Multiple fabricsMore servers• Consolidation• Scale-out• Web 2.0• ClusteringVanishing resources• Shrinking IT budgets• Power & cooling squeeze• Management complexity

VIRTUAL COOLER EASIER www.bladenetwork.net 5

Ethernet is the Future

Source: Dell’Oro Ethernet Forecast Summary, February 20092007 2008 2009 2010 2011 2012 2013

0

1,000,000

2,000,000

3,000,000

4,000,000

5,000,000

6,000,000

7,000,000

8,000,000

9,000,000

10,000,000

$0

$200

$400

$600

$800

$1,000

$1,200

272,815550,095

1,002,620

1,810,358

3,174,146

5,525,786

8,700,576$1,071

$876

$549

$437

$351$273

$212

Ports Avg $/Port

• Performance (Bandwidth & Latency)– 10Gb non-blocking, line-rate bandwidth

with 595 Million Packets/sec– Latency as low as .36µs for fast response

time– 40Gb & 100Gb are on the horizon

• Management– Universal Ethernet standard– Single converged fabric for data and

storage (using iSCSI, NAS or FCoE)– Interoperates seamlessly

• Savings– Switch <$500/10Gb port and falling– Fewer cables than with multiple gigabit

links– Fewer ports = fewer components = less

power & cooling

• Fastest growing fabric– By 2011, 10Gb will account for over 20%

of the LAN switch revenue (IDC)

Apr 13, 2023


Key Points





VIRTUAL COOLER EASIER 7

Reduce the Network Power Consumption

www.bladenetwork.net 7

• 12% of datacenter energy is used for networking equipment

• For every watt IT consumes, 3 watts are required to operate the datacenter

• BLADE has energy efficiency in its DNAApr 13, 2023


Top-of-Rack: Case Study

• Two switch per rack deployed in five racks (Total of ten G8124)

• Operating 24/7/365 during 3 years• BLADE G8124 consumes 47% less energy than a

leading competitor, this means:– $20,000 less on your energy bill

– 50,000 kg CO2 less in the atmosphere

– Requires 3,321 trees to offset– Equivalent of 5 cars off the road!


Lowering Power Consumption

80% lower power consumption

300 Watts

60 Watts

“While external chassis-based switches from leading vendors like Cisco are commonplace in enterprise networks, these solutions do not always perform at wire speed and do not always offer low latency. At twice the throughput, and with nine times less latency than the Catalyst 6509, we expect the BLADE product will garner serious consideration by any enterprise considering blade server deployments.”

- Kevin Tolly, The Tolly Group

Cisco WS-X6704-10GE295.26 Wattswww.cisco.com/powercalculator

75 Watts per 10G port3 Watts per 10G port

Conventional Data Center Switching Equipment

http://www.cisco.com/powercalculator


Blade Server Networking: Case Study

• 25 Datacenter world wide, 18 rows filled with blade servers with pass-through modules

• Networking energy cost is $20,000 per row• Replace the pass-through modules by BLADE

embedded blade server switch:– Reduce power by 50%– Uses 75% less cables– Saved 37 Million kWh

– 20 Million kg CO2 less in the atmosphere

– Requires 2,5 Million trees to offset– Equivalent of 3,700 cars off the road!


Energy Efficiency

• Air flow is important for datacenter networking• Power conserving design• Built to operate at room temperature or higher


Airflow to Match Servers and Storage

Side ViewHot/Cold Aisle

70°

70°

71°

72°

74°

73°

70°

70°

72°

83°

85°

95°

90°

Cold Aisle Hot Aisle Cold Aisle

Hot Loops

Traditional Switch

Server

Side Cooled Switch

Storage Device

Storage Device

Server

Storage Device

Server

Storage Device

Storage Device

Server

BLADE RackSwitch

Server

BLADE RackSwitch

Storage Device

Storage Device

Server

Storage Device

Server

Storage Device

Storage Device

Server


• Most switches pull hot air from server exhaust creating “hot loops”• More heat drives up cooling costs, and increases chance of failure for all

components in the rack

Using BLADERackSwitch

Using general-purpose switch


Key Points





VIRTUAL COOLER EASIER Apr 13, 2023BLADE Network Technologies | Confidential 14

Server Virtualization Is Commonplace – but Dynamic Migration is not!• Up to 90% of datacenters are using server

virtualization– Gaining better utilization, efficiency, power

savings– Scaling up without financial impact of adding

servers– Freeing applications from physical hardware

limitations• But few customers are enabling VM’s to be

dynamically created or moved

Source: IDC 2008

Static VM deployment

Dynamic VM deployment


Introducing VMready

• VMready is switch-resident software – no stealing cycles from servers• VMready automates network settings for VM movement

– Ensures network settings migrate with the VM• VMready is open

– Works with all leading VM providers• VMware VMotion, Xen XenMotion, Microsoft Hyper-v Live Migration, Sun, Oracle, etc.

– Standards-based – avoiding expensive vendor lock-ins• Interfaces to management platforms

– Export data on VM usage for accounting, change management, etc.

VM1VM2

VM3VM1

VM1VM6

VM3VM2

Video

Backup

Web

VM

rea

dy

™

VMready keeps VMs connected and protected as they move

SmartConnect™ Switch


VMready in Action

VM 1

VM 2

VM 3

VMready

VM 4

VM 5

Server A Server B

Ethernet Ethernet

VLAN idQOSACL

VMotion

VM 3

VLAN idQOSACL

• Specific Virtual Machine (VM) network characteristics are associated with the switch “virtual” port

• VMready detects a Vmotion process and “moves” the network characteristics of the VM to the new physical switch port

Switch


Key Points






Ultra-Fast Converged Networks

• Ultra low, deterministic latency– 10x faster than conventional

switches, as low as 360ns– Non-blocking, line-rate architecture– Ideal for high-speed trading

networks and HPC applications

• Converged Data Center Fabric – Loss-less fabric optimized for

iSCSI, NAS and FCoE (CEE)– IBM & BLADE announced the first

FCoE Ready switch for the BladeCenter in June 2009



Converged Switching Fabrics

• Several discreet networks are connecting to an individual server

• Cable management issues, rack space, air flow obstruction, etc.


Converged Switching Fabrics : Case Study

• 100 new servers for a server virtualization project with six Gigabit Ethernet and two fiber channel connections

• Replaced by BLADE 10 Gigabit Ethernet converged switches:– 35% CAPEX reduction– 4x less rack space– Requires 6x less energy

– 114,169 kg CO2 less in the atmosphere

– Requires 14,309 trees to offset– Equivalent of 21 cars off the road!


Convergence on 10GbE

SAN

LAN

RackSwitchG8124

Fibre Channel

InfiniBand

HPC Cluster

Ethernet

SAN, LAN, and Cluster traffic will converge on 10G Ethernet

• Lossless with Converged Enhanced Ethernet (CEE)– Fibre Channel over Ethernet (FCoE)

• Low latency for high-performance clusters (HPC)• Low power due to fewer components• Low cost – reduce adapters, cabling & management


FCoE Traffic

Ethernet


FCoE or IP Storage?

• Fiber Channel over Ethernet (FCoE) is arriving:− FCoE will enable fabric consolidation while preserving

investment in FC storage and management tools

− Pre-standard products are shipping today

− Requires lossless CEE capable switches > BLADE is an early leader

• IP Storage is a mature technology:− IP Storage works well today with wide vendor support

− No new Ethernet switches required

• Bottom line servers need to be connected with a single wire, you choose the right protocol


10G Ethernet iSCSI vs. Fibre Channel

Source: http://www.blade.org/docs/wp/10GbE_Blade_Performance_Final.pdf

http://www.blade.org/docs/wp/10GbE_Blade_Performance_Final.pdf

VIRTUAL COOLER EASIER Apr 13, 2023BLADE Network Technologies Confidential 24

The Need for a Better Network Design

Core

Distribution

Access

• Hierarchical design is best suited for enterprise —not the datacenter

• Complex and expensive to implement and maintain

• Various discreet equipment consume a lot of energy and generate a lot of heat

• Compromise scalability due to the added latency of the various components


Rackonomics: Racks are the Base Units

The Replicated Rack is the New Data Center!


Simplified Scalability: SmartConnect

• SmartConnect™ Switch Virtualization– Share I/O across a blade chassis or rack

• Decouple scaling of CPU, I/O and storage– Server-centric for server administrators

• Create Virtual Switch Group (VSG)– Assign Network config & servers to VSG

• Servers can be moved, replaced and added and the proper Network config will always be applied

• Simplified configuration interface (No Network PhD required)

Web traffic

Video traffic

Backup traffic


Putting it All TogetherVirtual, Cooler, Easier Networking

DatacenterNetwork

BLADE RackSwitch

BLADE Switches for HP, IBM, NEC, Verari

Virtualization SoftwareSmartConnect™ with VMready™

BLADEHarmony™ Manager

27www.bladenetwork.net Apr 13, 2023


BLADE Embedded Product Overview

Hardware SoftwareIBM Server Connectivity Module Intelligent Copper Pass-through Module Layer 2-7 Application Switch Module GE Layer 2/3 switch (Copper & Fiber) GE-down/10G-uplink Layer 2/3 switch 1Gb/10Gb Ethernet Layer 2/3 switch All 10G Layer 2/3 switch RackSwitch 8000 (iDataPlex & Cluster 1350) RackSwitch 8100/8124 (iDataPlex & Cluster 1350)

HP GE Layer 2/3 switch (Copper & Fiber) for p-Class GE Layer 2 switch (Copper) for c-Class GE Layer 2/3 switch (Dual Mode Copper/Fiber) for c-Class GE-down/GE & 10G-uplink Layer 2/3 switch for c-Class All 10G Layer 2/3 switch for c-Class

NEC GE Layer 2 switch (Copper) GE Layer 2/3 switch (Dual Mode: Copper/Fiber) All 10G Layer 2/3 switch

• SmartConnect™ (Network virtualization software)• VMready™• ServerMobility™ Software• IBM Open Fabric Manager with BNT Virtual

Switch Extensions • BLADEHarmony™ Manager (management

software)• SmartPanel™ (Simplified switch software)


Greater Performance

Ultra-low Latency

BLADE RackSwitch

RackSwitch G8000 RackSwitch G8100 RackSwitch G8124

Energy EfficiencyGreen Technology

Lowest cost of operation & airflow respecting cold/hot aisle design.

Applications and user experience improvement.

Server Connectivity FocusBest “Edge” Technology

Features set design for server connectivity, not backbone or wiring closet.


Data Center Wiring ClosetHigh availability Yes-Uplink Failure Detection,

HotLinks, VRRPNo

Virtualization Yes-VMready, Server Mobility No

Dual Homing Yes for servers No for PCs & IP phones

Power over Ethernet Not needed Yes for VoIP & Wireless

Traffic Flow ~70% internalPacket buffers critical

~70% uplink

Multicast Senders1024 IGMP Groups

Receivers60 IGMP Groups

Airflow Back-to-front orfront-to-back

Side-to-side

Uplink Ports In the Front / Easy to access In the back / hard to access

Switches Designed for the Data Center

VIRTUAL COOLER EASIER www.bladenetwork.net 31

RackSwitch Family Ethernet SwitchesTop Of Rack – 1U Switches

24 ports, 10 Gigabit Ethernet• 24 ports SFP+ for uplinks (10/1G)• Low latency – sub 700 nsec

RackSwitch G812410G SFP+ Switch

24 ports, 10 Gigabit Ethernet• 20 ports CX4 – the proven lowest latency• 4 ports SFP+ for uplinks (10/1G)• Lowest latency – 300 nsec• Patented CX4 cable retainer solves cable

issues

RackSwitch G810010G Low Latency Switch

48 ports, Gigabit Ethernet with 10G Uplinks

• 44 ports 1G, RJ-45 copper• 4 ports 1G, SFP• 4 ports 10G, CX4 or SFP+ for uplinks

RackSwitch G80001/10G Ethernet Switch

BLADE Top of Rack Switches Designed for Data Center• Front-to-Back Airflow • Variable Speed Fans – automatically reduce power

draw• Built-in redundant power supplies and fan units• Data Center Class Switching ASIC • Front Facing Uplink Ports

Leading Price Performance• Zero dropped packets in full mesh testing• Line Rate Performance• Aggressive Pricing

Mature IP – leveraging our experience:• >200,000 BLADE Switches currently operating in

Cisco-powered datacenters• 100% successful Tolly Switch Interop on closely

related BLADE switches• Cisco-like CLI

Apr 13, 2023


Certified Interoperability

• Certified interoperability with Cisco Catalyst

• Configurable using “Cisco-Like” CLI commands – no re-training needed

• 1000s of BLADE switches interop with Cisco everyday

http://www.bladenetwork.net/userfiles/file/PDFs/Tolly209116BladeRackSwitchInteroperability.pdf

32www.bladenetwork.net Apr 13, 2023

http://www.bladenetwork.net/userfiles/file/PDFs/Tolly209116BladeRackSwitchInteroperability.pdf


BLADE’s RackSwitch Outperforms Cisco

• BLADE versus Cisco 4900:− 8x lower latency− 2x more throughput− 3x greater energy efficiency− 6x better price/performance ratio

http://www.bladenetwork.net/userfiles/file/PDFs/Tolly209115BladeG8124Performance.pdf





Key Points

• BLADE reduce over 50% of the networking energy consumed in your datacenters

• Carefully design with power efficiency

• Converge several networks over 10 Gigabit Ethernet

• Outperform any other Ethernet switch on the market on:– Latency– Throughput– Power consumption– Resiliency– Price

© BLADE Network Technologies, 2009 www.bladenetwork.net©2009 www.bladenetwork.net VIRTUAL COOLER EASIER

www.bladenetwork.net

Thank You

Please visit www.bladenetwork.net

Follow us on @BLADENetwork

http://www.bladenetwork.net/

http://www.twitter.com/BLADENetwork

http://twitter.com/

Green Networking With Blade

Technology

Transcript of Green Networking With Blade