Hp The Future For Scale Out Computing

Dec 11, 2008

© 2008 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice

Technology for better business outcomes

The Future For Scale-Out Computing

Dennis Ang

Hewlett-Packard

Asia-Pacific Region

2 15 December 2008

Key Topics

• Drivers of Scale-Out Computing

− HPC Trends

− Advent Of Cloud Computing

• The Challenges Of Scale-Out Computing

• HP In Scale-Out Computing

3 15 December 2008

Drivers of Scale-Out Computing

4 15 December 2008

Top Trends in HPC

� HPC hit an all-time high of $11.5 billion in 2007

� 19% CAGR in server factory revenue over last 4 years

� X86 and Linux still dominate

� Clusters continue to gain shares across all segments

� Mid- to low-end of the market continue to fuel the growth

� Blades are making in-road to all segments

� Oil/Gas, CAE, DCC and EDA are high growth areas

� New challenges for datacenters:

� Power, cooling, real estate, system management, system consolidation

� Storage and data management continue to grow in importance

IDC data; market remains hot; growing in strategic importance.

5 15 December 2008

TOP500 Performance Projections

1993 1995 1997 1999 2001 2003 2005 2007 2009 2011 2013 2015

N=1

N=500

SUM

1 Gflop/s

1 Tflop/s

100 Mflop/s

100 Gflop/s

100 Tflop/s

10 Gflop/s

10 Tflop/s

1 Pflop/s

10 Pflop/s

1 Eflop/s

100 Pflop/s

6-8 years

1 Pflop/s

6 15 December 2008

Some interesting data

Peak performance: 12,288 Gflop/s

Weight: 106 Tons (w/ 160 TB storage)

Power: 3MW

Cost: US$110 million

Eight years ago: ASCI White

•#1 on the Top500 in June 2001

Today: one rack full of Bl2x220c

Peak performance: 12,288 Gflop/s

Weight: ~2000 lbs (~1 ton) – 100x lighter

Power: ~30KW – 100x less power

Cost: ~ US$1M -- more than 100x lower cost

7 15 December 20087

From rack-mount to blade

BladeSystem Advantage

Power: up to 30% saving

Floor space: from 8 racks to 5 racks

Network cables: up to 78% less

And excellent manageability!

Example configuration:

256-node cluster

w/ InfiniBand

8 15 December 2008

HP in the Top500 (Nov’07)

HP BladeSystem@ 28% share

• From launch in June 2006

• Most popular single platform, with 151 entries

8

www.top500.org

1 20

21 40

41 60

61 80

81 100

101 120

121 140

141 160

161 180

181 200

201 220

221 240

241 260

261 280

281 300

301 320

321 340

341 360

361 380

381 400

401 420

421 440

441 460

461 480

481 500

HP c-Class HP other

FootNote : TOP500 (Nov’ 08)

-209 entries for HP overall

-201 c-Class Blades @ 40% Share

9 15 December 2008

� ‘EKA’, the world’s 13th fastest supercomputer and #2 in Asia, delivering 175 Tflops peak performance, used for:

� Advanced modeling and simulation in computational sciences

� Cutting edge R&D in HPC, Petascale design

� Cloud computing research

� Based on highly scalable, high efficiency HP core technologies

� HP Cluster Platform 3000BL

� 1822 HP ProLiant BL460c server blades with 28 terabytes memory

� InfiniBand 4X DDR

� HP XC cluster management, HP MPI message passing libraries

� 140 terabytes storage, HP SFS parallel file system

� HP Smart Cooling data center services

9 15 December 2008

EKA in CRL’s Rajiv Gandhi InfoTech Park HPC Facility, Hinjewadi, Pune

“Computational Research Laboratories (CRL), a wholly-owned company of the Tata Group, India’s largest

conglomerate, used HP blades, cluster OS and technical assistance to design and implement the high

performance, high efficiency system EKA, the 8th fastest supercomputer in the world. HP’s highly scalable

core technologies, such as BladeSystem c-Class server blades and data center cooling services, have

helped CRL design and deploy EKA’s supercomputing infrastructure for cloud computing research with

Yahoo. This is the world's largest system used for research in cloud computing.”

S. Ramadorai, Chairman of CRL

10 15 December 2008

Cloud Computing is Changing the Game

reach

1970 1980 20001990 2010time

2005 2020

TheInternet

TheWeb

TheCloud

connectivity

information &

e-commerce

virtualized

services

11 15 December 2008

What’s new?

Service users

The cloud is a means by which certain types of highly scalable and flexible services can be delivered and consumed over the internet

through a as-needed, pay-per-use business model

What do we mean by cloud?

Service providers

New connections: information in context

New capabilities: multi-tenant software

New access: everything is a

service

15-Dec-0811

12 15 December 2008

Ext

ern

ally

hoste

d

Adaptive Infrastructure is the foundation to all technology-enabled services…

15-Dec-0812

Business outcomes

Infrastructure as a service

Business outcome

Technology-enabled services

Traditional applications Traditional applications Cloud-based applications

Infrastructure Utilitystandardized – optimized –

automated


automated


automated


automated

Inte

rnally

hoste

d

Adaptive InfrastructurePooled resources -- shared infrastructure

Adaptive InfrastructurePooled resources -- shared infrastructure

12

13 15 December 2008

Targeting the Convergence of Massive Scale-Out

Extreme pain points:Data center constraintsof power, cooling, space, manageability & automationof dynamic workloads

New metrics:Best performance per $/watt/sq. ft.

Photo/VideoSharing

Emerging business models:Best performance = faster time to revenue

• Engineering &Geo-Sciences

• Life & Materials Sciences

• Defense/Security

• Scientific Research

Enterprise/HPC Massive Scale-Out

Market Requirements :Optimized supply chain & unique products and services

• Financial Analytics

• Digital Content Creation

• Streaming Media

• Internet Commerce

• Interactive Media

• On-Line Gaming

Web 2.0

14 15 December 2008

The Challenges Of Scale-Out Computing

15 15 December 200815 15 December 2008

Scale-Out Changes EverythingTraditional IT Scale-Out

Single core Multi-core

Single site Multi-site

100s of nodes 1,000s of nodes

Proprietary Commodity

HW resiliency SW resiliency

Max performance Max efficiency

Data Marts Data Super Centers

Cost-Center

Systems Grids/Cloud

Revenue-CenterStatic Dynamic

Shared storage Replicated storage

Facility costs Power costs


Bridge the gap between scale and performance

• Grow the business – Scale performance

– Rapidly integrate new capacity

– Deploy globally

• Physical data center constraints– Power

– Cooling

– Density

• Control IT spend– Reduce TCO

– Reduce software costs

– Ease of management and automation

– Vendor reach & reliability

Scale-Out challenges

17 15 December 200817 4/1/2008 HP Confidential

Data Center Challenges

• Datacenters constraining growth

− Density, power, and cooling demands outpacing capacity in many data centers

• More energy efficiency needed

− Increasing energy costs driving focus on improving power efficiency

• Faster capacity expansion required

− Companies outgrowing data center capabilities and need immediate expansion space

• Increased focus on capital expense

− Pay as you grow enables capex postponement, and more efficient procurement

Belady, C., “In the Data Center, Power and Cooling Costs More than IT Equipment it Supports”, Electronics Cooling Magazine (Feb 2007)

18 15 December 2008

HP In Scale-Out Computing


HP Adaptive Infrastructure for Scale-Out

Provide new business models for delivering

technology as a service

Automate the environment for

dynamic workloads

Designed for massive scale-out

New baselines for energy,floor space& cooling

SoftwareInfrastructure

DenseServers

& Storage

Data CenterServices

Data CenterInfrastructure

Next-GenerationData Center


Recent additions to HP’s Scale-Out portfolio

Proliant BL2x220c

• Double compute density

• Infrastructure costs in half

• Maximum power & cooling efficiency

Performance Optimized Datacenter (POD)

• Industry-standard Flexibility

• Best-in-class Density

• Fast & easy deployment

• Energy Effectiveness

StorageWorks ExDS9100

� Extreme scalability

� Unified manageability

� Extreme affordability

AnnouncedMay 28, 2008

AnnouncedJuly 16, 2008

AnnouncedMay 6, 2008


Double the Compute Power in the same 20MW Data Center

Deliver movies to market faster, faster rendering, increase creative productivity, take on moreprojects at once

• Installed the first order for over 100 TeraFlops of BL2x220c

• Recently deployed 200TF more of BL2x220c due to success of first implementation

• 2x the performance - Same amount of powerin half the space

• Designed, tested, integrated, shipped and rapidly deployed internationally

Expects the 2-in-1 bladeto save ½ a data center


HP innovating across the Scale-Out value chain

compute & storage infrastructure

data center consulting & services

OS & networking

provisioning, monitoring, resource scheduling & mgmt

applications & development tools

energy efficiency

rapid & flexible deployment

HP technology innovation

HP-MPI, multi-core initiative

proprietary & open source s/w, integrated OS stacks

integrated OS stacks, IB in c-class

flexible compute services, cluster platform

chip to chiller energy portfolio, c-class blades

performance optimized datacenter

c-class infrastructure, scale-out optimized compute & storage

HP process innovation

ISV partnerships & joint development

streamline for scale-out

direct R&D with customers

customized supply chain

design for TCO

EYP MCF

custom engineered nodes

Successful Scale-Out Deployments

23 15 December 2008

The HP-Intel-Yahoo Open Cloud Computing Research Test Bed

What is it?

�An open, scalable, secure, large scale global test bed for cloud computing research and education

� Collaborative research focused on software, data center management, hardware issues at a larger scale than ever before; as well as support research on cloud applications and services

� Scalable, multi-continent, multi-datacenter, cloud computing system

� A broad base research community including HP, Intel, Yahoo and other partners and academic researchers

24 15 December 2008

Open Cloud Computing Research Testbed

� Initial 6 “Centers of Excellence” around the globe � Singapore IDA, UIUC, KIT, Intel Lab, Yahoo

and HP Labs

� Specific research agenda to each region

� external + internal nodes; fluid boundary

� Each center: 1000-4000 cores and few PB storage� base service: PRS (physical resource set)

� required services: EC2, S3, and Hadoop-on-demand

� plus additional local extensions/variants/service types

25 15 December 2008

HP - The Leader for Scale-Out Environments

• Expertise in scale-out computing

• Superior economics

• Innovative products and services to address emerging PetaScale & Cloud Computing

• Global research initiative and technology partnership

26 15 December 2008

Hp The Future For Scale Out Computing

Technology

Transcript of Hp The Future For Scale Out Computing