Mice, Elephants, Turtles Dimes & Dollars HPC & Big Data · Rackspace Angry Birds played Joyent...

19
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. Mice, Elephants, Turtles Dimes & Dollars HPC & Big Data Marc Hamilton Hyperscale Business Unit HP Enterprise Group March, 2013

Transcript of Mice, Elephants, Turtles Dimes & Dollars HPC & Big Data · Rackspace Angry Birds played Joyent...

Page 1: Mice, Elephants, Turtles Dimes & Dollars HPC & Big Data · Rackspace Angry Birds played Joyent Urban Hosting.comHP Tata Communications Datapipe ... every ScaleXtreme 60 seconds 400,710

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

Mice, Elephants, Turtles Dimes & Dollars HPC & Big Data Marc Hamilton

Hyperscale Business Unit

HP Enterprise Group

March, 2013

Page 2: Mice, Elephants, Turtles Dimes & Dollars HPC & Big Data · Rackspace Angry Birds played Joyent Urban Hosting.comHP Tata Communications Datapipe ... every ScaleXtreme 60 seconds 400,710

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 2

Big Data is Accelerating Innovation & Change

The Internet Client/Server

Mobile, Social, Big Data & The Cloud

Database

ERP

CRM

SCM

HCM

HCM

PLM

MRM

Amazon Web Services

OpSource

IBM

GoGrid

Rackspace

Joyent

Hosting.com Tata Communications

Datapipe

PPM

Alterian

Hyland

LimeLight NetDocuments

NetReach

OpenText

PaperHost

Xerox

Google

HP

Microsoft SLI Systems

EMC

IntraLinks

Jive Software

Qvidian

Sage

salesforce.com

SugarCRM

Volusion

Xactly

Zoho

Adobe

Avid

Corel

Microsoft

Paint.NET

Serif

Yahoo

CyberShift

Saba

Softscape

Sonar6

Ariba

Yahoo!

Quadrem

Elemica

Kinaxis

CCC

DCC

SCM

Cost Management

Order Entry

Product Configurator

Bills of Material Engineering

Claim Processing

Inventory

Manufacturing Projects

Quality Control

Business

Education

Entertainment

Games

Lifestyle

Music

Navigation

News

Photo & Video

Productivity

Reference

Social Networking

Sport

Travel

Utilities

every 60 seconds

400,710 ads requests

2000 lyrics played on Tunewiki

1,500 pings sent on PingMe

34,597 people are using Zinio

208,333 minutes Angry Birds played

23,148 apps downloaded

Unisys

Burroughs

Hitachi

NEC Bull

Fijitsu

ADP VirtualEdge

Cornerstone onDemand

CyberShift

Workbrain

Kenexa Saba

Softscape

Sonar6

SuccessFactors

Taleo

Workday

Workscape

Exact Online

FinancialForce.com

Intacct NetSuite

SAP

NetSuite

Plex Systems

Cash Management

Accounts Receivable

Fixed Assets Costing

Billing

Time and Expense

Activity Management

Payroll

Training

Time & Attendance

Rostering Sales tracking &

Marketing

Commissions Service

Data Warehousing

347,000 tweets

Finance

box.net

Facebook

LinkedIn

TripIt

Pinterest

Zynga

Zynga

Baidu

Twitter

Twitter Yammer

Atlassian

Atlassian

MobilieIron SmugMug

SmugMug

Atlassian

Amazon

Amazon iHandy

PingMe

PingMe

Associatedcontent

Flickr

Snapfish

YouTube

Answers.com

Tumblr.

Urban

Scribd.

Pandora

MobileFrame.com

Mixi

CYworld

Qzone

Renren

Xing

Yandex

Yandex

Heroku

RightScale

New Relic

AppFog

Bromium

Splunk

CloudSigma

cloudability

kaggle

nebula

Parse

ScaleXtreme

SolidFire

Zillabyte

dotCloud

BeyondCore

Mozy

Viber

Fring Toggl

MailChimp

Quickbooks

Hootsuite

Foursquare

buzzd

Dragon Diction eBay

SuperCam

UPS Mobile

Fed Ex Mobile

Scanner Pro

DocuSign

HP ePrint

iSchedule

Khan Academy

BrainPOP

myHomework

Cookie Doodle

Ah! Fasion Girl

Mainframe

• Change how technology is consumed & value it can bring

• Open up new business models

• Remove current inhibitors & unleash power of innovation

New technology access methods

Page 3: Mice, Elephants, Turtles Dimes & Dollars HPC & Big Data · Rackspace Angry Birds played Joyent Urban Hosting.comHP Tata Communications Datapipe ... every ScaleXtreme 60 seconds 400,710

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 3

Anywhere, anytime demand increases opportunities

Hyperscale to be 35% of x86 market

Customer demand for content

Device proliferation

Competitive edge

Driving the need for new and

purpose built products!

Hyperscale workloads growing significantly faster than overall market

Enterprise $28.0

Enterprise $26.0

SP, $2.8 SP, $4.2

Hosting, $2.4 Hosting, $3.3

HPC, $5.2 HPC, $6.4

$0.0

$5.0

$10.0

$15.0

$20.0

$25.0

$30.0

$35.0

$40.0

$45.0

2012 2015

27% 35%

Page 4: Mice, Elephants, Turtles Dimes & Dollars HPC & Big Data · Rackspace Angry Birds played Joyent Urban Hosting.comHP Tata Communications Datapipe ... every ScaleXtreme 60 seconds 400,710

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

Mice, Elephants, and Turtles

Page 5: Mice, Elephants, Turtles Dimes & Dollars HPC & Big Data · Rackspace Angry Birds played Joyent Urban Hosting.comHP Tata Communications Datapipe ... every ScaleXtreme 60 seconds 400,710

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 5

Mice and Elephants

• The elephant in the room

• Not all big data comes from mouse clicks

• Hadoop becoming ubiquitous - good or bad? • Is storing 3 full copies of data really efficient or just

easy? • Are Hadoop management tools ready for the

enterprise?

Page 6: Mice, Elephants, Turtles Dimes & Dollars HPC & Big Data · Rackspace Angry Birds played Joyent Urban Hosting.comHP Tata Communications Datapipe ... every ScaleXtreme 60 seconds 400,710

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 6

Breaking The Application Triangle

• As more and more data is stored in HDFS, disruptive innovation becomes difficult – you can’t break the APIs

• So how can you drive disruptive innovation?

Vendors pursue

sustaining innovation

of 2-socket x86

systems for Hadoop

Users select widely

available platforms

to solve their

business problems

Hadoop originally

ran on commonly

available 2-socket

x86 systems

Page 7: Mice, Elephants, Turtles Dimes & Dollars HPC & Big Data · Rackspace Angry Birds played Joyent Urban Hosting.comHP Tata Communications Datapipe ... every ScaleXtreme 60 seconds 400,710

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 7

SSDs are Turtles

• SSDs usage with Hadoop growing

• Disk protocols too slow for SSD/Flash

• Better hardware is available (PCIeGen3, etc.)

• Flash nearing end of life just in time for new NVRAM

• Now its time to address the software bottlenecks

• HDFS on top, but what’s inside?

Page 8: Mice, Elephants, Turtles Dimes & Dollars HPC & Big Data · Rackspace Angry Birds played Joyent Urban Hosting.comHP Tata Communications Datapipe ... every ScaleXtreme 60 seconds 400,710

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 8

HP Insight Cluster Management Utility

8

Page 9: Mice, Elephants, Turtles Dimes & Dollars HPC & Big Data · Rackspace Angry Birds played Joyent Urban Hosting.comHP Tata Communications Datapipe ... every ScaleXtreme 60 seconds 400,710

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

Dimes and Dollars

Page 10: Mice, Elephants, Turtles Dimes & Dollars HPC & Big Data · Rackspace Angry Birds played Joyent Urban Hosting.comHP Tata Communications Datapipe ... every ScaleXtreme 60 seconds 400,710

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 10

Are HPC compute nodes getting too powerful for big data use?

Dimes and Dollars

• Relative performance of mobile processors increasing quicker than

server processors

• Typical HPC compute node today, 300 watts, $300/year power

• Nvidia Tegra 5 mobile processor will be the size of a dime, run CUDA

and OpenGL apps

• 60 5-watt mobile processors = $300/year power

Page 11: Mice, Elephants, Turtles Dimes & Dollars HPC & Big Data · Rackspace Angry Birds played Joyent Urban Hosting.comHP Tata Communications Datapipe ... every ScaleXtreme 60 seconds 400,710

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 11

1.5 1.7

4.9

10.5 11.2 11.9 15.7 17.2 18.2

22.2 23.1 25.0 25.4 26.8 29.3

73.0

0.1

1.0

10.0

100.0

Rel

ativ

e p

erfo

ram

ance

(H

igh

er is

bet

ter)

Relative Performance Good Xeon performance ratios

Good ARM /Atom performance ratios

Page 12: Mice, Elephants, Turtles Dimes & Dollars HPC & Big Data · Rackspace Angry Birds played Joyent Urban Hosting.comHP Tata Communications Datapipe ... every ScaleXtreme 60 seconds 400,710

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 12

0.16

0.43

0.66 0.70

1.02

2.50 3.20

4.39

12.00

29.92

0.10

1.00

10.00

100.00R

elat

ive

per

form

ance

/wat

t (h

igh

er is

be

tter

) Relative Performance per Watt

Good ARM /Atom performance/ watt ratios

Page 13: Mice, Elephants, Turtles Dimes & Dollars HPC & Big Data · Rackspace Angry Birds played Joyent Urban Hosting.comHP Tata Communications Datapipe ... every ScaleXtreme 60 seconds 400,710

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 13

1.15 1.25

2.63 2.98 3.14 3.20 3.44 4.44 4.55 4.63 5.08 5.56

8.93 12.16

0.01

0.10

1.00

10.00

Rel

ativ

e p

erfo

rman

ce (

hig

her

is b

ette

r)

2H’13 HP Projections: big leap in mobile performance

Page 14: Mice, Elephants, Turtles Dimes & Dollars HPC & Big Data · Rackspace Angry Birds played Joyent Urban Hosting.comHP Tata Communications Datapipe ... every ScaleXtreme 60 seconds 400,710

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

HP Project Moonshot

Page 15: Mice, Elephants, Turtles Dimes & Dollars HPC & Big Data · Rackspace Angry Birds played Joyent Urban Hosting.comHP Tata Communications Datapipe ... every ScaleXtreme 60 seconds 400,710

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 15

Project Moonshot: A new era of extreme scale computing

Project Moonshot

• 1,000s of servers per rack

• Workload - tuned servers

• Federated infrastructure scales seamlessly with additional servers

Application-driven designs

Space Energy Costs

Redefining server infrastructure for rapid application optimization

Device agnostic architecture scales from extreme low energy CPUs to high performance GPGPUs

Page 16: Mice, Elephants, Turtles Dimes & Dollars HPC & Big Data · Rackspace Angry Birds played Joyent Urban Hosting.comHP Tata Communications Datapipe ... every ScaleXtreme 60 seconds 400,710

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 16

DOE’s National Renewable Energy Lab purchases $10M HP Supercomputer

Supercomputers That Reuse Energy?

- New ProLiant server platform will delivery 1 Pflop of Intel IvyBridge and Xeon Phi

- http://www.nrel.gov/news/press/2012/1985.html

- Power and warm water cooling system co-designed to work with NREL’s new $100M Energy Systems Integration Facility (pictured below)

- Waste heat used to

heat office space & melt

snow in winter

16

Page 17: Mice, Elephants, Turtles Dimes & Dollars HPC & Big Data · Rackspace Angry Birds played Joyent Urban Hosting.comHP Tata Communications Datapipe ... every ScaleXtreme 60 seconds 400,710

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 17

200 TF Linpack – Feb 27, 2013

National Renewable Energy Lab

Page 18: Mice, Elephants, Turtles Dimes & Dollars HPC & Big Data · Rackspace Angry Birds played Joyent Urban Hosting.comHP Tata Communications Datapipe ... every ScaleXtreme 60 seconds 400,710

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 18

Expanding the purpose-built portfolio for big data

SL250 SL270 SL230 Big Data

Accelerators

High-end nodes

Solutions

ProLiant SL Core

Customer specific

High-efficiency

computing

SL2500

Page 19: Mice, Elephants, Turtles Dimes & Dollars HPC & Big Data · Rackspace Angry Birds played Joyent Urban Hosting.comHP Tata Communications Datapipe ... every ScaleXtreme 60 seconds 400,710

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

Thank you