NOV 8 2012: Cloud Expo SF "Elastic Cloud Infrastructure: Why the Enterprise Wants It"

50
Why Most Organizations Will Need Two Clouds Cloud Expo, November 8, 2012, San Francisco Why Enterprises Need Two (or more) Clouds presented to Cloud Expo, San Francisco November 8, 2012 Troy Angrignon VP, BD & Partnering [email protected] @troyangrignon 1

description

A talk detailing how and why elastic cloud infrastructure emerged in the marketplace. NOTE: For current Cloudscaling messaging and presentations, please refer to http://www.slideshare.net/randybias and www.cloudscaling.com

Transcript of NOV 8 2012: Cloud Expo SF "Elastic Cloud Infrastructure: Why the Enterprise Wants It"

Page 1: NOV 8 2012: Cloud Expo SF "Elastic Cloud Infrastructure: Why the Enterprise Wants It"

Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco

Why Enterprises Need Two (or more) Cloudspresented toCloud Expo, San FranciscoNovember 8, 2012

Troy AngrignonVP, BD & [email protected]@troyangrignon

1

Page 2: NOV 8 2012: Cloud Expo SF "Elastic Cloud Infrastructure: Why the Enterprise Wants It"

Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco

Market DriversTwo Cloud Theory

EIC Design principlesReal-world scenarios

2

Page 3: NOV 8 2012: Cloud Expo SF "Elastic Cloud Infrastructure: Why the Enterprise Wants It"

Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco

Market Drivers

3

Page 4: NOV 8 2012: Cloud Expo SF "Elastic Cloud Infrastructure: Why the Enterprise Wants It"

Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco

2B+ people online but...

4http://www.businessinsider.com/state-of-internet-slides-2012-10?op=1

Page 5: NOV 8 2012: Cloud Expo SF "Elastic Cloud Infrastructure: Why the Enterprise Wants It"

Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco

2B+ people online but...

5http://www.businessinsider.com/state-of-internet-slides-2012-10?op=1

Page 6: NOV 8 2012: Cloud Expo SF "Elastic Cloud Infrastructure: Why the Enterprise Wants It"

Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco

2B+ people online but...

6http://www.businessinsider.com/state-of-internet-slides-2012-10?op=1

Page 7: NOV 8 2012: Cloud Expo SF "Elastic Cloud Infrastructure: Why the Enterprise Wants It"

Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco

App usage is swamping web usage

7http://www.businessinsider.com/state-of-internet-slides-2012-10?op=1

Page 8: NOV 8 2012: Cloud Expo SF "Elastic Cloud Infrastructure: Why the Enterprise Wants It"

Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco

Macro Market Trends

8

The application portfolio is expanding.

Mobile matters.

Application teams are embracing the agility benefits of public cloud.

Time to market pressures are accelerating.

Page 9: NOV 8 2012: Cloud Expo SF "Elastic Cloud Infrastructure: Why the Enterprise Wants It"

Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco

Applications are changing. And so are the approaches we use to create them

9

Applications Development Approaches

Page 10: NOV 8 2012: Cloud Expo SF "Elastic Cloud Infrastructure: Why the Enterprise Wants It"

Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco

The way we build code is changing...fast

10

Page 11: NOV 8 2012: Cloud Expo SF "Elastic Cloud Infrastructure: Why the Enterprise Wants It"

Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco

App Developers are Flocking to AWS

11

• Tremendous growth for market leader• 1 trillion objects in S3

• ~$1.5B business run rate for Amazon

• ~ 450,000 servers in seven data center hubs around the globe

• 100s of servers per admin ratio

• 20 price reductions in 5 years

• Fast scale and prominent companies running production workloads on AWS

• Zynga, Pinterest and Dropbox are a few

• AWS allow app developers to self serve and assume control • DevOps centric

• Auto-scaling

• Manage data replication

• Ensure server & data redundancy

• Geo-distribution

IT infrastructure teams are under increasing pressure to compete with highly elastic, on-demand, self-service public cloud offerings.

Page 12: NOV 8 2012: Cloud Expo SF "Elastic Cloud Infrastructure: Why the Enterprise Wants It"

Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco

A wave of new apps requiring new infra

12

Page 13: NOV 8 2012: Cloud Expo SF "Elastic Cloud Infrastructure: Why the Enterprise Wants It"

Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco

Two Clouds

13

Page 14: NOV 8 2012: Cloud Expo SF "Elastic Cloud Infrastructure: Why the Enterprise Wants It"

Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco

This has led to a bifurcation in infra & apps

14

Enterprise Virtualization Cloud

Elastic Infrastructure Clouds

Page 15: NOV 8 2012: Cloud Expo SF "Elastic Cloud Infrastructure: Why the Enterprise Wants It"

Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco

These are entirely different classes of apps

15

Loca

tion

of c

ompl

exity

Infra

App

Up OutPrimary scaling dimension

Cloud Apps

Existing Apps

Page 16: NOV 8 2012: Cloud Expo SF "Elastic Cloud Infrastructure: Why the Enterprise Wants It"

Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco

These apps require different architectures

16

Loca

tion

of c

ompl

exity

Infra

App

Up OutPrimary scaling dimension

Elastic Infrastructure

Cloud

“Enterprise” Cloud

Page 17: NOV 8 2012: Cloud Expo SF "Elastic Cloud Infrastructure: Why the Enterprise Wants It"

Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco

Two Clouds for Two Needs

17

Uptime in InfrastructureData mgmt in Infra

InfraOps centricIT Ticket Requests

Default to H/W redundancyCustom H/W Arch

Scale Up

Elastic Infrastructure

Cloud

EnterpriseVirtualization

Cloud

Uptime in AppsData mgmt in Apps

DevOps centricApp Developer Self ServeMinimal H/W redundancy

Template H/W ArchScale Out

Page 18: NOV 8 2012: Cloud Expo SF "Elastic Cloud Infrastructure: Why the Enterprise Wants It"

Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco

The network design is different

18

Cloud

Enterprise

Enterprise Virtualization Cloud

Elastic Infrastructure Cloud

EC2

VPC

Cloud Apps

Traditional Apps

VLAN

netw

orki

ng m

odel

cloud type

FLAT

Page 19: NOV 8 2012: Cloud Expo SF "Elastic Cloud Infrastructure: Why the Enterprise Wants It"

Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco

And so we end up with this:

19

Traditional apps Cloud Apps

APPS

INFRA

Page 20: NOV 8 2012: Cloud Expo SF "Elastic Cloud Infrastructure: Why the Enterprise Wants It"

Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco

Elastic Infrastructure Cloud Design Principles

20

Page 21: NOV 8 2012: Cloud Expo SF "Elastic Cloud Infrastructure: Why the Enterprise Wants It"

Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco

EICs have Open APIs and protocols

21

Page 22: NOV 8 2012: Cloud Expo SF "Elastic Cloud Infrastructure: Why the Enterprise Wants It"

Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco

EICs use commodity / ODM hardware

22

ODMs operate their businesses on 3-10%

margins.

AMZN, GOOG, and Facebook buy direct

without a middleman.

Only a few enterprise vendors are pivoting to

compete.

Page 23: NOV 8 2012: Cloud Expo SF "Elastic Cloud Infrastructure: Why the Enterprise Wants It"

Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco

EICs use open source software

23

Open Cloud System 2.0

Page 24: NOV 8 2012: Cloud Expo SF "Elastic Cloud Infrastructure: Why the Enterprise Wants It"

Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco

EICs force software to be responsible for uptime, not the hardware

24

Hardware fails.Software fails.

People fail.

Only software can measure itself &

respond to failure in near real-time.

Applications designed for 99.999% uptime can run anywhere

Page 25: NOV 8 2012: Cloud Expo SF "Elastic Cloud Infrastructure: Why the Enterprise Wants It"

Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco

EICs are inherently scale-out in nature

25

A B

A B

A B C D N

Scale-up - Make boxes bigger (usually an HA pair)

Scale-out - Make more boxes

Page 26: NOV 8 2012: Cloud Expo SF "Elastic Cloud Infrastructure: Why the Enterprise Wants It"

Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco

EICs help you stop hugging servers and start shooting them instead

26attrib: Bill Baker, Distinguished Engineer, Microsoft* added by yours truly ...

VMs are your pets

You name them and when they get

sick, you nurse them back to

health

garfield.company.com

Servers are cattle

You number them and when they get

sick, you shoot them

web001.company.com*thanks to Bill Baker, Distinguished Engineer, Microsoft for this

Page 27: NOV 8 2012: Cloud Expo SF "Elastic Cloud Infrastructure: Why the Enterprise Wants It"

Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco

EICs use open networking approaches, and are moving to commodity networking eqpt

27

Page 28: NOV 8 2012: Cloud Expo SF "Elastic Cloud Infrastructure: Why the Enterprise Wants It"

Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco

Summary of EVC vs. EIC

28

Enterprise Virtualization Cloud Elastic Infrastructure Cloud

Applications Traditional & Legacy Dynamic

Scaling Architecture Up Out

Technology Stack Heavy & Proprietary Distributed & Open

Price/Performance 4x-8x 1x

Failure Domains Large Small

Provisioning Slower & Manual Faster & 100% API

Best For: Server consolidation and lower datacenter mgmt costs

On-demand, scale-out infrastructure for new apps

Page 29: NOV 8 2012: Cloud Expo SF "Elastic Cloud Infrastructure: Why the Enterprise Wants It"

Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco

Real-world scenarios

29

Page 30: NOV 8 2012: Cloud Expo SF "Elastic Cloud Infrastructure: Why the Enterprise Wants It"

Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco

Your app portfolio is spreading out...

30

Bare Metal Infrastructure

Virtualized Infrastructure

Private Enterprise

Virtualization Cloud

Hosted Bare Metal

Hosted Virtualized

Infrastructure

Public Enterprise

Virtualization Cloud

Public

Private

Public Elastic Infrastructure

Cloud

Private Elastic

Infrastructure Cloud

Traditional inelastic client/server type applications

Dynamic applications

PaaS SaaS

Page 31: NOV 8 2012: Cloud Expo SF "Elastic Cloud Infrastructure: Why the Enterprise Wants It"

Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco

Bare Metal Infrastructure

Virtualized Infrastructure

Private Enterprise

Virtualization Cloud

Hosted Bare Metal

Hosted Virtualized

Infrastructure

Public Enterprise

Virtualization Cloud

Public

Private

Public Elastic Infrastructure

Cloud

Private Elastic

Infrastructure Cloud

Traditional inelastic client/server type applications

Dynamic applications

PaaS SaaS

Building a public or private EIC

31

OpenCloud

System2.0

Page 32: NOV 8 2012: Cloud Expo SF "Elastic Cloud Infrastructure: Why the Enterprise Wants It"

Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco

Bare Metal Infrastructure

Virtualized Infrastructure

Private Enterprise

Virtualization Cloud

Hosted Bare Metal

Hosted Virtualized

Infrastructure

Public Enterprise

Virtualization Cloud

Public

Private

Public Elastic Infrastructure

Cloud

Private Elastic

Infrastructure Cloud

Traditional inelastic client/server type applications

Dynamic applications

PaaS SaaS

Building a hybrid Elastic Infra Cloud?

32

Page 33: NOV 8 2012: Cloud Expo SF "Elastic Cloud Infrastructure: Why the Enterprise Wants It"

Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco

App Architecture: Split-tier

33

Bare Metal Infrastructure

Virtualized Infrastructure

Private Enterprise

Virtualization Cloud

Hosted Bare Metal

Hosted Virtualized

Infrastructure

Public Enterprise

Virtualization Cloud

Public

Private

Public Elastic Infrastructure

Cloud

Private Elastic

Infrastructure Cloud

Traditional inelastic client/server type applications

Dynamic applications

PaaS SaaSWeb-Tier

DB Tier

Page 34: NOV 8 2012: Cloud Expo SF "Elastic Cloud Infrastructure: Why the Enterprise Wants It"

Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco

Hybrid app portfolio (Gaming-model)

34

Bare Metal Infrastructure

Virtualized Infrastructure

Private Enterprise

Virtualization Cloud

Hosted Bare Metal

Hosted Virtualized

Infrastructure

Public Enterprise

Virtualization Cloud

Public

Private

Public Elastic Infrastructure

Cloud

Private Elastic

Infrastructure Cloud

Traditional inelastic client/server type applications

Dynamic applications

PaaS SaaSUNKnown

Known

Page 35: NOV 8 2012: Cloud Expo SF "Elastic Cloud Infrastructure: Why the Enterprise Wants It"

Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco

Building new legacy-style apps?

35

Bare Metal Infrastructure

Virtualized Infrastructure

Private Enterprise

Virtualization Cloud

Hosted Bare Metal

Hosted Virtualized

Infrastructure

Public Enterprise

Virtualization Cloud

Public

Private

Public Elastic Infrastructure

Cloud

Private Elastic

Infrastructure Cloud

Traditional inelastic client/server type applications

Dynamic applications

PaaS SaaS

Page 36: NOV 8 2012: Cloud Expo SF "Elastic Cloud Infrastructure: Why the Enterprise Wants It"

Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco

Building new dynamic cloud apps?

36

Bare Metal Infrastructure

Virtualized Infrastructure

Private Enterprise

Virtualization Cloud

Hosted Bare Metal

Hosted Virtualized

Infrastructure

Public Enterprise

Virtualization Cloud

Public

Private

Public Elastic Infrastructure

Cloud

Private Elastic

Infrastructure Cloud

Traditional inelastic client/server type applications

Dynamic applications

PaaS SaaS

Page 37: NOV 8 2012: Cloud Expo SF "Elastic Cloud Infrastructure: Why the Enterprise Wants It"

Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco

Full dev/test/production lifecycle in the cloud

37

Bare Metal Infrastructure

Virtualized Infrastructure

Private Enterprise

Virtualization Cloud

Hosted Bare Metal

Hosted Virtualized

Infrastructure

Public Enterprise

Virtualization Cloud

Public

Private

Public Elastic Infrastructure

Cloud

Private Elastic

Infrastructure Cloud

Traditional inelastic client/server type applications

Dynamic applications

PaaS SaaS

Page 38: NOV 8 2012: Cloud Expo SF "Elastic Cloud Infrastructure: Why the Enterprise Wants It"

Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco

Develop out, production in

38

Bare Metal Infrastructure

Virtualized Infrastructure

Private Enterprise

Virtualization Cloud

Hosted Bare Metal

Hosted Virtualized

Infrastructure

Public Enterprise

Virtualization Cloud

Public

Private

Public Elastic Infrastructure

Cloud

Private Elastic

Infrastructure Cloud

Traditional inelastic client/server type applications

Dynamic applications

PaaS SaaSDevelopment

Production

Page 39: NOV 8 2012: Cloud Expo SF "Elastic Cloud Infrastructure: Why the Enterprise Wants It"

Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco

Or the reverse.

39

Bare Metal Infrastructure

Virtualized Infrastructure

Private Enterprise

Virtualization Cloud

Hosted Bare Metal

Hosted Virtualized

Infrastructure

Public Enterprise

Virtualization Cloud

Public

Private

Public Elastic Infrastructure

Cloud

Private Elastic

Infrastructure Cloud

Traditional inelastic client/server type applications

Dynamic applications

PaaS SaaS

Development

Production

Page 40: NOV 8 2012: Cloud Expo SF "Elastic Cloud Infrastructure: Why the Enterprise Wants It"

Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco

Traditional “large data” + “big data”

40

Bare Metal Infrastructure

Virtualized Infrastructure

Private Enterprise

Virtualization Cloud

Hosted Bare Metal

Hosted Virtualized

Infrastructure

Public Enterprise

Virtualization Cloud

Public

Private

Public Elastic Infrastructure

Cloud

Private Elastic

Infrastructure Cloud

Traditional inelastic client/server type applications

Dynamic applications

PaaS SaaS

LargeStructured

Data;

Data Warehouse;

BI

BIG Data

Unstructured

Hadoop

Page 41: NOV 8 2012: Cloud Expo SF "Elastic Cloud Infrastructure: Why the Enterprise Wants It"

Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco

Hybrid Big Data (in/out)?

41

Bare Metal Infrastructure

Virtualized Infrastructure

Private Enterprise

Virtualization Cloud

Hosted Bare Metal

Hosted Virtualized

Infrastructure

Public Enterprise

Virtualization Cloud

Public

Private

Public Elastic Infrastructure

Cloud

Private Elastic

Infrastructure Cloud

Traditional inelastic client/server type applications

Dynamic applications

PaaS SaaSPublic

Big Data

Private Big Data

Page 42: NOV 8 2012: Cloud Expo SF "Elastic Cloud Infrastructure: Why the Enterprise Wants It"

Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco

Private or Public PaaS

42

Bare Metal Infrastructure

Virtualized Infrastructure

Private Enterprise

Virtualization Cloud

Hosted Bare Metal

Hosted Virtualized

Infrastructure

Public Enterprise

Virtualization Cloud

Public

Private

Public Elastic Infrastructure

Cloud

Private Elastic

Infrastructure Cloud

Traditional inelastic client/server type applications

Dynamic applications

PaaS SaaS

Page 43: NOV 8 2012: Cloud Expo SF "Elastic Cloud Infrastructure: Why the Enterprise Wants It"

Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco

Hybrid PaaS

43

Bare Metal Infrastructure

Virtualized Infrastructure

Private Enterprise

Virtualization Cloud

Hosted Bare Metal

Hosted Virtualized

Infrastructure

Public Enterprise

Virtualization Cloud

Public

Private

Public Elastic Infrastructure

Cloud

Private Elastic

Infrastructure Cloud

Traditional inelastic client/server type applications

Dynamic applications

PaaS SaaS

Page 44: NOV 8 2012: Cloud Expo SF "Elastic Cloud Infrastructure: Why the Enterprise Wants It"

Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco

Traditional Systems Mgmt: Tivoli, etc.

44

Bare Metal Infrastructure

Virtualized Infrastructure

Private Enterprise

Virtualization Cloud

Hosted Bare Metal

Hosted Virtualized

Infrastructure

Public Enterprise

Virtualization Cloud

Public

Private

Public Elastic Infrastructure

Cloud

Private Elastic

Infrastructure Cloud

Traditional inelastic client/server type applications

Dynamic applications

PaaS SaaS

Page 45: NOV 8 2012: Cloud Expo SF "Elastic Cloud Infrastructure: Why the Enterprise Wants It"

Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco

Application Mgmt: Cloudscaling OCS

45

Bare Metal Infrastructure

Virtualized Infrastructure

Private Enterprise

Virtualization Cloud

Hosted Bare Metal

Hosted Virtualized

Infrastructure

Public Enterprise

Virtualization Cloud

Public

Private

Public Elastic Infrastructure

Cloud

Private Elastic

Infrastructure Cloud

Traditional inelastic client/server type applications

Dynamic applications

PaaS SaaS

Page 46: NOV 8 2012: Cloud Expo SF "Elastic Cloud Infrastructure: Why the Enterprise Wants It"

Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco

Application Mgmt: RightScale

46

Bare Metal Infrastructure

Virtualized Infrastructure

Private Enterprise

Virtualization Cloud

Hosted Bare Metal

Hosted Virtualized

Infrastructure

Public Enterprise

Virtualization Cloud

Public

Private

Public Elastic Infrastructure

Cloud

Private Elastic

Infrastructure Cloud

Traditional inelastic client/server type applications

Dynamic applications

PaaS SaaS

Page 47: NOV 8 2012: Cloud Expo SF "Elastic Cloud Infrastructure: Why the Enterprise Wants It"

Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco

Application Mgmt: enStratus

47

Bare Metal Infrastructure

Virtualized Infrastructure

Private Enterprise

Virtualization Cloud

Hosted Bare Metal

Hosted Virtualized

Infrastructure

Public Enterprise

Virtualization Cloud

Public

Private

Public Elastic Infrastructure

Cloud

Private Elastic

Infrastructure Cloud

Traditional inelastic client/server type applications

Dynamic applications

PaaS SaaS

Page 48: NOV 8 2012: Cloud Expo SF "Elastic Cloud Infrastructure: Why the Enterprise Wants It"

Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco

Homework

48

Page 49: NOV 8 2012: Cloud Expo SF "Elastic Cloud Infrastructure: Why the Enterprise Wants It"

Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco

Your Homework

49

•Share this more defined worldview / language to your team•Look at your business and where you create value•Analyze your upcoming app dev and existing apps•Clearly bucket them into EVC / EIC candidates•Build out your EVC and EIC•Create and deploy the apps•Accrue the business value

Page 50: NOV 8 2012: Cloud Expo SF "Elastic Cloud Infrastructure: Why the Enterprise Wants It"

Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco

THANK YOU

50

Troy AngrignonVP, BD & [email protected]@troyangrignon