Cloud Foundry Introduction (w Demo) at Silicon Valley Code Camp

29
1 © Copyright 2013 Pivotal. All rights reserved. 1 © Copyright 2013 Pivotal. All rights reserved. Cloud Foundry The Self-healing, Elastic Runtime Cornelia Davis Director, Platform Engineering, Cloud Foundry, Pivotal [email protected] | @cdavisafc | October 2014

description

Silicon Valley Code Camp, The Self-healing Elastic Runtime that is Cloud Foundry. While we did mostly demo in this session, these slides set a bit of context first. Also includes the four levels of HA in Cloud Foundry.

Transcript of Cloud Foundry Introduction (w Demo) at Silicon Valley Code Camp

Page 1: Cloud Foundry Introduction (w Demo) at Silicon Valley Code Camp

1© Copyright 2013 Pivotal. All rights reserved. 1© Copyright 2013 Pivotal. All rights reserved.

Cloud FoundryThe Self-healing, Elastic Runtime

Cornelia DavisDirector, Platform Engineering, Cloud Foundry, [email protected] | @cdavisafc | October 2014

Page 2: Cloud Foundry Introduction (w Demo) at Silicon Valley Code Camp

2© Copyright 2013 Pivotal. All rights reserved.

The Power of PaaS (On Premise & Off Premise)

Traditional IT

Storage

Servers

Networking

O/S

Middleware

Virtualization

Data

Applications

Runtime

You

Man

age

O/S

IaaS

Storage

Servers

Networking

Middleware

Virtualization

Data

Applications

Runtime

You

Man

age

IaaS

O/S

PaaS

Storage

Servers

Networking

Middleware

Virtualization

Data

Applications

Runtime

Pivotal CF +

Choice of Virtualized

Infrastructure

Business Value, Agility & Cost Savings

You

M

anag

e

Page 3: Cloud Foundry Introduction (w Demo) at Silicon Valley Code Camp

3© Copyright 2013 Pivotal. All rights reserved.

“Software is Eating the World”

Page 4: Cloud Foundry Introduction (w Demo) at Silicon Valley Code Camp

4© Copyright 2013 Pivotal. All rights reserved.

Software is Eating the World

$5B valuationFinancial Services

$10B valuationTravel & Hospitality

$18B valuation Transportation

$3.2B Acquisition by GoogleHome Automation

$20B valuation Entertainment

$26B valuationAutomotive

Page 5: Cloud Foundry Introduction (w Demo) at Silicon Valley Code Camp

5© Copyright 2013 Pivotal. All rights reserved.

You are either building a software business…

Or losing to someone who is.

Page 6: Cloud Foundry Introduction (w Demo) at Silicon Valley Code Camp

6© Copyright 2013 Pivotal. All rights reserved.

Amazon, a book store in Seattle,deploys code every 11 seconds

Page 7: Cloud Foundry Introduction (w Demo) at Silicon Valley Code Camp

7© Copyright 2013 Pivotal. All rights reserved.

Continuously Delivered MicroservicesFaster & Safer

Page 8: Cloud Foundry Introduction (w Demo) at Silicon Valley Code Camp

8© Copyright 2013 Pivotal. All rights reserved.

Rapid Innovation Requires a Combined Approach

Dramatically improve developer experience

Agile teams, rapid iteration

Microservices, incubate open source advancements (data and apps)

Continuous delivery, no planned downtime

Instant scaling of apps and data services

Automation and deployment consistency at every step

DEVELOPERS OPERATORS

Page 9: Cloud Foundry Introduction (w Demo) at Silicon Valley Code Camp

9© Copyright 2013 Pivotal. All rights reserved.

Agile Development

DEVELOPMENT

Dev Space 1

AWS

DEVELOPMENT

Dev Space 2

AWS/vSphere

QA

QA/Scale

QA Space

AWS

Production

PRODUCTION

Prod 1

AWS/vSphere

No code or configuration changes!

Agile Methodologies Meets Agile Platforms

Prod 2

Page 10: Cloud Foundry Introduction (w Demo) at Silicon Valley Code Camp

10© Copyright 2013 Pivotal. All rights reserved.

The Reality in Enterprises…Months and Weeks

… and do it all over again from Dev Test Prod on any infrastructure

Page 11: Cloud Foundry Introduction (w Demo) at Silicon Valley Code Camp

11© Copyright 2013 Pivotal. All rights reserved.

USERS OPERATORS

The Pivotal CF Way…Hours and Minutes

App Deployment: 30-90 seconds

target <my cloud>push <my app>bind <my services>scale <my app> +1000

Cloud Deployment: 2-4 hours

provision cloud <Public/Private>provision service <PaaS,Hadoop...>upgrade/update <my cloud>scale <my cloud>

Page 12: Cloud Foundry Introduction (w Demo) at Silicon Valley Code Camp

12© Copyright 2013 Pivotal. All rights reserved.

OPEN SOURCE IS THE NEW OPEN STANDARD

Page 13: Cloud Foundry Introduction (w Demo) at Silicon Valley Code Camp

13© Copyright 2013 Pivotal. All rights reserved.

Industry Transformation

In the beginning…

Open vs Proprietary

Open Source is the new Open Standard

Open Source as a strategic asset

Purpose Motive as competitive differentiator

Page 14: Cloud Foundry Introduction (w Demo) at Silicon Valley Code Camp

14© Copyright 2013 Pivotal. All rights reserved.

Cloud Foundry: The Largest Open PaaS EcosystemPlatinum

Gold

Silver

Page 15: Cloud Foundry Introduction (w Demo) at Silicon Valley Code Camp

15© Copyright 2013 Pivotal. All rights reserved.

Page 16: Cloud Foundry Introduction (w Demo) at Silicon Valley Code Camp

16© Copyright 2013 Pivotal. All rights reserved.

…And One More Thing: Cloud Independent

Deploy, Operate, Update & Scale with minimal downtime on choice of IaaS

….and more

Application Containerization & Cluster Scheduling

Native & Extended Data, Mobile and Platform Services

Automatic AppServer & OS Configuration with Buildpacks (“just push your app”)

Policy, Identity and Roles Management

App Health Mng, Load Balancing, Rapid Scaling, Availability Zones

IaaS Provisioning, Scaling & Configuration

Application Network Security Groups

Application to Services Binding and Access

Logging as a service,Application metrics & performance,Metric based scaling

Page 17: Cloud Foundry Introduction (w Demo) at Silicon Valley Code Camp

17© Copyright 2014 Pivotal. All rights reserved.

A Multi-Cloud 3rd Platform: Cloud Foundry

Elastic Runtime

Agile Microservices

Elastic Hadoop

Jenkins Service

(CI)

Google

Redis

Cloud Foundry BOSH

KV Store

VMware EC2 Openstack

Multi-Cloud Declarative Service Deployment, Operations

Elastic managed runtime service integrated into leading data services; all scaled and managed by CF BOSH

Rabbit MQ

Page 18: Cloud Foundry Introduction (w Demo) at Silicon Valley Code Camp

18© Copyright 2014 Pivotal. All rights reserved. 18© Copyright 2014 Pivotal. All rights reserved.

Demo!

Page 19: Cloud Foundry Introduction (w Demo) at Silicon Valley Code Camp

19© Copyright 2013 Pivotal. All rights reserved.

Application Instances and Availability Zones

Rout

erDEA

DEA

DEA

Pivotal CF Elastic Runtime

DEA

DEA

DEA

Zone 1 Zone 2 Application instances are evenly distributed over two availability zones.

Loosing an AZ keeps instances running and available.

App Ops

Page 20: Cloud Foundry Introduction (w Demo) at Silicon Valley Code Camp

20© Copyright 2013 Pivotal. All rights reserved.

Rout

er

Failed Application Instances Replaced

BlobstoreCloud Controller

Health Manager

Actual StateDesired State

Messaging(NATS)

DEA DEA DEA

App Ops

Pivotal CF Elastic Runtime

Page 21: Cloud Foundry Introduction (w Demo) at Silicon Valley Code Camp

22© Copyright 2013 Pivotal. All rights reserved.

ERS Processes are Monitored

IaaSPivotal CF Operations Manager

PaaS Ops

Health Manager

AGENT

DEA

AGENT

Cloud Controller

AGENT

Message Bus

Health Monitor

Responses:

pager

email

monitoring

Page 22: Cloud Foundry Introduction (w Demo) at Silicon Valley Code Camp

23© Copyright 2013 Pivotal. All rights reserved.

ERS Processes are Monitored

IaaSPivotal CF Operations Manager

PaaS Ops

Health Manager

AGENT

DEA

AGENT

Cloud Controller

AGENT

Message Bus

Health Monitor

Responses:

pager

email

monitoring

Page 23: Cloud Foundry Introduction (w Demo) at Silicon Valley Code Camp

24© Copyright 2013 Pivotal. All rights reserved.

ERS Processes are Monitored

IaaSPivotal CF Operations Manager

PaaS Ops

Health Manager

AGENT

DEA

AGENT

Cloud Controller

AGENT

Message Bus

Health Monitor

Responses:

pager

email

monitoring

Page 24: Cloud Foundry Introduction (w Demo) at Silicon Valley Code Camp

25© Copyright 2013 Pivotal. All rights reserved.

VMs are Monitored

IaaSPivotal CF Operations Manager

PaaS Ops

Health Manager

AGENT

DEA

AGENT

Cloud Controller

AGENT

Message Bus

Health Monitor

Responses:

pager

email

monitoring

ressurector

BOSH Director

Desired State Actual State

Page 25: Cloud Foundry Introduction (w Demo) at Silicon Valley Code Camp

26© Copyright 2013 Pivotal. All rights reserved.

VMs are Monitored

IaaSPivotal CF Operations Manager

PaaS Ops

Health Manager

AGENT

DEA

AGENT

Cloud Controller

AGENT

Message Bus

Health Monitor

Responses:

pager

email

monitoring

ressurector

BOSH Director

Desired State Actual State

Page 26: Cloud Foundry Introduction (w Demo) at Silicon Valley Code Camp

27© Copyright 2013 Pivotal. All rights reserved.

VMs are Monitored

IaaSPivotal CF Operations Manager

PaaS Ops

Health Manager

AGENT

DEA

AGENT

Cloud Controller

AGENT

Message Bus

Health Monitor

Responses:

pager

email

monitoring

ressurector

BOSH Director

Desired State Actual StateCPI

Page 27: Cloud Foundry Introduction (w Demo) at Silicon Valley Code Camp

28© Copyright 2013 Pivotal. All rights reserved.

Four levels of HA in PCF

Elastic Runtime (ERS):

Distribution across availability zones

Application health management and recovery

Operations Manager (cluster management):

Process monitoring, recovery and alerting

Virtual machine health monitoring, recovery and alerting

http://blog.gopivotal.com/cloud-foundry-pivotal/products/the-four-levels-of-ha-in-pivotal-cf

Page 28: Cloud Foundry Introduction (w Demo) at Silicon Valley Code Camp

29© Copyright 2013 Pivotal. All rights reserved.

Thank you!

Slides can be found at: http://www.slideshare.net/cdavisafc

Page 29: Cloud Foundry Introduction (w Demo) at Silicon Valley Code Camp

BUILT FOR THE SPEED OF BUSINESS