Intel IT OpenStack Journey - OpenStack Fall 2012 Summit.pdf

Intel IT’s OpenStack Journey Das Kamhout, Principal Engineer, Intel IT Cloud Lead Twitter - @dkamhout Email - [email protected]

Copyright © 2012, Intel Corporation. All rights reserved. 2

Agenda

Our Cloud Journey

Intel IT Hybrid Open Cloud – Goals and Reality

Summary

http://preview.tinyurl.com/IntelITOpenCloud

http://preview.tinyurl.com/IntelITOpenCloud


Intel IT Vital Statistics

6,400 IT employees

– 54 global sites

91,500 Intel employees†

– 164 sites, 62 countries

67 Data Centers

– ~75,000 servers

>138,000 Devices

– >109K PCs (80%+ mobile)

– >38,000 Handhelds (60% BYO)

Source: Information provided by Intel IT as of Jan 2012. † does not include wholly owned subsidiaries that Intel IT does not directly support


ODCA and Intel IT Cloud Maturity Model

1 Intel IT future state goals – subject to change – as of June 2012

IT Ops

App Owner

App Dev

End User

Consumers

4 Simple Compute

IaaS

Compute, Storage,

and Network

2010 Intel® Cloud 1.0

Minimal Industry Solutions

Simple SaaS (e.g. exp reports)

Legacy Apps

Industry Normalized?

2014 Intel Cloud 3.0

Federated, Interoperable, and Open Cloud


Simple Compute IaaS

Compute, Storage,

and Network

Complex Compute IaaS

Early Industry Solutions

Simple SaaS (e.g. exp reports)

Cloud Aware Apps

Legacy Apps


Open Industry Materializes

Full Private IaaS

Complex SaaS (e.g. B2B)

Private PaaS

Industry Normalizing


Hybrid IaaS

Hybrid SaaS

Legacy

Hybrid PaaS

Cloud Aware Apps

In 2013 Hybrid applications will be the norm enabling low latency, lowest cost, improved security and seamless data sharing between services for end-user productivity.

Legacy Apps

Cloud Aware Apps


Intel® IT Cloud Strategic Direction

Deliver the necessary changes in how we expose applications/data to improve end user productivity

Drive the transformation to a large-scale automated Hybrid Cloud infrastructure

Accelerate the transformation of the Enterprise IT industry to Cloud


Intel’s Cloud Journey

Tomorrow

Hybrid Cloud Large

Private Cloud Limited

Public Cloud

Today

• 73% Virtualized (Traditional IT)

• 80% of New Services in the Cloud

• Under 1 Hour to Deploy Infrastructure

• Small number of SaaS apps in usage

• Land Applications in Minutes

• Open Cloud for Bursting Capacity

• SaaS for non-differentiated apps


Agenda

Our Cloud Journey


Summary


Key Concepts

Abstract users from underlying Cloud providers

Support multiple cloud providers, both private and public OpenStack and non-OpenStack is the reality

Common identity and entitlement services for reuse across interfaces

Open Source first, minimize proprietary API lock-in

Minimize internal technical debt, utilize the community to scale

Stay pragmatic, as we scale – not always 100% greenfield


Intel IT Cloud Future

Intel® Atom™ Intel® Xeon® Intel® Xeon® Phi™

Storage Compute Network

Physical Infrastructure

Infrastructure Services

App Platform Services Analytics Messaging Data Web

App Services Location Context Recommendation Identity

End User

Applications

Reusable Services empowering our end users


6 Months

Infr

astr

uctu

re

As a

Serv

ice

Co

ntr

ibu

tors

Compute Storage Network

12-18 Months

Physic

al

Infr

astr

uctu

re

Pro

du

cers

Cloud Operating Environment

Intel Contributions

Compute (Nova)

Block Storage (Nova Volume)

Object Storage (Swift)

Network (Quantum)

Dashboard (Horizon)

OS Images (Glance)

Open-Source (OpenStack*)

Intel® IT Open Cloud IaaS Platform Solution Stack

Manageability

3 Months M

onitori

ng

As a

Serv

ice

Watcher (e.g. Nagios*)

Decider (internal)

Collector (tbd)

Actor (e.g. Puppet*)

Intel Contributions Open-Source Foundation

Inte

rfaces

GUI (Graphical User Interface)

API (Application Programming Interface)

Co

nsu

mers

3 Months

Release Cadence


Function Intel IT Open Cloud (Private)

Compute OpenStack* - Nova Compute

Object Storage OpenStack* - Swift

Block Storage Gap – Cinder as target (reuse existing HW, and support new)

Load Balancers Using HW LB APIs – Direct integration with OpenStack* future

Networking Nova Network Now – move to Quantum with Grizzly

Auto Scaling Gap – Missing APIs (exploring HEAT. Ceilometer)

Monitoring Nagios* - Missing APIs (exploring HEAT, Ceilometer)

Configuration Puppet* - Missing APIs (exploring HEAT)

Backup and Recovery Snapshot to Object Storage

NoSQL Database Cassandra*, MongoDB* – Gap on APIs (exploring options)

Relational DB *SQL – Gap on APIs (exploring options)

Images Glance – Intel IT images, end user images later

Map Reduce – Analytics Hadoop* with APIs but without orchestration

DNS Missing APIs


Intel IT Open Cloud – Details Now Key Technologies • Cloud – OpenStack* Essex • Monitoring – Nagios*

• Configuration – Puppet*

• Hosts – Intel Xeon 5600 Blades • Network – 10GBe • Storage – Scale out on 2U

Running cutting edge Web services, on a predominantly open source cloud.

OPEN CLOUD HOSTING ENVIRONMENT

COMPUTE NODES Cloud Controller Services • Volume Controller • Network Controller • Scheduler • Databases • API

Hosting Services • Authentication • DNS • Automation • Security Services

STORAGE NODES

REMOTE DESKTOP SERVICE

Tenant 1

Tenant 2

Tenant x

Load Balancer

CENTRALIZED MONITORING AND MANAGEMENT • Patch Management • Package Repository • Authentication • Monitoring

INTEL DMZ/ENCLAVE ENVIRONMENT

Load Balancer

NETWORK FABRIC

INTERNET ICC Firewalls

Integration with Support Desk and other Ops capabilities


Focus Area Key Aspects

Technical Active/Active App Design – Software Design for Failure

Unified Monitoring/Manageability/Authentication

IT Service broker handling cloud on-boarding internal and external

Operational IT handling basic IaaS container levels externally, covering all IaaS internally

Business Single contract with Intel IT funding and showback to BUs

Liability/Indemnification at acceptable levels for associated risk

Intel IT Hybrid Cloud

INTERNET

INTEL SITE A

POD POD POD

INTEL SITE B

POD POD POD

EXTERNAL PROVIDER

POD POD POD

GLB

Fully Meshed VPN Tunnels


Self Remediation Framework – for 99.99%

Load Balancer Load Balancer

COMPUTE NODES STORAGE NODES

NETWORK FABRIC

CLOUD ORCHESTRATION SERVICES

VM VM VM VM

APP A APP B APP N Capabilitie

s t

o W

atc

h

Monitor

Event or Alert Initiate Action Actio

n E

xecutio

n

WATCHER (Nagios*)

ACTOR (Puppet*)

DECIDER (Analysis and Correlation)


Rules of Cloud Aware Apps Software Developer Changes

Shift to stateless cloud services − Assume and design for failure at all layers

Scale horizontally − Scaling up always has a break point, scaling horizontally ensures greater scalability

(close to “infinite” if you remove app bottlenecks)

Eventual consistency at the data layer

Shift to DevOps or NoOps model − Set rules/automation for desired effects, utilize APIs, continue to assume failure

− Never wait on IT, never wait on other software developers

− IT Infrastructure team should seem invisible

Implement true Web services for consumption

http://www.opendatacenteralliance.org/docs/DevCloudCapApp.pdf

http://www.opendatacenteralliance.org/docs/DevCloudCapApp.pdf


Areas to Close for Enterprise Keep VMs up for traditional/legacy apps:

1. Shared Block Storage – for boot volumes, and data

2. Live Migration for maintenance of hosts

3. Restart of instances when host fails

Enable a federated Hybrid cloud environment:

1. End users interface allowing for seamless use across zones, regions, and across clouds

2. Identity federated across instances and clouds

3. Orchestration across global/multiple instances

Highly Available Infrastructure Services (cloud built as cloud)

Secure, Auditable – Role Based Access, Regulatory Compliance, Audit Trails

Larger List - http://tinyurl.com/ChipInForEnterprise


Agenda

Our Cloud Journey


Summary


Wrap Up - Summary

Our Direction = Federated, Interoperable and Open Cloud

• Strong success with our Enterprise Private Cloud

• Open Cloud in production to handle cloud architected apps, enterprise apps up next

• Hybrid now, later just call it Cloud

• Lots of space and opportunity for us all to contribute

• Seeking other large scale Enterprises paving the path

However, Enterprise IT will change massively in next 2-5 years


Resources for You

• Engage with ODCA

• Learn about usage models

• Use the RFP Tool

• www.opendatacenteralliance.org

Over 300 Global IT leaders representing over $100B in annual IT spend

Learn more about IT@Intel best practices www.intel.com/it

Backup


Legal Notices

This presentation is for informational purposes only. INTEL MAKES NO WARRANTIES, EXPRESS OR IMPLIED, IN THIS SUMMARY.

Intel and the Intel logo are trademarks of Intel Corporation in the U.S. and/or other countries.

* Other names and brands may be claimed as the property of others.

Copyright © 2012, Intel Corporation. All rights reserved.

Intel IT OpenStack Journey - OpenStack Fall 2012 Summit.pdf

Documents

Transcript of Intel IT OpenStack Journey - OpenStack Fall 2012 Summit.pdf