IBM SmartCloud Orchestration

© 2013 IBM Corporation

IBM SmartCloud OrchestratorArchitected for Extensibility


Need for End to end Orchestration

End to End Automation

Automate everything to deliver a production environment: multi node applications, storage, network, change and configuration, …

Standardization

Deliver “services”: repeatable and controlled processes, auditable, simplified self service consumption,

An Open and Flexible Platform

Integrate with existing data center, processes and tools. Provide choices to customers that want to avoid a technology lock in - based on Open Standards

Provisioning is not enough. Customers need end to end automation to accelerate delivery of IT services, while reducing costs

© 2013 IBM Corporation3 IBM Confidential

Why do we need an Orchestrator ?

1. Customers are looking for end to end automation of cloud service delivery to achieve greater returns

2. Provisioning play a key role, but is just one of many steps that must be automated3. Each customer has unique requirements to integrate with existing data center processes and

tools.

VM Provisioning

Real customerexample


Orchestration Engine

Network Domain

Storage Domain

IT ManagementMonitoring

DomainData

Availability Domain

Compute Domain

Monitoring IT Asset

Management

Service Desk

Storage Domain

Change Management

Provision PatternProvision Pattern

OrchestrateOrchestrate

Network Domain

Workload Orchestration Workload aware placement, optimization and operation

Resource OrchestrationOnboard, provision, manage

CPU, Storage and Network

Service OrchestrationManage the lifecycle of business

applications

DBAppWeb

Managing workloads in a Cloud Enabled Data Centerrequires orchestration

© 2013 IBM Corporation5

What is SmartCloud Orchestration …

An open and scalable cloud platform

An easy to use orchestrator for cloud service automation

A ready to use automation library

A marketplace for content sharing and re-use


High level architecture

SCOrchestrator

Automation Engine

BPM Process Server

Automation Engine

BPM Process Server

Modeling and Admin

Modeling and Admin

Image LibraryImage Library

VMWare vCenterVMWare vCenter

ICCT

Image Creation

ICCT

Image Creation

Self ServiceSelf ServiceAutomation Modeling UI

IBM Business Process Manager (BPM)

Automation Modeling UI

IBM Business Process Manager (BPM)

IBM Tivoli Monitoring

(ITM)

IBM Tivoli Monitoring

(ITM)

KVMKVM

Content packagesContent packages

Composite Patterns ManagementComposite Patterns Management

APIAPISmartCloud Cost

Management

(SCCM)

SmartCloud Cost

Management

(SCCM)

CloudUser

Offering CatalogOffering Catalog

APIAPI

ServiceDesk

ServiceDesk

Account ing

Account ing

Cost Mgmt

Cost Mgmt

NetworkFW/LB

NetworkFW/LB

StorageFile-based

StorageFile-based

Hypervisor Management

OpenStack Gateway

Hypervisor Management

OpenStack Gateway

Amazon EC2Amazon EC2

Hybrid ExtensionHybrid Extension OpenStackOpenStack

…

*) supported in following releases


Zoom in the provisioning engine

Virtual Applications

Virtual Applications

Hypervisors & IAAS Management SHIMHypervisors & IAAS Management SHIM

REST APIsREST APIsSelf Service and Admin UISelf Service and Admin UI

OpenStack ShimOpenStack Shim

DeploymentDeployment

Virtual SystemsVirtual

Systems

IAAS Gateway

VMVM

KVMvCenter

OpenStack1

... VMVM

KVMvCenter

OpenStackN

Virtual Image Library

SCE SCE


SCOrchestrator – Content Types

Software Bundle– A software bundle contains and describes the software available for use within a virtual

image. It includes information about how to install and configure the software, prerequisites of the software, and parameters available for customizing.A software bundle is used during image creation with Image Construction and Composition Tool (ICCT, Part of SCP/SCO)

Virtual Image– A Virtual image contains the base operating system and the optional activation code

which configures a virtual server which is based on such virtual image. In addition it may also contain one or more software components.

Pattern (vSys & addOns)– A pattern is a collection of multiple images, each with optional software components.

Patterns are a logical representation of a recurring topology for a given set of deployment requirements such as e.g. a multi-tiered web application comprising of HTTP Server, App Server and DB Server.In this example, each tier would be represented by its own virtual image, which includes configuration scripts to configure the multi-tier application accordingly

Resource type operations (implemented as BPM workflows)

Patterns (vApp & TOSCA) – Patterns to compose workload aware topologies

Orchestration– Content for orchestration can be complete ready to use offerings implemented as

workflow processes including the corresponding user interface

– … and/or a collection of building blocks to ease the creation of orchestration.These building blocks can be activity implementations, user interfaces, UI widget, …

Service OrchestrationManage the lifecycle of business applications

Workload Orchestration Workload aware placement, optimization and operation

Resource OrchestrationOnboard, provision, manage CPU,

Storage and Network


Multiple pattern types to enable open ecosystem

Virtual Application Patterns

• Highly automated deployments using expert patterns

• Business policy driven elasticity

• Built for the cloud environment

• Leverages elastic workload management services

Virtual System Patterns

• Automated deployment of middleware topologies

• Traditional administration and management model

• Application and infrastruture driven elasticity

Virtual Appliances• Standard software installation and

configuration on OS

• Images created through extend/capture

• Traditional administration and management model

• Infrastructure driven elasticity

Virtual Appliance

Metadata

Softwareapplication

Operatingsystem

Virtual Appliance

Virtual Appliance

Metadata

ApplicationServer

Operatingsystem

Virtual Appliance

Metadata

ApplicationServer

Operatingsystem

Virtual Appliance

Metadata

HTTPServer

Operatingsystem

Virtual Application PatternsVirtual System PatternsVirtual Appliances

Softwareapplication


Custom Orchestration Operations

SCO allows definition of custom operations for various orchestration granularities

– Event triggered Actions… used to extend the basic pattern engine capabilities … plug into existing programming flows at predefined plugpoints/events… with defined semantics and data modele.g. Approval (‘pre’), Open firewall port (‘post’), …

– User triggered Actions… used to extend the basic manageability actions of service instances… provide addtl mgmt capabilities for all or specific patternse.g. Backup, Install SW, Open problem, …

– Service Operations… implementation of service catalog offerings … used for end user customized operations, e.g. deploy pattern, create filesystem, …… used for administrative actions such as datacenter configuration e.g. Register StorageHost, User onboarding, …

A

B

A

B

C

X


SCO

Custom BPM processes

Pattern engine base processing

Event triggered actions for typical pattern deployment

ResolveModel

DefinePlacement

Copyimages

Configurehypervisor Start VM

ExecuteConfigScripts

Notifyuser

Pre-provisionEvent

Pre-VM-startEvent

Post-provisonPost-provision-failed

Event

Trigger one or multiple custom

processes on certain events


Orchestration Registry


SCO Self-Service Catalog


Configuration of Orchestration Actions

BPM processwhich implements the

orchestration logic


end user interface


Configuration of Self Service Offerings


orchestration logic


end user interface

Settings to define the visualization

of the offering in the service catalog

1

2

3

1

2

3


Approval / Human Tasks


Library of virtual templates, sw packages,

script, add on ( disks, network cards, etc)

Graphical editor for composing and

configuring workloads

Creation of patterns

Reuse chef recipes from community


Connecting images in a pattern: example


Scenario 1 – Speed up business application deploymentEnd User : (1) Access the SCO self service catalog to deploy a new Media Wiki application.

Service Designer: (2) Modify the Media Wiki service via the pattern editor.(3) Publish the new service in the catalog


Scenario 2 – End to end automationService Designer: (1) Access the cloud market place and download a storage automation package.(2) Create a new MediaWiki offering which also performs automated storage and network configuration. (3) Publish the new offering in the catalog.

End User : (4) Access the catalogue and requests new “Media Wiki”


Cloud Marketplace

Enable customers to rapidly discover and implement cloud solutions

Enable business partners and ISVs to create value by adding content to IBM cloud solutions

Enable IBM services and development to rapidly deliver & iterate on capabilities in response to changing customer requirements and integration needs

Enable collaboration within the ecosystem to accelerate customer value creation

Establish cloud platform agility and value by rapidly delivering content (organic & partner ecosystem) using the AppStore model


Managing the infrastructure

Cloud group1

IWDOpenStack

.

.

.

Region 1

Compute node1

Compute nodeX

Availability zone1

...

Compute node1

Compute nodeK

Availability zoneZ

......

Region n

Compute node1'

Compute nodeX'

Availability zone1'

...

Compute node1'

Compute nodeK'

Availability zoneZ'

......

Cloud groupZ

Cloud group1'

Cloud groupZ'

A cloud group represents a pair [Region, availability zone] in OpenStack For each cloud group a single hypervisor is assigned despite the number of compute nodes in the availability zone


Managing the infrastructure

IWDOpenStack

.

.

.

Region 1

Compute node1

Compute nodeX

Availability zone1

...

Compute node1

Compute nodeK

Availability zoneZ

......

Region n

Compute node1'

Compute nodeX'

Availability zone1'

...

Compute node1'

Compute nodeK'

Availability zoneZ'

......

Network1 IP group1

Network2 IP group2

Networkn IP groupn

For each network in each region a pair [network, IP group] is created in IWD Each network in a region is attached to all hypervisors in IWD related to that region


In the beginning, there was the perfect image…1

Then users starting making changes and “snapshots”……and what they put in the images is unknown…

2

Then they get copied to multiple locations……and some change again…

3

Then you need to apply a critical security patch…how? … where?4

What’s the problem with Virtualization and Standardization?Managing images


Capturing Images is easy

There are many tool that simplify the process All you need is enough space the store them

However managing images is hard:

Standardization Search Version control Drift Detection Vulnerability Image building

Virtual Image Library and Image Construction and Composition Tool help you addressing these issues!


What's new in Virtual Image Library

• OpenStack support– Ability to federate OpenStack regions

– Ability to use OpenStack Keystone as custom user registry

– In addition, VIL 2.2 exposes OpenStack Glance-compliant REST APIs

• Federating operational repositories across WAN to support geographically distributed data centers

– New Proxy components to decentralize analytics and check-in/out capabilities over distributed sites

– New analytics engine providing better performances when introspecting image contents

– New Reference Repository based on a peer-to-peer network of nodes that build a shared repository

– Firewall-friendly solution to traverse segregated networks

• Improved control over indexing functions– Canceling queued indexing tasks

– Handling of user-initiated actions at higher priority than the automatically triggered tasks

• Handling OVA images and related metadata


What's new in ICCT

• New Cloud Provider for OpenStack

– Possibility to interact directly with an OpenStack instance

– Possibility to interact with the IaaS GW component and the VIL image service exposed through that component


• Learn more about the IBM SmartCloud Orchestrator

• Join the open development community to get access to SmartCloud Orchestrator

• http://ibm.co/CPandO

• Watch the video for a quick overview of SmartCloud Orchestrator http://bit.ly/YKe9gf

• Learn more about the benefits of cloud orchestration IDC Technology Spotlight on IBM SmartCloud Orchestrator http://ibm.co/105MtJO

• Join the IBM SmartCloud Community

References

IBM SmartCloud Orchestration

Technology

Transcript of IBM SmartCloud Orchestration