AND AUTOMATION OPENSTACK DEPLOYMENT - … fileCompute I/O based NUMA scheduling Quiesce file-systems...

28
@kernelcdub @thomasdcameron @jameslabocki May 5, 2015 OPENSTACK DEPLOYMENT AND AUTOMATION

Transcript of AND AUTOMATION OPENSTACK DEPLOYMENT - … fileCompute I/O based NUMA scheduling Quiesce file-systems...

Page 1: AND AUTOMATION OPENSTACK DEPLOYMENT - … fileCompute I/O based NUMA scheduling Quiesce file-systems during image snapshot using QEMU guest agent ... OPENSTACK DEPLOYMENT AND AUTOMATION

@kernelcdub@thomasdcameron@jameslabocki

May 5, 2015

OPENSTACK DEPLOYMENTAND AUTOMATION

Page 2: AND AUTOMATION OPENSTACK DEPLOYMENT - … fileCompute I/O based NUMA scheduling Quiesce file-systems during image snapshot using QEMU guest agent ... OPENSTACK DEPLOYMENT AND AUTOMATION

OPENSTACK AT RED HAT

Page 3: AND AUTOMATION OPENSTACK DEPLOYMENT - … fileCompute I/O based NUMA scheduling Quiesce file-systems during image snapshot using QEMU guest agent ... OPENSTACK DEPLOYMENT AND AUTOMATION

OPENSTACK CONTRIBUTIONS

OPENSTACK DEPLOYMENT AND AUTOMATION00

Overall Commits by Company (aggregated) Red Hat Commits by Project

Bitergia: http://activity.openstack.org/dash/browser/scm-companies.html?release=junoStakalytics: http://stackalytics.com/?release=juno&company=red%20hat

Red Hat Cares … About Every Project

Page 4: AND AUTOMATION OPENSTACK DEPLOYMENT - … fileCompute I/O based NUMA scheduling Quiesce file-systems during image snapshot using QEMU guest agent ... OPENSTACK DEPLOYMENT AND AUTOMATION

RHEL OpenStack Platform 7

●OpenStack Kilo

●3 Year Life-Cycle

●Co-Engineered with RHEL 7

●Faster Paced Management ToolRelease (2 months)

00 OPENSTACK DEPLOYMENT AND AUTOMATION

Page 5: AND AUTOMATION OPENSTACK DEPLOYMENT - … fileCompute I/O based NUMA scheduling Quiesce file-systems during image snapshot using QEMU guest agent ... OPENSTACK DEPLOYMENT AND AUTOMATION

NEW SERVICES

● Database as a Service (“Trove”) - Fully supported

● VM high availability Service based on Pacemaker Remote

● DNS as a Service (“Designate”) - Tech Preview

● Operational tools (logging, monitoring, etc) - Tech Preview

● File Share Service (“Manila”) - Tech Preview

00 OPENSTACK DEPLOYMENT AND AUTOMATION

Page 6: AND AUTOMATION OPENSTACK DEPLOYMENT - … fileCompute I/O based NUMA scheduling Quiesce file-systems during image snapshot using QEMU guest agent ... OPENSTACK DEPLOYMENT AND AUTOMATION

RED HAT CONTRIBUTIONS TO KILONetworking

● ML2/OVS port security● DPDK accelerated OVS (Tech Preview)● LBaaS v2 API

Compute

● I/O based NUMA scheduling● Quiesce file-systems during image

snapshot using QEMU guest agent● Support for vhost-user virtual interfaces

Storage

● Image Conversion● Incremental Backup● Private Volume Types● Import/Export snapshots

00 OPENSTACK DEPLOYMENT AND AUTOMATION

Identity

● Hierarchical multi-tenancy● Federation support

Dashboard

● Refined Plugin Framework● AngularJS based wizards● Improved Network Topology Graph

Management● Pluggable Horizon component● Integrated management tools

Page 7: AND AUTOMATION OPENSTACK DEPLOYMENT - … fileCompute I/O based NUMA scheduling Quiesce file-systems during image snapshot using QEMU guest agent ... OPENSTACK DEPLOYMENT AND AUTOMATION

DEPLOYMENT AND AUTOMATION

Page 8: AND AUTOMATION OPENSTACK DEPLOYMENT - … fileCompute I/O based NUMA scheduling Quiesce file-systems during image snapshot using QEMU guest agent ... OPENSTACK DEPLOYMENT AND AUTOMATION

CONFIGURATIONMANAGEMENT

Leverage existing expertise to deploy OpenStack

DEPLOYMENT AND AUTOMATION

RDO MANAGER

Tools for deploying and managing OpenStack with

OpenStack

CONTAINERS

The not so distant future for OpenStack deployments

Multiple Methodologies For Deployment

00 OPENSTACK DEPLOYMENT AND AUTOMATION

Page 9: AND AUTOMATION OPENSTACK DEPLOYMENT - … fileCompute I/O based NUMA scheduling Quiesce file-systems during image snapshot using QEMU guest agent ... OPENSTACK DEPLOYMENT AND AUTOMATION

DEPLOYMENT AND AUTOMATIONConfiguration Management

00 OPENSTACK DEPLOYMENT AND AUTOMATION

Tempest

QuickStack UpdatesCommitted to Git

Jenkins StartsBuild

Jenkins Verifies

Deployment

Jenkins UpdatesForeman

SystemsDeployClasses

Page 10: AND AUTOMATION OPENSTACK DEPLOYMENT - … fileCompute I/O based NUMA scheduling Quiesce file-systems during image snapshot using QEMU guest agent ... OPENSTACK DEPLOYMENT AND AUTOMATION

DEPLOYMENT AND AUTOMATIONRDO Manager

Hardware

Ironic

Nova

Tuskar and Heat

Ceilometer Glance

Ironic API

hardware management driver

hardware management driver

Deployment Orchestration

Instrumentation Agents

Bare Metal Drivers

Supporting ComponentsHA configurationService configuration

00 OPENSTACK DEPLOYMENT AND AUTOMATION

Page 11: AND AUTOMATION OPENSTACK DEPLOYMENT - … fileCompute I/O based NUMA scheduling Quiesce file-systems during image snapshot using QEMU guest agent ... OPENSTACK DEPLOYMENT AND AUTOMATION

DEPLOYMENT AND AUTOMATIONRDO Manager

00 OPENSTACK DEPLOYMENT AND AUTOMATION

Page 12: AND AUTOMATION OPENSTACK DEPLOYMENT - … fileCompute I/O based NUMA scheduling Quiesce file-systems during image snapshot using QEMU guest agent ... OPENSTACK DEPLOYMENT AND AUTOMATION

DEPLOYMENT AND AUTOMATIONRDO Manager

1. One or more Management Nodes are installed in the control rack.

00 OPENSTACK DEPLOYMENT AND AUTOMATION

Page 13: AND AUTOMATION OPENSTACK DEPLOYMENT - … fileCompute I/O based NUMA scheduling Quiesce file-systems during image snapshot using QEMU guest agent ... OPENSTACK DEPLOYMENT AND AUTOMATION

DEPLOYMENT AND AUTOMATIONRDO Manager

2. Operator logs into Operator Dashboard to configure the infrastructure

00 OPENSTACK DEPLOYMENT AND AUTOMATION

Page 14: AND AUTOMATION OPENSTACK DEPLOYMENT - … fileCompute I/O based NUMA scheduling Quiesce file-systems during image snapshot using QEMU guest agent ... OPENSTACK DEPLOYMENT AND AUTOMATION

DEPLOYMENT AND AUTOMATIONRDO Manager

3. Management App discovers your infrastructure hardware.

Hardware Discovery

00 OPENSTACK DEPLOYMENT AND AUTOMATION

Page 15: AND AUTOMATION OPENSTACK DEPLOYMENT - … fileCompute I/O based NUMA scheduling Quiesce file-systems during image snapshot using QEMU guest agent ... OPENSTACK DEPLOYMENT AND AUTOMATION

DEPLOYMENT AND AUTOMATIONRDO Manager

4. Operator defines the OpenStack control services.

00 OPENSTACK DEPLOYMENT AND AUTOMATION

Page 16: AND AUTOMATION OPENSTACK DEPLOYMENT - … fileCompute I/O based NUMA scheduling Quiesce file-systems during image snapshot using QEMU guest agent ... OPENSTACK DEPLOYMENT AND AUTOMATION

DEPLOYMENT AND AUTOMATIONRDO Manager

5. Operator defines the OpenStack resource nodes.

00 OPENSTACK DEPLOYMENT AND AUTOMATION

Page 17: AND AUTOMATION OPENSTACK DEPLOYMENT - … fileCompute I/O based NUMA scheduling Quiesce file-systems during image snapshot using QEMU guest agent ... OPENSTACK DEPLOYMENT AND AUTOMATION

DEPLOYMENT AND AUTOMATIONRDO Manager

6. Control service and Resource nodes get provisioned.(Tuskar -> Heat -> Nova -> Ironic -> Hardware)

00 OPENSTACK DEPLOYMENT AND AUTOMATION

Page 18: AND AUTOMATION OPENSTACK DEPLOYMENT - … fileCompute I/O based NUMA scheduling Quiesce file-systems during image snapshot using QEMU guest agent ... OPENSTACK DEPLOYMENT AND AUTOMATION

DEPLOYMENT AND AUTOMATIONRDO Manager

Logical view of the Management and Production clouds

Deployment & Management App

OpenStack Production Cloud

00 OPENSTACK DEPLOYMENT AND AUTOMATION

Page 19: AND AUTOMATION OPENSTACK DEPLOYMENT - … fileCompute I/O based NUMA scheduling Quiesce file-systems during image snapshot using QEMU guest agent ... OPENSTACK DEPLOYMENT AND AUTOMATION

DEPLOYMENT AND AUTOMATIONContainers

00 OPENSTACK DEPLOYMENT AND AUTOMATION

Current deployment methods have difficulties

● Build Based○ Inefficient - 1 service per operating system○ Difficult - Imperative deployments are not easily rolled back○ Slow - `yum install`

● Image Based○ Difficult - Someone still has to build the image○ Expensive - New update = Large new image

Page 20: AND AUTOMATION OPENSTACK DEPLOYMENT - … fileCompute I/O based NUMA scheduling Quiesce file-systems during image snapshot using QEMU guest agent ... OPENSTACK DEPLOYMENT AND AUTOMATION

DEPLOYMENT AND AUTOMATIONContainers

00 OPENSTACK DEPLOYMENT AND AUTOMATION

● Project Kolla○ Container Based Deployment of OpenStack Services○ Clean separation of host and openstack services○ Deploy all openstack services in under 2 minutes

● Kubernetes or Heat○ Declarative method for describing deployment ○ Application driven infrastructure

● Project Atomic○ minimal OS for container based workloads○ os-tree for atomic upgrades

Page 21: AND AUTOMATION OPENSTACK DEPLOYMENT - … fileCompute I/O based NUMA scheduling Quiesce file-systems during image snapshot using QEMU guest agent ... OPENSTACK DEPLOYMENT AND AUTOMATION

CONTAINER BASED SERVICES DEMOKolla

00 OPENSTACK DEPLOYMENT AND AUTOMATION

Page 22: AND AUTOMATION OPENSTACK DEPLOYMENT - … fileCompute I/O based NUMA scheduling Quiesce file-systems during image snapshot using QEMU guest agent ... OPENSTACK DEPLOYMENT AND AUTOMATION

DEPLOYMENT AND AUTOMATIONAutomated Scaling

00 OPENSTACK DEPLOYMENT AND AUTOMATION

Tenant VMs

Ready HostsWorkload Cloud

Deployment Cloud

Infrastructure Provider

Cloud Provider

PolicyUtilization Compliance

Page 23: AND AUTOMATION OPENSTACK DEPLOYMENT - … fileCompute I/O based NUMA scheduling Quiesce file-systems during image snapshot using QEMU guest agent ... OPENSTACK DEPLOYMENT AND AUTOMATION

DEPLOYMENT AND AUTOMATIONAutomated Scaling

00 OPENSTACK DEPLOYMENT AND AUTOMATION

Tenant VMs

Workload Cloud

Deployment Cloud

Infrastructure Provider

Cloud Provider

PolicyUtilization Compliance

Page 24: AND AUTOMATION OPENSTACK DEPLOYMENT - … fileCompute I/O based NUMA scheduling Quiesce file-systems during image snapshot using QEMU guest agent ... OPENSTACK DEPLOYMENT AND AUTOMATION

AUTOMATED SCALING DEMOManageIQ + OpenStack

00 OPENSTACK DEPLOYMENT AND AUTOMATION

Page 25: AND AUTOMATION OPENSTACK DEPLOYMENT - … fileCompute I/O based NUMA scheduling Quiesce file-systems during image snapshot using QEMU guest agent ... OPENSTACK DEPLOYMENT AND AUTOMATION

COMMUNITY TO ENTERPRISE

00 OPENSTACK DEPLOYMENT AND AUTOMATION

OpenStack

Foreman

ManageIQ

Kubernetes

Project Atomic

Page 26: AND AUTOMATION OPENSTACK DEPLOYMENT - … fileCompute I/O based NUMA scheduling Quiesce file-systems during image snapshot using QEMU guest agent ... OPENSTACK DEPLOYMENT AND AUTOMATION

00 OPENSTACK DEPLOYMENT AND AUTOMATION

Page 27: AND AUTOMATION OPENSTACK DEPLOYMENT - … fileCompute I/O based NUMA scheduling Quiesce file-systems during image snapshot using QEMU guest agent ... OPENSTACK DEPLOYMENT AND AUTOMATION

RESOURCES

This Presentation - www.allthingsopen.com

Foreman - www.theforeman.org

RDO Manager - https://www.rdoproject.org/RDO-Manager

Kolla - https://github.com/stackforge/kolla

ManageIQ - www.manageiq.org

Project Atomic - www.projectatomic.io

Kubernetes - www.kubernetes.io

00 OPENSTACK DEPLOYMENT AND AUTOMATION

Page 28: AND AUTOMATION OPENSTACK DEPLOYMENT - … fileCompute I/O based NUMA scheduling Quiesce file-systems during image snapshot using QEMU guest agent ... OPENSTACK DEPLOYMENT AND AUTOMATION

THANK YOU

plus.google.com/+RedHat

linkedin.com/company/red-hat

youtube.com/user/RedHatVideos

twitter.com/RedHatNews

facebook.com/redhatinc