Connect with BMC TrueSight Capacity Optimization

v10.0 Managing capacity in an OpenStack environment- Int'l Toll: 719-386-0002- US/CAN Toll free: 888-287-5534- Conference ID: 9962526- Participant Passcode: 333044

International Toll FreeArgentina: 0800 666 3168Australia: 1 800 106 747Austria: 0800 291 959Belgium: 0 800 75 269Brazil: 0 800 891 6846Bulgaria: 00 800 120 1113Chile: 123 0020 9728China, Northern Region: 10 800 714 1203China, Southern Region: 10 800 140 1182Colombia: 01 800 518 0791Costa Rica: 0800 015 0618Czech Republic: 800 700 296Denmark: 80 886 221France: 0 800 908 251Germany: 0 800 181 9045Greece: 00 800 161 2205 5966Hong Kong: 800 901 125Hungary: 06 800 162 52India: 000 800 1006 982Indonesia: 001 803 017 5966Ireland: 1 800 760 613Israel: 1 80 924 6043Italy: 800 873 746Japan: 00531 16 0846

Latvia: 8000 2413Lithuania: 8 800 3 05 27Luxembourg: 800 2 7667Malaysia: 1800 81 3716Mexico: 01 800 522 5328Monaco: 800 93 418Netherlands: 0 800 023 5307New Zealand: 0 800 451 052Norway: 800 196 67Panama: 00 800 226 5966Peru: 0800 55 436Philippines: 1 800 111 008 64Poland: 00 800 111 49 60Portugal: 800 819 731Russian Federation: 810 800 2706 1012Singapore, Singapore: 800 101 2004Slovakia: 0800 606 718Slovenia: 0 800 80205South Africa: 0 800 980 990South Korea, Korea, Republic Of: 003 0813 1965Spain: 900 947 606Sweden: 02 079 9908Switzerland: 0 800 564 399Taiwan: 00 801 126 975Thailand: 001 800 156 205 5966Trinidad and Tobago: 1 800 205 5966United Kingdom: 0 808 101 1148Uruguay: 0004 019 0190Venezuela: 0 800 100 8303

Ireland, Dublin: +353 (0) 1 437 0558Israel, Tel Aviv: +972 (0) 3 721 9307Italy, Milan: +39 02 8978 1996Italy, Rome: +39 06 8743 4379Japan, Tokyo: +81 (0) 3 4589 9498Latvia, Riga: +371 6601 3681Lithuania, Vilnius: +370 5205 5591Luxembourg, Luxembourg: +352 2786 0223Malaysia, Kuala Lumpur: +60 (0) 3 7724 0845Mexico, Mexico City: +52 55 4777 2669Netherlands, Amsterdam: +31 (0) 20 262 0092New Zealand, Auckland: +64 (0) 9 929 1882Norway, Oslo: +47 21 95 32 31Poland, Warsaw: +48 (0) 22 295 36 29Portugal, Lisbon: +351 21 120 1905Romania, Bucharest: +40 (0) 21 529 1342Russian Federation, Moscow: +7 495 620 9816Singapore, Singapore: +65 6416 9955Slovakia (Slovak Republic), Bratislava: +421 (0) 2 3278 6630Slovenia, Ljubljana: +386 (0) 1 888 8399South Africa, Johannesburg: +27 11 589 8380Spain, Madrid: +34 91 080 0151Sweden, Stockholm: +46 (0) 8 4030 4951Switzerland, Geneva: +41 (0) 22 555 0255Switzerland, Zurich: +41 (0) 44 556 8426Taiwan, Taipei: +886 (0) 2 2650 7290United Kingdom, London: +44 (0) 20 8150 0793

LocalAustralia, Brisbane: +61 (0) 7 3123 0044

Australia, Canberra: +61 (0) 2 6111 2009

Australia, Melbourne: +61 (0) 3 9951 0936

Australia, Sydney: +61 (0) 2 9038 0411

Austria, Vienna: +43 (0) 1 2675 902

Bahrain, Manama: +973 1619 9828

Belgium, Brussels: +32 (0) 2 303 2271

Brazil, Sao Paolo: +55 11 3181 3952

Bulgaria, Sofia: +359 (0) 2 491 6409

Canada, Montreal: +1 514 669 6114

Canada, Toronto: +1 647 426 9211

China: +86 400 120 2695

China: +86 400 120 26 95

Czech Republic, Prague: +420 234 147 001

Denmark, Copenhagen: +45 78 78 79 61

Estonia, Tallinn: +372 622 5740

Finland, Helsinki: +358 (0) 9 7479 0099France, Lille: +33 (0) 359 69 03 40France, Lyon: +33 (0) 426 10 30 22France, Paris: +33 (0) 1 70 71 29 51Germany, Berlin: +49 (0) 30 2555 5428Germany, Frankfurt: +49 (0) 69 1200 9825Germany, Munich: +49 (0) 89 1436 7909Hong Kong, Hong Kong: +852 3008 0381Hungary, Budapest: +36 1 577 9956India, Bangalore: +91 (0) 80 6127 5132India, Mumbai: +91 (0) 22 6150 2332

—

Connect with BMC TrueSight Capacity Optimization 10.0

Managing capacity in an OpenStack

environment

SpeakerSudheer Apte, Product Development Architect

April 28, 2015

Connect with BMC TrueSight Capacity Optimization

Agenda

Managing capacity in an OpenStack Environment

• Introduction to OpenStack

• OpenStack configurations and evolution

• Collecting data into TrueSight Capacity Optimization

• Managing Capacity of OpenStack

—Connect with BMC TrueSight Capacity Optimization 10.0

Introduction to OpenStack

What is OpenStack?

“Cloud operating system”

Infrastructure as a Service (IaaS) software.Manage compute, storage, network.

Open source, public APIs

Heat = service orchestration

What can it do?

IaaS

Examples:- start, stop, resume an instance- create, attach a volume- take snapshots

Horizon dashboardFor cloud provider and for tenant user

OpenStack terminology

OpenStack term Meaning

Server, instance Virtual machine

Compute node, hypervisor node Virtual host. Can be KVM, XenServer, VMware cluster…

Image Virtual machine template

Volume, block volume Virtual disk attached to a virtual machine

Ephemeral volume One having the same lifetime as its virtual machine

Persistent volume One created independently and attached to VM

Block storage service Service to create, delete, and manage block volumes

Image service Service to create, delete, and manage VM templates

Object storage service Service for URL-accessible files, like Amazon S3

—Connect with BMC TrueSight Capacity Optimization 10.0

OpenStack configurations and evolution

OpenStack FoundationPlatinum, Gold

Plus over 100 corporate sponsors and supporters

Key OpenStack service APIs

Purpose OpenStack component service API

Identity (Authentication, Authorization) Keystone

Compute Nova

Object storage service Swift

Image storage service Glance

Block storage service Cinder

Network Neutron (old name: Quantum)

Horizon

Neutron

Nova

Cinder

Keystone

Swift

Glance

Cloud controller node

Database

Message queue

API services

Scheduler

Identity

Image

Block storage

Compute node

Hypervisor

API service

Nova network

Block storage node

SCSI target

Cinder-volume

NFS server

Management network

Flat network

Public network

Example with Nova networking

Nova implementations and features - 1

Nova implementations and features - 2

Nova implementations and features - 3

Cinder implementations – 1

Cinder implementations – 2

Cinder implementations – 3

Ephemeral disk vs “block volume”

KVM host

sda

guest

/root /home

Devices

Partitions

Block volume

/data

storagepool type = “network”

Cinder storage host

In releases up to kilo:KVM host sees an iSCSI disk,which is presented to guest.

In releases from kilo:It is possible to import the iSCSIdisk as a “network” type, which isdirectly presented to the guest.

directory /cinder/vols

ephemeral disk

Storage

Evolution of OpenStackFeature 2013

Folsom, Grizzly, Havana

2014Havana, Icehouse

2015Juno,Kilo, Liberty

Keystone Request verification UUID tokens PKI tokens, domains

Integration with auth LDAP with write access Read-only LDAP Federated auth

Nova Hypervisor drivers Libvirt (KVM), XenServer, Hyper-V, VMware, PowerVM

PowerVM removed

Quotas Project (tenant) level User-level; default

Storage attach GlusterFS via FUSE GlusterFS native; iSER

Scheduling Utilization-aware scheduler

Glance Back-ends Sheepdog, Cinder GridFS, VMware datastore

Networking Floating IP module Cisco, Nova plugin Brocade plugin

Routers, Load balancers HAProxy-based

OpenStack components Quantum now called Neutron

Cinder Attach technology Fibre Channel

Back-end drivers EMC, 3Par, GlusterFS, many more

Configurations and evolution

SummaryMultiple components built and released by distributed teams Open source software (OSS) projects• GNU/Linux• Libvirt• KVM• Nova, Cinder, Swift, Glance, Keystone, …Plug-ins and drivers contributed by large constellation of vendorsBundled “distributions” of OpenStack created by multiple groups and companies• Always contain Nova• Almost always based on KVM hypervisorSupporting additional OSS components are becoming popular• Ceph (distributed storage)

Conclusions“Do you support OpenStack?”• Not a simple question• Look at exact combination deployed

• Hypervisor• Object storage• Ephemeral versus block storage policy

• Understand additional supporting components

• Commercial• OSS

• Exact releases deployed• In test• In production

—Connect with BMC TrueSight Capacity Optimization 10.0

Collecting data into TrueSight Capacity Optimization 10.0

Connect with BMC TrueSight Capacity Optimization

Agenda

Managing capacity in an OpenStack Environment

• Introduction to OpenStack

• OpenStack configurations and evolution

• Collecting data into TrueSight Capacity Optimization

• Managing Capacity of OpenStack

Data sources relevant to OpenStack

Openstack controllers

Clusters/hosts

Nova DB

MQ

scheduler

Openstack Admin UI

Nova API

Hypervisor

Guest OS

Hypervisor

API

Ceilometer components

Ceilometer

storeCeilometer

API

VM

Nova API• Hypervisors, VMs, relationships and some configuration• Host Aggregates, Availability Zones, Regions, relationships• Tenants, VMs, relationships and some configuration

Ceilometer (optional component)• Hypervisor performance data where collected and configured• VM performance data where collected and configured• Other (storage) performance data where collected and configured

Hypervisor access (depending on hypervisor type)• Hypervisor performance data• VM performance data

OS access (depending on hypervisor type)• OS, application performance data

OS access (depending on controller node type)• OS performance data• OpenStack components (database, MQ, services) process

and workload performance data

Available in 10.0 OOTB

Available in 10.0 OOTB:• Via GW + Agents – most platforms• Via RHEV-M – for RHEV-M KVM

Available in 10.0 OOTB

Available in 10.0 OOTB

OOTB Connector for OpenStack (Nova)

OpenStack– Open-source Cloud OS - also packaged by ISVs (e.g., RedHat)

– Support for multiple hypervisor technologies, including RedHat Enterprise Virtualization (RHEV), Linux KVM and VMware vSphere

– Pooling constructs (e.g. Host Aggregates, Availability Zones)– Tenants (aka “Projects”)– Admin dashboard for Cloud Admin– Self-provisioning web interface for End Users

New OpenStack API Extractor ETL– Supports OpenStack versions Grizzly, Havana and Ice House

– Leverages OpenStack Nova APIs to import infrastructure entities and tenants into TSCO:

• Basic configuration metrics (e.g., number of vCPUs requested) - more conf and performance metrics need to be collected from other ETLs, depending on which hypervisor is being adopted

• Cloud topology relationships, that is:– Infrastructure hierarchy (host aggregate – host – VM)– Tenant hierarchy (tenant – VM)

TrueSight Capacity Optimization 10.0Data flows for managing OpenStack cloud capacity – KVM example

Openstack controller nodes (Linux)

TSCO

CDB

TSCO OpenStack ETL

TSCO Console

Nova DB

Import resource and tenant hierarchies

Cloud Admin

Message queue

scheduler

Openstack Admin UI

Capacity Planner

Nova API

Compute node (KVM)

Agent

TSCO Gateway Server

BMC TrueSight

Capacity Optimization

import system and

workload data

BMC CONFIDENTIAL ©2015 BMC Software

VM

Keystone

Image serviceBlock storage

service

Compute controller

Agent

Agent

TSCO vis parser ETL

Object store

Network controller Volume controller

OpenStack hierarchy in TSCO

Hierarchy representing OpenStack relationships: mapping from Host Aggregates to Hosts and from Host to VMs

Data aggregated at Host Aggregate level from underlying Hosts data

Hierarchy representing Tenants (Projects) and their relationship to VMs from OpenStack environment

Tenant (Project) and VMs in use

Data aggregated at Cloud level from underlying Host Aggregate level

Cloud hierarchy

Host Aggregate hierarchy

Tenant hierarchy

OpenStack entities in workspace

Collected from OpenStack

Configuring OpenStack connector

Setup connection parameters

• Identity service URL: value of OS_AUTH_URL parameter from stack.sh on Keystone server (identity service used by OpenStack for authentication)

• Username and password (for an authenticated user with "admin" role): value of OS_USERNAME parameter (typically "admin“) from stack.sh on Keystone server

• Tenant name: value of OS_TENANT_NAME parameter (typically "admin" tenant) from stack.sh on Keystone server

Sharing entity catalog withperformance ETLs

Share Entity Catalog with other ETLs collecting performance/capacity data

Capacity Agents and Gateway Server

Other data sources

ETL Engine Server

Agent data collection

Gateway Server

Database Server Application Server

Console

VIS file integration

Extracting agent data – platform selection

Easier configuration of the collected metrics –including Virtual Nodes

Automatically configuring vis parsers

“Auto-create” option for Gateway Server configuration

Viewing Gateway Servers and connectors

Red Hat Enterprise Virtualization Manager (RHEV-M)

SH1 SH2

Virtual clusters contain physical hosts

– Running VMs

Storage clusters contain storage hosts

– Implementing “storage domains”

– Storage domains are used by Virtual clusters for storage

Datacenters contain clusters

– Both Virtual Clusters and Storage Clusters

– Organize clusters into larger units for management Storage Cluster SC1

Virtual Cluster VC1

VH1

VM1

VM2

VH2

VM3

VM4

Storage Domain D1

uses

Datacenter D1

RHEV – Extractor Service

Datacenter

Virtual Cluster

Storage cluster

Storage host

Storage domain

Virtual host

Virtual machines

Domain Tree imported by RHEV – Extractor Service

KVM Views with RHEV – Extractor Service

RHEV data gets populated into existing KVM Views

– There are metrics that RHEV connector does not support the Network, File System and Disk metrics from the Host and Partition detail pages (displayed as “No data available”)

Comparison of MetricsCapacity Agent vs. RHEV – Extractor Service

Virtual host KVM

BCO Metric BPA RHEV

RESNAME x x

ALIAS_NAME x

BYAPP_ACTIVE_PROC x

BYAPP_CPU_UTIL x

BYAPP_CPU_UTIL_SYSTEM x

BYAPP_CPU_UTIL_USER x

BYAPP_DISK_READ_RATE x

BYAPP_DISK_WRITE_RATE x

BYAPP_PAGE_FAULT_RATE x

BYAPP_THREADS x

BYBENCHMARK_COMP x

BYBENCHMARK_DATE x

BYBENCHMARK_SOURCE x

BYBENCHMARK_VALUE x

BYCPU_CPU_UTIL x

BYCPU_CPU_UTIL_IDLE x

BYCPU_CPU_UTIL_SYSTEM x

BYCPU_CPU_UTIL_USER x

BYCPU_CPU_UTIL_WAIO x

BYDISK_BLOCK_SIZE x

BYDISK_MODEL x

BYDISK_NONPAGING_IO_RATE x

BYDISK_PAGING_IO_RATE x

BYDISK_PAGING_TYPE x

BYDISK_PHYS_DEV x

BYDISK_PHYS_IO_RATE x

BYDISK_PHYS_IO_READ_RATE x

Virtual host KVM

BCO Metric BPA RHEV

BYDISK_PHYS_IO_WRITE_RATE x

BYDISK_QUEUE_SIZE x

BYDISK_SERVICE_TIME x

BYDISK_SIZE x

BYDISK_TRANSFER_RATE x

BYDISK_TYPE x

BYDISK_UTIL x

BYFS_FREE x

BYFS_FREE_INODES x

BYFS_SIZE x

BYFS_TOTAL_INODES x

BYFS_USED_INODES_PCT x

BYFS_USED_SPACE_PCT x

BYIF_BANDWIDTH x

BYIF_COLLISION_RATE x

BYIF_DUPLEX_STATUS x

BYIF_ERROR_RATE x

BYIF_IN_BYTE_RATE x

BYIF_IN_PKT_RATE x

BYIF_OUT_BYTE_RATE x

BYIF_OUT_PKT_RATE x

BYUSR_ACTIVE_PROC x

BYUSR_CPU_UTIL x

BYUSR_CPU_UTIL_SYSTEM x

BYUSR_CPU_UTIL_USER x

BYUSR_DISK_READ_RATE x

BYUSR_DISK_WRITE_RATE x

Virtual host KVM

BCO Metric BPA RHEV

BYUSR_PAGE_FAULT_RATE x

CPU_CORES_PER_SOCKET x x

CPU_DESCRIPTION x

CPU_MAX_PROCESSORS x

CPU_MHZ x x

CPU_MODEL x x

CPU_MT_TYPE x

CPU_NUM x x

CPU_RUN_QUEUE x

CPU_THREADS_PER_CORE x x

CPU_TOTAL_MHZ x x

CPU_UTIL x x

CPU_UTIL_IDLE x x

CPU_UTILMHZ x x

CPU_UTILSPEC x

CPU_UTIL_SYSTEM x x

CPU_UTIL_USER x x

CPU_UTIL_WAIO x

CPU_VENDOR x

DESCRIPTION x

DISK_IO_RATE x

DISK_NUM x

DISK_READ_RATE x

DISK_SIZE x

DISK_TRANSFER_RATE x

DISK_WRITE_RATE x

GM_NUM x

Comparison of Metrics – 2Capacity Agent vs. RHEV – Extractor Service

Virtual host KVM

BCO Metric BPA RHEV

GM_ON_NUM x

HOST_ID x

HW_DESCRIPTION x

HW_MODEL x

HW_VENDOR x

LCPU_NUM x

MEM_BUFFERED x

MEM_CACHED x x

MEM_COMMITED_AS x

MEM_FREE x x

MEM_PAGE_IN_RATE x

MEM_PAGE_OUT_RATE x

MEM_PAGE_SIZE x

MEM_REAL_CONSUMED x

MEM_REAL_UTIL x x

MEM_SYSTEM x

MEM_USED x x

MEM_USER x

MEM_UTIL x x

MEM_UTIL_CACHED x

MEM_UTIL_SYSTEM x

MEM_UTIL_USER x

NET_BIT_RATE x

NETIF_NUM x

NET_IP_ADDRESS x

NETWORK_DOMAIN x

OS_TYPE x x

Virtual host KVM

BCO Metric BPA RHEV

OS_VER x x

TOTAL_FS_SIZE x

TOTAL_FS_USED x

TOTAL_FS_UTIL x

TOTAL_LDISK_SIZE x

TOTAL_LDISK_USED x

TOTAL_REAL_MEM x

UPTIME_PCT x

W_CPU_UTIL x

W_DESCRIPTION x

W_MEM_PRIVATE_ACTIVE x

W_MEM_PRIVATE_INACTIVE x

W_MEM_SHARED_ACTIVE x

W_MEM_SHARED_INACTIVE x

W_RESPONSE_TIME x

W_TRANSACTION_RATE x

SWAP_SPACE_FREE x

SWAP_SPACE_TOT x

SWAP_SPACE_USED x

SWAP_SPACE_UTIL x

TOTAL_REAL_MEM x

Virtual guest KVM

BCO Metric BPA RHEV

RESNAME x x

CPU_CORES_PER_SOCKET x

CPU_LIMIT_MHZ x

CPU_NUM x x

CPU_RESERVED_MHZ x

CPU_SHARES x

CPU_UTIL x x

CPU_UTIL_OVERHEAD x

CPU_UTILMHZ x

DISK_TRANSFER_RATE x x

HOST_ID x

HOST_NAME x

LDISK_NUM x

MEM_ALLOCATION x

MEM_CONSUMED x

MEM_FREE x

MEM_RESERVED x

MEM_UTIL x

NET_BIT_RATE x

NET_IN_BYTE_RATE x

NET_IN_ERROR_RATE x

NET_OUT_BYTE_RATE x

NET_OUT_ERROR_RATE x

NET_MAC_ADDRESS x

OS_TYPE x x

TOTAL_LDISK_SIZE x

TOTAL_REAL_MEM x x

—Connect with BMC TrueSight Capacity Optimization 10.0

Managing OpenStack Capacity

Capacity use cases for cloudsCategory Use cases Typical role of TrueSight CO

Capacity visibilityViews and reports showing aggregated CPU, memory, disk, network, used and spare capacity

Analyses, Views

Capacity analysisManual analysis; Early warning of capacity risks; detection of opportunities for savings

Workspace; Capacity Pool Views:recommendations and alerts

Cloud metering Show-back usage reporting for tenants. Chargeback.

Capacity planning Sizing of servers and services; hardware sizing P2V, V2V studies

Integrated demand and capacity mgmt

Reserve capacity for projects in advance; plan hardware deployments

Reservations.

Placement during cloud provisioning

Placement advice during instance creationCapacity-aware placement advice (CAPA)

Rebalancing or “defrag”

Batch-mode optimization of a large environmentby moving workloads to “rebalance” clusters.

Recommendations for source cluster; V2V study to find destination cluster.

Types of OpenStack nodes• Compute nodes: appear as KVM hosts; relationships extracted via Nova API.

• Grouped into Host Aggregates, Availability Zones, and Regions.

• Instances: appear as KVM guests; relationships extracted via Nova API.

• Grouped into Availability Zones and Regions.

• Belong to individual Tenants.

• Cloud storage nodes: could appear as:

• KVM guests. (Option 1) OR

• Standalone Linux machines (Option 2)

• Cloud controller nodes: could appear as:

• KVM guests. (Option 1) OR

• Standalone Linux machines (Option 2)Control resources

Payloadresources

Capacity visibility for payload resources

Compute (Nova)

• CPU, memory, ephemeral disk space on compute nodes

• Size, used, available

• Aggregated by:

• Host aggregates – groups of hosts

• Availability zones – user-visible groups of hosts

• Regions – administrator-defined geographic partitions

Storage (Cinder)

• Storage volumes – size, used, available

• Depends on storage host types (cinder backends)

• RHEV storage nodes running Gluster

• Ceph storage clusters

• iSCSI on LVM

Capacity analysis: Analyses, Models

Time – Line Analysis: CPU and Memory Utilization % over last 2 months

at Host Aggregate level

Time Forecasting Model:for Memory Utilization % over the next 2 months

at Cloud level

Capacity analysis: By-exception reporting

Capacity visibility for control resourcesController node• Generic name for any host

that runs OpenStack services

• Great flexibility in deployment on machines

• Could run some services on compute nodes, too

Machine type• Any Linux machine• Could be a VM

Typical modes for resource usageInstance provisioning• Authentication steps not shown

Compute serverGlance service

provision

Swift service

GET objectGET image

Scheduler

Nova DB

Nova API

Instance create

update

update

Control resourcesvisible as processusage on controllernodes

Find active intervals in Gateway Server Console

Process statistics for top-10 processes

UNIX process aggregation report

By-user summary for workloads

Workload analysis in Workspace

Capacity in OpenStack environments

SummaryAll standard TrueSight Capacity Optimization use cases for clouds• Data collection OOTB in most

cases• Payload resources can be

managed using OOTB views, chargeback, reservations, etc.

• Control resources often require some manual interpretation

• Controller nodes can be configured in many ways

Conclusions

“Do you support OpenStack?”

• Many possible deployment options

• Rapidly evolving

Understand key drivers

• Payload capacity

• Controller capacity

—Reference Material

BMC TrueSight Capacity Optimization 10.0

TrueSight Capacity Optimization 10.0New Welcome Page and How-to videos

More to come …

How to videos

TrueSight Capacity Optimization v10.0 BMC Communities

https://communities.bmc.com/community/bmcdn/service_assurance/capacity_management

TrueSight Capacity Optimization 10.0Documentation

https://docs.bmc.com/docs/display/btco100/Home

One single tree with updated and new sectionsMore to come…

TrueSight Capacity Optimization 10.0Collaterals

http://www.bmc.com/it-solutions/capacity-optimization.html

new 10.0 datasheet new TrueSight solution brief new videos (10.0 demo about reservations

and Engage session from Product Mgmt) new research papers (Forrester) (more to come)

TrueSight Capacity Optimization 10.0AMIGO program now available

https://communities.bmc.com/docs/DOC-33065

—

Bring IT to Life.™

Thank You