FUT1744BU The Benefits of VMware Integrated OpenStack or … · 2019-06-27 · Hassan HAMADE...

Hassan HAMADEMauricio VALDUEZA

FUT1744BU

#VMworld #FUT1744BU

The Benefits of VMware Integrated OpenStack for Your NFV Platform

VMworld 2017 Content: Not fo

r publication or distri

bution

• This presentation may contain product features that are currently under development.

• This overview of new technology represents no commitment from VMware to deliver these features in any generally available product.

• Features are subject to change, and must not be included in contracts, purchase orders, or sales agreements of any kind.

• Technical feasibility and market demand will affect final delivery.

• Pricing and packaging for any new technologies or features discussed or presented have not been determined.

Disclaimer

2



bution

Introductions

Mauricio Valdueza is an NFV Strategist for VMware, responsible for increasingmarket awareness and driving growth of VMware’s NFV solutions in existing andnew enterprise accounts across the EMEA region. Mauricio brings more than 30years of experience in the IT and telecoms sector to the team. Prior to joiningVMware in February 2016, Mauricio spent three years at Dell as a SDN/NFVEnterprise Technologist and four years at Dell as a Specialist Consultant

Hassan is a Cloud Solution Architect at VMware in the EMEA SDDC technologypractice team. He works with large entreprises and service provider customers ontheir cloud initiatives and projects with a focus on CMP (cloud managementplatform) frameworks such as vRealize Automation, VIO (VMware IntegratedOpenStack) and NFV MANO (management and orchestration).

3



bution

Agenda

CONFIDENTIAL4

1 VMware vCloud for NFV

2 A word on NFV orchestration…

3 VMware Integrated OpenStack

4 VIO as an NFV VIMVMworld 2017 Content: N

ot for publicatio

n or distribution

VMware vCloud NFV



bution

vCloud NFV

6

• VMware vCloud NFV is an ETSI compliant, fullyintegrated and modular solution for all NFV deployments.

• A solution that is built, tested and packaged basedon a published reference architecture usingmultiple VMware Products for the SP market.

• A Solution that supports Multi-vendor Virtual NetworkFunctions (VNFs) and VNF Orchestrators (VNFOs).

• A Common Platform Architecture that can be deployedacross Access, Transport and Core Networks.

• Sold as hard bundle configuration witha single SKU either directly by from VMware or throughOEM/NEP partners (DELL, Nokia and Ericsson) to CSPs

vCloud NFV 2.0 Reference Architecture



bution

https://www.vmware.com/techpapers/2017/vmware-vcloud-nfv-2-reference-architecture.html

7

VMware products mapping to ETSI NFV

VMware

Integrated

OpenStack

vCloud Director



bution

vCloud NFV 2.0: Choice of Virtual Infrastructure Managers

8

Choice, Flexibility & Full Control of VIM Evolution Path and Timeline

VMware vCloud Director SP VMware Integrated OpenStack



bution

NFV Orchestration



bution

WHY do Service Providers need Orchestration ?

10



bution

WHAT do Service Providers orchestrate ?

11



bution

A deeper look at the VIM in NFV Architectures

Functions

• An Über Resource ManagerIaaS provider (network, compute and storage) to northbound layers

• Enforces of multi-tenancy

Resource guarantees, fine-grained policy controls

• Exposes a Northbound API to NFV MANO

Covers the deployment and management

of the complete VNFs lifecycle

Requirements

• Carrier-gradeness

Minimal downtime (5*9s), HA/resiliency, ease

of operations, performance, scalability, etc…

12



bution

A VIM in action

13

Basic NFV orchestration workflow

RE

ST

Infr

astr

uctu

re Multi-tenancy

Infrastructure Modeling

Inventory

Management

NFVO

Orchestrator

VNF4 VNF5VNF 3VNF 2VNF1

NFVO API

REST Infrastructure

Specific

Components

Service

Chaining

Manager

Element

Management

NetConf/YANG

NetConf/YANG

NFVI API VIMVNFManager

NFVO API



bution

14



bution

VMware Integrated OpenStack



bution

VMware is OpenStack!


OpenStack Ocata Release

CLI / API HeatHorizon

VMware Optimized

OpenStack Install

+

Management

+

Upgrade

VMware SDDC

Nova Cinder Glance Neutron

vCenter vCenter vCenter

VSAN / vSphere Datastores / vVols

NSX

vRealize Operations

vRealize Business

vRealize Log Insight

• A VMware Distribution.

• Simple Installation.

• Rich Infrastructure Features.

• Supported by vRealize Operations.

• Log Insight for Diagnostics.

• Hardened and Tested by VMware.

• Single Vendor Support.

Production OpenStack Up and Running in 15 mins.

vCenter



bution

17

Simplify OpenStack

Operations

VMware SDDC(vSphere, NSX, VSAN, vROps, LI…)

OpenStack Value

Battle-testedInfrastructure & Operations

Differentiated

Features

Standard, Production Ready &

Fully Supported OpenStack

VMware Integrated OpenStack Approach

CONFIDENTIAL



bution

Virtual Infrastructure

What is VMware Integrated OpenStack (VIO) ?

• It’s OpenStack!

– Not a “proprietary distribution”

– DefCore API compliant (From Trunk)

• Preconfigured drivers & plugins for VMware infrastructure technology

– vSphere

– NSX

– VMDK (any datastore – VMFS, NFS, VSAN)

• Free license with vSphere Enterprise/Plus

Framework

OpenStack APIs

VMDK

Driver

vCenter

Plugin

NSX

VMFS

NFS

vSAN

vSphere

Physical Infrastructure

NSX

Plugin



bution

CONFIDENTIALVMware SDDC


What is VMware Integrated OpenStack (VIO) ?

• VIO is an “Integrated Product” Approach to OpenStack

• Standard OpenStack Distribution (delivered as OVA)

• Deploys & Manages Proven Production Architecture on VMware SDDC

• Fully Supported by VMware

Standard OpenStack

Nova Neutron Cinder

Keystone HeatHorizon Ceilometer

Glance

VIO Management

Server(Deploy, configure, patch,

upgrade …OpenStack)

vSphere NSX vSphere Datastores:

3rd-party / Virtual SAN

19



bution

VIO Deployment Approach

21

vCenter Server

Management Cluster Compute Cluster 1 Compute Cluster 2

OpenStack

Mgmt

Server

(OMS)

1. Import OVA and power on

2. Configure IP parameters



bution

Ubuntu

VMware

Integrated

OpenStack

Manager

OpenStack Deployment

Nova Neutron Cinder

Glance Keystone Swift

Heat

Ceilometer

Load

Balancers

Management from within vCenter

22

vCenter Server

Compute Cluster 1 Compute Cluster 2

Tenant VMs Tenant VMs

Management Cluster



bution

Slim Full HA Control Plane Architecture

Users (+ cloud brokers, etc.)

External network (API Access)

Load Balancers (HA pair)

Public Virtual IP

Private Virtual IP

management network

OS

Controller 2

OS

Controller 1

OS API / Horizon Nodes (active/active)

OpenS

tack c

ore

vS

phere

/ VIO

mgm

t

NSX

Manager

vCenter /

SSOVIO

Manager

OS mpute 2

Nova

Compute 1N times Nova Compute

(per vSphere Cluster)

DB 1

DB 2

(active/active DB Cluster)

DB 3

vSphereCluster(s)

vSphereDatastores

vSphereDatastores

vSphere Datastoresfor Glance (Images)



bution

VIO Upgrade Process



Public Virtual IP

Private Virtual IP management network

OS

Controller 2

OS

Controller 1

OS API / Horizon Nodes

(active/active)

memcache 1

memcache 2

RabbitMQ 1

RabbitMQ 2

(active/active)

(active/active)

OS mpute 2

Nova

Compute 1N times Nova Compute

(per vSphere Cluster)

DB 1

DB 2

(active/active DB Cluster)

DB 3

OpenStack core

vSphere Web Client provides a new tab: upgrade

(upwards arrow is the upgrade button)

Step

2

CLI at OMS (OpenStack Management Server)

stage the patch and upgrade OMS

Step

1

sudo viopatch add …

sudo viopatch list …

sudo viopatch install …

vSphere / VIO mgmt

NSX

Manager

vCenter /

SSOVIO

Manager

1) Optional customer experience program

2) Configure new deployment name

3) Configure (temp.) LB addresses

4) Verification and go

Upgrade Wizard (4 steps)Step

3



bution

VIO Upgrade Process


Public Virtual IP

Private Virtual IP management network

vSphere / VIO mgmt

NSX

Manager

vCenter /

SSOVIO

Manager

New (prepared)

vSphere Web Client

Right click existing OpenStack and „migrate data“

Step

4

Old

Old (running)


Temp

Verify new deployment via temp. LB addressStep

5vSphere Web Client

Switch to new deployment

Step

6



bution

DAY 2: vRealize Operations & Log Insight

26

Learned Behavior Real-time Events Expected Demand

AgilityEfficiency Visibility



bution

VMware Integrated OpenStack Core Benefits

Seamless

Upgrades

Zero service downtime (hitless) during upgrades and patching

Control and Data Plane Separation

Fast Upgrade with vCenter maintenance mode

Simplified

Installation

Fastest path to fully operational OpenStack environment

Seamless Experience with vCenter Integration

Templated install and deployment with few clicks

Intelligent

Operations

360 degree visibility

Proactive and Predictive Analytics

Root Cause Analysis (RCA) and fast remediation



bution

VIO as VIM solution for NFV



bution

NVF is not Cloud ComputingThe network differs from the computing environment in 2 key areas:

Data plane workloads

HIGH demands

Network requires shape

E2E interconnection

HIGH AND PREDICTABLE

PERFORMANCE

GLOBAL NETWORK VIEW

for MANAGEMENT VMworld 2017 Content: Not fo


bution

31



bution

NFV vs Cloud. Performance Figures (even 100 time faster)

32Source: Telefonica

Even large frame sizes cannot hide the actual difference between both scenarios.



bution

How to reach these numbers?

33



bution

34

QPI

NUMA1

NUMA1CORE 0

TH1 TH2

LI /L2 Cache

CORE nTH1 TH2

LI /L2 Cache

CORE

TH1 TH2

LI /L2 Cache

CORE

TH1 TH2

LI /L2 Cache

I/0 I/0I/0

NUMA0CORE 0

TH1 TH2

LI /L2 Cache

CORE nTH1 TH2

LI /L2 Cache

CORE

TH1 TH2

LI /L2 Cache

CORE

TH1 TH2

LI /L2 Cache

I/O Controller

I/0I/0

Memory Controller

Memory

Memory

Dual Socket Technology



bution

Dual Socket Technology

35

QPI

NUMA1

NUMA1CORE 0

TH1 TH2

LI /L2 Cache

CORE nTH1 TH2

LI /L2 Cache

CORE

TH1 TH2

LI /L2 Cache

CORE

TH1 TH2

LI /L2 Cache

NUMA0CORE 0

TH1 TH2

LI /L2 Cache

CORE nTH1 TH2

LI /L2 Cache

CORE

TH1 TH2

LI /L2 Cache

CORE

TH1 TH2

LI /L2 Cache

I/0 I/0I/0

I/0I/0

I/O Controller

Memory Controller

Memory

Memory

Mem

ory

Mem

ory

Mem

ory

Mem

ory

Mem

ory

Mem

ory

QPI

QPI

To 9.6GT/s

I/0 I/0I/0

I/0 I/0I/0

Local

Remote

~ 70ns

~ 130ns

NUMA Awareness

CPU Pinning

Minimize QPI usage Full I/O Assignment

Enable Hugepages

E.P.A. (Enhanced Platform Awareness)(NUMA) Non Uniform Memory Access



bution

NUMA Placement in KVM

36

FILTERS

Weights= ∑ costs

Resource Tracker

• Naive decision

• One action

• Nova has to talks with all KVM

Virtual Machine

Nova Agent

Neutron Agent

WEIGTHS



bution

NUMA Placement in VIO

37

FILTERS

by APIs

WEIGTHS

Vsphere

DRS

Virtual Machine

VMware NUMA Scheduler (initial Placement)

Load balance (epoch): every two minutes

Virtual Machine



bution

NUMA Placement in VIO• VMotion

• High Availability

• Fault Tolerance

• Power Management

• Load Balance

• I/O control

• Downtime-free server maintenance

Vsphere

DRS



bution

Hugepages. Why?

3939

• Using a larger page size, a single TLB entry can represent a larger memory range.

• Default page size is 4 KB

• A large page is 2 MB

• Huge pages means the processor’s MMU spends less time walking page tables

Same memory range as 512 x 4 KB pages.

Less pressure on the TLB = better performance

CORE

TBL

TRANSLATION

CACHE MEMORYMISS MISS

DATA

DATA

HIT

HIT

hugepages in esxi



bution

SR-IOV as solution for Dataplane

40

Kernel

Hypervisor

vswitch

Virtual

Machine

E1000VMXNET 2VMXNET 3

Virtual NIC

Kernel

Hypervisor

Virtual

Machine

XGBEXL710

Pass-Through

Kernel

Hypervisor

Virtual

Machine

XGBEVFXL710VF

SR-IOV

Kernel

Hypervisor

vswitch

VNF

vswitch

Management Control Plane Data Plane

MULTI –TYPE NIC

PRO & CONS

• More complex platform

• Best Performance

• Some cases MANDATORY

• Con

• Complex Underlays

• Hardware Dependency

• No DRS featuresVMworld 2017 Content: Not fo


bution

VIO ROADMAP

41



bution

42

VIO Journey and Releases

VIO2.x

VIO1.0

VIO3.x

Ocata Based

EPA Awareness

SDDC Advancements

Scalability and HA

Container Support (K8S)

Operations Management

Dynamic Scaling

Advanced Networking

Q1 2015

IcehouseSimplified Deploy

Day 2 Ops

Automated Patching

Enterprise Ready

Q2 2016

MitakaExisting Workloads Import

Policy Support

Multi v-Center

NSX-T Support

Pass-through

Troubleshooting

…

Q3 2015

KiloSeamless Upgrade

Automated Rollback

Backup & Recovery

Compact Architecture

VM Template Import

Simplified Monitoring

Q3 2017VMworld 2017 Content: Not fo


bution

47

Advanced Logging & Analytics

Native Integration with vRealize

• Operations (vROps)

• Log Insight (vRLI)

• Network Insight (vRLI)

KPI export through Ceilometer

• Feedback Loop Enablement

Single pane of glass for entire NFV Infrastructure

• 360 Degrees Visibility

Proactive Issue Isolation and Troubleshooting

Out-of-box OpenStack dashboards

• OpenStack services (Nova, Neutron, Keystone, etc..)

vRealize Network Insight

vRealize Log InsightvRealize Operations

vRealize Business



bution



bution

FUT1744BU The Benefits of VMware Integrated OpenStack or … · 2019-06-27 · Hassan HAMADE...

Documents

Transcript of FUT1744BU The Benefits of VMware Integrated OpenStack or … · 2019-06-27 · Hassan HAMADE...