SDN Scale-out Testing at OpenStack Innovation Center (OSIC)

OpenStack Summit | Barcelona, Spain

SDN Scale-out Testing at OpenStack Innovation Center (OSIC)

Copyright © PLUMgrid, Inc. 2011-2016Copyright © PLUMgrid, Inc. 2011-20162

IntroductionSpeakers

Title/Designation

HillsmanMelvin

Solutions ArchitectPLUMgrid

ArifJamal

Product Marketing EngineerIntel Corporation

BroughtonTravis


What is the OpenStack Innovation Center?

OSIC’s Mission:Making OpenStack* easy to deploy, operate and use, with all of the features of an enterprise-class computing platform

OSIC has three main tenets:1) Grow the number of OpenStack contributors2) Increase upstream OpenStack contributions3) Enable OpenStack innovation at Unmatched scale

*Other names and brands may be claimed as the property of others.


Grow the number of OpenStack* Contributors



Increase Upstream OpenStack* Contributions



Enable OpenStack* Innovation at Unmatched Scale

To support advanced, community-wide, large-scale testing of OpenStack.


PLUMgrid Scale-Out Testing at OSIC: Infrastructure Setup

7


OSIC Test Bed (April 2016)

• 131 Physical Node Cluster • Three Weeks • Installation

• OpenStack Ansible Community (OSA) Version 12 (Liberty)• PLUMgrid OpenStack Networking Suite (ONS) Version 4 (Neutron Plugin)• PLUMgrid CloudApex Version 1 (Cloud Visualization and Operation Tool)

• Scale: • 80 Tenants (Virtual Domains) 1600 Virtual Machines


OSIC Test Bed (Oct 2016)

• 131 Physical Node Cluster • Three Weeks • Installation

• OpenStack Ansible Community (OSA) Version 13 (Mitaka)• PLUMgrid OpenStack Networking Suite (ONS) Version 6 (Neutron Plugin)• PLUMgrid CloudApex Version 1.2 (Cloud Visualization and Operation Tool)

• Scale: • 140 Tenants (Virtual Domains) 4000 Virtual Machines


What is PLUMgrid ONS?Extensive software-only networking solution for OpenStack® Clouds

Top Security & Compliance Support with built-in isolation, micro-segmentation via Virtual Domains & BYO service

Unmatched Operational tools with proactive visibility & analytics (CloudApex)

Virtual networks provisioned by users

Scalable, distributed & highly available architecture enables Production Deployments


PLUMgrid ONS OverviewFull Hybrid Solution for Private and Hybrid Cloud

Internet

IO Visor Gateway

IO Visor Edges (Compute Nodes)

PLUMgrid Directors

VXLAN-based Overlay

PLUMgrid CloudApex & OpsVM

PLUMgrid IO Visor based Edges

PLUMgrid Director

PLUMgrid Gateways


OSIC Test Bed Setup

Internet

External Servers x 2

Gateway Servers x 4

Director / OpenStack Controllers x 3

Infra Host

Compute Nodes x 121

OPS LCM BOOT


OpenStack Dashboard + PLUMgrid Console


CloudApex (Cloud Visualization and Orchestration Tool) (1)


CloudApex (Cloud Visualization and Orchestration Tool) (2)

PLUMgrid Scale-Out Testing

16


PLUMgrid Scale-Out Testing

• OpenStack Functional Validation with Tempest Suite

• Cluster Scale testing using Heat templates

• PLUMgrid High-Availability Testing at Scale

• PLUMgrid Scale Out Testing with Rally Tests


OpenStack Functional/Api Validation

There were NO applicable deviations observed

Tempest tests to cover the OpenStack functional/api validation (neutron, image, identity, compute)


PLUMgrid Scale using Heat Templates

Service Virtual Domain For External Connectivity

Tenant Virtual Domains Network Topology

Each Tenant with distributed virtual network functions (Distributed Bridge, Distribted Router, Distributed NAT, Distributed Security Policy framework)

Heat templates to reach 140 tenants and 4000 VMs


Is it Highly Available at Scale?

PLUMgrid Single Director Failure Test• Successfully verified Connectivity of

VMs

3 Controllers ( 3 PG Directors)), 121 Compute Nodes (PG Edges, 4 PG Gateway Servers, 140 tenants, 4000 VMs

PLUMgrid Director Cluster Failure (Control Plane Failure)

• Successfully verified Connectivity of VMs in Headless Mode


OpenStack/PLUMgrid Rally Testing

Tests at 80 Tenants (Virtual Domains) 160 VMs

Tests at No Load (Bench Marking)

80 Tenants (Virtual Domains) 1600 VMs

• Neutron Networks• neutron.create_network• Neutron.list_networks

• Neutron Routers• neutron.create_network• neutron.create_subnet• neutron.create_router• neutron.add_interface_router• neutron.list_routers

• Neutron Security Groups• neutron.create_security_group• neutron.list_security_groups

• Neutron Subnets• neutron.create_network• neutron.create_subnet• neutron.list_subnets

• Neutron VMs• neutron.boot_servers• neutron.delete_servers


Rally Bench Marking with NO Load


80 Tenants, 160 VMs


80 Tenants, 1600 VMs


What did we Learn?(1)

• Host inventory playbook issues

• Tweaked the SSH settings (timeout/retries) to reduce ‘unreachable’ errors

• Time – 2 days (48 hours)

Installation


What did we Learn?(2)

• RabbitMQ• Optimization patches• Increasing the number of file descriptors

• Overrides for RPC thread pool sizes for nova & neutron services

• Horizon dashboard slow response at Scale

• Average network request service times showed an incremental increase with scale

Scale Out Testing

Visit Us @Booth B37

THANK YOU!

www.plumgrid.com

Visit Us @Booth B37

THANK YOU!

www.plumgrid.com

SDN Scale-out Testing at OpenStack Innovation Center (OSIC)

Technology

Transcript of SDN Scale-out Testing at OpenStack Innovation Center (OSIC)