ViPR Suite: Storage as a Service - Dell Technologies World ... · Select Ports Based on...

67
ViPR Suite: Storage as a Service & What’s New with ViPR

Transcript of ViPR Suite: Storage as a Service - Dell Technologies World ... · Select Ports Based on...

ViPR Suite:Storage as a Service& What’s New with ViPR

© Copyright 2017 Dell Inc.2

Agenda• ViPR Suite Overview

What’s new in

• ViPR Controller 3.6What’s new in

• ViPR SRM 4.1

“The Beginning of IT Transformation”

© Copyright 2017 Dell Inc.4

By Show of Hands…How many are currently using ViPR SRM?

© Copyright 2017 Dell Inc.5

By Show of Hands…How many are currently using both?

+= SaaS

© Copyright 2017 Dell Inc.6

Enterprise Strategy Group

https://www.emc.com/collateral/analyst-reports/esg-dellemc-it-transformation-maturity-report.pdf

© Copyright 2017 Dell Inc.7

Transformation Story: It’s a JourneyTaming Complexity

Many Interfaces

Many Compute and Orchestration Platforms

CRUD

Challenges: migrate from the above to an automated environment• Not immediate, nor easy• ViPR Controller can help!

• If you set the stage properly

© Copyright 2017 Dell Inc.8

Dell EMC VIPR SRM & VIPR ControllerAutomated Management and Insight to Optimize Resources

INSIGHT ACTION

© Copyright 2017 Dell Inc.9

Trends in Your Environment

Storage admins are being pressured to deliver faster turnaround on storage requests

Rise of generalists vs. specialists has led to a breakdown of storage, network and host silos

Storage requestfor Application

Manual PlanningGUI for execution

Manual planningScripted execution

Intelligent Automation

© Copyright 2017 Dell Inc.10

Simplifies & automates complex tasks Up to 89% reduction in manual steps

Enables Self Service Storage Cuts time between "request" & "ready” by up to 80%

Simplifies Management Interfaces Plugs into northbound Cloud & Orchestration stacks

Automates Workflows Increases the amount of storage managed while

reducing risk

ViPR Controller

© Copyright 2017 Dell Inc.11

Automate Storage Service DeliveryMulti-Step

Process for host to see the volume

Select Storage Array Which Can Meet the SLO

Select Ports Based on Performance

Create Port Groups

Create Initiator Groups

Create Storage Groups

Create Masking Views

Create Zones on SAN switches

Rescan the HostEliminate SAN Zoning Steps

VIRTUAL STORAGE POOLS

Platinum withRemote Protection

Gold withLocal & Remote

Diamond withRemote Protection

Gold withLocal Protection

Choose Host

Select Diamond

Identify Capacity

Without Controller

ControllerVirtual Storage Arrays

With Controller

© Copyright 2017 Dell Inc.12

Provision data protection simultaneously with storage

SRDFREMOTE REPLICATION

OPERATIONAL RECOVERYDISASTER RECOVERY

89%average reduction in

manual steps

CONTINUOUS AVAILABILITY

RECOVERPOINTLOCAL & REMOTE REPLICATION

ACTIVE-ACTIVEDATA CENTERS

ARRAY-BASEDLOCAL COPIES

NON-DISRUPTIVEMIGRATIONS

CHANGE CLASS OF SERVICE

VPLE

X

DATA DOMAINBACKUP & ARCHIVE

Automate Data Protection As A Service

© Copyright 2017 Dell Inc.13https://coprhd.github.io

Increase Development Velocity

Expand 3rd Party Array Support

Full Transparency

Community-Driven Development• Open Source Project CoprHD

© Copyright 2017 Dell Inc.14

ViPR Controller – The Road Ahead

• Integrate with external scripts/workflows

• Seamless Ingestion

Extensible and Scalable

• Remove bottlenecks

Optimize Performance

• Simplifies and automates complex provisioning and orchestration tasks

Automation

© Copyright 2017 Dell Inc.15

ViPR Controller – 3.6

• Integration with external scripts/workflows

• Seamless Ingestion

Extensible and Scalable

• Remove bottlenecks

Optimize Performance

• Simplifies and automates complex provisioning and orchestration tasks.

Automation

ViPR Controller What’s new this summer

© Copyright 2017 Dell Inc.17

ViPR-Controller Portal Services

Portal REST APIs (NGINX)

Workflow Engine

Base & Custom Services

Authentication Service

DB Services

ViPR-C REST APIs External REST APIs

Management GUI Service Catalog

Base Services

© Copyright 2017 Dell Inc.18

Port Rebalancing

Rebalancing Considerations

• Re-Balance front-end ports to reduce array hot spots

• Add new ports and rebalance workloads

• Introduce a new array and migrate applications to rebalance workloads

Controller

© Copyright 2017 Dell Inc.19

The Insight to Enable Better

Decisions

ViPR SRM

© Copyright 2017 Dell Inc.20

Reduce time to resolution for performance problems via end-to-end topology views

Slow down your incremental storage capacity purchases

Ensure your storage configuration matches your best practices

Show your business users true end-to-end storage infrastructure cost

ViPR SRM

© Copyright 2017 Dell Inc.21

Visualize. Analyze. Optimize.Compliance • SLA reporting• Configuration management• Data protection compliance

Capacity• Usage & trends• Chargeback• Reporting

Performance• Infrastructure topology mapping• Performance trending & reporting• Performance troubleshooting

Phys

ical

Virtu

al &

Sof

twar

e-de

fined

Dell EMC ViPR SRM

What’s New in ViPR SRM 4.1Targeted Delivery: July 7th

© Copyright 2017 Dell Inc.23

Dell SC (Compellent) SolutionPack

GA 1/27

© Copyright 2017 Dell Inc.24

New Summary Views

© Copyright 2017 Dell Inc.25

Host Dashboards

© Copyright 2017 Dell Inc.26

VMWare Hypervisor Clusters

© Copyright 2017 Dell Inc.27

Hyper-V SolutionPack

© Copyright 2017 Dell Inc.28

New Alerts Dashboard

© Copyright 2017 Dell Inc.29

Potential Savings Dashboards – VMAX and Unity

© Copyright 2017 Dell Inc.30

Situations to Watch Dashboards

© Copyright 2017 Dell Inc.31

Hosts Attached to a Port

Quickly identify which hosts are attached to a director or port, to plan for

maintenance or identify potential bullies

© Copyright 2017 Dell Inc.32

ViPR Controller Tenant Chargeback Report

Eliminates the need to manually map hosts to tenants

© Copyright 2017 Dell Inc.33

Easy Deploy Wizard

© Copyright 2017 Dell Inc.34

Single, slightly larger collector (8 vCPU, 64GB RAM) can

handle 50-100 arrays

Dramatic Reduction in Collector VMs

Collectors

Filters/Tagging

RDF MySQL

Arbiter

REST API

HTML UI

Collector Collector…

Col

lect

ion

Pers

iste

nce

Pres

enta

tion

Having several small Collectors results in significant code overlap and an inefficient use of resources

A typical SRM instance consists of 80% Collectors and 20% Backend/Frontends

© Copyright 2017 Dell Inc.35

How Do I Migrate to Mega-Collector?

RDF MySQL

Arbiter

REST API

HTML UI

Col

lect

ion

Pers

iste

nce

Pres

enta

tion

Collector Collector

Collector Collector

Mega-Collector

2. In Centralized Mgmt UI, move collections to new Collector

1. Deploy new Mega-Collector via vApp or binary install (or resize an existing Collector)

© Copyright 2017 Dell Inc.36

How Do I Migrate to Mega-Collector?

RDF MySQL

Arbiter

REST API

HTML UI

Col

lect

ion

Pers

iste

nce

Pres

enta

tion

No loss of history

Collector Collector

Collector Collector

Mega-Collector

3. Decommission old Collectors

© Copyright 2017 Dell Inc.37

Questions

© Copyright 2017 Dell Inc.38

Learn MoreDemos available on show floor all week

Hands on Labs available for both SRM and Controller

ViPR Controller-SRM User Group Thurs. 8-2Please see a ViPR representative to sign up

© Copyright 2017 Dell Inc.42

Topology Mappings

• Understand host to storage relationships

• Visualize end-to-end topology and dependencies

• Analyze performance and availability trends

End to End Connectivity

© Copyright 2017 Dell Inc.43

REST APIs

Mozart: CoprHD Orchestration Engine

Storage Automation

API Interface

Business Driven Orchestrator EngineWorkflowDevelopment

© Copyright 2017 Dell Inc.44

End to End Migration Workflow

Migration Considerations

Plan migration by grouping volumes from a set of host together to plan for degraded performance

Setup target environment and host connectivity – zoning, mounting, rescanning hosts

Execute migration by mobility groups leveraging VMAX NDM

Cleanup after completion of migration

• Customers interested– JPMC– Citibank– Northrop Grumman

© Copyright 2017 Dell Inc.45

SIMPLIFY WITH VIPR-CSimplify to

3 inputs from users

100% Reduction in SAN Zoning Steps

Reduce time from request to provisioned storage

by >80% Choose Host or Cluster

Select Service Level

Identify Capacity Required

One API Call

© Copyright 2017 Dell Inc.46

Abstract Physical to Virtual

Turn Storage Silos into Policy-based Pools of Storage

IsilonVNX

EXCHANGE DATABASEVDI ARCHIVESHAREPOINT HOMEDIRECTORY

VMAX3 VMAX40K

VIRTUAL STORAGE POOLS

Vblock Systems

3rd PartyXtremIO

© Copyright 2017 Dell Inc.47

Performance Trending and Reporting• Analyze Performance from Host, Hypervisor, Switch, VPLEX & Array Perspective

Host/VMHypervisorSwitchVPLEXArray

© Copyright 2017 Dell Inc.48

Storage & Application Capacity Trends• Integrated Capacity Dashboards and Reports

• Automate capacity reporting

• Analyze capacity usage and trends

• Plan and justify new purchases

Go from“Just in Case”

to“Just in Time”

© Copyright 2017 Dell Inc.49

VMAX Storage Configuration Policies

• Define policies and best practices

• Validate compliance to Dell EMC Support Matrix

• Ensure proper configuration to meet SLOs

• Track configuration changes

Track Storage Configuration Compliance

Track changes & view breach details

© Copyright 2017 Dell Inc.50

Application Chargeback/ShowbackIdentify True Cost of Application Storage

Mapped/masked to backup server

Copy for testing new version of applicationMapped to dev server

DR copy; may or may not be mapped to a DR server

BackupServer

Dev/TestServer

ApplicationCluster

Primary volume

Local copy

Remote copy

Local copy

I can’t charge this to the

backup administrator!

Who do I charge for this copy?

ViPR Controller 4.0Skywalker Custom Services

© Copyright 2017 Dell Inc.52

ViPR Controller – Why Custom Services

Import New Custom Services from DellEMC Repository

Utilize Building Blocks from External DevOps Frameworks

Export Custom Services to other ViPR-C Instances -Build/Test/Deploy

REST APIs

Create New or Extend Existing Services

Publish to Service Catalog

© Copyright 2017 Dell Inc.53

ViPR-C Portal Services

Portal REST APIs (NGINX)

Workflow Engine

Base & Custom Services

Authentication Service

DB Services

ViPR-C REST APIs External REST APIs

Management GUI Service Catalog

Base Services

© Copyright 2017 Dell Inc.54

ViPR Controller – Service Catalog

© Copyright 2017 Dell Inc.55

Custom Services – Workflow Builder

© Copyright 2017 Dell Inc.56

CLOUD STACK SUPPORTVMWARE

MICROSOFTOPENSTACK

PROGRAMINGREST API

SELF-SERVICE UIMULTI-TENTANCY

TENANT & PROJECT QUOTASSERVCE CATALOG

ROLE BASED ACCESS CONTROLORDER APPROVAL PROCESSORDER EXECUTION WINDOW

ACCESS CONTROL LIST

HOSTSVMWARE ESX

WINDOWSLINUX

AIXOTHERS

PLATFORMS - NATIVEISILONSCALEIOVCE VBLOCK SYSTEMSVMAX, VMAX3

VNX, VNXeXTREMIODATA DOMAIN FILERHITACHI DATA SYSTEMSNETAPP – FILE IBM XIV

PLATFORMS – VIA OPENSTACKNETAPP – BLOCK IBM SVC, DS8000DELL EQUAL LOGIC HP 3PAR, LEFTHANDORACLE SUN ZFSSOLIDFIRE

DATA PROTECTION TECHNOLOGIESRECOVERPOINTVPLEXSRDF

SWITCHESCISCOBROCADE

ViPR Controller Supported Environments

© Copyright 2017 Dell Inc.57

ONE EXTENSIBLE SOFTWARE PLATFORM TO UNITE ALL DELL EMC STORAGEVIPR-C - CHOICE WITHOUT COMPROMISE

100% Open & Extensible Simplified REST API and CLI across EMC storage

Plugs into ANY Cloud Stacks e.g., VMware, Microsoft, OpenStack

Automate Dell EMC Recommended PracticesReduces manual tasks up to 89% & 73% of cost

POLICY BASED STORAGE BEST PRACTICES

OPEN REST APIs

HIGHAVAILIBILTY PROTECTION

SELF-SERVICEPORTAL

MIGRATION

SAN &STORAGE

OPERATIONS

SERVICES

DISASTERRECOVERY

XTREMIO VMAX2 VMAX3 VNX2 Unity ISILON

VCEVBLOCK SCALEIO

SOUTHBOUND SDK

Centralize management of all Dell EMC Storage technologiesIntuitive GUI for use throughout Dell EMC technologies

VMAX AF VPLEXRECOVER

POINT DATA DOMAIN ECS

Rest API SMIS Rest APIRest APISMIS/CLIXML API Rest API

© Copyright 2017 Dell Inc.58

Automate Storage Service DeliveryMulti-Step

Process for host to see the volume

Select Storage Array Which Can Meet the SLO

Select Ports Based on Performance

Create Port Groups

Create Initiator Groups

Create Storage Groups

Create Masking Views

Create Zones on SAN switches

Rescan the HostEliminate SAN Zoning Steps

VIRTUAL STORAGE POOLS

PlatinumRemote Protection

GoldLocal & Remote

DiamondRemote Protection

GoldLocal Protection

SAN Automation & Zoning

Choose Host

Select Diamond

Identify Capacity

Without Controller

ControllerVirtual Storage Arrays

With Controller

© Copyright 2017 Dell Inc.59

Deliver Storage-as-a-Service

Self-service in 5 clicks

© Copyright 2017 Dell Inc.60

60

Ease of Heterogeneous Storage ManagementIntroduction of New Platforms in the Datacenter

BeforeIn-Depth Array Training

Longer Time to ValueMultiple User Interfaces

AfterReduced Training Investment

Immediate Time to ValueOne User Interface for All Arrays

© Copyright 2017 Dell Inc.61

ViPR Controller Supported EnvironmentsCLOUD STACK SUPPORT

VMWAREMICROSOFTOPENSTACK

PROGRAMINGREST API

SELF-SERVICE UIMULTI-TENTANCY

TENANT & PROJECT QUOTASSERVCE CATALOG

ROLE BASED ACCESS CONTROLORDER APPROVAL PROCESSORDER EXECUTION WINDOW

ACCESS CONTROL LIST

HOSTSVMWARE ESX

WINDOWSLINUX

AIXOTHERS

PLATFORMS - NATIVEDell SCISILONSCALEIOVCE VBLOCK SYSTEMSVMAX, VMAX3

VNX, VNXeXTREMIODATA DOMAIN FILERHITACHI DATA SYSTEMSNETAPP – FILE IBM XIV

PLATFORMS – VIA OPENSTACKNETAPP – BLOCK IBM SVC, DS8000DELL EQUAL LOGIC HP 3PAR, LEFTHANDORACLE SUN ZFSSOLIDFIRE

DATA PROTECTION TECHNOLOGIESRECOVERPOINTVPLEXSRDF

SWITCHESCISCOBROCADE

© Copyright 2017 Dell Inc.62

Not locked in to one storage vendor• integration with openstack cinder for Simple management

• Supports 57 storage drivers out of the box• wiki.openstack.org/wiki/CinderSupportMatrix

• Drivers actively maintained and supported by their respective vendors

• Supports common operations, including:• Create, expand, delete Block Volume• Export Volume to Host• Remove Volume by Host• Create, remove Block Snapshot• Create volume from snapshot

• Great for simple management operations

NetApp IBM

Hitachi

© Copyright 2017 Dell Inc.63

Not locked in to one storage vendor• Advanced capabilities with Southbound SDk storage drivers

• Add new drivers or enhancements via SB SDK

• Dell EMC Professional services• Comprehensive ViPR Controller

management capabilities• You choose: self-support, Dell EMC

Professional Services, or preferred technology provider

NetAppIBM

Hitachi

SB SDK

© Copyright 2017 Dell Inc.64

ViPR Controller – Key Focus areas(2017)Automate data migration

VPLEX– VMAX2-VMAX3/VMAX3 – VMAX3 AF NDM– Any – VMAX

Storage Rebalancing – Re-balance front-end ports to reduce array hot spots– Move applications to meet SLOs

Application provision and protect Application layout across technologies Copies for Operational Recovery & Backup – Application DR management– Application based provisioning

Flexible Orchestrator engine (2017)– Create completely custom services leveraging ViPR Rest API library– Call pre and post scripts/actions– Schedule services

3

© Copyright 2017 Dell Inc.65

65

Power of ViPR Controller PlatformAnd SAN Management

BeforeSAN Outages

Manual managementIntroduced human error

Cumbersome change mgt process

AfterAutomated SAN Mgt

Consistent, repeatable processSimplified change mgt

© Copyright 2017 Dell Inc.66

ViPR Controller – Part of the Automation Journey• One Extensible Software Platform To Manage All Your Storage

• Open & Extensible REST APIJava, Ruby and Python SDKsOpen source development via CoprHD

• Plugs into Northbound Stacks VMware, Microsoft, OpenStack

• Optimized for Dell EMC StorageDell SC, VMAX, SRDF, XtremIO, VNX, RecoverPoint, Isilon, ScaleIO, VPLEX,

Automate Storage Provisioning• Orchestrates

Repetitive and complex tasks

Multi-tenant, Multi-Site

HIGH LOWMEDIUM

Storage Automation

Multivendor Storage

© Copyright 2017 Dell Inc.67

Cost of managing heterogeneous storage

Storage integration with automation tools & cloud stacks

CHALLENGES

MANAGING STORAGE LIFECYCLE

Lead times associated with storage allocation

Storage capacity and performance metrics across data center

End-to-end visibility

© Copyright 2017 Dell Inc.68

Distributed Scale-out Software Platform

• Clustered Architecture supporting 3 or 5 identical nodes operating in Active/Active mode

• No shared resources with redundant services across nodes

• Supports thousands of Operations/Hour

• Multi-tenant, Multi-user Access Control

• Redundant, fault-tolerant and distributed persistence layer

• Delivered as group of Virtual Appliances

• Supports Multi-site Disaster Recovery configurations

• Supports rolling upgrade/updates from EMC repository

DISTRIBUTED COORDINATION

REVERSE PROXY & LOAD BALANCER

DISTRIBUTED DATABASE

Physical Storage