ViPR Suite: Storage as a Service - Dell Technologies World ... · Select Ports Based on...
Transcript of ViPR Suite: Storage as a Service - Dell Technologies World ... · Select Ports Based on...
© Copyright 2017 Dell Inc.2
Agenda• ViPR Suite Overview
What’s new in
• ViPR Controller 3.6What’s new in
• ViPR SRM 4.1
“The Beginning of IT Transformation”
© Copyright 2017 Dell Inc.3
By Show of Hands…How many are currently using ViPR Controller?
© Copyright 2017 Dell Inc.6
Enterprise Strategy Group
https://www.emc.com/collateral/analyst-reports/esg-dellemc-it-transformation-maturity-report.pdf
© Copyright 2017 Dell Inc.7
Transformation Story: It’s a JourneyTaming Complexity
Many Interfaces
Many Compute and Orchestration Platforms
CRUD
Challenges: migrate from the above to an automated environment• Not immediate, nor easy• ViPR Controller can help!
• If you set the stage properly
© Copyright 2017 Dell Inc.8
Dell EMC VIPR SRM & VIPR ControllerAutomated Management and Insight to Optimize Resources
INSIGHT ACTION
© Copyright 2017 Dell Inc.9
Trends in Your Environment
Storage admins are being pressured to deliver faster turnaround on storage requests
Rise of generalists vs. specialists has led to a breakdown of storage, network and host silos
Storage requestfor Application
Manual PlanningGUI for execution
Manual planningScripted execution
Intelligent Automation
© Copyright 2017 Dell Inc.10
Simplifies & automates complex tasks Up to 89% reduction in manual steps
Enables Self Service Storage Cuts time between "request" & "ready” by up to 80%
Simplifies Management Interfaces Plugs into northbound Cloud & Orchestration stacks
Automates Workflows Increases the amount of storage managed while
reducing risk
ViPR Controller
© Copyright 2017 Dell Inc.11
Automate Storage Service DeliveryMulti-Step
Process for host to see the volume
Select Storage Array Which Can Meet the SLO
Select Ports Based on Performance
Create Port Groups
Create Initiator Groups
Create Storage Groups
Create Masking Views
Create Zones on SAN switches
Rescan the HostEliminate SAN Zoning Steps
VIRTUAL STORAGE POOLS
Platinum withRemote Protection
Gold withLocal & Remote
Diamond withRemote Protection
Gold withLocal Protection
Choose Host
Select Diamond
Identify Capacity
Without Controller
ControllerVirtual Storage Arrays
With Controller
© Copyright 2017 Dell Inc.12
Provision data protection simultaneously with storage
SRDFREMOTE REPLICATION
OPERATIONAL RECOVERYDISASTER RECOVERY
89%average reduction in
manual steps
CONTINUOUS AVAILABILITY
RECOVERPOINTLOCAL & REMOTE REPLICATION
ACTIVE-ACTIVEDATA CENTERS
ARRAY-BASEDLOCAL COPIES
NON-DISRUPTIVEMIGRATIONS
CHANGE CLASS OF SERVICE
VPLE
X
DATA DOMAINBACKUP & ARCHIVE
Automate Data Protection As A Service
© Copyright 2017 Dell Inc.13https://coprhd.github.io
Increase Development Velocity
Expand 3rd Party Array Support
Full Transparency
Community-Driven Development• Open Source Project CoprHD
© Copyright 2017 Dell Inc.14
ViPR Controller – The Road Ahead
• Integrate with external scripts/workflows
• Seamless Ingestion
Extensible and Scalable
• Remove bottlenecks
Optimize Performance
• Simplifies and automates complex provisioning and orchestration tasks
Automation
© Copyright 2017 Dell Inc.15
ViPR Controller – 3.6
• Integration with external scripts/workflows
• Seamless Ingestion
Extensible and Scalable
• Remove bottlenecks
Optimize Performance
• Simplifies and automates complex provisioning and orchestration tasks.
Automation
© Copyright 2017 Dell Inc.17
ViPR-Controller Portal Services
Portal REST APIs (NGINX)
Workflow Engine
Base & Custom Services
Authentication Service
DB Services
ViPR-C REST APIs External REST APIs
Management GUI Service Catalog
Base Services
© Copyright 2017 Dell Inc.18
Port Rebalancing
Rebalancing Considerations
• Re-Balance front-end ports to reduce array hot spots
• Add new ports and rebalance workloads
• Introduce a new array and migrate applications to rebalance workloads
Controller
© Copyright 2017 Dell Inc.20
Reduce time to resolution for performance problems via end-to-end topology views
Slow down your incremental storage capacity purchases
Ensure your storage configuration matches your best practices
Show your business users true end-to-end storage infrastructure cost
ViPR SRM
© Copyright 2017 Dell Inc.21
Visualize. Analyze. Optimize.Compliance • SLA reporting• Configuration management• Data protection compliance
Capacity• Usage & trends• Chargeback• Reporting
Performance• Infrastructure topology mapping• Performance trending & reporting• Performance troubleshooting
Phys
ical
Virtu
al &
Sof
twar
e-de
fined
Dell EMC ViPR SRM
© Copyright 2017 Dell Inc.31
Hosts Attached to a Port
Quickly identify which hosts are attached to a director or port, to plan for
maintenance or identify potential bullies
© Copyright 2017 Dell Inc.32
ViPR Controller Tenant Chargeback Report
Eliminates the need to manually map hosts to tenants
© Copyright 2017 Dell Inc.34
Single, slightly larger collector (8 vCPU, 64GB RAM) can
handle 50-100 arrays
Dramatic Reduction in Collector VMs
Collectors
Filters/Tagging
RDF MySQL
Arbiter
REST API
HTML UI
Collector Collector…
Col
lect
ion
Pers
iste
nce
Pres
enta
tion
Having several small Collectors results in significant code overlap and an inefficient use of resources
A typical SRM instance consists of 80% Collectors and 20% Backend/Frontends
© Copyright 2017 Dell Inc.35
How Do I Migrate to Mega-Collector?
RDF MySQL
Arbiter
REST API
HTML UI
Col
lect
ion
Pers
iste
nce
Pres
enta
tion
Collector Collector
Collector Collector
Mega-Collector
2. In Centralized Mgmt UI, move collections to new Collector
1. Deploy new Mega-Collector via vApp or binary install (or resize an existing Collector)
© Copyright 2017 Dell Inc.36
How Do I Migrate to Mega-Collector?
RDF MySQL
Arbiter
REST API
HTML UI
Col
lect
ion
Pers
iste
nce
Pres
enta
tion
No loss of history
Collector Collector
Collector Collector
Mega-Collector
3. Decommission old Collectors
© Copyright 2017 Dell Inc.38
Learn MoreDemos available on show floor all week
Hands on Labs available for both SRM and Controller
ViPR Controller-SRM User Group Thurs. 8-2Please see a ViPR representative to sign up
© Copyright 2017 Dell Inc.42
Topology Mappings
• Understand host to storage relationships
• Visualize end-to-end topology and dependencies
• Analyze performance and availability trends
End to End Connectivity
© Copyright 2017 Dell Inc.43
REST APIs
Mozart: CoprHD Orchestration Engine
Storage Automation
API Interface
Business Driven Orchestrator EngineWorkflowDevelopment
© Copyright 2017 Dell Inc.44
End to End Migration Workflow
Migration Considerations
Plan migration by grouping volumes from a set of host together to plan for degraded performance
Setup target environment and host connectivity – zoning, mounting, rescanning hosts
Execute migration by mobility groups leveraging VMAX NDM
Cleanup after completion of migration
• Customers interested– JPMC– Citibank– Northrop Grumman
© Copyright 2017 Dell Inc.45
SIMPLIFY WITH VIPR-CSimplify to
3 inputs from users
100% Reduction in SAN Zoning Steps
Reduce time from request to provisioned storage
by >80% Choose Host or Cluster
Select Service Level
Identify Capacity Required
One API Call
© Copyright 2017 Dell Inc.46
Abstract Physical to Virtual
Turn Storage Silos into Policy-based Pools of Storage
IsilonVNX
EXCHANGE DATABASEVDI ARCHIVESHAREPOINT HOMEDIRECTORY
VMAX3 VMAX40K
VIRTUAL STORAGE POOLS
Vblock Systems
3rd PartyXtremIO
© Copyright 2017 Dell Inc.47
Performance Trending and Reporting• Analyze Performance from Host, Hypervisor, Switch, VPLEX & Array Perspective
Host/VMHypervisorSwitchVPLEXArray
© Copyright 2017 Dell Inc.48
Storage & Application Capacity Trends• Integrated Capacity Dashboards and Reports
• Automate capacity reporting
• Analyze capacity usage and trends
• Plan and justify new purchases
Go from“Just in Case”
to“Just in Time”
© Copyright 2017 Dell Inc.49
VMAX Storage Configuration Policies
• Define policies and best practices
• Validate compliance to Dell EMC Support Matrix
• Ensure proper configuration to meet SLOs
• Track configuration changes
Track Storage Configuration Compliance
Track changes & view breach details
© Copyright 2017 Dell Inc.50
Application Chargeback/ShowbackIdentify True Cost of Application Storage
Mapped/masked to backup server
Copy for testing new version of applicationMapped to dev server
DR copy; may or may not be mapped to a DR server
BackupServer
Dev/TestServer
ApplicationCluster
Primary volume
Local copy
Remote copy
Local copy
I can’t charge this to the
backup administrator!
Who do I charge for this copy?
© Copyright 2017 Dell Inc.52
ViPR Controller – Why Custom Services
Import New Custom Services from DellEMC Repository
Utilize Building Blocks from External DevOps Frameworks
Export Custom Services to other ViPR-C Instances -Build/Test/Deploy
REST APIs
Create New or Extend Existing Services
Publish to Service Catalog
© Copyright 2017 Dell Inc.53
ViPR-C Portal Services
Portal REST APIs (NGINX)
Workflow Engine
Base & Custom Services
Authentication Service
DB Services
ViPR-C REST APIs External REST APIs
Management GUI Service Catalog
Base Services
© Copyright 2017 Dell Inc.56
CLOUD STACK SUPPORTVMWARE
MICROSOFTOPENSTACK
PROGRAMINGREST API
SELF-SERVICE UIMULTI-TENTANCY
TENANT & PROJECT QUOTASSERVCE CATALOG
ROLE BASED ACCESS CONTROLORDER APPROVAL PROCESSORDER EXECUTION WINDOW
ACCESS CONTROL LIST
HOSTSVMWARE ESX
WINDOWSLINUX
AIXOTHERS
PLATFORMS - NATIVEISILONSCALEIOVCE VBLOCK SYSTEMSVMAX, VMAX3
VNX, VNXeXTREMIODATA DOMAIN FILERHITACHI DATA SYSTEMSNETAPP – FILE IBM XIV
PLATFORMS – VIA OPENSTACKNETAPP – BLOCK IBM SVC, DS8000DELL EQUAL LOGIC HP 3PAR, LEFTHANDORACLE SUN ZFSSOLIDFIRE
DATA PROTECTION TECHNOLOGIESRECOVERPOINTVPLEXSRDF
SWITCHESCISCOBROCADE
ViPR Controller Supported Environments
© Copyright 2017 Dell Inc.57
ONE EXTENSIBLE SOFTWARE PLATFORM TO UNITE ALL DELL EMC STORAGEVIPR-C - CHOICE WITHOUT COMPROMISE
100% Open & Extensible Simplified REST API and CLI across EMC storage
Plugs into ANY Cloud Stacks e.g., VMware, Microsoft, OpenStack
Automate Dell EMC Recommended PracticesReduces manual tasks up to 89% & 73% of cost
POLICY BASED STORAGE BEST PRACTICES
OPEN REST APIs
HIGHAVAILIBILTY PROTECTION
SELF-SERVICEPORTAL
MIGRATION
SAN &STORAGE
OPERATIONS
SERVICES
DISASTERRECOVERY
XTREMIO VMAX2 VMAX3 VNX2 Unity ISILON
VCEVBLOCK SCALEIO
SOUTHBOUND SDK
Centralize management of all Dell EMC Storage technologiesIntuitive GUI for use throughout Dell EMC technologies
VMAX AF VPLEXRECOVER
POINT DATA DOMAIN ECS
Rest API SMIS Rest APIRest APISMIS/CLIXML API Rest API
© Copyright 2017 Dell Inc.58
Automate Storage Service DeliveryMulti-Step
Process for host to see the volume
Select Storage Array Which Can Meet the SLO
Select Ports Based on Performance
Create Port Groups
Create Initiator Groups
Create Storage Groups
Create Masking Views
Create Zones on SAN switches
Rescan the HostEliminate SAN Zoning Steps
VIRTUAL STORAGE POOLS
PlatinumRemote Protection
GoldLocal & Remote
DiamondRemote Protection
GoldLocal Protection
SAN Automation & Zoning
Choose Host
Select Diamond
Identify Capacity
Without Controller
ControllerVirtual Storage Arrays
With Controller
© Copyright 2017 Dell Inc.60
60
Ease of Heterogeneous Storage ManagementIntroduction of New Platforms in the Datacenter
BeforeIn-Depth Array Training
Longer Time to ValueMultiple User Interfaces
AfterReduced Training Investment
Immediate Time to ValueOne User Interface for All Arrays
© Copyright 2017 Dell Inc.61
ViPR Controller Supported EnvironmentsCLOUD STACK SUPPORT
VMWAREMICROSOFTOPENSTACK
PROGRAMINGREST API
SELF-SERVICE UIMULTI-TENTANCY
TENANT & PROJECT QUOTASSERVCE CATALOG
ROLE BASED ACCESS CONTROLORDER APPROVAL PROCESSORDER EXECUTION WINDOW
ACCESS CONTROL LIST
HOSTSVMWARE ESX
WINDOWSLINUX
AIXOTHERS
PLATFORMS - NATIVEDell SCISILONSCALEIOVCE VBLOCK SYSTEMSVMAX, VMAX3
VNX, VNXeXTREMIODATA DOMAIN FILERHITACHI DATA SYSTEMSNETAPP – FILE IBM XIV
PLATFORMS – VIA OPENSTACKNETAPP – BLOCK IBM SVC, DS8000DELL EQUAL LOGIC HP 3PAR, LEFTHANDORACLE SUN ZFSSOLIDFIRE
DATA PROTECTION TECHNOLOGIESRECOVERPOINTVPLEXSRDF
SWITCHESCISCOBROCADE
© Copyright 2017 Dell Inc.62
Not locked in to one storage vendor• integration with openstack cinder for Simple management
• Supports 57 storage drivers out of the box• wiki.openstack.org/wiki/CinderSupportMatrix
• Drivers actively maintained and supported by their respective vendors
• Supports common operations, including:• Create, expand, delete Block Volume• Export Volume to Host• Remove Volume by Host• Create, remove Block Snapshot• Create volume from snapshot
• Great for simple management operations
NetApp IBM
Hitachi
© Copyright 2017 Dell Inc.63
Not locked in to one storage vendor• Advanced capabilities with Southbound SDk storage drivers
• Add new drivers or enhancements via SB SDK
• Dell EMC Professional services• Comprehensive ViPR Controller
management capabilities• You choose: self-support, Dell EMC
Professional Services, or preferred technology provider
NetAppIBM
Hitachi
SB SDK
© Copyright 2017 Dell Inc.64
ViPR Controller – Key Focus areas(2017)Automate data migration
VPLEX– VMAX2-VMAX3/VMAX3 – VMAX3 AF NDM– Any – VMAX
Storage Rebalancing – Re-balance front-end ports to reduce array hot spots– Move applications to meet SLOs
Application provision and protect Application layout across technologies Copies for Operational Recovery & Backup – Application DR management– Application based provisioning
Flexible Orchestrator engine (2017)– Create completely custom services leveraging ViPR Rest API library– Call pre and post scripts/actions– Schedule services
3
© Copyright 2017 Dell Inc.65
65
Power of ViPR Controller PlatformAnd SAN Management
BeforeSAN Outages
Manual managementIntroduced human error
Cumbersome change mgt process
AfterAutomated SAN Mgt
Consistent, repeatable processSimplified change mgt
© Copyright 2017 Dell Inc.66
ViPR Controller – Part of the Automation Journey• One Extensible Software Platform To Manage All Your Storage
• Open & Extensible REST APIJava, Ruby and Python SDKsOpen source development via CoprHD
• Plugs into Northbound Stacks VMware, Microsoft, OpenStack
• Optimized for Dell EMC StorageDell SC, VMAX, SRDF, XtremIO, VNX, RecoverPoint, Isilon, ScaleIO, VPLEX,
Automate Storage Provisioning• Orchestrates
Repetitive and complex tasks
Multi-tenant, Multi-Site
HIGH LOWMEDIUM
Storage Automation
Multivendor Storage
© Copyright 2017 Dell Inc.67
Cost of managing heterogeneous storage
Storage integration with automation tools & cloud stacks
CHALLENGES
MANAGING STORAGE LIFECYCLE
Lead times associated with storage allocation
Storage capacity and performance metrics across data center
End-to-end visibility
© Copyright 2017 Dell Inc.68
Distributed Scale-out Software Platform
• Clustered Architecture supporting 3 or 5 identical nodes operating in Active/Active mode
• No shared resources with redundant services across nodes
• Supports thousands of Operations/Hour
• Multi-tenant, Multi-user Access Control
• Redundant, fault-tolerant and distributed persistence layer
• Delivered as group of Virtual Appliances
• Supports Multi-site Disaster Recovery configurations
• Supports rolling upgrade/updates from EMC repository
DISTRIBUTED COORDINATION
REVERSE PROXY & LOAD BALANCER
DISTRIBUTED DATABASE
Physical Storage