CMG Canada Home Page - Restoring Data Storage...
Transcript of CMG Canada Home Page - Restoring Data Storage...
![Page 1: CMG Canada Home Page - Restoring Data Storage Predictabilitycmgcanada.altervista.org/presentations/2017 Apr pres/CMG...2017/04/25 · Hybrid Fast Any IOPS intensive Average High 2](https://reader033.fdocuments.in/reader033/viewer/2022050412/5f88f1a165129f37bd53b330/html5/thumbnails/1.jpg)
1
Restoring Data Storage Predictability
Thoughts and Approaches on Managing Storage Performance and Capacity in 2017
Brent Phillips – Managing Director, Americas Brett Allison – Director of Technical Services
![Page 2: CMG Canada Home Page - Restoring Data Storage Predictabilitycmgcanada.altervista.org/presentations/2017 Apr pres/CMG...2017/04/25 · Hybrid Fast Any IOPS intensive Average High 2](https://reader033.fdocuments.in/reader033/viewer/2022050412/5f88f1a165129f37bd53b330/html5/thumbnails/2.jpg)
2
Agenda
• The Predictability Challenge
• Storage Background
• Storage Capacity Management
• Storage Performance Management
![Page 3: CMG Canada Home Page - Restoring Data Storage Predictabilitycmgcanada.altervista.org/presentations/2017 Apr pres/CMG...2017/04/25 · Hybrid Fast Any IOPS intensive Average High 2](https://reader033.fdocuments.in/reader033/viewer/2022050412/5f88f1a165129f37bd53b330/html5/thumbnails/3.jpg)
3
The Predictability Challenge
• What risky conditions exist right now across our entire environment? (rated metrics & exception charts for space, performance, configuration issues)
• Where do go next to see root causes? (intelligent drill downs)
• What related metrics are relevant to the context of this issue? (side-by-side mini-charts of related metrics that are clickable)
• What help is there to create a solutions? (built-in recommendations)
![Page 4: CMG Canada Home Page - Restoring Data Storage Predictabilitycmgcanada.altervista.org/presentations/2017 Apr pres/CMG...2017/04/25 · Hybrid Fast Any IOPS intensive Average High 2](https://reader033.fdocuments.in/reader033/viewer/2022050412/5f88f1a165129f37bd53b330/html5/thumbnails/4.jpg)
4
Predictability Requires Better Analytics • Lots of disparate data from:
‒ Hosts ‒ SAN Switches ‒ Storage Arrays
• Need to automatically: ‒ Normalize the data ‒ Enrich, additional calculations ‒ Correlate, interrelate ‒ Evaluate, good or bad? ‒ Easily navigate through it
IT Operations Analytics (ITOA)
"The use of mathematical algorithms and other innovations to extract
meaningful information from the sea of raw data collected
by management and monitoring technologies.”
Forrestor Research
![Page 5: CMG Canada Home Page - Restoring Data Storage Predictabilitycmgcanada.altervista.org/presentations/2017 Apr pres/CMG...2017/04/25 · Hybrid Fast Any IOPS intensive Average High 2](https://reader033.fdocuments.in/reader033/viewer/2022050412/5f88f1a165129f37bd53b330/html5/thumbnails/5.jpg)
5
Predictability Requires Better Analytics
• “..and other innovations…” ‒ Most useful ITOA innovation for storage is applying a
storage-specific type of artificial intelligence (AI).
• “Artificial intelligence is the science of making machines do things that would require intelligence if done by men” - Marvin Minsky 1968
• What could be done that there is no time to do?
• This is an example of why Applied AI is the #1 strategic technology trend according to Gartner
![Page 6: CMG Canada Home Page - Restoring Data Storage Predictabilitycmgcanada.altervista.org/presentations/2017 Apr pres/CMG...2017/04/25 · Hybrid Fast Any IOPS intensive Average High 2](https://reader033.fdocuments.in/reader033/viewer/2022050412/5f88f1a165129f37bd53b330/html5/thumbnails/6.jpg)
6
• Spend time on proactive storage management ‒ Not reactive fire fighting ‒ Not on maintaining the analytics infrastructure
• Allows for quick, easy Proof of Concept (POC)
Predictability through ITOA as a Service
© IntelliMagic 2016
![Page 7: CMG Canada Home Page - Restoring Data Storage Predictabilitycmgcanada.altervista.org/presentations/2017 Apr pres/CMG...2017/04/25 · Hybrid Fast Any IOPS intensive Average High 2](https://reader033.fdocuments.in/reader033/viewer/2022050412/5f88f1a165129f37bd53b330/html5/thumbnails/7.jpg)
7
Storage Background
![Page 8: CMG Canada Home Page - Restoring Data Storage Predictabilitycmgcanada.altervista.org/presentations/2017 Apr pres/CMG...2017/04/25 · Hybrid Fast Any IOPS intensive Average High 2](https://reader033.fdocuments.in/reader033/viewer/2022050412/5f88f1a165129f37bd53b330/html5/thumbnails/8.jpg)
8
What is Data Storage?
This Photo by Unknown Author is licensed under CC BY-SA This Photo by Unknown Author is licensed under CC BY-NC
Primary Storage Remote Storage
![Page 9: CMG Canada Home Page - Restoring Data Storage Predictabilitycmgcanada.altervista.org/presentations/2017 Apr pres/CMG...2017/04/25 · Hybrid Fast Any IOPS intensive Average High 2](https://reader033.fdocuments.in/reader033/viewer/2022050412/5f88f1a165129f37bd53b330/html5/thumbnails/9.jpg)
9
Data Center Storage Architectures and Industry Adoption
![Page 10: CMG Canada Home Page - Restoring Data Storage Predictabilitycmgcanada.altervista.org/presentations/2017 Apr pres/CMG...2017/04/25 · Hybrid Fast Any IOPS intensive Average High 2](https://reader033.fdocuments.in/reader033/viewer/2022050412/5f88f1a165129f37bd53b330/html5/thumbnails/10.jpg)
10
![Page 11: CMG Canada Home Page - Restoring Data Storage Predictabilitycmgcanada.altervista.org/presentations/2017 Apr pres/CMG...2017/04/25 · Hybrid Fast Any IOPS intensive Average High 2](https://reader033.fdocuments.in/reader033/viewer/2022050412/5f88f1a165129f37bd53b330/html5/thumbnails/11.jpg)
11
State of Industry
State of Technology
![Page 12: CMG Canada Home Page - Restoring Data Storage Predictabilitycmgcanada.altervista.org/presentations/2017 Apr pres/CMG...2017/04/25 · Hybrid Fast Any IOPS intensive Average High 2](https://reader033.fdocuments.in/reader033/viewer/2022050412/5f88f1a165129f37bd53b330/html5/thumbnails/12.jpg)
12
State of Industry
State of Technology
![Page 13: CMG Canada Home Page - Restoring Data Storage Predictabilitycmgcanada.altervista.org/presentations/2017 Apr pres/CMG...2017/04/25 · Hybrid Fast Any IOPS intensive Average High 2](https://reader033.fdocuments.in/reader033/viewer/2022050412/5f88f1a165129f37bd53b330/html5/thumbnails/13.jpg)
13
Performance Management Characteristics Tier Purpose Performance External
Dependencies * I/O Profile Ideal
Capacity Growth
Availability
0 Flash Extremely Fast Any IOPS intensive Average High (if in enterprise storage array)
1 Enterprise Hybrid
Fast Any IOPS intensive Average High
2 Mid-range Spinning
Good Any IOPS average/Throughput
Average High
3 Nearline/NAS Medium to slow, but predicable response times
Any IOPS low intensity Medium growth
High
4 Tape/VTS Archive
Not latency sensitive, think batch/archive
Any IOPS low intensity/Occasional high throughput
High growth
Moderate
5 Cloud Slow and unpredictable
None High throughput is okay
High growth
Moderate
![Page 14: CMG Canada Home Page - Restoring Data Storage Predictabilitycmgcanada.altervista.org/presentations/2017 Apr pres/CMG...2017/04/25 · Hybrid Fast Any IOPS intensive Average High 2](https://reader033.fdocuments.in/reader033/viewer/2022050412/5f88f1a165129f37bd53b330/html5/thumbnails/14.jpg)
14
Storage Capacity Management
![Page 15: CMG Canada Home Page - Restoring Data Storage Predictabilitycmgcanada.altervista.org/presentations/2017 Apr pres/CMG...2017/04/25 · Hybrid Fast Any IOPS intensive Average High 2](https://reader033.fdocuments.in/reader033/viewer/2022050412/5f88f1a165129f37bd53b330/html5/thumbnails/15.jpg)
15
Storage Capacity Management Methodology
Collect
Report
Calculate Growth
Forecast Requirements
Make Recommendations
Identify Important Metrics
![Page 16: CMG Canada Home Page - Restoring Data Storage Predictabilitycmgcanada.altervista.org/presentations/2017 Apr pres/CMG...2017/04/25 · Hybrid Fast Any IOPS intensive Average High 2](https://reader033.fdocuments.in/reader033/viewer/2022050412/5f88f1a165129f37bd53b330/html5/thumbnails/16.jpg)
16
Technology Enhanced Storage Capacity Management Methodology
Collect
Report
Calculate Growth
Forecast Requirements
Make Recommendations
Identify Important Metrics
Automated Analysis
![Page 17: CMG Canada Home Page - Restoring Data Storage Predictabilitycmgcanada.altervista.org/presentations/2017 Apr pres/CMG...2017/04/25 · Hybrid Fast Any IOPS intensive Average High 2](https://reader033.fdocuments.in/reader033/viewer/2022050412/5f88f1a165129f37bd53b330/html5/thumbnails/17.jpg)
17
Storage Capacity Measurement (Local)
![Page 18: CMG Canada Home Page - Restoring Data Storage Predictabilitycmgcanada.altervista.org/presentations/2017 Apr pres/CMG...2017/04/25 · Hybrid Fast Any IOPS intensive Average High 2](https://reader033.fdocuments.in/reader033/viewer/2022050412/5f88f1a165129f37bd53b330/html5/thumbnails/18.jpg)
18
Storage Capacity Measurement (NAS)
![Page 19: CMG Canada Home Page - Restoring Data Storage Predictabilitycmgcanada.altervista.org/presentations/2017 Apr pres/CMG...2017/04/25 · Hybrid Fast Any IOPS intensive Average High 2](https://reader033.fdocuments.in/reader033/viewer/2022050412/5f88f1a165129f37bd53b330/html5/thumbnails/19.jpg)
19
Storage Capacity Measurement (SAN)
![Page 20: CMG Canada Home Page - Restoring Data Storage Predictabilitycmgcanada.altervista.org/presentations/2017 Apr pres/CMG...2017/04/25 · Hybrid Fast Any IOPS intensive Average High 2](https://reader033.fdocuments.in/reader033/viewer/2022050412/5f88f1a165129f37bd53b330/html5/thumbnails/20.jpg)
20
Storage Capacity Measurement (Hyper-converged)
![Page 21: CMG Canada Home Page - Restoring Data Storage Predictabilitycmgcanada.altervista.org/presentations/2017 Apr pres/CMG...2017/04/25 · Hybrid Fast Any IOPS intensive Average High 2](https://reader033.fdocuments.in/reader033/viewer/2022050412/5f88f1a165129f37bd53b330/html5/thumbnails/21.jpg)
21
Storage Capacity Measurement (Public Cloud)
![Page 22: CMG Canada Home Page - Restoring Data Storage Predictabilitycmgcanada.altervista.org/presentations/2017 Apr pres/CMG...2017/04/25 · Hybrid Fast Any IOPS intensive Average High 2](https://reader033.fdocuments.in/reader033/viewer/2022050412/5f88f1a165129f37bd53b330/html5/thumbnails/22.jpg)
22
Common Storage Capacity Forecasting Techniques
• HisS: Historical Swag or Order about the same as last year
• LRA: Linear Regression Analysis: Apply linear regression analysis to your usable capacity trend from the previous year(s). Continue growth line for some time in future.
• ABRBO: Burn rate/Burn out: Calculate average burn rate per day/month/etc. Divide capacity left by burn rate to calculate days until burn out.
• WARP: Wait and Reach out to vendor in Panic
![Page 23: CMG Canada Home Page - Restoring Data Storage Predictabilitycmgcanada.altervista.org/presentations/2017 Apr pres/CMG...2017/04/25 · Hybrid Fast Any IOPS intensive Average High 2](https://reader033.fdocuments.in/reader033/viewer/2022050412/5f88f1a165129f37bd53b330/html5/thumbnails/23.jpg)
23
Example of Burnout
![Page 24: CMG Canada Home Page - Restoring Data Storage Predictabilitycmgcanada.altervista.org/presentations/2017 Apr pres/CMG...2017/04/25 · Hybrid Fast Any IOPS intensive Average High 2](https://reader033.fdocuments.in/reader033/viewer/2022050412/5f88f1a165129f37bd53b330/html5/thumbnails/24.jpg)
24
Burn out Tabular View for Multiple Systems
![Page 25: CMG Canada Home Page - Restoring Data Storage Predictabilitycmgcanada.altervista.org/presentations/2017 Apr pres/CMG...2017/04/25 · Hybrid Fast Any IOPS intensive Average High 2](https://reader033.fdocuments.in/reader033/viewer/2022050412/5f88f1a165129f37bd53b330/html5/thumbnails/25.jpg)
25
Track Capacity By Application
![Page 26: CMG Canada Home Page - Restoring Data Storage Predictabilitycmgcanada.altervista.org/presentations/2017 Apr pres/CMG...2017/04/25 · Hybrid Fast Any IOPS intensive Average High 2](https://reader033.fdocuments.in/reader033/viewer/2022050412/5f88f1a165129f37bd53b330/html5/thumbnails/26.jpg)
26
Storage Performance Management
![Page 27: CMG Canada Home Page - Restoring Data Storage Predictabilitycmgcanada.altervista.org/presentations/2017 Apr pres/CMG...2017/04/25 · Hybrid Fast Any IOPS intensive Average High 2](https://reader033.fdocuments.in/reader033/viewer/2022050412/5f88f1a165129f37bd53b330/html5/thumbnails/27.jpg)
27
Storage Performance Management Methodology
Load
Report
Assess
Correlate
Make Recommendations
Collect
![Page 28: CMG Canada Home Page - Restoring Data Storage Predictabilitycmgcanada.altervista.org/presentations/2017 Apr pres/CMG...2017/04/25 · Hybrid Fast Any IOPS intensive Average High 2](https://reader033.fdocuments.in/reader033/viewer/2022050412/5f88f1a165129f37bd53b330/html5/thumbnails/28.jpg)
28
Technology Enhanced Storage Performance Management Methodology
Prepare
Enrich
Assess
Rate
Visualize
Correlate
Recommend
Collect
Automated Analysis
![Page 29: CMG Canada Home Page - Restoring Data Storage Predictabilitycmgcanada.altervista.org/presentations/2017 Apr pres/CMG...2017/04/25 · Hybrid Fast Any IOPS intensive Average High 2](https://reader033.fdocuments.in/reader033/viewer/2022050412/5f88f1a165129f37bd53b330/html5/thumbnails/29.jpg)
29
Storage Performance Measurements: Collect
![Page 30: CMG Canada Home Page - Restoring Data Storage Predictabilitycmgcanada.altervista.org/presentations/2017 Apr pres/CMG...2017/04/25 · Hybrid Fast Any IOPS intensive Average High 2](https://reader033.fdocuments.in/reader033/viewer/2022050412/5f88f1a165129f37bd53b330/html5/thumbnails/30.jpg)
30
Prepare: Validate, Normalize and Categorize
1. Validate 2. Normalize: EMC vs HDS
3. Categorize
![Page 31: CMG Canada Home Page - Restoring Data Storage Predictabilitycmgcanada.altervista.org/presentations/2017 Apr pres/CMG...2017/04/25 · Hybrid Fast Any IOPS intensive Average High 2](https://reader033.fdocuments.in/reader033/viewer/2022050412/5f88f1a165129f37bd53b330/html5/thumbnails/31.jpg)
31
Enrich: Add Meaning
![Page 32: CMG Canada Home Page - Restoring Data Storage Predictabilitycmgcanada.altervista.org/presentations/2017 Apr pres/CMG...2017/04/25 · Hybrid Fast Any IOPS intensive Average High 2](https://reader033.fdocuments.in/reader033/viewer/2022050412/5f88f1a165129f37bd53b330/html5/thumbnails/32.jpg)
32
Enrich: Add Meaning
![Page 33: CMG Canada Home Page - Restoring Data Storage Predictabilitycmgcanada.altervista.org/presentations/2017 Apr pres/CMG...2017/04/25 · Hybrid Fast Any IOPS intensive Average High 2](https://reader033.fdocuments.in/reader033/viewer/2022050412/5f88f1a165129f37bd53b330/html5/thumbnails/33.jpg)
33
Enrich: Add Meaning
![Page 34: CMG Canada Home Page - Restoring Data Storage Predictabilitycmgcanada.altervista.org/presentations/2017 Apr pres/CMG...2017/04/25 · Hybrid Fast Any IOPS intensive Average High 2](https://reader033.fdocuments.in/reader033/viewer/2022050412/5f88f1a165129f37bd53b330/html5/thumbnails/34.jpg)
34
Assess: Define the Criteria
1. Hardware Specific Storage System Throughput
2. Workload Dependent Storage System Response Time
![Page 35: CMG Canada Home Page - Restoring Data Storage Predictabilitycmgcanada.altervista.org/presentations/2017 Apr pres/CMG...2017/04/25 · Hybrid Fast Any IOPS intensive Average High 2](https://reader033.fdocuments.in/reader033/viewer/2022050412/5f88f1a165129f37bd53b330/html5/thumbnails/35.jpg)
35
Assess: Define the Criteria
![Page 36: CMG Canada Home Page - Restoring Data Storage Predictabilitycmgcanada.altervista.org/presentations/2017 Apr pres/CMG...2017/04/25 · Hybrid Fast Any IOPS intensive Average High 2](https://reader033.fdocuments.in/reader033/viewer/2022050412/5f88f1a165129f37bd53b330/html5/thumbnails/36.jpg)
36
Rate: Apply The Assessment Criteria
• (∑ 𝑟𝑟𝑖𝑖𝑛𝑛𝑖𝑖=1 )/n
‒ Where • r = rating at interval i • n = number of intervals
‒ Rating is always either • 0 = Value is less than warning • 1 = Value is greater than or equal to warning or less than
performance exception • 3 = Value is greater than or equal to performance exception
![Page 37: CMG Canada Home Page - Restoring Data Storage Predictabilitycmgcanada.altervista.org/presentations/2017 Apr pres/CMG...2017/04/25 · Hybrid Fast Any IOPS intensive Average High 2](https://reader033.fdocuments.in/reader033/viewer/2022050412/5f88f1a165129f37bd53b330/html5/thumbnails/37.jpg)
37
Visualize: Visualize the Rating
• How does color relate to the rating displayed? ‒ 0-.1 is Green ‒ >.1-.3 is Yellow ‒ >.3-3.0 is Red
• So out of 96 intervals: ‒ we need no more than 3 red or 9 yellow intervals to rate
green. ‒ Less than 28 yellow or 9 red intervals make the chart rated
yellow. ‒ Otherwise, the chart is rated red.
![Page 38: CMG Canada Home Page - Restoring Data Storage Predictabilitycmgcanada.altervista.org/presentations/2017 Apr pres/CMG...2017/04/25 · Hybrid Fast Any IOPS intensive Average High 2](https://reader033.fdocuments.in/reader033/viewer/2022050412/5f88f1a165129f37bd53b330/html5/thumbnails/38.jpg)
38
Correlate Configuration
![Page 39: CMG Canada Home Page - Restoring Data Storage Predictabilitycmgcanada.altervista.org/presentations/2017 Apr pres/CMG...2017/04/25 · Hybrid Fast Any IOPS intensive Average High 2](https://reader033.fdocuments.in/reader033/viewer/2022050412/5f88f1a165129f37bd53b330/html5/thumbnails/39.jpg)
39
Apply Rating to Correlation?
Port Issues
![Page 40: CMG Canada Home Page - Restoring Data Storage Predictabilitycmgcanada.altervista.org/presentations/2017 Apr pres/CMG...2017/04/25 · Hybrid Fast Any IOPS intensive Average High 2](https://reader033.fdocuments.in/reader033/viewer/2022050412/5f88f1a165129f37bd53b330/html5/thumbnails/40.jpg)
40
Application Views
![Page 41: CMG Canada Home Page - Restoring Data Storage Predictabilitycmgcanada.altervista.org/presentations/2017 Apr pres/CMG...2017/04/25 · Hybrid Fast Any IOPS intensive Average High 2](https://reader033.fdocuments.in/reader033/viewer/2022050412/5f88f1a165129f37bd53b330/html5/thumbnails/41.jpg)
41
Automated Analysis
Automatic Correlation
Application Performance
Capacity Forecasting
How Can You Restore Data Storage Predictability?
Accurately and Quickly Identify Risks
Highlight potential affected paths
Understand health of applications
Plan for demand
Challenges Benefits
![Page 42: CMG Canada Home Page - Restoring Data Storage Predictabilitycmgcanada.altervista.org/presentations/2017 Apr pres/CMG...2017/04/25 · Hybrid Fast Any IOPS intensive Average High 2](https://reader033.fdocuments.in/reader033/viewer/2022050412/5f88f1a165129f37bd53b330/html5/thumbnails/42.jpg)
42
IntelliMagic Vision Architecture
![Page 43: CMG Canada Home Page - Restoring Data Storage Predictabilitycmgcanada.altervista.org/presentations/2017 Apr pres/CMG...2017/04/25 · Hybrid Fast Any IOPS intensive Average High 2](https://reader033.fdocuments.in/reader033/viewer/2022050412/5f88f1a165129f37bd53b330/html5/thumbnails/43.jpg)
43
IntelliMagic Vision for SAN Logical Architecture
![Page 44: CMG Canada Home Page - Restoring Data Storage Predictabilitycmgcanada.altervista.org/presentations/2017 Apr pres/CMG...2017/04/25 · Hybrid Fast Any IOPS intensive Average High 2](https://reader033.fdocuments.in/reader033/viewer/2022050412/5f88f1a165129f37bd53b330/html5/thumbnails/44.jpg)
44
IntelliMagic Vision as a Service Architecture
![Page 45: CMG Canada Home Page - Restoring Data Storage Predictabilitycmgcanada.altervista.org/presentations/2017 Apr pres/CMG...2017/04/25 · Hybrid Fast Any IOPS intensive Average High 2](https://reader033.fdocuments.in/reader033/viewer/2022050412/5f88f1a165129f37bd53b330/html5/thumbnails/45.jpg)
45
Thank you
For more information, please visit
www.intellimagic.com
Contact us with any questions or feedback:
Email: [email protected]
![Page 46: CMG Canada Home Page - Restoring Data Storage Predictabilitycmgcanada.altervista.org/presentations/2017 Apr pres/CMG...2017/04/25 · Hybrid Fast Any IOPS intensive Average High 2](https://reader033.fdocuments.in/reader033/viewer/2022050412/5f88f1a165129f37bd53b330/html5/thumbnails/46.jpg)
Save the Date!