Right data right place right time: automated data tiering - Mike Klemm, Distinguished Engineer and...

22
Right data right place right time: automated data tiering Mike Klemm Distinguished Engineer

Transcript of Right data right place right time: automated data tiering - Mike Klemm, Distinguished Engineer and...

Page 1: Right data right place right time: automated data tiering - Mike Klemm, Distinguished Engineer and Lazarus Vekiarides Exec. Director, EqualLogic

Right data right place right time: automated data tiering

Mike KlemmDistinguished Engineer

Page 2: Right data right place right time: automated data tiering - Mike Klemm, Distinguished Engineer and Lazarus Vekiarides Exec. Director, EqualLogic

Right data right place right time: automated data tiering

Lazarus VekiaridesExec. Director, EqualLogic Software Engineering

Page 3: Right data right place right time: automated data tiering - Mike Klemm, Distinguished Engineer and Lazarus Vekiarides Exec. Director, EqualLogic

Fluid Data tenets: engineered to move your business forward

Better togeth

er

Best ownershi

p experienc

e

Innovative

licensing

Maximum efficiency

Dynamictiering

Native cloud

integration

Scale-out designs

Self protectin

g

Page 4: Right data right place right time: automated data tiering - Mike Klemm, Distinguished Engineer and Lazarus Vekiarides Exec. Director, EqualLogic

Data growth and its impacts

1 Horizon Information Strategies, Storage Facts, Figures, Best Practices and Estimates, April 20112 IDC, Worldwide Enterprise Storage Systems 2011-2015 Forecast: “Emerging” Once Again is a Keyword in the Storage Market, #228255, May 2011

2006 2007 2008 2009 2010 2011 2012 2013 2014 2015

WW Enterprise Storage Capacity Shipped (Petabytes)2

48% CAGRgrowth in storage capacity requirements

46%time of storage staff spent on operations1

Storage Administration

Total Hours

Provisioning

Migrations

Backup

Storage budget is hardware1

amount of storage typically underutilized

zSer

ies

iSer

ies

Unix/

Linu

x

Win

dows

0

20

40

60

80

Average Disk Allocation Levels

(upper/lower range shown)2

Page 5: Right data right place right time: automated data tiering - Mike Klemm, Distinguished Engineer and Lazarus Vekiarides Exec. Director, EqualLogic

Per-GB costs for high-capacity storage can be

1/30th the cost of high-performance storage *

5

*Cost multiples are estimates only, based on recent component cost data, and subject to change.

Reduces costs• Aligns inactive data

with capacity-optimized storage

Improves performance• Aligns demanding

applications with performance optimized storage

Storage tiering provides two benefits

30XTier 1

3XTier 2

XTier 3P

erf

orm

an

ce

Cost

Page 6: Right data right place right time: automated data tiering - Mike Klemm, Distinguished Engineer and Lazarus Vekiarides Exec. Director, EqualLogic

Not all tiering is created equal

Volume

Storage pool

• Complete virtualization of storage

• Granular approach

• Intelligent automation

• Non-disruptive data movement

• Performance and capacity optimization

Metadata: information about

each block

Read20

timessince

12:05:09...

Page 7: Right data right place right time: automated data tiering - Mike Klemm, Distinguished Engineer and Lazarus Vekiarides Exec. Director, EqualLogic

Dell storage tiering approaches

Compellent Data Progression

EqualLogic Load Balancing

• Optimizes data placement across 3 tiers

• Balances across multiple axes– Drive type– RAID level– Platter location

• Optimizes data placement and network load

• Balances load in a pool of arrays

– Capacity– Performance

• Balances load within a hybrid array

• Highly virtualized, IP-based storage with a peer-scale architecture

• Ideal for IT generalist

• Multi-protocol, core storage for the enterprise and critical workloads

• Custom-tuned by storage administrator

Capabilities Use cases

Page 8: Right data right place right time: automated data tiering - Mike Klemm, Distinguished Engineer and Lazarus Vekiarides Exec. Director, EqualLogic

NetworkI/O balancing and MPIO

EqualLogic automated tiering

Capacity Manages disk utilization

Automatic performance Optimizes high I/O data distribution throughout the pool

Hybrid arrayDistributes high I/O data throughout the array

Page 9: Right data right place right time: automated data tiering - Mike Klemm, Distinguished Engineer and Lazarus Vekiarides Exec. Director, EqualLogic

Latency: 2 ms Latency: 2 ms

Automatic load balancing

EqualLogic SAN

Latency: 1 ms Latency: 4 ms

Spreads data across all available resources

• Dynamically adjust to workloads

• Real time I/O balancing

• Move hot and cold data

• Improves performance

• Capacity balancing

• Access frequency vs. array latency

SSD NL-SASSSD NL-SAS

Storage pool

Array 1 Array 2

Page 10: Right data right place right time: automated data tiering - Mike Klemm, Distinguished Engineer and Lazarus Vekiarides Exec. Director, EqualLogic

Prioritize placement for application optimization and maximum value

• First place data on SSD

• Move data to HDD

• Frequent access = hot data

• Move hot data to SSD

• A portion of SSD can be used as controller write cache extension

• Very different than SSD cache

Hybrid arrays: auto tiering within the array

Page 11: Right data right place right time: automated data tiering - Mike Klemm, Distinguished Engineer and Lazarus Vekiarides Exec. Director, EqualLogic

Virtualized, automated SAN-wide tiering

Solution • Tier 1: 1 PS6010XVS• Tier 2: 5 PS6510XV • Tier 3: 3 PS6510X• 250 VMware vSphere™ VMs running

Microsoft™ SQL Server® and other business applications

Results• 2X improvement in query

performance• 80X faster creation of new

customer environments• 100% availability over 16 months –

zero need for planned downtime

“Dell EqualLogic greatly simplifies the process of adding a new SAN…. The firmware automatically begins load balancing to the new array, with no downtime.”

Robert ScarbroughVice President, Technical OperationsOptumInsight

Page 12: Right data right place right time: automated data tiering - Mike Klemm, Distinguished Engineer and Lazarus Vekiarides Exec. Director, EqualLogic

MetadataTracks page usage within volumes

Compellent automated tiering

MigratesBetween tiers, RAIDs and within drives

WritesDirectly to tier 1

Page 13: Right data right place right time: automated data tiering - Mike Klemm, Distinguished Engineer and Lazarus Vekiarides Exec. Director, EqualLogic

13

Data progressionDaily data movement• Default start time is 7 p.m.• Data is moved per page• Historical Replay pages

eligible to move to lowest tier immediately

• Data progression will run against multiple volumes at the same time

RAID restripe occurs• Adding additional drives

Page 14: Right data right place right time: automated data tiering - Mike Klemm, Distinguished Engineer and Lazarus Vekiarides Exec. Director, EqualLogic

14

Fast Track

• Places the busiest pages on the outer portion of the drive – the “Fast Tracks”

• Uses the same data movement engine as data progression

• Data is moved when progression runs

Full disk drive With fast track

The most active blocks are dynamically and automatically

placed on outer edge

Page 15: Right data right place right time: automated data tiering - Mike Klemm, Distinguished Engineer and Lazarus Vekiarides Exec. Director, EqualLogic

Efficient operations at cloud scale

Solution • Compellent SAN:

– Tier 1: 9 SSDs – Tier 2: 15K RPM Fibre Channel – Tier 3: 7,200 RPM SATA drives

• 29 VMs running SAP applications on 4 Dell PowerEdgeR710 servers

Results• Performance gains from 80% to

400% • Full backups down from 16 to 6

hours• System-wide snapshot process now

takes 30 seconds

“Thanks to the way the architecture manages data at the block level, we discovered we could perform I/O writes to the storage system very rapidly.”

Kai SookwongseMazda North American Operations

Page 16: Right data right place right time: automated data tiering - Mike Klemm, Distinguished Engineer and Lazarus Vekiarides Exec. Director, EqualLogic

How Fluid Cache tier works

Low-latency interconnectStorage network

Fluid cache SW

PCIE SSD

• Extension of fluid data tiering

• Cluster-wide cache pool

• H/A through redundant cache writes

• Ease of management

• Full integration with array data protection

Page 17: Right data right place right time: automated data tiering - Mike Klemm, Distinguished Engineer and Lazarus Vekiarides Exec. Director, EqualLogic

Confidential

Accelerating efficiencies

High Availability • Fault tolerant between nodes

Unprecedented Performance• Accelerate applications by up to 30X*

over traditional SAN with rotating media

• Increase the number of users per server by 10X

Efficient• Double the number of VMs per server• Reduce infrastructure support by 1/6

for same user count and SLAs

Better together• Systems management for server and

SAN work in concert • Largest working data set for cache with

full coherency to SAN

* Garner #G00231588 IOPS HDD vs. SSD

Page 18: Right data right place right time: automated data tiering - Mike Klemm, Distinguished Engineer and Lazarus Vekiarides Exec. Director, EqualLogic

Let Dell help you fulfill your whole IT visionwith our extensive enterprise portfolio

Storage

Fluid Data architecture is designed to automatically and intelligently optimize data everywhere

Servers

PowerEdge servers feature customer-inspired design, advanced systems management, and innovations in energy efficiency

Networking

Virtual Network Architecture: innovation drives responsiveness, agility, and efficiency for next-generation networks

Services

A modular, adaptive and flexible approach, configurable for any organizational size or budget

Page 19: Right data right place right time: automated data tiering - Mike Klemm, Distinguished Engineer and Lazarus Vekiarides Exec. Director, EqualLogic

Dell Fluid Data architectureThe right data in the right place at the right time for the right cost

Primarystorage

Offsitestorage

Backupto disk and tape

Applicationservers

CloudObject-based archive

X = relative performanceTier 3

3XTier 2

30XTier 1

100X Tier 0

Fluid Cache tier

Page 20: Right data right place right time: automated data tiering - Mike Klemm, Distinguished Engineer and Lazarus Vekiarides Exec. Director, EqualLogic

Dell World 2012

What next?Visit solutions expo

Schedule Solutions Center visitSchedule an EBC

Whiteboard ConsultingVisit services kiosks in expo

Page 21: Right data right place right time: automated data tiering - Mike Klemm, Distinguished Engineer and Lazarus Vekiarides Exec. Director, EqualLogic

Confidential

On the Dell World app

Or

Contentstyleguidelines Session Evaluation Survey

On paper• Forms in room• Turn in on the way

out

4. Select survey title

5. Simply complete the survey

3. Select Surveys

1. Select My Schedule

2. Select session to evaluate

Please help Dell meet your needsby filling out the Session Evaluation Surveys

Page 22: Right data right place right time: automated data tiering - Mike Klemm, Distinguished Engineer and Lazarus Vekiarides Exec. Director, EqualLogic