Enterprise Storage Services Mission, Vision & Plan · affecting user access. • Storage Processors...

28
Enterprise Storage Services Mission, Vision & Plan Greg Fish January 27, 2011

Transcript of Enterprise Storage Services Mission, Vision & Plan · affecting user access. • Storage Processors...

Page 1: Enterprise Storage Services Mission, Vision & Plan · affecting user access. • Storage Processors on NS480 approaching ... • Constantly running out of tapes to keep offsite pool

Enterprise Storage ServicesMission, Vision & Plan

Greg FishJanuary 27, 2011

Page 2: Enterprise Storage Services Mission, Vision & Plan · affecting user access. • Storage Processors on NS480 approaching ... • Constantly running out of tapes to keep offsite pool

Mission

To provide excellent and reliable data storage and backup services to UCIT and it’s customers in a cost-efficient manner.

Page 3: Enterprise Storage Services Mission, Vision & Plan · affecting user access. • Storage Processors on NS480 approaching ... • Constantly running out of tapes to keep offsite pool

Vision

• Deliver Enterprise Class Storage and Backup Services

• Reduce Dependence on Tape Backup• Develop Full Disaster Recovery capability• Fully Embrace “Yes We Can!” for all

services

Page 4: Enterprise Storage Services Mission, Vision & Plan · affecting user access. • Storage Processors on NS480 approaching ... • Constantly running out of tapes to keep offsite pool

Where are we????

Page 5: Enterprise Storage Services Mission, Vision & Plan · affecting user access. • Storage Processors on NS480 approaching ... • Constantly running out of tapes to keep offsite pool

Applications

• Blackboard• UC Flex• Virtual Hosting – Server and Workstation• File Sharing• Database

Page 6: Enterprise Storage Services Mission, Vision & Plan · affecting user access. • Storage Processors on NS480 approaching ... • Constantly running out of tapes to keep offsite pool

Storage History

Page 7: Enterprise Storage Services Mission, Vision & Plan · affecting user access. • Storage Processors on NS480 approaching ... • Constantly running out of tapes to keep offsite pool

Current Storage Issues• Backup Tasks and Database Load Tasks utilizing

NS480 are expanding into first shift potentially affecting user access.

• Storage Processors on NS480 approaching maximum utilization due to high SATA drive usage

• Critically low on space – unable to meet demands of new customers and applications.

Page 8: Enterprise Storage Services Mission, Vision & Plan · affecting user access. • Storage Processors on NS480 approaching ... • Constantly running out of tapes to keep offsite pool

• Even though shelf space in NS480 is available, unacceptably high storage processor utilization prevents all but minimal expansion using the more expensive fiber channel drives.

• Unable to complete migration off of aging CX-700 due to unavailability of space.

• Unable to complete migration off of aging Tagmastore due to unavailability of space.

Page 9: Enterprise Storage Services Mission, Vision & Plan · affecting user access. • Storage Processors on NS480 approaching ... • Constantly running out of tapes to keep offsite pool

Backup History – Nightly Avg.

Page 10: Enterprise Storage Services Mission, Vision & Plan · affecting user access. • Storage Processors on NS480 approaching ... • Constantly running out of tapes to keep offsite pool

Tape Utilization

Page 11: Enterprise Storage Services Mission, Vision & Plan · affecting user access. • Storage Processors on NS480 approaching ... • Constantly running out of tapes to keep offsite pool

Current Backup Issues• Constantly running out of tapes to keep offsite pool

up-to-date. Running out of tapes causes backups to fail.

• We have never retired a tape. 9940 drives are hard on the tape leaders and once broken, the tape cannot be read.

• Current VTL is rapidly running out of space. IBM recommends against and does not support expansion.

Page 12: Enterprise Storage Services Mission, Vision & Plan · affecting user access. • Storage Processors on NS480 approaching ... • Constantly running out of tapes to keep offsite pool

• Full maintenance contract for SL8500 not cost effective. Currently only library and software on maintenance. We are self-insuring drives.

• Oracle support for Storage Tek product line is unacceptable for enterprise class organization.

• Limited capacity of current tape drives causes backup sets to be spread across too many tapes. A full restore requires all tapes be read perfectly. A full restore of aitl-fs03 would require 180 tapes. The probability of reading 180 old tapes without error is low.

Page 13: Enterprise Storage Services Mission, Vision & Plan · affecting user access. • Storage Processors on NS480 approaching ... • Constantly running out of tapes to keep offsite pool

Where are we going??

Page 14: Enterprise Storage Services Mission, Vision & Plan · affecting user access. • Storage Processors on NS480 approaching ... • Constantly running out of tapes to keep offsite pool

Plan – Step 1

Augment additional storage and backup services in G95MSB to enable enterprise class performance, facilitate tape reduction and offsite disaster recoveryTiming: Now

Page 15: Enterprise Storage Services Mission, Vision & Plan · affecting user access. • Storage Processors on NS480 approaching ... • Constantly running out of tapes to keep offsite pool

0

5

10

15

20

25

30

0 25,000 50,000 75,000 100,000 125,000 150,000 175,000 200,000 225,000

IBM DS5300Sep 2008

transaction-intensive applications typically demand response time < 10 ms

Res

pons

e Ti

me

(ms)

IBM DS8300 TurboDec 2006

HDS USP VOct 2007

EMC CLARiiONCX4-480Jan 2008

NetApp FAS3170Jun 2008

3PAR InServ T800Sep 2008

SPC-1 Performance Comparisons

Mid Range

High EndHDS AMS 2500

Mar 2009

Late

ncy

in (m

s)

IOPS

IBM DS4800Jun 2008

Page 16: Enterprise Storage Services Mission, Vision & Plan · affecting user access. • Storage Processors on NS480 approaching ... • Constantly running out of tapes to keep offsite pool

EMC Symmetrix VMAX

Page 17: Enterprise Storage Services Mission, Vision & Plan · affecting user access. • Storage Processors on NS480 approaching ... • Constantly running out of tapes to keep offsite pool
Page 18: Enterprise Storage Services Mission, Vision & Plan · affecting user access. • Storage Processors on NS480 approaching ... • Constantly running out of tapes to keep offsite pool
Page 19: Enterprise Storage Services Mission, Vision & Plan · affecting user access. • Storage Processors on NS480 approaching ... • Constantly running out of tapes to keep offsite pool

Symmetrix Configuration

• (2) VMAX Engines• (16) 8GB Front End Fiber Channel Ports• (8) 8GB Multi-Mode Ficon Ports• 128GB Cache• 163TB Usable Capacity with EFD, Fiber

Channel and SATA• FAST-2 Dynamic Tiering

Page 20: Enterprise Storage Services Mission, Vision & Plan · affecting user access. • Storage Processors on NS480 approaching ... • Constantly running out of tapes to keep offsite pool

Tape Deduplication

• Process of removing duplicate information during the backup process, thus requiring less storage space and less replication transmission time.

• Deduplication rates vary but based on our application mix, a 6:1 deduplication ratio is not unreasonable to expect.

Page 21: Enterprise Storage Services Mission, Vision & Plan · affecting user access. • Storage Processors on NS480 approaching ... • Constantly running out of tapes to keep offsite pool
Page 22: Enterprise Storage Services Mission, Vision & Plan · affecting user access. • Storage Processors on NS480 approaching ... • Constantly running out of tapes to keep offsite pool

Data DomainSoftware options:DD Boost, DD Virtual Tape Library, DD Replicator, DD Retention Lock, and DD Encryption

DD140 Remote Office Appliance

DD600 Appliance Series

DD880

DD140 DD610 DD630 DD670 DD880

Speed (Other) 450 GB/hr 675 GB/hr 1.1 TB/hr 3.6 TB/hr 5.4 TB/hr

Speed (DD Boost) 490 GB/hr 1.3 TB/hr 2.1 TB/hr 5.4 TB/hr 8.8 TB/hr

Logical capacity 17–43 TB 75–195 TB 165–420 TB 1.1–2.7 PB 2.8–7.1 PB

Raw capacity 1.5 TB Up to 6 TB Up to 12 TB Up to 76 TB Up to 192 TB

Usable capacity 0.86 TB Up to 3.98 TB Up to 8.4 TB Up to 55.9 TB Up to 142.5 TB

New

Page 23: Enterprise Storage Services Mission, Vision & Plan · affecting user access. • Storage Processors on NS480 approaching ... • Constantly running out of tapes to keep offsite pool
Page 24: Enterprise Storage Services Mission, Vision & Plan · affecting user access. • Storage Processors on NS480 approaching ... • Constantly running out of tapes to keep offsite pool

EMC Recover Point

Page 25: Enterprise Storage Services Mission, Vision & Plan · affecting user access. • Storage Processors on NS480 approaching ... • Constantly running out of tapes to keep offsite pool
Page 26: Enterprise Storage Services Mission, Vision & Plan · affecting user access. • Storage Processors on NS480 approaching ... • Constantly running out of tapes to keep offsite pool
Page 27: Enterprise Storage Services Mission, Vision & Plan · affecting user access. • Storage Processors on NS480 approaching ... • Constantly running out of tapes to keep offsite pool

Plan – Step 2Locate Suitable DR Site and equip with second Recover Point appliance, DD880 and storage which will:• Drastically reduce or potentially eliminate

tape usage• Give the University true DR.

Timing: ?????????

Page 28: Enterprise Storage Services Mission, Vision & Plan · affecting user access. • Storage Processors on NS480 approaching ... • Constantly running out of tapes to keep offsite pool

The End