1 Dave Shafer, ITS Systems & Platforms June 25, 2010.

21
1 Dave Shafer, ITS Systems & Platforms June 25, 2010

Transcript of 1 Dave Shafer, ITS Systems & Platforms June 25, 2010.

Page 1: 1 Dave Shafer, ITS Systems & Platforms June 25, 2010.

1

Dave Shafer, ITS Systems & Platforms

June 25, 2010

Page 2: 1 Dave Shafer, ITS Systems & Platforms June 25, 2010.

2

Central File Storage

• Individuals: 1-5 GB• Departments: 1 GB per FTE

Base Entitlement

• Asynchronous replication to identical system at remote data center

4 Hour Recovery Objectives

• < 1 hour of downtime in the past year99.97% Uptime

• 33K of 37K eligible users89% Participation

June 25, 2010

Page 3: 1 Dave Shafer, ITS Systems & Platforms June 25, 2010.

3

The Effect

“One price fits all” network file storage

Lower-cost network file storage

Lowest-cost bare server storage

June 25, 2010

Page 4: 1 Dave Shafer, ITS Systems & Platforms June 25, 2010.

4

Storage TiersHigh Performance Enterprise SAN

Central File Storage

Low Cost SAN

Target Users Centrally managed servers

End users or distributed servers

Distributed servers

Funding Model Centrally funded Base entitlement, pay for more

Pay for use

Monthly Price per Gigabyte

N/A $0.12 – $0.25 $0.03 – $0.14

http://its.uiowa.edu/spa/storage/

June 25, 2010

Page 5: 1 Dave Shafer, ITS Systems & Platforms June 25, 2010.

5

Moving Forward

Interviewed partners,

peers

Categorized storage

Analyzing data

Storage Services Roadmap

• 11 peer institutions• 17 campus units• 2.7 petabytes of campus storage

June 25, 2010

Page 6: 1 Dave Shafer, ITS Systems & Platforms June 25, 2010.

6

Peer Institutions

1. Indiana

2. Iowa State

3. Michigan

4. Michigan State

5. Minnesota

6. Northern Iowa

7. Northwestern

8. Ohio State

9. Penn State

10. Purdue

11. Wisconsin

June 25, 2010

Page 7: 1 Dave Shafer, ITS Systems & Platforms June 25, 2010.

7

Campus Units

1. College of Education

2. College of Engineering

3. College of Law

4. College of Liberal Arts and Sciences

5. College of Nursing

6. College of Pharmacy

7. College of Public Health

8. Department of Biology

9. Department of Psychology

10. Division of Mathematical Sciences

11. Graduate College

12. International Programs

13. Office of the Vice-President for Research

14. College of Business

15. Information Technology Services

16. Institute for Clinical and Translational Science

17. University of Iowa Libraries

June 25, 2010

Page 8: 1 Dave Shafer, ITS Systems & Platforms June 25, 2010.

8

Campus Storage by Provider

Information Technology

Services42%

College of Engineering27%

Institute for Clinical and Translational

Science12%

College of Public Health

8%

UI Libraries4%

Other7%

June 25, 2010

Page 9: 1 Dave Shafer, ITS Systems & Platforms June 25, 2010.

9

Storage by University Mission

Administration & Overhead

35%

Research51%

Teaching11%

Public Service4%

June 25, 2010

Page 10: 1 Dave Shafer, ITS Systems & Platforms June 25, 2010.

10

Storage by Access Type

Backup72%

Online24%

Archive4%

June 25, 2010

Page 11: 1 Dave Shafer, ITS Systems & Platforms June 25, 2010.

11

Issues

Research storage• Fragmented• Poor data protection

Backup storage• Inefficient• No central service

Archival storage• Few options• Shifts to online or

backup storage

Cost

June 25, 2010

Page 12: 1 Dave Shafer, ITS Systems & Platforms June 25, 2010.

12

Common Solutions Group Survey

1. Carnegie Mellon

2. Chicago

3. Colorado

4. Columbia

5. Cornell

6. Duke

7. Georgetown

8. Illinois

9. Iowa

10. Michigan State

11. Minnesota

12. NYU

13. Princeton

14. UC Berkeley

15. UC San Diego

16. USC

17. Virginia

18. Virginia Tech

19. Washington

20. Wisconsin

21. Yale

June 25, 2010

Page 13: 1 Dave Shafer, ITS Systems & Platforms June 25, 2010.

13

CSG: Central Storage Services

Other

Digital repository/archive

Desktop backups

Storage for distributed servers

Departmental file space

Backups for distributed servers

Individual file space

0 5 10 15 20 25

6

10

11

17

18

18

21

Iowa

June 25, 2010

Page 14: 1 Dave Shafer, ITS Systems & Platforms June 25, 2010.

14

CSG: Biggest Storage Challenge

• “Bootstrapping a funding plan for central storage services where growth is explosive.”Data growth

• “As Central IT, our biggest challenge is fighting the misconception that storage is ‘cheap.’”

Perception of cost

• “Well by volume it is research data storage and particularly data generated by instruments like telescopes and sequencers.”

Research storage

June 25, 2010

Page 15: 1 Dave Shafer, ITS Systems & Platforms June 25, 2010.

15

Possible Next Steps

Identify and promote research solutions

Build central backup service

Build, promote archival solutions

June 25, 2010

Page 16: 1 Dave Shafer, ITS Systems & Platforms June 25, 2010.

16

Research Storage

Low cost

• Commodity server hardware

• Inexpensive disks

High capacity

• Scale out capability

Service broker vs. provider

• Partner with existing campus providers

June 25, 2010

Page 17: 1 Dave Shafer, ITS Systems & Platforms June 25, 2010.

17

Central Backup Service

Focus on distributed

servers

Engage potential

users

Define requirements

Identify possible solutions

June 25, 2010

Page 18: 1 Dave Shafer, ITS Systems & Platforms June 25, 2010.

18

Archival/Repository Solutions

June 25, 2010

Page 19: 1 Dave Shafer, ITS Systems & Platforms June 25, 2010.

19

Next Steps

Census

• Share data with the campus

Roadmap

• Propose future directions

Projects

• Initiate projects according to roadmap

Services

• Roll out new services

June 25, 2010

Page 20: 1 Dave Shafer, ITS Systems & Platforms June 25, 2010.

20

Feedback

• What other data do we need?• What changes should ITS make to

existing services?• What new services should ITS offer?• http://its.uiowa.edu/spa/storage

June 25, 2010

Page 21: 1 Dave Shafer, ITS Systems & Platforms June 25, 2010.

21

Contact Information

Dave Shafer

Enterprise Storage Manager

ITS Systems & Platforms

[email protected]

June 25, 2010