Recent Evolution in ‘my’ Domains of Interest

24
© 2010 IBM Corporation Recent Evolution in ‘my’ Domains of Interest Walter Casteels

Transcript of Recent Evolution in ‘my’ Domains of Interest

Page 1: Recent Evolution in ‘my’ Domains of Interest

© 2010 IBM Corporation

Recent Evolution in ‘my’ Domains of Interest

Walter Casteels

Page 2: Recent Evolution in ‘my’ Domains of Interest

© 2010 IBM Corporation 2

zOS en Open - 09/2009: TS3500 + > 6887 Slots (S24 / S54 Frames)

High Density Storage Frame

Cartridge cache (Tier 0)

Side View

S24

S54

HD Slots (Tier 1 to 4)

HD Slots (Tier 1 to 5)

Cartridge cache (Tier 0)

Page 3: Recent Evolution in ‘my’ Domains of Interest

© 2010 IBM Corporation 3

Scalable Capacity and Performance

Better Performance

Larger Capacity

Scalable

Highest Performance

Largest Capacity

Open - IBM TS7650 ProtecTIER® Deduplication Family

Page 4: Recent Evolution in ‘my’ Domains of Interest

© 2010 IBM Corporation 4

07/2010: TS7610 ProtecTier Deduplication Appliance

  ~80+ MB/s sustained write performance   5.4 TB useable physical capacity holds up to 137

TB or more of backup data   Easy to deploy, easy to manage

  Superior HyperFactor deduplication:   Inline Deduplication, no post processing

  Data Agnostic   Designed for 100% data integrity , non-hash-

based

TS7610 ProtecTIER Appliance

An enterprise level deduplication solution for midrange environments!

Page 5: Recent Evolution in ‘my’ Domains of Interest

© 2010 IBM Corporation 5

Open - 04/2010: ProtecTier – Many to One Replication

Up to 12 Branch Offices (spokes): Gateways and/or Appliances

1 target (hub): Appliance, Gateway, single or two-node cluster

Physical capacity ProtecTIER

Gateway

Backup Server

Central / DR Site

IP based NR links

Tape library

Virtual cartridges can be cloned to tape by the

Main-Site B/U server

Hub repository includes local backups and remote DR copies

Protect More. Store Less.™

Page 6: Recent Evolution in ‘my’ Domains of Interest

© 2010 IBM Corporation 6

zOS - 09/2009: TS7740/TS7720 4 Way Grid

Drives/Library

TS7740 Cluster1

TS7720 Cluster2

LAN/WAN Drives/Library

TS7740 Cluster0

TS7720 Cluster3 City A City B

Page 7: Recent Evolution in ‘my’ Domains of Interest

© 2010 IBM Corporation 7

zOS - TS7720/TS7740 Grid: Cooperative Replication   Copy management uses information to optimize long-distance copy links

–  For deferred mode copies –  Prioritizes getting one copy to each family before making copies to members in a

family –  Executes single copy between families, then local copies between family members

  Enhanced bandwidth utilization –  Reduces redundant copy tasks moving data between sites

Drives/Library

TS7740 Cluster

TS7720 Cluster

LAN/WAN Drives/Library

TS7740 Cluster

TS7720 Cluster City A City B

Family to Family

Within family

Page 8: Recent Evolution in ‘my’ Domains of Interest

© 2010 IBM Corporation 8

zOS - TS7720/TS7740 Grid: Automatic Removal Policy

 Provides automatic data migration function between the TS7720s and other TS7700s in the grid –  Manages copies between TS7700 clusters just like TS7700 HSM

component manages data in a TS7700 cache –  Only keep the most recently accessed or most important content in the

limited capacity TS7720 clusters –  Allow older or less active data to only reside on the TS7740 clusters

which contain back end tape

TS7720 Cluster

Drives/Library

TS7740 Cluster

LAN/WAN Data Migration

Migrated Data Access

Page 9: Recent Evolution in ‘my’ Domains of Interest

© 2010 IBM Corporation 9 9

zOS - TS7720/TS7740 Grid: Extended Removal Policies  Configurable Volume Migration Settings

– “Pinned” – These volumes remain pinned in the TS7720 cache (except when scratched). – “Prefer Remove” LRU Group 0 and “Prefer Remove” Group 1 – As the TS7720 reaches full

capacity, these volumes will be automatically removed in LRU order favoring those in Group 0 over those in Group 1. Only volumes that have completed peer copies are candidates for removal.

•  Minimum Retention Time – Associated pin duration or grace period where data must exist prior to removal. Only after the pin time has elapsed since last access will the LRU Group 0 and 1 volumes become candidates for removal.

– Fast Ready/Scratch Volumes – When removal takes place, volumes that have been returned to scratch are always preferred first. This includes both “Pinned” and “LRU Group 0/1” volumes.

 Removed volumes remain accessible through all clusters – Grid links are used to remotely access the volume data in other TS7700s if locally removed.

TS7720 Cluster

Drives/Library

TS7740 Cluster

LAN/WAN Data Migration

Migrated Data Access

Page 10: Recent Evolution in ‘my’ Domains of Interest

© 2010 IBM Corporation 10

zOS - 05/2010: TS7720/TS7740 – Enhanced Disk Buffer

  Two models provide high performance and capacity –  Both support performance of 600MBps or greater

–  TS7720 provides ~ 1200TB of native cache capacity (3:1 compression) •  No attachment to back end tape except via Grid attachment to a TS7740

–  TS7740 provides over 72TB of native cache capacity (3:1 compression) •  Supports attachment to IBM TS1130, TS1120 or 3592 J1A tape drives •  Supports tape drives in an IBM TS3500 or 3494 tape library •  Supports TS1130/TS1120 data encryption

Page 11: Recent Evolution in ‘my’ Domains of Interest

© 2010 IBM Corporation 11

zOS - 02/2010: TS7680 (ProtecTier Integrated with zOS)

Host

Control Unit Control Unit

FICON FICON

FC FC

Disk

ProtecTIER ProtecTIER

  Managed using system-managed tape (SMStape)

–  No JCL changes required

  Appears to the host as an automated tape library with 3592 Model J1A devices supporting MEDIA5 cartridges

  No host application or tape management changes needed

  Integration with the TS7680 during return to scratch processing to free backend cache

  Host alerts when cache starts to run low (warning and critical state notification)

  Single frame implementation is easy to install

  IP Replication available Dual controller pairs support enterprise class high

availability

Page 12: Recent Evolution in ‘my’ Domains of Interest

© 2010 IBM Corporation 12

Overview of IBM Tape Virtualization Options for zOS

Product Key Strengths Ideal customer profile(s)

TS7740 Grid and tight tape integration  Traditional large MF environments

 Multisite (2, 3 and 4 way Grids) TS7720 Grid and tape integration (2010,

via TS7740) with large, low cost cache

 Environments requiring fast access and intermediate storage requirements

 Suitable for those needing tapeless

VTFM  Performance, and ability to use standard DASD

 SW model allows flexibility

 Mid-range customers with tape-bound processing issues (inability to meet batch window) and/or looking for low cost entry

TS7680 Local high availability via clustering, high performance, excellent TCO with delta-based native IP replication

 Customers not requiring tape

 Large cache at low TCO

 HA

 Native IP replication for DR

Page 13: Recent Evolution in ‘my’ Domains of Interest

© 2010 IBM Corporation 13

All Platforms - 02/2010: Information Archive

SSAM Collection

TSM API Client

SSAM Server

Tape or other devices

Disk Storage

NAS Collection

IA High Level Architecture

NAS Client Web-browser

NAS Interface

Migration Mgr.

Disk Storage

IA Management GUI IA CLI

IBM Information Archive

Tape or other devices

Clustered Filesystem & Middleware Clustered Filesystem & IA Middleware

Shared Tape Device

NAS Interface

NAS Client

One Namespace

New

Page 14: Recent Evolution in ‘my’ Domains of Interest

© 2010 IBM Corporation 14

Compliance Policy

Mode Delete before expire?

Retention Period

Shorten? Lengthen?

Basic Yes Yes Yes Intermediate No Yes Yes Maximum* No No Yes

All Platforms - 02/2010: Information Archive

Page 15: Recent Evolution in ‘my’ Domains of Interest

© 2010 IBM Corporation 15

Open (and zLinux) - LTO Roadmap

http://ultrium.com/technology/roadmap.html

Page 16: Recent Evolution in ‘my’ Domains of Interest

© 2010 IBM Corporation 16

Open - 04/2010: LTO Generation 5 Highlights

  Fifth Generation of LTO Tape Drive –  140 MB/sec performance native data transfer rate –  1.5 TB capacity (up to 3.0 TB at 2:1 compression) –  Encryption capable –  Media partitioning –  SAS at 6 Gbit/sec –  FC at 8 GB/sec –  Form Factor : Full Height and Half Height –  Capability to Read/Write Ultrium 4 and read

Ultrium 3 cartridges

–  IBM Long Term File System •  Available on External drives only

  Platform Support –  IBM System x, System p –  Selected platforms from HP and Sun Microsystems –  Selected versions of Microsoft Windows™ and Linux –  zLinux

Page 17: Recent Evolution in ‘my’ Domains of Interest

© 2010 IBM Corporation 17

Open - LTO5 and LTFS

  IBM Long Term File System is based on: 1.  Partitioning LTO-5 tapes in two partitions

•  Partition 1: Index Partition is “small” (2 wraps, 37.5 GB) •  Partition 2: Data Partition fills the remainder of the tape   Approved by LTO consortium

2.  Open LTFS Format which is written to tape •  Describes the format of data and meta data •  Meta data is based on XML schema   Developed and disclosed by IBM

3.  Open source LTFS software •  externalizes the LTO-5 tape as file system •  Software uses two partitions on LTO-5 tape to write LTFS format   Available on Linux and Mac OS X (planned for windows)

Page 18: Recent Evolution in ‘my’ Domains of Interest

© 2010 IBM Corporation 18

Open - LTO5 and LTFS

Page 19: Recent Evolution in ‘my’ Domains of Interest

© 2010 IBM Corporation 19

Open - 09/2010: Real Time Compression (RTC) for NAS

Page 20: Recent Evolution in ‘my’ Domains of Interest

© 2010 IBM Corporation

(Physical) Tape is not Dead

Page 21: Recent Evolution in ‘my’ Domains of Interest

© 2010 IBM Corporation 21

Future: 35 TByte/cart - demonstrating 29.5 Gb/in2

This demonstration shows that tape can sustain the roadmap for at least another decade while maintaining a cost advantage over other storage technologies.

Page 22: Recent Evolution in ‘my’ Domains of Interest

© 2010 IBM Corporation 22

Magnetic Tape (R)evolution

Product / Year: IBM 726 /1952 JAG3 / 2008 LTO6 / 2012 Demo 2009

Capacity: 2.3MByte 1TByte 3TByte 35TByte

Areal Density: 1400 bit/in2 790Mbit/in2 1.87Gbit/in2 29.5Gbit/in2

Linear Density: 100 bit/in 343 kbit/in 488 kbit/in 518 kbit/in

Track Density: 14 tracks/in 2.3 ktracks/in 3.84 ktracks/in 57 ktracks/in

Track density increase will be the key contributor for future tape

capacity increase

25x

Page 23: Recent Evolution in ‘my’ Domains of Interest

© 2010 IBM Corporation 23

Price Comparison of Disk and Tape Storage

Page 24: Recent Evolution in ‘my’ Domains of Interest

© 2010 IBM Corporation 24