Introduction to IBM Real-Time Compression Appliances

168
ibm.com  /redbooks Front cover Introduction to IBM Real-time Compression Appliances Roland Tretau Michael Jahn Christof Schirra Eyal Traitel Lucian Vlaicu See how seamless compression integrates into storage environments Get familiar with the leading edge real-time compression solution Learn how to set up and configure the appliance

Transcript of Introduction to IBM Real-Time Compression Appliances

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 1/168ibm.com /redbooks

Front cover

Introduction to IBM

Real-time CompressionAppliances

Roland Treta

Michael Jah

Christof Schirr

Eyal Trait

Lucian Vlaic

See how seamless compressionintegrates into storage environments

Get familiar with the leading edge

real-time compression solution

Learn how to set up and

configure the appliance

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 2/168

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 3/168

International Technical Support Organization

Introduction to IBM Real-timeCompression Appliances

July 2011

SG24-7953-00

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 4/168

 © Copyright International Business Machines Corporation 2011. All rights reserved.

Note to U.S. Government Users Restricted Rights -- Use, duplication or disclosure restricted by GSA ADP Schedule

Contract with IBM Corp.

First Edition (July 2011)

This edition applies to IBM Real-time Compression Appliances for Network Attached Storage (NAS)as of April 2011.

Note: Before using this information and the product it supports, read the information in “Notices” onpage vii.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 5/168

 © Copyright IBM Corp. 2011. All rights reserved.iii

Contents

Notices . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .vii

Trademarks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . viii

Preface . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . ixThe team who wrote this book . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . ixNow you can become a published author, too! . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xiComments welcome. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .xiiStay connected to IBM Redbooks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xii

Chapter 1. The industry requirement for compression . . . . . . . . . . . . . . . . . . . . . . . . . . 11.1 Current IT challenges . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2

1.2 How compression can overcome the challenges . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21.3 Identifying use cases for compression . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3

1.3.1 Home directories. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4

1.3.2 CAD/CAM . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 41.3.3 Oil and gas data . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 41.3.4 Log data . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 41.3.5 Database. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 41.3.6 Virtualized infrastructures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5

Chapter 2. Compression technology discussed . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 72.1 Compression technology history. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 82.2 Data efficiency technologies . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9

2.2.1 Space efficient . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 92.2.2 Flash Copy (space efficient) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 92.2.3 Easy Tiering . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10

2.2.4 Archiving and space management . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 112.2.5 Data deduplication . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 112.3 Data compression technologies . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12

Chapter 3. Introduction to RTCA design. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 153.1 The RTCA approach . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 163.2 IBM Real-time Compression . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16

3.2.1 Lempel-Ziv algorithm. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 173.2.2 Huffman coding. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 173.2.3 Compression in real-time . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17

3.3 Random Access Compression Engine . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18

3.3.1 Random Access Compression Engine: RACE . . . . . . . . . . . . . . . . . . . . . . . . . . . 183.3.2 Unified Protocol Manager . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20

3.3.3 Monitoring and Reporting Manager. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 203.4 Performance considerations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 213.5 Data integrity . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22

3.5.1 Data integrity at the network level. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 223.5.2 Data integrity at the protocol layer . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 233.5.3 Data integrity at the storage layer . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23

3.6 Storage advantages . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 24

Chapter 4. Hardware and software components . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 254.1 Base model configurations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 26

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 6/168

iv  Introduction to IBM Real-time Compression Appliances

4.1.1 IBM Real-time Compression Appliance STN6500 (2452-650) . . . . . . . . . . . . . . . 264.1.2 IBM Real-time Compression Appliance STN6800 (2452-680) . . . . . . . . . . . . . . . 26

4.2 Front-panel components . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 274.3 Rear-panel components . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 274.4 Technical specifications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29

4.4.1 Physical specifications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29

4.4.2 Technical specifications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 304.4.3 Operating environment . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 304.4.4 Supported clients and servers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 30

4.5 Software components . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 31

Chapter 5. Performance considerations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 335.1 Performance requirements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 345.2 Performance best practices . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34

5.2.1 Read-cache allocation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 345.2.2 Parallelism of I/O. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 355.2.3 Compression ratio. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 355.2.4 Transparent versus compressed traffic. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35

Chapter 6. Implementation planning . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 376.1 Solution requirements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 386.2 Architectural planning . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 38

6.2.1 Physical installation and cabling considerations. . . . . . . . . . . . . . . . . . . . . . . . . . 38

6.2.2 Network. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 396.2.3 Antivirus services considerations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 42

6.3 Network considerations summary . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 436.4 Configuration planning . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 45

Chapter 7. Deploying Real-time Compression Appliances . . . . . . . . . . . . . . . . . . . . . . 477.1 Physical installation of Real-time Compression Appliance . . . . . . . . . . . . . . . . . . . . . . 487.2 Cabling the RTCA product for configuration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 48

7.3 Connecting to the RTCA product . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 487.3.1 Direct connection . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 497.3.2 Remote connection . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 49

7.4 Configuring the RTCA product . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 507.5 Configuring bonds and bridges . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 53

7.5.1 Creating bonds . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 54

7.5.2 Creating bridges . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 577.6 Configuring high availability . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 62

7.6.1 Synchronizing high availability manually. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 63

7.6.2 Synchronizing high availability automatically . . . . . . . . . . . . . . . . . . . . . . . . . . . . 657.6.3 Configuring high availability from the command line interface . . . . . . . . . . . . . . . 67

Chapter 8. Administration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 69

8.1 Working with the IBM Real-time Compression Appliance. . . . . . . . . . . . . . . . . . . . . . . 708.1.1 The web interface . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 708.1.2 The menu . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 708.1.3 Input area . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 718.1.4 Connecting to the web interface and access permissions . . . . . . . . . . . . . . . . . . 71

8.2 Configuring compression accelerator . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 728.2.1 Compression accelerator procedure. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 728.2.2 Scheduling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 758.2.3 Monitoring the Compression Accelerator . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 778.2.4 Resetting the accelerator log . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 78

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 7/168

Contentsv

8.3 High availability concepts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 788.4 Configuring storage and compression filters. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 79

8.4.1 Transparent mode. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 808.4.2 Compress mode . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 83

8.5 Monitoring the compression appliance . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 888.5.1 Displaying compression appliance status. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 89

8.5.2 Displaying storage status . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 948.5.3 Displaying compression status . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 95

8.6 Configuring SNMP . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 978.7 Configuring LDAP . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 99

8.7.1 Configure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 99

8.7.2 Diagnose. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1038.8 Miscellaneous tasks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 105

8.8.1 Date and time settings . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1058.8.2 Setting up the remote syslog servers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1068.8.3 Resetting the compression statistics. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1078.8.4 Web interface session timeout . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1078.8.5 DNS server setup . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 107

8.9 Maintaining the compression appliances . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1088.9.1 Reboot and shutdown. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 108

8.9.2 Backing up and restoring the configuration settings . . . . . . . . . . . . . . . . . . . . . . 1098.10 Software installation or upgrade . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 111

8.10.1 Installing/upgrade on a single RTCA. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1118.10.2 Installing/upgrade on a high availability RTCA . . . . . . . . . . . . . . . . . . . . . . . . . 1138.10.3 Updating the hardware configuration file. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 113

8.11 Configuring system options. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1148.12 Diagnosing problems . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1198.13 Recovering files when appliance is unavailable . . . . . . . . . . . . . . . . . . . . . . . . . . . . 119

8.13.1 Using the data recovery utility . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 119

8.13.2 Recovery procedure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1208.13.3 Creating data-recovery tasks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1218.13.4 Running data-recovery tasks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1228.13.5 Viewing data-recovery logs. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 122

Chapter 9. NAS / N series solution design . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1239.1 Terms and definitions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1249.2 N series single node solutions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 124

9.2.1 N series and single RTCA product . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1249.2.2 N series and single RTCA product, active/passive path . . . . . . . . . . . . . . . . . . . 1259.2.3 N series and active/passive path, RTCA product HA pair. . . . . . . . . . . . . . . . . . 1279.2.4 Active/passive path, RTCA product HA, EtherChannel/LACP bonds . . . . . . . . . 128

9.3 N series dual node solutions. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1319.3.1 Active/passive RTCA product on LACP bonds . . . . . . . . . . . . . . . . . . . . . . . . . . 131

9.3.2 Controller configurations. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1329.4 N series MetroCluster solutions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1339.5 N series with MultiStore . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 136

9.5.1 Considerations for vfilers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1379.5.2 Types of configurations. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 137

Chapter 10. ProtecTIER solution design. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13910.1 Combining RTCA and IBM ProtecTIER deduplication . . . . . . . . . . . . . . . . . . . . . . . 14010.2 Solution setup . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 141

Abbreviations and acronyms . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 143

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 8/168

vi  Introduction to IBM Real-time Compression Appliances

Related publications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 145IBM Redbooks publications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 145

Other publications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 145Online resources . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 145Help from IBM . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 146

Index . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 147

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 9/168

 © Copyright IBM Corp. 2011. All rights reserved.vii

Notices

This information was developed for products and services offered in the U.S.A.

IBM may not offer the products, services, or features discussed in this document in other countries. Consultyour local IBM representative for information on the products and services currently available in your area. Anyreference to an IBM product, program, or service is not intended to state or imply that only that IBM product,program, or service may be used. Any functionally equivalent product, program, or service that does notinfringe any IBM intellectual property right may be used instead. However, it is the user's responsibility toevaluate and verify the operation of any non-IBM product, program, or service.

IBM may have patents or pending patent applications covering subject matter described in this document. Thefurnishing of this document does not give you any license to these patents. You can send license inquiries, inwriting, to:IBM Director of Licensing, IBM Corporation, North Castle Drive, Armonk, NY 10504-1785 U.S.A.

The following paragraph does not apply to the United Kingdom or any other country where suchprovisions are inconsistent with local law: INTERNATIONAL BUSINESS MACHINES CORPORATIONPROVIDES THIS PUBLICATION "AS IS" WITHOUT WARRANTY OF ANY KIND, EITHER EXPRESS OR

IMPLIED, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF NON-INFRINGEMENT,MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. Some states do not allow disclaimer ofexpress or implied warranties in cer tain transactions, therefore, this statement may not apply to you.

This information could include technical inaccuracies or typographical errors. Changes are periodically madeto the information herein; these changes will be incorporated in new editions of the publication. IBM may makeimprovements and/or changes in the product(s) and/or the program(s) described in this publication at any timewithout notice.

Any references in this information to non-IBM Web sites are provided for convenience only and do not in anymanner serve as an endorsement of those Web sites. The materials at those Web sites are not part of thematerials for this IBM product and use of those Web sites is at your own risk.

IBM may use or distribute any of the information you supply in any way it believes appropriate without incurringany obligation to you.

Information concerning non-IBM products was obtained from the suppliers of those products, their publishedannouncements or other publicly available sources. IBM has not tested those products and cannot confirm theaccuracy of performance, compatibility or any other claims related to non-IBM products. Questions on thecapabilities of non-IBM products should be addressed to the suppliers of those products.

This information contains examples of data and reports used in daily business operations. To illustrate themas completely as possible, the examples include the names of individuals, companies, brands, and products.All of these names are fictitious and any similarity to the names and addresses used by an actual businessenterprise is entirely coincidental.

COPYRIGHT LICENSE:

This information contains sample application programs in source language, which illustrate programmingtechniques on various operating platforms. You may copy, modify, and distribute these sample programs in

any form without payment to IBM, for the purposes of developing, using, marketing or distributing applicationprograms conforming to the application programming interface for the operating platform for which the sampleprograms are written. These examples have not been thoroughly tested under all conditions. IBM, therefore,cannot guarantee or imply reliability, serviceability, or function of these programs.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 10/168

viii  Introduction to IBM Real-time Compression Appliances

Trademarks

IBM, the IBM logo, and ibm.com are trademarks or registered trademarks of International Business MachinesCorporation in the United States, other countries, or both. These and other IBM trademarked terms aremarked on their first occurrence in this information with the appropriate symbol (® or ™), indicating USregistered or common law trademarks owned by IBM at the time this information was published. Such

trademarks may also be registered or common law trademarks in other countries. A current list of IBMtrademarks is available on the Web at http://www.ibm.com/legal/copytrade.shtml

The following terms are trademarks of the International Business Machines Corporation in the United States,other countries, or both:

IBM® ProtecTIER® 

Redbooks® Redbooks (logo) ®  

System Storage® 

The following terms are trademarks of other companies:

MultiStore, Data ONTAP, NetApp, and the NetApp logo are trademarks or registered trademarks of NetApp,Inc. in the U.S. and other countries.

Oracle, JD Edwards, PeopleSoft, Siebel, and TopLink are registered trademarks of Oracle Corporation and/orits affiliates.

Microsoft, Windows, and the Windows logo are trademarks of Microsoft Corporation in the United States,other countries, or both.

Intel, Intel logo, Intel Inside logo, and Intel Centrino logo are trademarks or registered trademarks of IntelCorporation or its subsidiaries in the United States and other countries.

Linux is a trademark of Linus Torvalds in the United States, other countries, or both.

Other company, product, or service names may be trademarks or service marks of others.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 11/168

 © Copyright IBM Corp. 2011. All rights reserved.ix

Preface

Continuing its commitment to developing and delivering industry-leading storage

technologies, IBM® is introducing the IBM Real-time Compression Appliances for NAS, aninnovative new storage offering that delivers essential storage efficiency technologies,combined with exceptional ease of use and performance.

In an era when the amount of information, particularly in unstructured files, is exploding, butbudgets for storing that information are stagnant, IBM Real-time Compression technologyoffers a powerful tool for better information management, protection, and access.

IBM Real-time Compression can help slow the growth of storage acquisition, reducingstorage costs while simplifying both operations and management. It also enablesorganizations to keep more data available for use rather than storing it offsite or onharder-to-access tape, so they can support improved analytics and decision making.

IBM Real-time Compression Appliances provide on-line storage optimization throughreal-time data compression, delivering dramatic cost reduction without performancedegradation.

This IBM Redbooks® publication is an easy-to-follow guide that describes how to designsolutions successfully using IBM Real-time Compression Appliances. It provides practicalinstallation examples, ease of use, remote management, high availability, and administrationtechniques.

The team who wrote this book 

This book was produced by a team of specialists from around the world working at the IBMEuropean Storage Competence Center (ESCC) located in Mainz, Germany in closecooperation with the International Technical Support Organization (ITSO), San Jose,California, USA.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 12/168

x  Introduction to IBM Real-time Compression Appliances

The team, from left to r ight: Lucian, Michael, Christof, Eyal, and Roland 

Roland Tretau is an Information Systems professional with over 15 years experience in the ITindustry. He holds Engineering and Business Masters degrees, and is the author of manystorage related IBM Redbooks publications. Roland has a solid background in projectmanagement, consulting, operating systems, storage solutions, enterprise searchtechnologies, and data management.

Michael Jahn is a Client Technical Specialist for IBM Storage Systems Sales in Germany.Michael has 18 years of experience as an IT professional and joined IBM 5 years ago. Hisfocus area is providing technical pre-sales support covering the IBM storage product portfolio.He is an IBM System Storage® N series expert and designs the storage concepts andcomplex solution designs using N series systems.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 13/168

Prefacexi

Christof Schirra is an IBM level 2 Certified Consulting IT Specialist and expert for StorageNetworking and Virtualization Architecture. Christof has a solid background in informationinfrastructure solutions. He joined IBM in 1999 and holds an Electrical Engineering degree.As a member of the Advanced Technical Support (ATS) team, he is responsible for technicalsales support in Europe for IBM System Storage Solutions. The ATS System Storage teamacts as the leader to detect new and sustainable areas in the IT business, developing

invaluable IBM System Storage solutions to address and enable the field force to becomeself-sufficient in selling IT infrastructure solutions.

Eyal Traitel is a Manager of Development Support for IBM Real-time Compression in Israel.Eyal has 15 years of IT, support, sales, and marketing experience in Network AttachedStorage in various established and start-up storage vendors. He joined IBM through theacquisition of Storwize in 2010. He is managing the worldwide product support team for theIBM Real-time Compression Appliance product. His team provides analysis of complexcustomer problems and is extensively involved in improving the overall customer experiencethrough product improvements and documentation.

Lucian Vlaicu is a Client Technical Specialist for IBM Systems and Technology Group inRomania. Lucian has seven years of experience in the IT professional hardware field, movingfrom installation and management to consulting and design for the last five years. Since 2008,when he joined IBM, his areas of expertise include performance analysis, designing storagearea networks, storage virtualization, backup solutions, and disaster recovery for highavailability solutions. He holds a degree in Electrical Engineering and Computers and aMasters degree in Communication Technology Science, both from University Transylvania inRomania.

Thanks to the following people for their contributions to this project:

Bertrand Dufrasne, Alex Osuna, Ann LundInternational Technical Support Organization, Poughkeepsie Center

Chaim Koifman, Guy Meir, Tzahi ShahakIBM Israel

Jochen ErbIBM Germany

Now you can become a published author, too!

Here's an opportunity to spotlight your skills, grow your career, and become a publishedauthor—all at the same time! Join an ITSO residency project and help write a book in yourarea of expertise, while honing your experience using leading-edge technologies. Your effortswill help to increase product acceptance and customer satisfaction, as you expand yournetwork of technical contacts and relationships. Residencies run from two to six weeks in

length, and you can participate either in person or as a remote resident working from yourhome base.

Find out more about the residency program, browse the residency index, and apply online at:

ibm.com/redbooks/residencies.html

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 14/168

xii  Introduction to IBM Real-time Compression Appliances

Comments welcome

Your comments are important to us!

We want our books to be as helpful as possible. Send us your comments about this book orother IBM Redbooks® publications in one of the following ways:

Use the online Contact us review Redbooks form found at:

ibm.com/redbooks

Send your comments in an email to:

[email protected]

Mail your comments to:

IBM Corporation, International Technical Support OrganizationDept. HYTD Mail Station P0992455 South RoadPoughkeepsie, NY 12601-5400

Stay connected to IBM Redbooks

Find us on Facebook:

http://www.facebook.com/IBMRedbooks

Follow us on Twitter:

http://twitter.com/ibmredbooks

Look for us on LinkedIn:

http://www.linkedin.com/groups?home=&gid=2130806

Explore new Redbooks publications, residencies, and workshops with the IBM Redbooksweekly newsletter:

https://www.redbooks.ibm.com/Redbooks.nsf/subscribe?OpenForm

Stay current on recent Redbooks publications with RSS Feeds:

http://www.redbooks.ibm.com/rss.html

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 15/168

 © Copyright IBM Corp. 2011. All rights reserved.1

Chapter 1. The industry requirement for

compression

With file capacity projected to grow from 10,000 PB in 2008 to over 62,000 PB in 2012 (55%CAGR), file data growth and economic pressures are driving rapid adoption of data reductiontechnologies. While much of the attention around data reduction has focused on backup,many businesses are taking advantage of the opportunity to apply data reduction throughoutthe entire data life-cycle. Not surprisingly, according to recent research from leading marketresearch firms, NAS users are looking for features that reduce costs associated with power,cooling, floor space, and data footprint:

30% of users say they will not buy NAS without data reduction. 46% of users say they strongly

prefer a solution with data reduction.

Traditionally, the most common form of data reduction technology has been deduplication,generally for use with highly redundant data sets found in backup-to-disk, virtual tape, orphysical tape library applications. Although deduplication provides an acceptable solution forsuch sequential access workloads that are less sensitive to performance, deduplicationcannot meet the demanding requirements of primary storage for random-access, hightransaction volumes, and high throughput.

The IBM Real-time Compression Appliance (RTCA) solution addresses all the requirementsof primary storage data reduction, including performance, using a purpose-built technologycalled real-time compression. This IBM Redbooks publication discusses the key requirementsfor primary storage data reduction.

1

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 16/168

2  Introduction to IBM Real-time Compression Appliances

1.1 Current IT challenges

Businesses and organizations around the world are challenged with tough economicconditions. The IT environment, which was historically viewed as an expense, is now viewedas a source of innovation that can drive future revenue. However, the reality is of everincreasing data storage requirements that consume the available resources and disruptattempts to innovate the IT environment.

Now let us review each challenge in detail:

Support for increasing data storage requirements: Shrinking IT budgets are pressuring ITmanagers to increase the lifetime of existing storage systems. The traditional methods ofcleanup of unneeded data and archival of files to secondary storage are very timeconsuming and therefore shift one resource constraint, physical storage, to another:the human work of storage administrators.

Power, cooling, and floor space: A data center provides the means to host the storagesystems. However, the physical characteristics of the hard drive based systems, which arethe primary form of storage in use today, limit the amount of data that can be stored perrack unit. High power consumption and heat dissipation have become major concerns forIT managers, who are also challenged with fitting the storage systems into a limited datacenter. This conflicts with the increased demand for computing power that is needed forsupporting new types of applications.

High availability of data: Digital information has become the basis for any service in usetoday. As a result, the underlying systems providing access to digital information areexpected to be online at all times of day. This has made it impossible to introduce datareduction solutions that impose any kind of down time, be it actual inability to access thedata, or even a major slowdown when accessing an optimized data set.

Compression of primary storage provides an innovative approach designed to overcomethese challenges.

1.2 How compression can overcome the challenges

A compression solution can overcome the challenges just mentioned if it is designed from theground up for primary storage:

Immediate reduction to the required physical storage across all storage tiers: A solutionthat supports online compression of existing data allows storage administrators to gainback free disk space in the existing storage system without the need to change anyadministrative processes or enforcing users to clean up or archive data. The benefits tothe business are immediate because the capital expense of upgrading the storage systemis delayed. As data is stored in compressed format at the primary storage system, all otherstorage tiers and the transports in between them observe the same benefits. Replicas,backup images, and replication links all require less expenditure after implementingcompression at the source.

Reduction of environmental requirements per unit of storage: After compression is appliedto stored data, the required power and cooling per unit of storage are reduced becausemore logical data is stored on the same amount of physical storage. In addition, within aparticular storage system, more data can be stored, therefore the overall rack unitrequirements are lowered.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 17/168

Chapter 1. The industry requirement for compression3

Implemented without impacting the existing environment: A compression solution that isdesigned with transparency in mind can be implemented without changes to applications,servers, networks or storage systems. In addition, it is compatible with downstreamstorage processes such as snapshots, cloning, mirroring, archiving and backup, includingdeduplicated backups. This enables administrators to provide the business benefits ofstorage efficiency without incurring additional costs in the form of human intervention.

High availability access to compressed data: A compression solution which senselesslyintegrates with existing high availability storage system configurations enables storageadministrators to maintain the same level of availability that the storage system isproviding before compression is implemented. In addition, with high availability built intothe solution, the compression can be implemented into an existing environment without animpact to service, and existing data can be compressed transparently while data is beingaccessed by users and applications.

1.3 Identifying use cases for compression

In this section we explore the most common use cases for implementing compression. We

discuss the following use cases:

Home directories CAD/CAM Oil and gas data Log data Database Virtualized infrastructures

Various use cases for compression are depicted in Figure 1-1. B aware that values providedcan vary, depending on different environments, and cannot be guaranteed.

Figure 1-1 Compression use cases 

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 18/168

4  Introduction to IBM Real-time Compression Appliances

1.3.1 Home directoriesThe most basic use case for NAS in general is storage consolidation of file servers.Compressing this type of data provides immediate capacity reduction to home directoryshares as well as shared project data. More space can be provided to end users without anychange to the environment.

There are many file types stored in home directories and general project shares, however, forpractical information, here we are providing estimated compression ratios based on actualfield experience.

Expected compression ratios: 50% to 60%.

1.3.2 CAD/CAM

Computer-aided design or manufacturing files contain design data for mechanical, electric, orother information that is visually rich. For practical matters of discussion, geographicalinformation systems (GIS) data can be also considered part of this data type.

Expected compression ratios: 30% to 80%.

1.3.3 Oil and gas data

Seismographic research creates very large amounts of information that has to be digested byapplications and research engineers. All of the data set has to be available online for this

research and therefore offline data optimization methods are impacting the research activity.

Expected compression ratios: 30% to 80%.

1.3.4 Log data

Many applications require constant recording of application or user status. In addition, lab testresults are considered log data as well. Logs are typically represented as text files or binaryfiles that contain a high repetition of the same data patterns.

Expected compression ratios: 30% to 93%.

1.3.5 Database

Database information is stored in tablespace files. It is very common to observe highcompression ratios in database files. In addition, the compression appliance’s large readcache and the reduced I/O to the storage system end up reducing the latency of the databaseoperations.

Expected compression ratios: 70% to 80%.

Important: The expected compression ratios are based on samples taken from thatindustry. Real life ratios can vary from the stated values and are dependent on individualcustomers’ environments and data structures.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 19/168

Chapter 1. The industry requirement for compression5

1.3.6 Virtualized infrastructures

The proliferation of open systems virtualizations in the market has actually increased the useof storage space with more and more virtual server images and backups kept online. The useof compression assists in reducing the storage requirements at the source. Again, reducedI/O to the storage system and the large read cache provide higher scalability to the existing

storage system.

Expected compression ratios: 50% to 80%.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 20/168

6  Introduction to IBM Real-time Compression Appliances

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 21/168

 © Copyright IBM Corp. 2011. All rights reserved.7

Chapter 2. Compression technology

discussed

In this chapter we provide a general overview of data compression and data efficiencytechnologies.

2

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 22/168

8  Introduction to IBM Real-time Compression Appliances

2.1 Compression technology history

For the last 100 years, the IT technology has evolved from very large systems built to executesimple mathematical operations to small devices able to execute, generate, and manipulatemassive amounts of data. Devices that are able to store and capture data are showing anexponentially growth from year to year.

Because of requirements that data must be stored over a long period of time for long-termreference, compliance, and/or security purposes, new ways to optimize the capacity utilizationare needed. For more information about data growth evolution, see Chapter 1, “The industryrequirement for compression” on page 1.

Historically, over the last 200 years, the technologies available to reduce the amount of datastored or transported from one place to another have been greatly improved.

One of the first methods for reducing the amount of data was the usage of symbols andrepresentations in mathematical format. For example, instead of writing the words “multipliedby,” the related representation used is the asterisk character ( * ). In the same way, the word“minus” is represented with the dash character ( - ).

In 1938 the invention of Morse code allowed messages to be transmitted very quickly overlong distances by replacing the Roman letters and Arabic numbers with symbols formed fromlines and dots. In order to reduce the amount of dots or lines used to represent each letter,statistical analysis of the commonality of letters was performed. The most common letters arerepresented with a shorter combination of dots and lines. The commonality is different foreach language, as is the Morse code. For example, in the English language, the letter “c” isrepresented in the Morse code by 3 dots, while the letter “h” is represented by 4 dots. Therepresentation would therefore consist of 7 dots. However, in some languages “ch” is a verycommon combination, so the dots were replaced by lines, and “ch” is represented by 4 lines,effectively saving transmission time.

Later in the 20th century the development of IT technologies raised the need for complex

algorithms able to reduce the amount of data by interpreting the information beyond thesimple substitution of specific strings or letters.

One of the first techniques of mathematical data compression was proposed by Claude E.Shannon and Robert Fano in 1949. In the Shannon-Fano coding, symbols are sorted from themost probably to the least probable, and then encoded in a growing number of bits. Forexample, if the source data contains A B C D E, where A is the most common letter and E isthe least common letter, the Shannon-Fano coding will be: 00-01-10-110-111.

In 1952 a Ph.D. student at MIT named David A. Huffman proposed a more efficient algorithmfor mapping source symbols to unique string of bits. In fact, Huffman has proved that hiscoding is the most efficient method for this task, with the smallest average output bits persource symbol.

Later, Abraham Lempel and Jacob Ziv in 1977 proposed a method of replacing repeatingwords with code words. The method was applicable also to a pattern of text such asexpressions. This was the actual dawn of modern data compression.

Later in 1984 Terry Welch improved the algorithm proposed by Lempel and Ziv (also knownas LZ78) and developed a method known as LZW. Today this algorithm is the basis of moderncompression techniques used in PKZIP for general file compression, or within GIF and TIFFformats for images.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 23/168

Chapter 2. Compression technology discussed9

Over time, many data compression algorithms have been developed around the Lempel - Zivmethod: LZSS (LZ - Storer-Szymanski), LZARI (LZ with Arithmetic encoding), and LZH(LZ + Huffman encoding, used by the ARJ utility).

2.2 Data efficiency technologies

Data compression technologies can be found in various implementations over the last 15years. These range from compression at the application level to in-band solutions that areable to compress data as it is transferred from a host to a storage device. During recent years,a lot of new technologies and new concepts have been developed in order to address theneed for optimized storage space and more efficient capacity usage. We discuss some ofthese technologies briefly in this chapter in order to avoid confusion between datacompression and other space optimization methods.

2.2.1 Space efficient

Space efficient, sometimes also referred to as Thin Provisioning, is a technology that allows

the storage to declare the required capacity at the host level, but to allocate on the physicalstorage media—hard disk drives—only the actual used capacity in terms of space. Figure 2-1 presents the difference between a traditional volume and a space efficient volume.

Figure 2-1 Space efficient volume 

2.2.2 Flash Copy (space efficient)

Space efficient Flash Copy is a technique that allows the multiplication of volume data anddata instances without multiplying the required space with the number of copies. Thistechnology allows the copy to depend on the source with all the data that is in common. Whendata is changed from the original volume those changes will be available and reflected only in

the updated instance while the rest of the data will remain as a common foundation.

Detected Space by the H ost  

Free Sp ace(allocated)

Used Sp ace(allocated)

Tradit ional Volum e Spa ce Eff ic ient Volume

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 24/168

10  Introduction to IBM Real-time Compression Appliances

Figure 2-2 presents graphically a data volume and its dependency on a Flash Copy.

Figure 2-2 Space efficient Flash Copy 

2.2.3 Easy Tiering

Easy Tiering is a technology that is optimizing the way data is placed across different types ofdrives (FC/SAS, SATA/SAS_NL, and SSDs). In current environments, the storage systemconfiguration is done by using a rule set. Those rules are well known by a specialist and theyrefer usually to what should be the result after configuring a storage system. The hardest partis to address in a price/performance way the capacity needs over the performance needs.

Usually when you need capacity, you add drives; and when you need performance, you adddrives. There are a lot of situations when you need to add drives in order to accommodate aspecific performance, although those drives are not needed in terms of capacity. In thesesituations, the infrastructure will be oversized in terms of capacity.

Easy Tier (Figure 2-3) is a feature able to provide an optimized balance between the capacityand performance by identifying specific hot zones and by moving them from slower drives to

faster drives automatically. By doing so, you will be able to profit from using a combination ofSSD drives with much slower but higher capacity SATA drives, instead of using many morefaster drives to accommodate the needed load.

Figure 2-3 Easy Tier data allocation 

Volume A

Common Data

Data changed in volume A

Flash Copy of Volume A

Data originaly in volume A

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 25/168

Chapter 2. Compression technology discussed11

2.2.4 Archiving and space management

Archiving and space management, also known as Information Life-cycle Management (ILM)is a concept rather than a dedicated technology solution. It can be used in environmentswhere you need to keep data over a long period of time and you need to optimize the spaceoccupied on different storage types (tapes, hard disk drives, and so on). The old or not used

data can be moved out of the production area and placed on a much cheaper support (that is,by moving data from enterprise storage systems to low end storage systems and then fromhard drives to tapes). The historical information is usually kept in a database that holdsmetadata to provide accurate information about the managed data.

2.2.5 Data deduplication

The data deduplication mechanism identifies identical chunks of data within a storagecontainer and keeps only one copy of each chunk, while all the other logically identical chunkswill be pointed to this chunk. There are various implementations of this method. Onepossibility is in-line deduplication and the other one is post-processing. In-line solutions(Figure 2-4) deduplicate information as it is stored, and post-processing solutions deduplicate

data after the information is stored in the original format at certain time intervals.

Figure 2-4 Data deduplication 

Comparison: All the technologies presented in 2.2, “Data efficiency technologies” onpage 9 are used to optimize the way that the available storage capacity is used. None ofthose technologies change information but rather optimize how this information is stored orhow much of this information is duplicated within the storage system. Data compressiontechnologies are able to interpret data. For that, they are able to provide storageoptimization, both regarding the amount of data stored and the performance needed for thestorage system used in back-end systems.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 26/168

12  Introduction to IBM Real-time Compression Appliances

2.3 Data compression technologies

The compression of data has rapidly become a focus for the IT industry. Because of thedifferent types of data and the reasons why data is compressed, two concepts are used:

Reversible data compression: This method allows the information to be rebuilt completely

with no impact on the quantity or quality of the original information. Irreversible data compression: This method synthesizes the information and keeps only

the data that is needed. The original information cannot be rebuilt completely to its originalform when the data is decompressed.

Examples of irreversible data compression include audio, image, video compression, reports,and graphics generated in order to visualize large amounts of data, statistics, and so on. Oneclear example can be a situation with the runners at the Olympic Games who manage to gounder 10.1 seconds in the 100 meter speed running probe. We can say for example that 35%of the runners manage to go under 10.1 seconds and retain this value. But if we do not look atthe input data where all runners have their time, we cannot say that runner “X” has that time.

In this way, reversible data compression offers the advantage of the possibility to recreate

completely and accurately the input information, whereas the irreversible method offers onlysome specific information related to the original information.

Because of the massive amounts of data and the calculation needed to be made forcompressing data there are two approaches: real-time compression and post-processingcompression. These are their major characteristics:

Real-time compression: This method processes the data before it is written to the storagedevice. The key advantage of this approach is that it reduces the storage resourcesrequired for a given data set. If done correctly, the capacity-reduction application willpreserve the inherent performance of the storage environment. Data, already optimized,will be written to storage and mitigate the capacity explosion challenge at the point oforigin by eliminating the need to allocate additional storage capacity as required withpost-processing solutions. In addition, because this is primary storage, any compressiontechnique has to be performed in real time and must maintain the high availability featuresof the existing storage system.

Post-processing optimization: These solutions eliminate the need to deal with theperformance issues in real time and usually do not have any advanced high availabilitycapabilities. The challenge with post-processing optimization is that it uses storageresources for the capacity-reduction application, which causes a significant impact onstorage I/O resources. Post-process solutions require a read operation and pull a full copyof the original data to the storage; continue scanning the data, reading the data, andwriting the optimized file; and then delete the original file. In addition, when datadeduplication is thrown into the equation, the pointer between the optimized file and itsdeduplicated file needs to be written to storage before the deletion of the original file. Thisis a very complex and I/O intensive process. It is also the case that when you want the

optimized data, there must be enough space available on disk to uncompress it, whichmeans you do not actually improve storage utilization.

It is important to keep in mind, when considering post-process optimization techniques,that all optimization operations should be scheduled during a time of day when there arefree resources on the subsystem (non-production, non-backup windows) and after a pointin time when snapshots have been completed and newly optimized files have been writtento disk. Managing a schedule like this is next to impossible, and you risk not finding thetime to optimize your capacity before you actually run out of disk space.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 27/168

Chapter 2. Compression technology discussed13

Over the years, IBM has introduced a series of reversible, real-time compression algorithmsand solutions used in wide range of technologies:

The LTO-DC algorithm used in IBM Linear Tape Open, formally known as LTO tape drives

The Streaming Lossless Data Compression (SLDC) algorithm used in IBMEnterprise-class TS1130 tape drives

The Adaptive Lossless Data Compression (ALDC) used by the IBM Information Archivefor its disk pool collections

The Random Access Compression Engine (RACE) used inside Real-time CompressionAppliance.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 28/168

14  Introduction to IBM Real-time Compression Appliances

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 29/168

 © Copyright IBM Corp. 2011. All rights reserved.15

Chapter 3. Introduction to RTCA design

In this chapter we discuss the main concepts used in the IBM Real-time CompressionAppliance (RTCA), namely the Random Access Compression Engine (RACE) algorithm.We also examine the way the RTCA product manages to deliver high performance and thetechnology used for preserving data integrity.

3

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 30/168

16  Introduction to IBM Real-time Compression Appliances

3.1 The RTCA approach

The industry need for data compression is clearly to be fast, reliable, and scalable. Thecompression algorithm used must assure date consistency and a very good compression ratein order to be implemented. In addition, the data compression solution must also be easy toimplement, and the compression should occur without impacting the production use of thedata at any time.

From the technologies described in 2.3, “Data compression technologies” on page 12, andbased on industry requirements, the best model was chosen for the RTCA product, which is acombination of both reversible data compression and a real-time compression algorithm.In other words, the RTCA solution compresses the incoming flow of the data with minimumperformance impact. A generic overview of the RTCA solution is presented in Figure 3-1.

Figure 3-1 Real-time Compression Appliance overview 

3.2 IBM Real-time Compression

To understand the basic design of the IBM Real-time Compression technology, it is necessaryto review in detail the basics of modern compression techniques - the Lempel-Ziv algorithmand Huffman coding mentioned in 2.1, “Compression technology history” on page 8.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 31/168

Chapter 3. Introduction to RTCA design17

3.2.1 Lempel-Ziv algorithm

The Lempel-Ziv algorithm detects repetitions in the data stream and replaces them withreferences to the matching data.

Details about Lempel-Ziv coding can be found at the following websites:

Lempel-Ziv explained:http://www-math.mit.edu/~shor/PAM/lempel_ziv_notes.pdf

Lempel-Ziv coding:

http://www.code.ucsd.edu/cosman/NewLempel.pdf

3.2.2 Huffman coding

Another important algorithm is lossless coding as introduced by Huffman.

Details about Huffmann coding can be found at the following websites:

Huffmann coding explained:

http://webphysics.davidson.edu/faculty/dmb/py115/huffman_coding.htm

Detailed Huffman coding:

http://homepage.smc.edu/kennedy_john/HUFFMAN.PDF

3.2.3 Compression in real-time

The IBM Real-time Compression Appliance is based on a reversible data compressionalgorithm that operates in a real-time method.

The Real-time Compression Appliance compresses data on initial write in order to assure thatless data is stored on primary storage. Because of this, the storage system has to processless data, using less CPU overhead and lower disk spindles utilization. The storage systemcan therefore serve more requests from its read/write cache while some reads can be servedfrom the RTCA product’s read-ahead cache.

In addition to compressing data in real-time, the IBM RTCA product also enables itscustomers to non-disruptively compress existing data that is already saved to disk with theCompression Accelerator utility. Compression Accelerator is a high-performance andintelligent software application running on the IBM RTCA product which, by policy, allowsusers to compress data that has already been saved to disk while that data remains onlineand accessible by applications and end users.

The policies allow users to throttle how decompressed data gets compressed so as not tohave an impact on existing storage performance. The ability to compress already stored datasignificantly enhances and accelerates the benefit to end users, allowing them to see atremendous return on their IBM RTCA investment. On initial purchase of an IBM RTCAproduct, users can defer their purchase of new storage. As new storage needs to be acquired,IT purchases less than half of the “required” storage before compression. the IBM RTCAproduct enables IT to save on their overall storage investment.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 32/168

18  Introduction to IBM Real-time Compression Appliances

3.3 Random Access Compression Engine

The IBM Random Access Compression Engine (RACE) technology is the core of IBM RTCAproducts for NAS. RACE is based on 35 patents that are not about compression, but ratherdefine how to make industry standard LZ compression of primary storage operate in real-timeand allow random access. The primary intellectual property behind this is our RACE engine.

The IBM RACE engine sits on an appliance in front of any NFS or CIFS deployment, acting asan “intelligent cable” between the IP switch and the storage, as shown in Figure 3-1 onpage 16; no software agents or drivers are required on clients or servers.

The RACE technology (see Figure 3-2) is made up of three components:

1. Random Access Compression Engine (RACE): Enables random-access datacompression without compromising performance.

2. Unified Protocol Manager (UPM): Enables transparent support of multiple storage andnetwork protocols, including CIFS and NFS.

3. Monitoring and Reporting Manager (MRM): Enables online storage compression trending,analysis and reporting.

Figure 3-2 RACE technology overview 

3.3.1 Random Access Compression Engine: RACE

The traditional Compression Technologies start from a constant file size and, aftercompression, the result is a variable file in terms of capacity. Because of this, when usinglarge data chunks, the performance impact is high. However, when using small data chunks,

although the performance impact is small, the compression ratio is also very small. Over time,there are many disadvantages that can occur: garbage collection, poor performance while thevolume of the data increases, or losing parts of metadata, such as the date of creation, dateaccessed, user rights, or modification dates. Another issue can be fragmentation in the targetstorage space because after the file is stored in its original size, the result of compression isstored in a new zone and then the input is deleted.

The Random Access Compression Engine (RACE) starts from an unknown data stream andcompresses data coming from the host. The resulting compressed file keeps all attributesfrom the original; metadata is not changed. Also, because of the in-line approach, there is noneed at the storage level to write original data, read it, write the result of compression, and

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 33/168

Chapter 3. Introduction to RTCA design19

finally, delete the initial file. At the end, there will not be any garbage or fragmentation on thestorage system. The performance needed at the storage level will be decreased because thewrites and reads will be made only in compressed format instead of a complete one. A logicaloverview of the Random Access Engine is presented in Figure 3-3.

Figure 3-3 Random Access Compression Engine 

RACE takes incoming data streams and compresses the data within these data requests,leaving the metadata intact, to the storage array. The data is stored in the array and theacknowledgement that the write has been committed is sent directly back from the array tothe end user or application. This process flow is important because from a data availabilityperspective, it is imperative that it is the storage array that acknowledges the write

commitment—not the IBM RTCA product. It is for this reason that the IBM RTCA product hasno write cache. All storage commits come from the array, preserving the integrity of the databetween the storage and the application.

As stated before, the IBM RTCA technology leverages industry standard LZ compressionalgorithms. Although the “secret sauce” is not the compression algorithms that the RTCAproduct uses to do its compression, but rather the manner in which that compression isaccomplished. One of the key ways that the RTCA product is able to achieve its highcompression ratios and performance is by compressing data utilizing random accesstechniques.

The benefits of compressing data using random access techniques are twofold. First, theability to read or write only the blocks of the compressed file that require read or modification

means faster access performance for these operations. If you only need to write a small pieceof data in order to update a whole file, your storage performance is maximized. Second,because the RTCA product has this capability, updates to the file are accomplished in a waythat does not disrupt the other blocks in the compressed file.

Operating under the notion that upstream data compression significantly reducesdownstream data deduplication ratios, it is preferable to apply data deduplication technologiesover decompressed data prior to performing a deduplicated backup. While this can be true fordata compressed with traditional techniques, the unique, random access nature of the IBMRTCA product's compression preserves data deduplication ratios, allowing end users toexperience maximum data optimization in both primary and downstream tiers.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 34/168

20  Introduction to IBM Real-time Compression Appliances

In order for the IBM RTCA product to appear in the network as an intelligent cable, thereneeds to be technology to ensure that the system provides the same functionally to act like acable even though it is a device in the network. This is achieved through Link Status Mirroringor LSM. LSM sits behind each cable in the data path. If any cable fails, or for that matter, if anycomponent in the data path fails—the switch or storage or the I/O traffic coming into thatcable, from either the sending or receiving end—all need to be failed over to the other

available link in the solution.When a failure occurs and one link in the device is not available, LSM ensures that the otherside of the link is also downed such that data traffic can be rerouted to the available link in thedata path. This operation happens in microseconds to ensure the highest degree ofavailability to the data. Additionally, when the failure is fixed, and the link is restored, LSM alsoprovides a mechanism to fail the link back to the predominant active link.

3.3.2 Unified Protocol Manager

One of the key components of RACE is the Unified Protocol Manager (UPM) that allows theIBM RTCA product to seat in line between the storage NAS (NFS and CIFS shares) and theuser and to act as an intelligent cable. 

This transparent behavior means there is no change required to the end user environment.Further, there are no changes required to storage, networking or applications. The IBM RTCAproduct does not require any changes to the existing infrastructure or to downstreamprocesses such as snapshots, backup, replication and archiving; the RTCA product enhancesthese environments because you are moving and storing less data.

The following use cases are examples:

Snapshots: After you have installed the RTCA product, if your array allows you to takesnapshots of your data, your snapshot data will also be compressed and be accessible,without any system changes to the server. The metadata, such as file permissions, size,ownership, and the Access Control List (ACL), are maintained in the compressed file.

Conserving the file attributes: When a user performs a directory listing of the compresseddata, the RTCA product reports back all of the actual file metadata as if the file was notcompressed, including the file size and all of the ownership and permissions. Byinterpreting the file envelope and providing the native file attributes, the IBM RTCA productnegates the need for applications to be changed in order to read the compressed data ondisk. This means that there is no change required for IT, allowing the solution to fitseamlessly into the environment.

When operating system commands such as df are run on the storage subsystem, the IBMRTCA product does not mask the compressed file size, allowing the server to always knowexactly how much free space there is for files, and if quotas are in use, they can be enforced.These functions truly make the IBM RTCA product fully transparent in the environment.

3.3.3 Monitoring and Reporting Manager

Another component to the overall RACE technology is the Monitoring and Reporting Manageror MRM. The MRM enables online storage compression trending, analysis, and reporting.Further, MRM provides users with a host of services to efficiently manage and report on theIBM RTCA status and activities, and to quantify the benefits of the solution across theenvironment.

Space: The df command displays information about total space and available space on afile system.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 35/168

Chapter 3. Introduction to RTCA design21

The MRM provides users standard interfaces such as SNMP, allowing visibility into appliancehealth and performance through numerous traps and “poll-able” objects. DownloadableSNMP MIB libraries allow end users to integrate IBM RTCA monitoring into their monitoringand reporting tool of choice. MRM also allows users to integrate LDAP with the IBM RTCAproduct, facilitating auditable login authorizations. In an HA configuration, MRM alsoautomatically synchronizes the configuration setting between partner appliances to ensure

the accuracy of configuration and streamline solution management.In addition, MRM provides the users with the ability to select certain file types to include orexclude from compression as well as the ability to select shares to include or exclude fromcompression. MRM also allows users to see the amount of space saved by utilizing the IBMRTCA product. MRM provides the ability to select the file types to include or exclude fromcompression. But more importantly, in most cases, it selects which shares to include orexclude from compression.

3.4 Performance considerations

There are many factors that impact storage performance, including but not limited to these:

Disk drives: Performance cannot be any faster in any system than the slowest mechanismin the chain. In storage, this is the mechanical movement of the disk drive. The greater theactuator arm has to travel, the slower the disk performance.

I/O: The next consideration involves reads and writes, or I/O. The more reads and writesthere are in a storage system, the more the storage system has to processes these I/Orequests, the longer it takes for the storage system to respond, and consequently, theslower the storage system. If the storage system is busy processing all of these I/Orequests and moving the storage arm to read and write data, it means that the storageCPU gets busier and busier, and the response to more storage requests gets slower.

Cache: At the top of the storage array performance is its cache. Storage cache is veryexpensive; however, if configured properly for a given application, it can take a lot of theworkload off of the disk, I/O, and CPU, and provide faster response back to the end user or

application requesting data. Data that lives in cache is served significantly faster than datathat must be retrieved from disk.

In order for any storage compression solution to fit into this environment, it cannot negativelyimpact any of these functions. To be a good solution, it must enhance these functions.

Also, because there is less data being written to the storage array, there is less I/O. With lessI/O also come more CPU cycles to process the given read and write requests.

Finally, by compressing data in front of the storage array, a net increase in effective cachesize is achieved. Whatever the compression ratio is for your data, this compression ratiotranscends to your storage cache. Because cache is one of the most expensive componentsof a storage array, and also, cache tends to have the biggest impact on storage performance,the more you can increase cache, the better performance users and applications will see.

Performing compression in real-time, before the data gets to the storage, has tremendousbenefits to overall storage performance. It removes a lot of the hurdles that storageadministrators face when considering compression as a technology for their primary storage.

For more best practices and performance considerations, see Chapter 5, “Performanceconsiderations” on page 33.

Tip: If your data is compressible by 3:1, IBM Real-time Compression provides theequivalent of increasing the size of your storage cache by 3 times.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 36/168

22  Introduction to IBM Real-time Compression Appliances

3.5 Data integrity

As part of the solution design, IBM Real-time Compression has developed the DIA DataIntegrity Assurance architecture. The multi tiered data protection it provides, built into everyIBM Real-time Compression data compression appliance, is a quantum leap forward inguaranteeing data integrity.

To ensure 100% data integrity, the IBM Real-time Compression product line was developedhaving in mind the following goals:

Preserving existing data integrity mechanisms in the storage array Preserving existing data integrity mechanisms in the network Verifying the reliability of storing and retrieving the compressed data Using the industry-proven Lempel-Ziv (LZ) lossless data compression algorithm Using error-correcting code (ECC) memory modules to ensure data integrity for memory

access

This list describes how the IBM Real-time Compression Appliance integrates seamlessly intoNAS environments, increasing the storage capacity, while assuring data integrity as follows:

Preserving the data integrity mechanisms already in place in the network Providing mechanisms to guarantee the reliability of the compressed data through the DIA

Data Integrity Assurance architecture

3.5.1 Data integrity at the network level

The IBM Real-time Compression Appliance preserves data integrity mechanisms at theprotocol and storage levels.

Performing verification checks at the network protocol layer ensures data integrity duringtransmission between components in your network. These checks are cyclic redundancycheck (CRC) checksum mechanisms that verify data integrity during transmission of data

between components. A graphical representation is shown in Figure 3-4.

Figure 3-4 Network data integrity mechanism 

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 37/168

Chapter 3. Introduction to RTCA design23

3.5.2 Data integrity at the protocol layer

When you install the IBM Real-time Compression Appliance (Figure 3-5), the checksummechanisms employed in your network continue to function as usual. The IBM Real-timeCompression Appliance manages two sets of checksum mechanisms:

Checksums on the uncompressed data in the connection between the IBM Real-time

Compression Appliance and the switch

Checksums on the compressed data in the connection between the IBM Real-timeCompression Appliance and the storage array

The network protocol layer checksums include these:

Ethernet-layer checksum (IEEE 802.3): A checksum that protects data against corruptionduring transmission on the Ethernet wire by performing a CRC checksum at the framelevel

IP header checksum (RFC 791): A checksum that ensures the integrity of the data fields inthe IP header

TCP checksum (RFC 793): A checksum that verifies the integrity of each data block during

TCP/IP transmission UDP checksum (RFC 1122) – An optional checksum that verifies the integrity of data

packets associated with the UDP datagram

Figure 3-5 Network implementation 

3.5.3 Data integrity at the storage layer

The write acknowledgement is a critical aspect of the functionality of client server storage

applications. When the storage system completes a client write request, the storage systemreturns a write acknowledgement message. The write acknowledgement message providesconfirmation that the data was transmitted successfully through the network and written tostorage. This confirmation protects against failures in transmission caused by any componentof the network, between the client server and the storage system.

When the IBM Real-time Compression Appliance is installed in your network, it transparentlypasses write acknowledgement messages received from the storage system to the client thatrequested the write, ensuring that the data was stored on the storage array (Figure 3-5).

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 38/168

24  Introduction to IBM Real-time Compression Appliances

3.6 Storage advantages

Installing the IBM Real-time Compression Appliance in a storage configuration providesunmatched benefits to the storage environment:

Primary storage compression: The IBM Real-time Compression Appliance compresses

the data before it reaches the storage unit. This provides unique advantages over otherstorage capacity solutions:

– Improves response time: Reduces traffic to and from the storage system.

– Reduces the storage system’s read/write activity: Compressing data before it reachesthe storage system enables the storage system to store and provide data with lessread and write activity.

– Read gains: Increases the effective size of the storage read cache, improving theperformance of read operations. Storage system read performance is greatlyinfluenced by the cache hit ratio. Better use of the read cache reduces the need for diskhead movement, which is slower than cache access. Because IBM Real-timeCompression compresses the data before it reaches the storage system, the effectivesize of the read cache increases. The read cache improvement is proportionate to the

compression ratio.

– Write gains: Increases the effective size of the write cache, improving the performanceof write operations. Storage systems typically cache write operations to enableimmediate acknowledgement to clients and reduce response time. The size of the writecache significantly impacts the throughput of write operations to storage. The IBMReal-time Compression Appliance compresses the data before it reaches the writecache, so the effective size of the cache increases proportionately with thecompression ratio.

Reduces infrastructure costs: Using IBM Real-time Compression appliances reduces yourstorage capacity by up to 80 percent, and helps to eliminate the expensive infrastructurerequirements of expanding your storage footprint.

No changes or server resources required: The IBM Real-time Compression Applianceprovides storage gains with the advantages of self-contained, appliance simplicity:

– No need to change the storage system configuration– No need to change your workflow– No server resources used

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 39/168

 © Copyright IBM Corp. 2011. All rights reserved.25

Chapter 4. Hardware and software

components

In this chapter we provide an overview of the IBM Real-time Compression Appliance (RTCA)hardware and software components. Currently, the IBM RTCA product portfolio consists oftwo models.

This chapter outlines base model configurations and the technical specifications, such asnumber of ports, memory capacity, and the physical attributes of the products.

4

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 40/168

26  Introduction to IBM Real-time Compression Appliances

4.1 Base model configurations

Currently, the IBM RTCA product portfolio consists of two models that are configurable withbase and optional features.

4.1.1 IBM Real-time Compression Appliance STN6500 (2452-650)

The STN6500 is a 2U appliance. It comes equipped with 16 one-gigabit copper Ethernetports and one management port. These ports are factory-set when the appliance is ordered.

At least two cables are required for each NAS. One cable connects the NAS to the STN6500,and another cable connects the STN6500 to the LAN switch for that NAS. Port layoutdepends on product revision. Figure 4-1 on page 27 shows the front panel of the STN6500appliance. Figure 4-2 on page 28 shows the rear panel of the STN6500 appliance.

The following list provides a hardware overview of STN6500 base components:

IBM System x3650 M3 7945AC1 Dual Xeon E5620 4C 2.40 GHz 12 MB cache processors 72 GB 1333 MHz LP RDIMM Dual 146GB 10K 6Gbps SAS HDD Optical drive Redundant 675W ac power supplies Two C13-C14 PDU cables Four Intel® PRO/1000 Quad Port NICs One 3m Blue Cat5e cable Eight 3m Green Cat5e cables One 3m RS-232 cable

4.1.2 IBM Real-time Compression Appliance STN6800 (2452-680)

The STN6800 is a 2U appliance. It comes equipped with 1-gigabit copper Ethernet, 10-gigabitoptical Ethernet (10GBASE-SR), or both ports in the following configurations:

Four 10-GbE optical ports and eight 1-GbE copper ports Eight 10-GbE optical ports

In addition, the STN6800 is equipped with a management port. This port configuration isfactory-set when the appliance is ordered. At least two cables are required for each NAS.One cable connects the NAS to the STN6800, and another cable connects the STN6800 tothe LAN switch for that NAS. Figure 4-1 on page 27 shows the front panel of the STN6800appliance. Figure 4-3 on page 28 and Figure 4-4 on page 28 show the rear panel options ofthe STN6800 appliance.

The following list provides a hardware overview of STN6800 base components: IBM System x3650 M3 7945AC1 Dual Xeon X5660 6C 2.80 GHz 12 MB cache processors 72 GB 1333 MHz LP RDIMM Dual 146GB 10K 6Gbps SAS HDD Optical drive Redundant 675W ac power supplies Two C13-C14 PDU cables One 3m Blue Cat5e cable One 3m RS-232 cable

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 41/168

Chapter 4. Hardware and software components27

Optional features: One of these two separate NIC configurations must be selected:

Four 10 GbE ports and eight 1 GbE ports (FC #1001) with two LC-LC cables and four 3mGreen Cat5e cables

Eight 10 GbE ports (FC #1010) with four 5m LC-LC cables

4.2 Front-panel components

Both the STN6500 and STN6800 have the same front panel. It is depicted in Figure 4-1.

Figure 4-1 STN6500 and STN6800 front-panel components 

The front panel includes these components:

LED indicators and pinholes Power pinhole: Turns the compression appliance powersupply on or off.

Power LED: Indicates if the compression appliance is receiving power.

Light path diagnostics LED: Indicates whether there are any compression appliance

alerts. Light path diagnostics panel: Provides monitoring and alerting for system components. If a

failure occurs, a light is illuminated on the front panel of the compression appliance. Anycomponent failure will also be illuminated by LEDs on the light path panel itself, as well aswithin the system.

USB port: Used for manufacturing purposes (initial installation of the compressionappliance).

Hot-swappable RAID-1 mirrored hard drives: Holds the IBM Real-time CompressionAppliances software and configuration.

4.3 Rear-panel componentsThis section describes the rear panel components of the RTCA product. Figure 4-2 shows therear view of the STN6500 with 16 copper ports.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 42/168

28  Introduction to IBM Real-time Compression Appliances

Figure 4-2 STN6500 rear-panel components with 16 copper ports 

Figure 4-3 displays the rear view of the STN6800 with four 10 GbE ports and eight 1 GbEports (FC #1001)

Figure 4-3 STN6800 rear panel with four 10 GbE ports and eight 1 GbE ports (FC #1001) 

Figure 4-4 displays the rear view of the STN6800 with eight 10 GbE ports (FC #1010)

Figure 4-4 STN6800 rear panel with Eight 10 GbE ports (FC #1010) 

The STN6500 and STN6800 have different rear panels. Nevertheless, many of the por ts andconnections serve the same functions:

STN6500 data ports (eth0-eth15):

The STN6500 has 16 copper data ports. Each pair of data ports can be connected to asingle NAS and the LAN switch for that NAS. See Figure 4-2 on page 28.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 43/168

Chapter 4. Hardware and software components29

STN6800 optical and copper data ports (eth0-eth11): The STN6800 can have four 10-GbEoptical ports and eight 1-GbE copper ports. Each pair of data ports can be connected to asingle NAS and the LAN switch for that NAS. See Figure 4-3 on page 28.

STN6800 optical data ports (eth0-eth7): The STN6800 can have eight 10-GbE opticalports. Each pair of data ports can be connected to a single NAS and the LAN switch forthat NAS. Figure 4-4 on page 28.

Serial console port (RJ-45): Connects a terminal directly to the compression appliance.

Management port: Configures the compression appliance using the web interface. Ingeneral, you should connect to the administration tool through the management port.

Power supply units (PSUs): There are 2 power supply units. If a single power supplymalfunctions or stops receiving power, a beeping sound is emitted, informing you thatthere is a problem. The other power supply unit automatically senses the failure andmaintains uninterrupted power to the appliance.

AC connectors: Connects the power supply units to the power source through the acconnectors.

PSU cable lock: Ensures the power source cables are securely fixed to the ac connectors.

4.4 Technical specifications

This section discusses the technical specifications for the RTCA models STN6500 andSTN6800.

4.4.1 Physical specifications

Table 4-1 lists the physical specifications for models STN6500 and STN6800.

Table 4-1 Physical specifications for models STN6500 and STN6800 

Table 4-2 lists the network interfaces of the RTCA product.

Table 4-2 Network interfaces of the RTCA product 

Feature STN6500 STN6800

1 GbE ports 16 Up to 8

10 GbE ports None Up to 8

ECC Memory (GB) 72 72

Network interfaces STN6500 STN6800

with feature #1001a

a. (#1001) 4x10Gb and 8x1Gb Enet ports, this feature provides both 1-Gb and 10-Gb Ethernet.

STN6800

with feature #1010b

b. (#1010) 8x10Gb Ethernet ports, this feature provides a 10-Gb-only configurationEither feature #1010 or #1001 must be included in the initial order of STN6800.

1 Gbps copper ports 16 8 -

10 Gbps copper ports - 4 8

1Gbps copperManagement port

1 1 1

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 44/168

30  Introduction to IBM Real-time Compression Appliances

4.4.2 Technical specifications

Technical specifications for models STN6500 and STN6800 are shown in Table 4-3.

Table 4-3 Technical specifications for models STN6500 and STN6800 

4.4.3 Operating environment

Operating environment specifications for models STN6500 and STN6800 are shown inTable 4-4.

Table 4-4 Operating environment for models STN6500 and STN6800 

4.4.4 Supported clients and servers

For more information about supported clients and servers, see the Interoperability Matrices inthe IBM Real-time Compression Appliances v3.7 Release Notes, located at this website:

https://www-304.ibm.com/support/docview.wss?q1=linux&rs=219&uid=ssg1S7003383&context=HW28X&cs=utf-8&lang=en&loc=en_US

Feature Value

Operating weight 55 lbs

Form factor 2 rack units

Dimensions width 17.5 in

Depth 25.5 in

Height 3.36 in

Power 100-240V ac

50-60 Hz

780 watts

Hot-swap PSUs

Thermal Output 307-2662 BTU / hr

Feature Value

Temperature server on 50.0° to 95.0°F

Server off 50.0° to 109.4°F

Humidity server on/off: 8% to 80%

Acoustical noise emissions: Declared soundpower, idle

6.1 bel

Acoustical noise emissions: Declared soundpower, idle, operating

6.1 bel

Compliance RoHS-compliant

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 45/168

Chapter 4. Hardware and software components31

4.5 Software components

Three main software components enable the IBM RTCA product to perform storagecompression:

Random Access Compression Engine: Enables data compression without compromising

performance. Details can be found in 3.3.1, “Random Access Compression Engine:RACE” on page 18.

Unified Protocol Manager: Enables transparent support of multiple storage and networkprotocols, including CIFS and NFS. Details can be found in 3.3.2, “Unified ProtocolManager” on page 20.

Monitoring and Reporting Manager: Enables online storage compression managementand reporting. Details can be found in 3.3.3, “Monitoring and Reporting Manager” onpage 20.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 46/168

32  Introduction to IBM Real-time Compression Appliances

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 47/168

 © Copyright IBM Corp. 2011. All rights reserved.33

Chapter 5. Performance considerations

In this chapter we discuss various considerations in designing an optimal configuration withthe IBM Real-time Compression Appliance (RTCA).

A key benefit of the IBM RTCA solution is the ability to perform compression whilemaintaining high performance. The compression appliance is part of the overall storagesolution, and as such, it has to be reviewed together with the storage system itself. There arevarious performance requirements that need to be part of this review.

5

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 48/168

34  Introduction to IBM Real-time Compression Appliances

5.1 Performance requirements

The following list provides three focus areas:

Throughput The storage solution is typically measured by the number megabytesper second of data being read or written to it. We can measure this

throughput during work hours as well as peak time, to make sure thesystem is designed to provide expected service levels even in highload time windows.

Response time End users are sensitive to how responsive the system is to the actionsand jobs that they perform in the computing systems. The end userresponse time is affected by many components: the user actionsthemselves, client side application processing time, operatingsystems, networking layers, physical links, file system processing, andthe disk sub-system.

Scalability Any computer system is typically designed to handle current andfuture load levels. Planning ahead requires a detailed review of theperformance metrics of an overall storage solution.

Next we review best practices for configuring the highest performance Real-timeCompression Appliances solutions.

5.2 Performance best practices

There are various configuration items and parameters that affect the performance of aNetwork Attached Storage (NAS) setup that includes the IBM Real-time CompressionAppliances solutions.

5.2.1 Read-cache allocationA specific amount of the compression appliance memory is allocated for read cachepurposes. The default allocation in V3.7.1 is 30 gigabytes, which typically provides very highcache hit ratios. However, in some cases it would be necessary to increase the read cache.

To increase the read cache to 50 GB, run the following commands:

option Buffer:MaxMemoryUse4Pages 10000option Buffer:NumberOfBuffers 50000

An engine warm restart is required to apply the settings.

Read cache: For various releases, other values might be applicable. Consult with IBM

Support if you are running a release other than V3.7.0 or V3.7.1. Do not increase the readcache if the appliance is implemented in option General:MemoryProfileMode 1 modebecause in this mode, the read cache is reduced to a minimal size such that more memoryis available for other appliance tasks.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 49/168

Chapter 5. Performance considerations35

5.2.2 Parallelism of I/O

The Real-time Compression Appliance software is tuned for a multi-core processorarchitecture and is highly efficient in handling concurrent compression and decompressiontasks. However, single threaded I/O does not fully utilize this capability. For this reason, anyapplication configuration changes that increase the concurrency of I/O operations will

increase the overall performance and reduce the overall load of the appliance.

5.2.3 Compression ratio

The rule of thumb is that the higher the compression ratio, the lower the CPU time spent oncompressing the data. The same rule applies for decompression as well. It is thereforepreferable to configure file types with low expected compression ratio in the “File Extensionsto Exclude” field in the “Compression Filters” page. This will reduce CPU time spent onattempting to compress files with low expected file size reduction.

Here is a list of file extensions to exclude:

zip gz tgz arj

5.2.4 Transparent versus compressed traffic

A basic concept of the compression appliance is that it adds minimal latency when trafficarrives to it and gets processed by its network interfaces. However, it reduces the latency ofI/O requests sent to the storage, as less data is sent to the storage compared with the originaldata sent by the client. However when the appliance is implemented without compressingdata, or when only a minimal amount of data is compressed, the latency added by theappliance being an additional network hop will not be compensated, and the overall

throughput will be lowered. It is best to implement the appliance and start compressing filesright away.

Tip: Multi threaded parallel I/O increases performance.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 50/168

36  Introduction to IBM Real-time Compression Appliances

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 51/168

 © Copyright IBM Corp. 2011. All rights reserved.37

Chapter 6. Implementation planning

In this chapter we present a planning guide to provide proper solution design. We discussphysical and logical installation of the IBM Real-time Compression Appliance (RTCA).

6

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 52/168

38  Introduction to IBM Real-time Compression Appliances

6.1 Solution requirements

The following list provides an outline for important solution requirements:

NAS storage platform: The IBM Real-time Compression Appliance supports NASprotocols only. Ensure that your Storage Server and required NAS protocols are

supported. Information about supported features can be found at the following Web site:http://www.ibm.com/support/entry/portal

Data type: It is highly desirable to identify compressible data before starting theconfiguration of the IBM Real-time Compression Appliance. See 1.3, “Identifying usecases for compression” on page 3.

Capacity: It is best to have enough capacity to make the solution cost effective. Fromexperience, in most cases this should be more than 20 TB NAS data.

Growth rate: You should not have a negligible annual growth rate. The higher the growthrate, the more cost effective will be the RTCA product.

6.2 Architectural planning

The following section discusses architectural planning for RTCA solutions.

6.2.1 Physical installation and cabling considerations

Next we start to evaluate physical and cabling considerations.

Network interfacesTable 6-1 shows the three different network options of the RTCA product.

Table 6-1 Network interfaces of the RTCA product 

Rack considerationsIBM RTCA hardware (2452-650 and 2452-680) must be installed in a standard 19-inch rackusing the rack mounting hardware provided with the machine. The rack cabinet must have a2U slot available for each RTCA product. For more detailed information about the physicalspecifications, see 4.4.2, “Technical specifications” on page 30.

Network interfaces STN6500 STN6800

with feature #1001a

a. (#1001) 4x10Gb and 8x1Gb Enet ports; this feature provides both 1-Gb and 10-Gb Ethernet.

STN6800

with feature #1010b

b. (#1010) 8x10Gb Ethernet ports; this feature provides a 10-Gb-only configuration.Either feature #1010 or #1001 must be included in the initial order of STN6800.

1 Gbps copper ports 16 8 -

10 Gbps copper ports - 4 8

1 Gbps copperManagement port

1 1 1

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 53/168

Chapter 6. Implementation planning39

Cables and portsYour network cables would be unplugged from current storage, and plugged into thecompression appliance. IBM supplies cables that go from the compression appliance to thestorage:

(#3003) 3m Green Cat5e cable:

This feature provides one 3-meter Green Cat5e cable with RJ-45 connectors for 1-GbEthernet connections.

(#3705) 5m LC-LC optical cable:

This feature provides one 5-meter LC-LC Optical cable for 10-Gb Ethernet connections.

If you do not purchase cables from IBM, you need an additional set of network cables toconnect the RTCA product with your NAS storage server.

If the NAS storage is connected with eight 1-Gb copper cables to one Ethernet switch,you will need additionally eight 1-Gb copper cables and one 1-Gb copper cable for themanagement port for installing the RTCA product. This means that only one additionalnetwork port per RTCA product is required on the Ethernet switch.

Physical bypassUnder normal conditions it is not necessary to bypass the RTCA product for any Ethernettraffic.

If you have free Ethernet ports an your NAS storage server an want to use these ports foriSCSI or replication purposes, at these Ethernet ports all NAS protocols should bedeactivated.

6.2.2 Network 

This section discusses network terms associated with the RTCA product.

Introduction to RTCA network terminologyThe RTCA product acts as a “intelligent cable” between the Ethernet switch and the NASstorage server. To provide network connectivity it is necessary bonds and bridges.

Bond A bond combines physical RTCA ports to a single virtual interface. In other words, a bond isthe vehicle for port aggregation. The RTCA product supports the common port aggregationprotocols Etherchannel and 802.3ad (LACP). Also, you can create active-backup bonds.

Bridge 

A bridge combines two physical interfaces or bonds to establish a network connectionbetween the Ethernet switch and the NAS storage server. For every bridge, a new IP addresshas to be configured. This IP address is used by the RTCA product to poll the NAS sharesand exports.

Tip: To avoid direct access to compressed data by clients without passing the RTCAproduct, it is best to connect all network interfaces of the NAS storage server with theRTCA product.

Important: For proper solution design, you must understand these networking concepts.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 54/168

40  Introduction to IBM Real-time Compression Appliances

The general use of bridges and bonds is illustrated in Figure 6-1.

Figure 6-1 general use of bonds and bridges 

Logical interfacesIf your NAS storage system is configured with port aggregation, it is necessary to have a lookat the port aggregation configuration and to document the allocation of virtual interfaces to

physical interfaces. It is preferable that you adapt the aggregated physical interfaces of yourNAS storage server to corresponding bonds at your RTCA product. In other words, allphysical interfaces of an aggregated interface will be in the same bond.

In Example 6-1, you see the configuration of different types of virtual interfaces of a IBMSystem Storage N series controller. The physical interfaces ‘e0a’ and ‘e0c’ are trunked by‘vifa’ as multi mode vif. The physical interfaces ‘e0b’ and ‘e0d’ are trunked by ‘vifb’ as anothermulti mode vif. ‘vifa’ and ‘vifb’ are configured as member in a second level vif ‘vif1’ as a singlemode vif.

In an HA configuration, you need to use one bond for ‘vifa’ at the first RTCA product and onebond for ‘vivb’ at the second RTCA product. Both bonds will be bridged to the correspondingbonds, which include the Ethernet connection to the switch. The vif configuration will be

unchanged at the N series system.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 55/168

Chapter 6. Implementation planning41

Example 6-1 Virtual interface configuration of N series with four physical interfaces 

bran1> vif statusdefault: transmit 'IP Load balancing', VIF Type 'multi_mode', fail 'log'vifa: 2 links, transmit 'Round-Robin Load balancing', VIF Type ' multi_mode' fail'default'

VIF Status Up Addr_set

trunked: vif1up:

  e0a: state up, since 23Mar2011 15:24:49 (22:18:23)mediatype: auto-1000t-fd-upflags: enabledinput packets 19529, input bytes 2358737output packets 30533, output bytes 1509659up indications 10, broken indications 7drops (if) 0, drops (link) 0indication: up at 23Mar2011 15:24:49

consecutive 170269, transitions 17  e0c: state up, since 23Mar2011 10:00:55 (1+03:42:17)

mediatype: auto-1000t-fd-up

flags: enabledinput packets 278152, input bytes 16971759output packets 30757, output bytes 1522361up indications 8, broken indications 5drops (if) 0, drops (link) 0indication: up at 23Mar2011 10:00:55

consecutive 170755, transitions 13vifb: 2 links, transmit 'Round-Robin Load balancing', VIF Type ' multi_mode' fail'default'

VIF Status Up Addr_settrunked: vif1down:

  e0b: state up, since 23Mar2011 09:55:33 (1+03:47:39)mediatype: auto-1000t-fd-upflags: enabledinput packets 346488, input bytes 101244051output packets 86193, output bytes 41936062up indications 4, broken indications 2drops (if) 0, drops (link) 0indication: up at 23Mar2011 09:55:33

consecutive 171415, transitions 6  e0d: state up, since 23Mar2011 09:55:33 (1+03:47:39)

mediatype: auto-1000t-fd-upflags: enabledinput packets 347356, input bytes 98485301

output packets 84014, output bytes 43590209up indications 2, broken indications 0drops (if) 0, drops (link) 0indication: up at 23Mar2011 09:55:33

consecutive 171880, transitions 2

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 56/168

42  Introduction to IBM Real-time Compression Appliances

vif1: 1 link, transmit 'none', VIF Type 'single_mode' fail 'default'VIF Status Up Addr_set

up:  vifa: state up, since 23Mar2011 10:00:55 (1+03:42:17)

mediatype: Enabled virtual interfaceflags: enabled favored

input packets 297681, input bytes 19330496output packets 61290, output bytes 3032020output probe packets 56815, input probe packets 167902strike count: 0 of 10up indications 7, broken indications 4drops (if) 0, drops (link) 0indication: up at 23Mar2011 10:00:55

consecutive 170785, transitions 11down:

  vifb: state down, since 23Mar2011 10:01:27 (1+03:41:45)mediatype: Enabled virtual interfaceflags: enabled unfavoredinput packets 693844, input bytes 199729352

output packets 170207, output bytes 85526271output probe packets 56831, input probe packets 170706strike count: 0 of 10up indications 2, broken indications 0drops (if) 0, drops (link) 0indication: up at 23Mar2011 09:55:33

consecutive 171880, transitions 2

For further support information, see the RTCA Release Notes and the RTCA AdministrationGuide at this website:

http://www.ibm.com/support/entry/portal

Planning the physical connectionBefore you begin to create bridges and bonds, document the existing cabling diagram todetermine which RTCA ports will be used to bring the switch-to-RTCA and the RTCA-to-NASconnection together. It is preferable that paired cables (cable from the switch to RTCA andcable from NAS) reside on the same PCI card if possible for ease of cabling management andbetter availability.

6.2.3 Antivirus services considerations

In many NAS environments, the antivirus scanning activities are offloaded for betterscalability and performance. NAS vendors often advise having a dedicated physical networkconnection or dedicated VLAN configuration to transmit data from the NAS storage server tothe antivirus server. It is highly desirable that you configure your physical network and theRTCA product, thus all data passes the RTCA product. If you configure a physical bypass ofthe RTCA product, compressed files will be transmitted to the antivirus server and maliciousvirus code will never be detected. If necessary, you can configure a dedicated bridge toseparate the antivirus scanning traffic from all other network traffic.

Attention: All members of an active/active port aggregation, such as multi vif or lacp vif ofData ONTAP®, must be connected to the same RTCA product. If the same shares/exportsare accessed through different links, an active/active setup can lead to data access issuesbecause concurrent access to files through separate RTCA products is prohibited.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 57/168

Chapter 6. Implementation planning43

An example of an antivirus configuration is illustrated in Figure 6-2.

Figure 6-2 Antivirus server in an RTCA environment 

6.3 Network considerations summary

This section summarizes important network considerations:

Bridges connecting between the network and storage:

Each side of a bridge has to be connected to either a network switch or a NAS storageserver interface. Do not connect the two sides of the bridge to the network switch; this willcreate a network loop that can impact service to users.

Direct connection to the NAS:

The Link State Mirroring (LSM) is monitoring the network link status and automaticallymirrors this status between the bridge interfaces. Connecting active components such aslink converters or powered patch panels in between the appliance and the NAS storageserver can cause the LSM mechanism to fail and is therefore not supported.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 58/168

44  Introduction to IBM Real-time Compression Appliances

Number of network interface ports:

The compression appliance acts a bridge between two “sides”, so the number of requiredports is 50% of the total number of links configured in the NAS storage server. Forexample, if an N series system is configured with four 1-gigabit links, a total of eight1-gigabit links will be required on the RTCA product to support this configuration.

In addition, the total number of links must support the expected aggregate throughput.For example, a particular NAS storage server is expected to provide ~500 MB/s totalthroughput. Because each 1-gigabit link provides ~80-100 MB/s, in this environment it isbest to configure at least five interfaces.

Number of bridges:

Up to eight physical bridges can be configured on a single appliance, and up to 128bridges configured with VLAN tagging (802.1q).

Number of storage system interfaces:

Each individual storage system physical and VLAN-tagged interface has to berepresented in the RTCA network configuration. Each RTCA product provides up to 16ports, so a NAS storage server with up to 8 physical interfaces can be implemented.Connect all network interfaces through the appliance unless some interfaces are used

solely for NDMP or replication traffic that is not based on NFS/CIFS.

Number of IP addresses configured in the NAS:

Each NAS IP address must be configured in the compression appliance to supportcommunication between the client and the NAS storage server. This includes IP aliasesand virtual server IP addresses.

Distribution of network links across NICs:

The RTCA product is configured with either quad-port gigabit Ethernet cards, or dual-port10 gigabit Ethernet cards. To provide the highest redundancy possible, it is preferable toconfigure bridges from ports located on separate cards.

For example:

br0 – eth0 and eth4br1 – eth1 and eth5br2 – eth2 and eth6br3 – eth3 and eth7br4 – eth8 and eth12br5 – eth9 and eth13br6 – eth10 and eth14br7 – eth11 and eth15

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 59/168

Chapter 6. Implementation planning45

6.4 Configuration planning

Before powering on your RTCA product for the first time, use the configuration worksheets togather the information that the upcoming setup process will require:

Use Table 6-2 to gather the information for the initial setup.

Fill in Table 6-3 with the required information for configuring autosupport. Insert miscellaneous information for NTP, DNS, and logging in Table 6-4.

For every NAS storage server, fill in Table 6-5 to gather the required information for laterconfigurations.

Depending on the interface configuration of your NAS storage server, you can use eitherTable 6-6 or Table 6-7 to gather the network information.

Table 6-2 Port management port setup 

Table 6-3 Autosupport configuration 

Table 6-4 Miscellaneous configurations 

RTCA product hostname

IP Address

Subnet MaskGateway

MTU (default 1500)

Link mode auto10baseT/Half10baseT/Full100baseT/Half100baseT/Full1000baseT/Full

Email from(the “from” user used for sending email)

SMTP server(IP address or hostname)

SMTP remote port(default - 25)

Attachment prefix(The names of email attachments are prefixedwith this name to avoid the possibility that theemail will be rejected by some email servers)

IP address NTP server 1

IP address NTP server 2

IP address Remote syslog server

DNS domain

DNS search list

DNS name server IP address

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 60/168

46  Introduction to IBM Real-time Compression Appliances

Table 6-5 NAS storage configuration - one table per NAS storage server IP address 

Table 6-6 NAS storage physical interfaces to bridge directly switch - one table per interface 

Table 6-7 NAS storage virtual interface configuration - one table per virtual interface 

Storage system name

Storage Vendor

Storage IP address

Name of the interface

IP address for the bridge

Name of virtual interface

Member of virtual interface (physical interfaces)

Type multi (Etherchannel)multi (802.3ad LACP)

single (active-backup)

IP address for the bridge

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 61/168

 © Copyright IBM Corp. 2011. All rights reserved.47

Chapter 7. Deploying Real-time

Compression Appliances

In this chapter we provide a description of the first installation steps that are needed in orderto configure the Real-time Compression Appliance (RTCA) system.

7

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 62/168

48  Introduction to IBM Real-time Compression Appliances

7.1 Physical installation of Real-time Compression Appliance

The first step is to install the IBM Real-time Compression Appliance (RTCA) in the rack.Follow the instructions in the Rack Installation Instructions for IBM Gen-II Slides Kit, 69Y4034document. You can find it on the IBM Real-time Compression Appliances Documentation CDor on the IBM support website:

http://www.ibm.com/support

7.2 Cabling the RTCA product for configuration

The second step after mounting the device in the rack is to connect the minimum cablingneeded in order to perform the basic installation steps.

At this stage it is not necessary to connect the RTCA product within the data paths. You cando it later after the initial installation setup in order to provide non-disruptive implementation.

7.3 Connecting to the RTCA product

The RTCA product can be managed using two kinds of connections:

Direct connection: Standard KVM or using serial console connection by RS232 serialprotocol as shown in Figure 7-1.

Figure 7-1 Direct management connection 

Remote connection: Web GUI management or SSH CLI. In this case, you will have toconfigure the remote access protocol by setting up an IP address at the Real-timeCompression Appliance as shown in Figure 7-2.

Important: Connect the RTCA product to an appropriate power source. For higherredundancy, connect both power supplies to different main electricity lines, while at leastone power supply for the engine must be connected through an uninterruptible power

supply.

Precaution: This product is not intended to be connected directly or indirectly by anymeans whatsoever to interfaces of public telecommunications networks.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 63/168

Chapter 7. Deploying Real-time Compression Appliances49

Figure 7-2 Remote management connection 

Using the KVM, RS232, and SSH, you will be able to perform CLI management at theReal-time Compression Appliance.

7.3.1 Direct connection

The direct connection can be made by using a standard VGA monitor and a USB keyboard orby RS232. Table 7-1 presents the required information for connecting using console or serialinterface.

Table 7-1 Connect a communication device 

7.3.2 Remote connection

The remote connection can be made using HTTP and SSH. For both interfaces, the default IPaddress is: 10.10.0.254.

Communication device How to connect

VGA monitor and keyboard 1. Connect the VGA monitor to any of the VGA ports onthe compression appliance.

2. Connect the USB keyboard to any of the USB ports onthe compression appliance.

Standard RS-232 serial console 1. Connect the serial port cable to the 9-pin console port

on the compression appliance;2. Connect the other side to a terminal server, or to a PC

or server with serial console port;

3. Configure the terminal emulation software to thefollowing settings:

– Bits per second: 38400– Data bits: 8– Parity: None– Stop bits: 1– Flow control: None

Connection: Use the following default credentials to connect to the RTCA system:

User name: userPassword: a1b2c3

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 64/168

50  Introduction to IBM Real-time Compression Appliances

The minimum requirements to use the web interface are as follows:

Microsoft® Internet Explorer 5.5 or later Mozilla Firefox 2.0 or later

7.4 Configuring the RTCA product

After the cabling is made, the next step is to power-up the RTCA product. Simply press thepower button. The RTCA product starts the initial boot sequence. Wait for the compressionappliance software to start. This process might take up to five minutes:

1. The following text will display on a direct connection management system when the

compression appliance is fully operational:

2. The next step is to connect to the RTCA product to change the standard IP address andthe default administrator password.

3. Use a web browser and go to http://10.10.0.254 as shown in Figure 7-3.

Figure 7-3 Log in welcome screen 

After logging in, the following interface displays as depicted in Figure 7-4. This view showsthe general status of your system, and you are able to perform different tasks.

Connection: Use the following credentials to connect to the RTCA product over HTTP orSSH:

User name: userPassword: a1b2c3

Starting Appliance ManagementLogin:

Tip: If you have configured a DHCP server, the RTCA product will not request an IPaddress from the DHCP server.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 65/168

Chapter 7. Deploying Real-time Compression Appliances51

Figure 7-4 First view after login to the RTCA product 

4. From the left panel, select Management Port (see Figure 7-5). Enter the desired IPaddress, subnet mask, and gateway. If necessary, you can change the default MTU or theLink Mode. In the last field, named Hostname, you will have to enter the designated namefor this host. After finishing the settings, click the Accept button.

Figure 7-5 Setting the management interface 

IP address: After changing the IP address, the following message will display askingyou to log on again on the new IP address. The Management Port IP has changed.

Wait up to 30 seconds before trying to connect on the new IP address.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 66/168

52  Introduction to IBM Real-time Compression Appliances

5. If you are using a Direct Connection or over SSH, change the IP address using theifconfig command (see Example 7-1).

Example 7-1 Changing the management settings 

[email protected]> ifconfig mgmt -i 9.155.66.157 -s 255.255.255.0 -gw 9.155.66.1 -m1500 -f auto

6. After the command was executed successfully, log on again on the new IP address. Inorder to check if the new configuration was made correctly, submit the ifconfig mgmt command (see Example 7-2).

Example 7-2 Verifying the current configuration of the management interface 

[email protected]> ifconfig mgmtManagement PortIP: 9.155.66.157Subnet: 255.255.255.0Gateway: 9.155.66.1MTU: 1500Link mode: autoActual link mode: 100baseT/Half

7. Next change the administrator password. From the web interface, choose the Security option. From the newly configured state (see Figure 7-6), change the administrationpassword and also secure the web management interface by imposing only one IP thatwill be served. The password must be between 6 and 8 characters.

Figure 7-6 Changing the admin password 

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 67/168

Chapter 7. Deploying Real-time Compression Appliances53

a. You can do the same task from the CLI using the passwd command (Example 7-3). Thepasswd command will change the password only for the default user: ‘user’. You haveto enter the password twice. After successfully changing the password, the followingmessage is displayed: “User password changed successfully”.

Example 7-3 Changing the default management password - part 1

[email protected]> passwdNOTE: This will change the login password for username 'user'Enter password:Enter password:User password changed successfully

b. You can also change the passwd command using the following syntax: passwd a1b2c3(Example 7-4). In this situation, the password will be changed instantly without anyother confirmation.

Example 7-4 Changing the default management password - part 2 

[email protected]> passwd a1b2c3User password changed successfully

7.5 Configuring bonds and bridges

After configuring the management interface and the administrator password, the next step isto configure bonds and bridges. A brief definition can be found in 6.2.2, “Network” onpage 39.

To configure first bonds and bridges, proceed as follows:

1. On the left panel of the interface, select the Network option. In the Network pane(Figure 7-7), you can see the current configuration of your compression engine, showing

the following information:

– Interface cards installed– Created bonds and bridges– Compression engine status

2. From the top of the panel, select to create a new bond, a new bridge, or to define a staticrouting table for the management interface. At the bottom of the page, select to start, stop,or restart the compression engine.

Tip: The compression engine cannot be started if there are no bridges defined. InFigure 7-7, the status of the compression engine is: Halted .

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 68/168

54  Introduction to IBM Real-time Compression Appliances

Figure 7-7 Network panel overview 

7.5.1 Creating bonds

If your implementation design includes some adapter bonding between different interfaces,first you have to replicate the bonds defined in your storage at the appliance level. Becausethe appliance is acting as an intelligent cable by using adapter bonding topology, you will notbe able to achieve higher failover support than the standard storage configuration.

Tip: The bonds and bridges can be defined without moving the storage traffic through thestorage engine or without cabling the compression appliance. Good planning can save alot of time during the implementation and can assure a proper implementation withoutdowntime. For more details on how to plan the implementation, see Chapter 7, “DeployingReal-time Compression Appliances” on page 47.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 69/168

Chapter 7. Deploying Real-time Compression Appliances55

Adding a bondIn order to add a new bond, follow these steps:

1. On the Network Configuration page, click Add New Bond. The panel form is displayed(Figure 7-8).

Figure 7-8 Add new bond - choosing modes 

The compression engine adds a new bond and names automatically it by incrementing theprevious bond number by 1 (starting with bond0).

2. On the “Add a New Bond” page, select the bond mode as described in the next section.

Bond modesThere are three modes of bonding physical adapters:

EtherChannel: Use when configured to operate with EtherChannel port aggregation.

Active-backup: Use when configured to operate with active/passive trunks (for example,Data ONTAP for IBM Systems Storage for N series single virtual interface).

802.3ad: Use when configured to operate with Link Aggregation Control Protocol (LACP)dynamic port aggregation.

Continue with choosing the desired bond mode as follows:

1. Choose the bond mode and then click Accept.

2. In the Modify Bond panel showing bond0, configure the Bond Mode and Interfaces asshown in Figure 7-9. For the physical port layout of the appliance, see 4.3, “Rear-panelcomponents” on page 27.

Tip: The bond can be used for failover or for higher throughput. In order to make sense ofa bond configuration, you need to configure, at the storage level, a round robin loadbalancing or a failover or both, between two or more physical ports. For a deeperunderstanding of this, see Example 6-1 on page 41.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 70/168

56  Introduction to IBM Real-time Compression Appliances

Figure 7-9 Add new bond - choosing interfaces 

3. After you finish selecting the interfaces, apply Accept Changes to bond0. Then clickGo Back to Network Configuration. In the Network panel, you can review your newlyconfigured bond. By clicking it, you are able to go back to the Modify Bond panel. SeeFigure 7-10.

Figure 7-10 Add new bond - checking the bond configuration 

Tip: The configuration of a bond can be modified later, based on your infrastructure needs.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 71/168

Chapter 7. Deploying Real-time Compression Appliances57

Adding a bond is a procedure that you can perform using the CLI. The command used isshown in Example 7-5.

Example 7-5 Bond command structure 

bond create BondInterfaceName -t [bond mode] [PhysicalInterfaceName...]

The bond command syntax is as follows:

BondInterfaceName: Must have the following structure “bond[1 to 12]. Comparing to theGUI here, you can define bonds without incrementing the previous number starting from 0.

bond mode: See “Bond modes” on page 55.

PhysicalInterfaceName: Defines the interfaces that should be included in bondsseparated by space.

You can use the bond command to list the current bond configuration. In Example 7-6, wecreate a second bond using the CLI by SSH connection.

Example 7-6 Add new bond using CLI 

[email protected]> bondBond Mode Interfacesbond0 EtherChannel eth4 eth8

[email protected]> bond create bond1 -t EtherChannel eth5 [email protected]> bondBond Mode Interfacesbond0 EtherChannel eth4 eth8bond1 EtherChannel eth5 eth9

7.5.2 Creating bridges

To create a bridge using the GUI, proceed as follows:

1. From the GUI interface left panel, choose Network (see Figure 7-4 on page 51).

2. From the Network panel select Add New Bridge (see Figure 7-10 on page 56).

3. In the new panel (see Figure 7-11 on page 58), select Accept.

4. The system now generates a new bridge name and you are able to review it on theNetwork Configuration page below the ports and any configured bonds.

Important: A physical interface cannot belong to two different bonds at the same time.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 72/168

58  Introduction to IBM Real-time Compression Appliances

Figure 7-11 Add new bridge 

5. On the Network Configuration page, click the bridge name (br0) as shown in Figure 7-12 to review the information.

Figure 7-12 Add new bridge - list current configuration 

6. In the next panel, named “Modify Bridge” (see Figure 7-13 on page 60), select the physicalor logical interfaces that are part of the bridge.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 73/168

Chapter 7. Deploying Real-time Compression Appliances59

The IP address used for the bridge is used for discovering shares and exports from thestorage system. This IP address must be in the same network as the IP address of thestorage system connected to the interfaces of the specific bridge.

The bridge IP address is also used by the auto-support, diagnostics features for shares,and exports discovery, as well as by the various network probes. Client communication tothe storage system will continue to use the storage system IP address as endpoint.

At the storage level, the client IP address will be detected while discovery process occurs.

7. For using VLANs, you have to provide the following information (see Figure 7-13):

– VLAN ID: A unique number between 1 and 4094 that identifies a particular VLAN.VLAN ID 1 is typically reserved for the default VLAN.

– IP: The IP address of the bridge port. The IP address must be in the same subnet as

the assigned storage server.

– Subnet: The network mask of the IP address.

– Gateway: The default gateway IP address for that bridge.

– MTU: An optional maximum transmission unit size. The default value is 1500.

8. Click Accept Changes to VLAN if you configured a VLAN and want to apply changes tothe bridge name to complete the configuration. The system creates the bridge anddisplays a success message. Click Back to Network Configuration to display the currentconfiguration.

Tip: When using bonds, select the bonds to configure; otherwise, select the twophysical ports (storage port and network port). Mixing bonds with physical interfaces isnot allowed.

Important: Consider these important points when using bonds: A physical interface or a bond cannot be part of two bridges in the same time.

A bridge can have only two members of logical or physical interfaces.

Physical network interfaces are identified during the boot process, before thecompression engine is active. This can affect configurations with active/passive linksor bonds, such as IBM N series single vif and EMC Fail-Safe Networking thatinclude favoring a particular link (or bond) in case a failover of the storage systemstakes place during the RTCA boot process. It is important to notice that this issue isonly relevant for single links or EtherChannel bonds. LACP bonds are unaffected bythis issue are therefore the best bond type.

Important: When configuring VLAN-tagged bridges, a top-level bridge IP configurationis required. The top-level bridge can use any subnet.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 74/168

60  Introduction to IBM Real-time Compression Appliances

Figure 7-13 New bridge parameters.

9. After completing the bridge configuration, you can start up the Real-time CompressionEngine. After a successful start, go on the Status Panel and verify if all indicators aregreen (see Figure 7-14).

Figure 7-14 Checking the RTCA Engine status 

Important: A bridge configuration cannot be changed while the compression engine isstarted. In order to change a bridge configuration, you must stop the compression engine.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 75/168

Chapter 7. Deploying Real-time Compression Appliances61

To create a bridge by using the CLI, proceed as follows:

1. Use the bridge command. The command used to create a new bridge has the structureshown in Example 7-7.

Example 7-7 Bridge command structure 

bridge create BridgeIfName [-i BridgeIP -s BridgeMask [-b broadcastMask] [-gw

GateWay]]

2. Define the following parameters:

– BridgeIfName - the name of the bridge you want to create. The name must containbr[number of the bridge].

– Bridge IP - the IP address used by the bridge in the network.

 – BridgeMask 

 – GateWay

3. Add the logical or physical interfaces to the bridge, as shown in Example 7-8.

Example 7-8 Add new interfaces to the bridge 

bridge addif BridgeIfName InterfaceA InterfaceB

Example 7-9 presents the complete sequence shown before by using the GUI, but done herefrom the CLI, using the bridge command and the engine start command.

Example 7-9 Add new bridge 

[email protected]> bridgeNo bridges or vlans have been defined

[email protected]> bridge create br0 -i 192.168.0.110 -s 255.255.255.0

[email protected]> bridge

Bridge IP Netmask Broadcast Gateway MTUbr0 192.168.0.110 255.255.255.0 192.168.0.255 - 1500Interfaces-

[email protected]> bridge addif br0 bond0 [email protected]> bridgeBridge IP Netmask Broadcast Gateway MTUbr0 192.168.0.110 255.255.255.0 192.168.0.255 - 1500Interfacesbond0 bond1

[email protected]> engine startEngine started successfully

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 76/168

62  Introduction to IBM Real-time Compression Appliances

7.6 Configuring high availability

Continuous data access to network storage solutions involves a redundant and fault-tolerantnetwork infrastructure and a highly available storage solution with built-in data protectionfeatures. The IBM Real-time Compression Appliance product integrates into all highavailability topologies and configurations seamlessly, without introducing any new single point

of failure or degradation of the service level that is offered by the storage and networkingequipment.

If a network link of any of the bridge interfaces fails for any reason (such as switch poweredoff or cable disconnected), the corresponding NAS-connected port of the same bridge is shutdown as well to reflect the status of the network. This feature makes the compressionappliance consistent with the configuration in place before connecting the IBM Real-timeCompression Appliance.

The following list summarizes four possible topologies for high availability:

Active/passive at access path, defines path failover Active/active link aggregation, using vifs

Path failover using two switches Clustered environment

For detailed descriptions, see Chapter 6, “Implementation planning” on page 37 and theIBM RTCA Administration Guide available at the following website:

http://www.ibm.com/support

Because IBM has developed a unique link status mirroring (LSM) feature to support variouslink aggregation and high availability configurations, this feature helps the compressionappliance to integrate transparently and seamlessly into the high availability configuration inplace. LSM reflects the link status of interfaces that are members of the same virtual bridgeinterface in the compression appliance configuration.

Keep in mind that the RTCA product will preserve performance and availability configurationsfor the back-end NAS. If the NAS configuration is not configured to assure high availability, theRTCA product will offer the same level after complete installation (that is, single filterconfigurations or vifs created using single physical interfaces are not consider to be highavailability topologies).

The high availability synchronization option allows you to export the compression appliancecompression filters to a different appliance in a high availability configuration. There aremanual and automatic modes for synchronizing a high availability configuration.

As described previously, there are two types of information that can be set on the RTCAproduct regarding the compression process:

Compression Filters: Shares from the NAS storage that will be included in the

compression process.

File Extensions to exclude: Types of files that will not be compressed but will be “dropped”as they are on the share.

You have two options to configure the high availability function on the RTCA product:manually or automatically. Details are discussed in the following sections.

Tip: When you configure a compression appliance in a high availability configuration, bothappliances must have the same compression filters and file extension set.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 77/168

Chapter 7. Deploying Real-time Compression Appliances63

7.6.1 Synchronizing high availability manually

In order to create a manual synchronization, you have to export the current configuration ofthe filters from one appliance, and then import it on all other partner appliances.

Proceed as follows:

1. From the management interface, choose High Availability in order to open the HighAvailability panel (see Figure 7-15).

Figure 7-15 Configuring High Availability 

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 78/168

64  Introduction to IBM Real-time Compression Appliances

2. From the top menu, select MANUAL. In the new panel, select Exports For HighAvailability. Choose to save the *.stn file on a preferred path as shown in Figure 7-16.

Figure 7-16 Exporting the configuration for High Availability 

3. Next, log in to the other compression appliance that you want to configure in the highavailability configuration. Have prepared the file that was saved from the first appliance,and this time select Browse from the Import field (see Figure 7-16). Locate yourpreviously saved *.stn file and upload it on the new appliance. If the configuration was

imported successfully, the success message shown in Figure 7-17 will be displayed.

Figure 7-17 Importing the configuration for High Availability 

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 79/168

Chapter 7. Deploying Real-time Compression Appliances65

After a successful configuration, the newly added appliance will return to you a message withthe new imported configurations.

Be aware that for a manual configuration, the modifications (new/deleted filters, and new fileextension exclusions or extensions) made on one appliance will not be sent to the otherpartners automatically. You will have to export them and import them every time you arechanging any settings.

7.6.2 Synchronizing high availability automatically

If you want to configure the high availability to update the changes automatically, you can

configure the Management IPs on one appliance, and credentials for all other appliances.The distribution will be made automatically after that in a mesh topology.

Proceed as follows:

1. Starting at the Main panel, select the High Availability panel (see Figure 7-15) andchoose the options that you want to be automatically synchronized between the HApartners: File Extensions and Filters.

2. Define the name that you want to appear on the other appliance as the high availabilitypartner. This name is different than the one described before in 7.4, “Configuring theRTCA product” on page 50. This name function is only descriptive and is not mandatory tocomply with the RTCA name, which is configured for management purposes.

3. In the “Remote Partner List” you must enter the IP address of the high availability partnertogether with the User name and password used to manage the partner appliance. Afterfinishing completing these fields, select Apply Changes and Synchronize.

4. A message will confirm to you that the partner has been found, and the Shared Serverslist will show you the common storage devices that are configured on both appliances (seeFigure 7-18). For these storage devices, the appliances will exchange information everytime when something is changed in the filters or file extension configuration.

Errors: The high availability configuration returns an error message in these situations:

The Storage device, NAS, is not configured on all appliances that have access to it withthe same name for the same share - different filters interpretation.

The File extensions exclusions are configured differently on the appliances involved inhigh availability.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 80/168

66  Introduction to IBM Real-time Compression Appliances

Figure 7-18 Configuring the filters and file extension automatic synchronization 

In case that some File Extensions are configured wrongly the following error message canappear asking you if there the RTCA product can perform a forced configuration on theremote partner (see Figure 7-19).

Figure 7-19 High Availability Auto Synchronization Error message 

Tip: Be aware that all appliances must be able to communicate at the managementinterface level in order to synchronize the filters and file extension exclusions.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 81/168

Chapter 7. Deploying Real-time Compression Appliances67

7.6.3 Configuring high availability from the command line interface

All steps described before can be performed using the CLI. The command used to configurehigh availability configuration is partner. A general overview of the commands andassociated options to do so can be found in Example 7-10.

Example 7-10 Partner command 

partneradd -i IPRemote -u userName -p passwordcheckdelete name

{disable | enable}globalsyncextensionsyncsync name}

sync_all forceset name

localPartnerName

The parameters from Table 7-2 can be applied by using the partner command.

Table 7-2 Partner command parameters 

Parameter Description

IpRemote Specifies the IP address of the remote appliance.

userName The name used to log on at the remote appliance.

password The password used to access the remote appliance.

add Adds a new partner appliance.

check Checks that the appliance configuration is synchronized with its par tners.

delete Deletes a par tner appliance from the synchronization configuration.

globalsync Enables or disables the automatic synchronization of filters.

extensionsync Enables or disables the automatic synchronization of files extensions.

set name Sets up the name of the current appliance.

sync Synchronizes filters with a partner appliance.

sync_all force Synchronizes filters with all partners and automatically forces updates to allpartners.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 82/168

68  Introduction to IBM Real-time Compression Appliances

An example regarding the usage of partner command and configuration of high availability ispresented in Example 7-11.

Example 7-11 Configuring high availability 

[email protected]> partnerEnable Auto Sync: No

Enable File Extension Sync: NoAppliance HA Name: TestIP Name AutoSync LastSyncDate Shared Servers

[email protected]> partner enable globalsync

[email protected]> partner enable extensionsync

[email protected]> partner set name RtCA1

[email protected]> partnerEnable Auto Sync: YesEnable File Extension Sync: Yes

Appliance HA Name: RtCA1IP Name AutoSync LastSyncDate Shared Servers

[email protected]> partner add -i 9.155.66.158 -u user -p a1b2c3

[email protected]> partner sync RtCA2Partner synced successfully

[email protected]> partnerEnable Auto Sync: YesEnable File Extension Sync: YesAppliance HA Name: RtCA1

IP Name AutoSync LastSyncDate Shared Servers9.155.66.158 RtCA2 Yes Mon Apr 4 18:23:01 CEST 2011192.168.0.10,192.168.0.20

After configuring the RTCA bridges, bonds, and high availability functions, the next step inorder to finish the installation of the device is to upgrade the firmware in case an upgrade isavailable. For a detailed procedure showing how to perform a firmware upgrade, seeChapter 8, “Administration” on page 69.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 83/168

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 84/168

70  Introduction to IBM Real-time Compression Appliances

8.1 Working with the IBM Real-time Compression Appliance

After hardware installation and initial configuration, you can use the web interface to furtherconfigure the IBM Real-time Compression Appliance (RTCA).

8.1.1 The web interface

This topic provides a brief overview of the IBM Real-time Compression Appliance web-basedadministration tool and describes the elements of the compression appliance web-basedadministration tool.

Each page in the web interface has a structure that is consistent with the page that isdisplayed in Figure 8-1, including a menu pane and an input area. The link in the lower rightcorner displays the direction to the next step and displays only on some pages.

Figure 8-1 IBM Real-time Compression Appliance web interface 

8.1.2 The menu

The main page has a menu bar on the left that consists of three main menu options:Configuration, General, and Administration.

The Configuration menu contains the following options:

Management Port: Used for configuring the compression appliance management port.

Network: Used for configuring the compression appliance data ports, creating bonds andbridges, and stopping and starting the compression engine.

Storage: Used for configuring which storage systems the compression applianceconnects to.

Compression Filters: Used for configuring which CIFS shares and NFS exports have to becompressed.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 85/168

Chapter 8. Administration71

The General menu contains the following options:

Status: This page provides an overview of the compression appliance configuration,status, network ports, and resource utilization. This is also the main page displayed afterthe login is performed.

High Availability: Used for configuring the high availability of the compression appliance.

SNMP: Used for configuring SNMP settings.

LDAP: Used for configuring LDAP settings.

Security: Used for changing the compression appliance login password and specifying theIP addresses that can access the management interface.

System Options: Used for configuring various settings, such as web interface accessprotocol (HTTP and HTTPS), SNMP and other compression engine settings.

Miscellaneous: Used for setting the current date, time, and web interface session time-out;resetting the statistics counters; and configuring remote syslog servers.

The Administration menu contains the following options:

Upgrade: Used for upgrading the software version. For more information, see Upgrading 

the compression appliance software .

HW Configuration File: Used for installing and reviewing the compression appliancehardware configuration file.

Configuration Backup: Used for saving or restoring the compression applianceconfiguration settings. For more information, see Backing up the configuration.

Diagnostics: Used for saving system logs and downloading diagnostic information.

Maintenance: Used for either shutting down or rebooting the system.

About: Used for viewing details of the software components versions installed.

Logoff: Used for logging out of the web interface.

8.1.3 Input area

Each page displays information according to the selected menu option. Parameters and otherinformation items are displayed and can be configured here.

The next step to be performed is displayed in the lower right-hand corner of each page and isoptional (see Figure 8-1).

8.1.4 Connecting to the web interface and access permissions

You can find information about how to connect to the RTCA using a web browser in7.4, “Configuring the RTCA product” on page 50.

Reference: See the IBM Real-time Compression Appliances Installation and Planning Guide for information about configuring remote management, bonds, bridges, storageservers, and compression filters.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 86/168

72  Introduction to IBM Real-time Compression Appliances

8.2 Configuring compression accelerator

This topic provides a description of configuration options to be used when configuring theCompression Accelerator feature.

Before you begin, configure the compression filters for the shares and exports that need to be

compressed by Compression Accelerator.

By default, only newly written data is compressed on shares that are configured withcompression filters; existing files that are not updated are not compressed. The compressionaccelerator feature on the Storage page can be configured to compress existing files inspecified shares.

8.2.1 Compression accelerator procedure

Following is a step-by-step process showing how to configure the compression accelerator:

1. On the Storage page (Figure 8-2), click Configure on the Compression Accelerator tab.The Compression Accelerator page opens.

Figure 8-2 Storage configuration 

2. Start the compression appliance.

3. When you compress NFS exports using Compression Accelerator, verify that the export

provides read/write access to the bridge IP addresses.4. When you compress CIFS shares using the Compression Accelerator, configure a user

name, password, and domain name in the CIFS user name, CIFS password, and CIFSdomain fields, respectively, and click Apply Changes.

Tip: Configure a CIFS user with read/write permissions on files that are processed bythe compression accelerator.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 87/168

Chapter 8. Administration73

The Compression Accelerator supports various configuration parameters for scheduling,throttling, and policy-based file optimization that you can use to fine-tune the process.Figure 8-3 shows the Compression Accelerator Configuration items.

Figure 8-3 Compression accelerator settings 

The Compression Accelerator Shares tab allows you to select the CIFS shares on the storageto be compressed in place (Figure 8-4).

Figure 8-4 Compression accelerator shares tab 

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 88/168

74  Introduction to IBM Real-time Compression Appliances

The Compression Accelerator Exports tab allows you to select the NFS exports on thestorage to be compressed in place (Figure 8-5).

Figure 8-5 Compression Accelerator Exports tab 

The Compression Accelerator Status tab allows you to manage and monitor compressiontasks (Figure 8-6).

Figure 8-6 Compression Accelerator Status tab 

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 89/168

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 90/168

76  Introduction to IBM Real-time Compression Appliances

YYYYMMDD The file time stamp in the format: YYYY (year), MM (month), DD (day ofweek).FileExt The file extension of the file. Example:((size > 9000) or (ctime >20080304)) andmtime=20080909 and ext ='doc' The default policy is size > 512. Using the default,only files larger than a compressed file header size (512 bytes) are compressed.

– Directories to Ignore: Define the subdirectories to ignore when the task is processed inthe entire share or export using the Directories to Ignore field. Use this option forvarious types of snapshot or backup directories, which usually have the same name. Itis sufficient to specify only a directory name and not its path. The default policy is asfollows:

.snapshot ~snapshot .ckpt .isilon .ifsvar

– Maximum Total Throughput: Define compression I/O throttling in MB/sec using theMaximum Total Throughput field. When the throughput of write I/O that is directedtoward the NAS IP address that was configured on the Storage page reaches the limitspecified in this field, Compression Accelerator stops adding new files to itscompression queue until the throughput drops below the specified threshold.

– Amount of Changes: Define a quota (in MB/hours) for the aggregated changes that canbe written to the NAS server within the defined number of hours using the Amount ofChanges field. Define values that reflect the rate of change as observed on the NASsystem; for example, in N series snap delta output.

– Free Space Threshold: Set a minimum percentage of free space in the Free SpaceThreshold field and then click Apply Changes. Compression Accelerator In-Placetasks automatically pause if this threshold is exceeded. The default setting is 5%.

– Interval Between Files: Define the interval (in milliseconds) between new files enteringthe compression accelerator queue using the Interval Between Files field. The valuecan be in the range 1 - 10000; the default value is 10 milliseconds. Increasing thisvalue reduces the load on the storage; however, it slows the compression. Setting theinterval to 1 millisecond provides the highest compression throughput.

3. Click Save Configuration to apply the settings.

4. Select the shares or exports to compress from the list of available compression filters andthen click Update List.

Results: After applying the configuration and adding the shares, the CompressionAccelerator Configuration page opens showing the changes.

NAS: The free disk space verification relies on reporting that is provided by theNAS. The NAS configuration items such as quotas can affect the behavior of thisfeature.

Tip: Avoid adding the NAS root file system (for example, /vol/vol0 in N series systems)to the Compression Accelerator task list. Adding this file system to the task list can

result in compression of the storage system files, which are read directly by the NASsystem and therefore must remain uncompressed.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 91/168

Chapter 8. Administration77

8.2.3 Monitoring the Compression Accelerator

You can start and monitor the Compression Accelerator processes (see Figure 8-8).

The following procedure shows how to perform the task:

1. Click Start.

Figure 8-8 Compression Accelerator Status tab 

2. Click Refresh in the upper-right corner of the menu to refresh the page.

3. View the Compression Accelerator status under Current Status. The following states arepossible:

– Not started: The compression accelerator process has not started.– Pending: The compression accelerator process is busy mounting an export.– Started: The compression accelerator process has started.– Finished: The compression accelerator process has finished processing all exports or

shares and has now stopped.

4. View information about the configured compression tasks:

– Export or Share: The name of the export or share that is configured for compression.

– Type: NFS or CIFS

– State: The state of the compression task for this export or share; the following valuesare possible:

• Not running: The compression task for this export or share is not running.• Started: The compression task is running.• Pending: The compression task is pending, for example, when another task is

running.• Paused: The compression task is paused because a configured threshold has been

reached.

Status: The status is updated in real time on the page and shows the files that arecurrently being compressed.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 92/168

78  Introduction to IBM Real-time Compression Appliances

• Unmounting: The compression task is disconnecting from the export or share.• Finished: The compression task has finished.

– Number of Files processed: Total number of files that have been processed by thecompression accelerator.

– Number of Files scanned: Total number of files that have been scanned by thecompression accelerator.

– Total Data processed: Total amount of data that has been processed by thecompression accelerator.

– Total Data scanned: Total amount of data that has been scanned by the compressionaccelerator.

– Start Time: The start time of the compression task.

– End Time: The end time of the compression task.

8.2.4 Resetting the accelerator log

You can reset the Compression Accelerator log. To do so, click Reset Log File For

<server_name> at the bottom of the Compression Accelerator Configuration page.

8.3 High availability concepts

The high availability (HA) concept for the IBM RTCA refers to both the appliance configurationand external environment configuration. Because the IBM RTCA is acting as an intelligent cable without involvement in the TCP/IP traffic management, but only reducing the amount ofdata from IP frames, the way high availability is implemented is different from other similarimplementations. When you configure a compression appliance in a high availabilityconfiguration, both appliances must have the same compression filters because the dataflows are not under RTCA care but more on the network and storage mechanism.

The important aspect in RTCA HA implementation is to be sure that if failover occurs and thedata becomes accessible over the second appliance, the filters are also in place and userswill not connect directly to an uncompressed volume. A procedure for synchronizing the filtersis given in 7.6, “Configuring high availability” on page 62. Suggested configurations to achievehigh availability can be found in Chapter 6, “Implementation planning” on page 37 andChapter 9, “NAS / N series solution design” on page 123.

Another very important aspect is the configuration of the appliance behavior as Compress orNot Compress and No New Compression activation. These topics are described in 8.4,“Configuring storage and compression filters”.

Important: When synchronizing the filters, you need to know that if there are differences,the filters from the target appliance or partner will be deleted and replaced with the filtersfrom the initiator of the sync procedure. In this situation, if on the target appliance there aresome filters that are not created on the sync initiator, those filters will be lost and thecompressed volumes can become accessible directly by the user. In this situation, youmight affect data integrity by changing the information without being aware that data iscompressed, not affected or compromised. This situation can apply also when you breakthe high availability pair, remove the Sync Pair, and modify the filters on both appliances.When rebuilding the high availability pair, filters are replicated in one way and thedifferences are replicated at this stage, also in one way.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 93/168

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 94/168

80  Introduction to IBM Real-time Compression Appliances

8.4.1 Transparent mode

The transparent mode is the default in the software version 3.7. If you have a lot of NASresources at your NAS storage server that must not be compressed, such as datacompressed by an ECM application in many shares, and you want to compress only a part ofyour NAS storage server, it is best to use the transparent mode.

To switch to the transparent mode, proceed as follows:

1. Set the option “Compress Mode” to disabled. Click System Option under the Generalsection and then click disabled in the row “Compress Mode” as shown in Figure 8-10.

Figure 8-10 Compress Mode Disabled, No New Compression Disabled 

2. If you want to enable the “No New Compression” configuration capability, you have to setthe system option “No New Compression” to enable.

The option “No New Compression” unhides the drop-down box in the “CompressionFilters” menu under the Configuration section to switch on or off the condition that newdata will be written pass-through or compressed. Click System Options under theGeneral section and then click Enable in the row “No New Compression,” as you can seein Figure 8-11.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 95/168

Chapter 8. Administration81

Figure 8-11 Compress Mode Disabled, No New Compression Enabled 

The configuration of compression of shares/exports can be done on the “CompressionFilters” menu under the “Configuration” section, as shown in Figure 8-12 for CIFS and inFigure 8-13 for NFS. You can see CLI examples in Example 8-2.

3. To create a new compressed share, select the share from the drop-down box or type theUNC name of the share manually in the appropriate field and click Apply changes toShares/Exports. Additionally you can add some file extension in the field “Extension to

exclude” to avoid double compressing of compressed data.

The impact of the NNC switch is as follows:

– If you set the NNC option to “off”, all new data in the corresponding share/export will becompressed.

– If you set the NNC option to “on”, any new written data will not be compressed.

However, independently of the NNC switch, all existing data will not be changed.

4. To remove a compressed share/export from the filter list, mark the Delete check box of thecorresponding share/export and click Apply Changes to Shares/Exports.

Tip: If you delete a share/export from the list, all data will be unchanged and presented to

the clients directly without passing the compression engine. If the share/export containcompressed data, you can only access them after manually recovery; see “Recoveringfiles when appliance is unavailable” on page 119.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 96/168

82  Introduction to IBM Real-time Compression Appliances

Figure 8-12 Compression filters CIFS 

Example 8-2 creating a compression filter for CIFS by command line 

[email protected]> filter add bran1b -c nocheck -t cifs homeTransparent - - \\bran1b\C$Transparent - - \\bran1b\D$Transparent - - \\bran1b\E$Transparent - - \\bran1b\ETC$Transparent - - \\bran1b\F$Transparent - - \\bran1b\HIDDEN$Transparent - - \\bran1b\IPC$Transparent - - \\bran1b\home

Tip: The column NNC is only displayed if the system option “No New Compression” is setto enabled.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 97/168

Chapter 8. Administration83

Figure 8-13 Compression filters NFS 

Example 8-3 Creating a compression filter for NFS by CLI 

[email protected]> filter list available -t nfsbran1:/vol/bran1abran1:/vol/bran1bbran1:/vol/databran1a:/vol/bran1a/databran1a:/vol/bran1a/rootbran1b:/vol/bran1b/data

bran1b:/vol/bran1b/rootbran2:/vol/databran2:/vol/vol0bran2:/vol/vol0/home

[email protected]> filter add bran1b -c check -t nfs /vol/bran1b/[email protected]> filter list -t nfsCompression Mode No New Compression Warnings Share/ExportCompressed Off - bran1:/vol/dataTransparent - - bran1b:/vol/bran1b/dataTransparent - - bran1b:/vol/bran1b/rootCompressed Off - bran2:/vol/data

8.4.2 Compress mode

In large environments with a lot of NAS resources that you want to compress, it can be easierto switch the system-wide policy to compress mode. An additional advantage of compressmode is the possibility to compress data of dynamic shares, such as home directory shares ofNetApp FAS or IBM N series in an easier way without creating a dedicated compression filterfor every share.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 98/168

84  Introduction to IBM Real-time Compression Appliances

To switch the RTCA to compress mode, proceed as follows:

1. Set the option “Compress Mode” to Enabled. Click System Options under the Generalsection and then click Enable in the row “Compress mode” as you can see in Figure 8-14.

Figure 8-14 Compress mode enabled 

After you have enabled the compress mode, the option “No New Compression” is enabledautomatically. Now you have the choice of using both modes at the NAS storage level:

– Transparent mode– Compress mode

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 99/168

Chapter 8. Administration85

In Figure 8-15 you can see the new menu for configuring storage servers. For everystorage server, you can configure the compression mode independently.

Figure 8-15 Compress mode and transparent mode for different storage servers 

2. Choose Compressed from the drop-down box and click Apply changes. Alternatively,change the compress mode by using the CLI, as shown in Example 8-4.

Example 8-4 Changing compress mode by CLI 

[email protected]> server display bran1aServer Name Storage Vendor Storage IP Mode No New CompressionStatus Antivirus Server IPbran1a N-Series 192.168.0.11 Transparent -Active

[email protected]> server change bran1a -m Compressed -noNewCompression onServer successfully changed

[email protected]> server display bran1aServer Name Storage Vendor Storage IP Mode No New CompressionStatus Antivirus Server IPbran1a N-Series 192.168.0.11 Compressed OnActive

The data of a storage server in transparent mode will be handled as described in“Transparent mode” on page 80.

Attention: A transition from compressed mode to transparent mode is not allowed.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 100/168

86  Introduction to IBM Real-time Compression Appliances

When converting a storage system from transparent mode to compressed mode, thecompression filters for this storage system will be modified accordingly to preserve theexisting configuration.

Administrators must check the compression filter exclusion list so that all administrativeshares or exports are included. Otherwise the RTCA will store configuration files of theroot directory or etc$ share as compressed files.

Writing compressed data to administrative shares or exports, which contain the storagesystem's operating system and configuration parameters (such as /vol/vol0), can causesevere storage system functionality issues. If you have a virtual filer (vfiler) configured, itmight be necessary to add the root qtrees/volumes of vfiler manually; see Figure 8-16.

3. To complete the conversion of your NAS storage server, select off on the drop-down box“NNC” and click Apply Changes, as shown in Figure 8-15 on page 85, or change it by CLIas you can see here in Example 8-5.

Example 8-5 Changing No New Compression using the CLI 

[email protected]> server change bran1a -noNewCompression offServer successfully [email protected]> server display bran1aServer Name Storage Vendor Storage IP Mode No New CompressionStatus Antivirus Server IPbran1a N-Series 192.168.0.11 Compressed Off Active

After the conversion is complete (that is, the storage system is now configured incompressed mode), by default, all new shares or exports created on the storage systemand accessed through this interface will be compressed (Figure 8-16).

Figure 8-16 Compression filter, exclude administrative shares/exports of vfiler manually 

Tip: For security reasons, the NNC option is set to “on” for a freshly converted storageserver. This means that no data will be compressed until this option is set to “off”.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 101/168

Chapter 8. Administration87

“No New Compression” sets the operation mode for new files created on shares andexports marked for compression using the compression filters mechanism. After settingthis mode to Off, new files will be created as compressed or non-compressed, based onthe compression mode in the compression filters list.

In Figure 8-17 you can see the default administrative shares of \\bran1b after conversion.The Compression mode for these shares is configured as “Transparent”.

Figure 8-17 Compression filter in RTCA compress mode, default administrative shares 

If the storage server will be operated in compress mode, it is not necessary to create anynew compression filter for new created shares and exports.

To disable the compression of specific shares or exports, create those shares or exportson the storage system, and then add them to the compression filters exclusion list whilethis storage server is configured in “No New Compression” (NNC) mode.

4. Open the CIFS/NFS filters menu by clicking Compression Filters under the“Configuration” section. Now you can either select the share from the drop-down box ortype it manually. Click Apply changes to Shares/Exports” to finish, as you can see inFigure 8-17. The configuration steps to add a compression filter exclusion using the CLIare shown in Example 8-6.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 102/168

88  Introduction to IBM Real-time Compression Appliances

Example 8-6 Creating a compression filter exclusion for NFS by CLI 

[email protected]> filter list available -t nfsbran1:/vol/bran1abran1:/vol/bran1bbran1:/vol/databran1a:/vol/bran1a/data

bran1a:/vol/bran1a/rootbran1b:/vol/bran1b/databran1b:/vol/bran1b/rootbran2:/vol/databran2:/vol/vol0bran2:/vol/vol0/home

[email protected]> filter add bran1a -t nfs /vol/bran1a/[email protected]> filter list -t nfsCompression Mode No New Compression Warnings Share/ExportCompressed Off - bran1:/vol/dataTransparent - - bran1a:/vol/bran1a/rootTransparent - - bran1b:/vol/bran1b/data

Transparent - - bran1b:/vol/bran1b/rootCompressed Off - bran2:/vol/[email protected]>

8.5 Monitoring the compression appliance

The management of the RTCA can be done by using the CLI or GUI. For most use cases, theGUI would provide an easier approach, but we also describe the CLI commands used in ourexamples. The main tasks for management are as follows:

Displaying compression appliance status: Compression appliance status informationavailable on the Status page.

Displaying storage status: Review information about the connectivity status of each fileserver or NAS.

Displaying compression status: Describes how to display information about thecompression engine, including the status of the shares and exports and the file nameextensions excluded from compression.

Configuring SNMP: Configure and modify the SNMP configuration settings.

Configuring LDAP: Configure and modify the LDAP notification settings.

Performing other compression appliance tasks: Set the time and date, reset compressionstatistics, configure the web interface session time-out, configure an external syslog

server, and configure DNS.

In the following sections, we describe these main tasks in detail.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 103/168

Chapter 8. Administration89

8.5.1 Displaying compression appliance status

A general view of the Status panel is shown in Figure 8-18.

Figure 8-18 Status panel overview 

On the status page, use the panel components as follows:

1. Device Information (Figure 8-18): Data about the compression appliance hardware andsoftware. Use this panel to see the following device information:

– Product: The compression appliance model.– Hostname: The compression appliance host name.– Version: The compression software version ID.– Serial Number: The compression appliance serial number.

2. Status (Figure 8-18): The current state of the compression engine and various diagnosticprobes. Use this panel to see the following status information:

– Engine: The recent status of the compression engine, either running (green) orstopped (red).

– Bonds: The recent status of the bonding probe. This probe verifies whether ports ofLink Aggregation Control Protocol (LACP) bonds are connected according to theconfiguration. This probe uses LACP information that is available for each port to verifythat ports are connected correctly.

LACP: The LACP, also known as IEEE 802.3ad standard, is a port aggregationprotocol that allows for multiple network cables and ports to work in parallel toincrease the link speed beyond the limits of any one single cable or port, and toincrease the redundancy for higher availability.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 104/168

90  Introduction to IBM Real-time Compression Appliances

– Duplicate IPs: The recent status of the duplicate IP addresses probe. This probedetects whether there are any duplicate IP addresses in the network (using any of thecompression appliance bridge IP addresses).

– Gateways: The recent status of the default gateway probe. This probe detects whetherthere is access to the default gateways that are configured for the compressionappliance bridges. This probe uses Internet Control Message Protocol (ICMP) todetect connectivity to the default gateways.

– Vendors: The recent status of the storage vendor probe. This probe detects whetherthe NAS system vendor that was chosen on the Storage page matches the actualsystem vendor that was detected.

– Hardware: The current state of the hardware platform.This probe is using the hardwarealarms form the server to signal if there are any failed components.

3. Network (Figure 8-18): Use this panel to see the status of network ports (Figure 8-19).

Figure 8-19 Network interface legend 

The following interface status information is displayed:

– Interface Up: The interface is configured and the physical link is up - port green.

– Interface Down: The interface is configured and the physical link is down - port red.

– Not configured: The interface is not configured; the physical link state is unknownbecause the interface is shut down from the software - port grey.

4. Resource (Figure 8-18): Utilization Monitoring of various system resources andperformance metrics. Use this panel to see the following resources:

– CPU: Current compression appliance CPU utilization.

– System Memory: Total amount of RAM that is installed in the appliance.

– Engine Memory: Amount of memory that is currently allocated to the compression

engine.– CIFS Connections: Current and peak number of CIFS connections.

– NFS Connections: Current and peak number of NFS connections.

– Compression Rate: The percentage of capacity saved; as data passes through thecompression engine and gets compressed, the compression rate is calculated by theamount of data that has been saved (during write operations) compared to the totalamount of data that has passed through the compression appliance.

Probe: This probe uses information that is available in networking command outputson the compression appliance to detect duplicate IP addresses. The duplicate IPsprobe is checked only on the direct attached network (not on passing routers).

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 105/168

Chapter 8. Administration91

– Accumulated Space Savings: The accumulated amount of disk space that has beensaved by the compression over the complete runtime of the compression appliance orsince the time the space savings counter was reset.

5. From the CLI, use the following commands to monitor all previous parameters:

– Hostname (Example 8-7): Returns the name of your appliance. Also you can modifythe name of the appliance with this command.

Example 8-7 Hostname command output 

[email protected]> hostnameHostname: RtCA1

– Display (Example 8-8): With the “config” or “sensor” attribute will return most of thehardware, software and networking information. The values attributes for probingmodules are: green value is 1 and for red value is 0. Example 8-8 is displaying only theoutput for the display config command.

Example 8-8 Display command output 

[email protected]> display config

======================================== DNS ========================================DNS Enabled: noDNS Domain:DNS Search:

======================================== NTP ========================================There are no ntp servers defined======================================== SNMP ========================================SNMP Enabled Yessyslocation Computer roomsyscontactRead Only Community publicLow Free Memory Trap Interval (secs) 1800

Low Free Disk Space Trap Interval (secs) 1800Fan Failed Trap Interval (secs) 1800Power Supply Failed Trap Interval (secs) 1800High Temperature Trap Interval (secs) 1800Disk Failed Trap Interval (secs) 60

Trap Destination Trap Port (Default 162) Trap Community127.0.0.1 - public

======================================== SYSLOG ========================================Send messages: yesSend changelog: yesSend sw_hw_snmp: yes======================================== LDAP ========================================

LDAP: Disableduri:base:LDAP Server Type:binddn:bindpw: ******anonymous bind: noauthorization filter:

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 106/168

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 107/168

Chapter 8. Administration93

======================================== OPTIONS advanced========================================Key ValueCAInPlace:CAInPlaceMode 2General:logbuf 4General:logcifs 4General:logfs 4

General:lognfs 4General:logsock 4General:logutil 4General:noOcteon 1Z_OPTIONS:AutoSequenceTimeoutMins 30Z_OPTIONS:CAthreads 10Z_OPTIONS:engineWatchdog 1

– Engine (Example 8-9): Returns the status of the compression engine.

Example 8-9 Engine command output 

[email protected]> engineEngine: running

– Partner (Example 8-10): Returns the state and configuration of the high availabilityfeature.

Example 8-10 Partner command output 

[email protected]> partnerEnable Auto Sync: YesEnable File Extension Sync: YesAppliance HA Name: RtCA1

IP Name AutoSync LastSyncDate Shared Servers9.155.66.158 RtCA2 Yes Wed Apr 13 12:53:08 CEST 2011192.168.0.11,192.168.0.10,192.168.0.20,192.168.0.12

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 108/168

94  Introduction to IBM Real-time Compression Appliances

8.5.2 Displaying storage status

To display the storage status, proceed as follows:

1. From the left panel, choose Storage to view the current status of your storage device.

Figure 8-20 Storage status monitoring 

The Storage panel provides information about the connectivity status of each fileserver/storage.

There are three possible states for the Status parameter:

– Not Connected: The compression appliance is unable to reach the file server.– Active: The compression appliance is connected in a high availability configuration and

is currently the active appliance for this file server.

– Standby: The compression appliance is connected in a high availability configurationand is currently the passive appliance for this file server.

2. To monitor the storage systems from the CLI, use the server command as shown in

Example 8-11. Here you can see the output of this command.

Example 8-11 Server command output 

[email protected]> serverServer Name Storage Vendor Storage IP Mode No New Compression Statusbran1 N-Series 192.168.0.10 Transparent - Activebran1a N-Series 192.168.0.11 Transparent - Activebran1b N-Series 192.168.0.12 Transparent - Activebran2 N-Series 192.168.0.20 Transparent - Standby

Attention: The columns “Compression Mode” and “NNC” (No New Compression) areavailable for settings only if, from the “System Options,” you choose to enable them. The“Compression Mode” setting will automatically activate the “NNC” option.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 109/168

Chapter 8. Administration95

8.5.3 Displaying compression statusTo view the compression status at each volume level, proceed as follows:

1. ,Navigate to Diagnose from the left panel and then choose the Display CompressionFilters option (Figure 8-21).

Figure 8-21 Compression filters status 

This page displays information about the compression engine, including these items:

– Status: Lists the status of each of the CIFS shares and NFS exports that are definedon the Compression Filters page.

– CIFS shares: Lists the status of the CIFS shares that were defined in the CompressionFilters page.

– NFS Exports: Lists the status of the NFS exports that were defined in the CompressionFilters page. Child exports are displayed indented under the parent.

– File name extensions: Lists those that are excluded from compression. Displays anyfile name extensions that have been configured to be excluded from compression.

Tip: There could be several reasons why a file server is unreachable. For example, theserver might be physically disconnected, the network switch port settings might beincorrect (wrong VLAN), and so on.

Status: A green status indicates that the share/export exists and compression isapplied for the share/export. A red status indicates that compression is not applied forthe share/export.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 110/168

96  Introduction to IBM Real-time Compression Appliances

2. From the CLI, use the filter command with the list parameter, as shown inExample 8-12.

Example 8-12 Filter output command 

[email protected]> filter list available -t cifs\\bran1\data

\\bran1\data_bz\\bran1a\data\\bran1b\data\\bran2\dataz

[email protected]> filter list -t cifsCompression Mode No New Compression Warnings Share/ExportCompressed Off - \\bran1\dataCompressed Off - \\bran1a\dataCompressed Off - \\bran1b\data

[email protected]> filter list available -t nfsbran1:/vol/bran1abran1:/vol/bran1b

bran1:/vol/databran1a:/vol/bran1a/databran1a:/vol/bran1a/rootbran1b:/vol/bran1b/databran1b:/vol/bran1b/rootbran2:/vol/databran2:/vol/vol0bran2:/vol/vol0/home

[email protected]> filter list -t nfsCompression Mode No New Compression Warnings Share/ExportCompressed Off - bran2:/vol/data

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 111/168

Chapter 8. Administration97

8.6 Configuring SNMP

To configure the SNMP configuration settings, proceed as follows:

1. Go on the SNMP panel from the left of the Web GUI, as shown in Figure 8-22.

.

Figure 8-22 SNMP Settings panel 

2. From this panel, download MIB (Management Information Base) libraries as follows:

Choose Download from the top of the panel. These files are used within a monitoringmanagement system. After importing the SNMP MIB libraries in your management server,

you can move on and configure the SNMP protocol at the RTCA level. You need toconfigure the following parameters:

– SNMP: Select Enabled or Disabled to enable or disable the SNMP service.

– syslocation: The physical location of the compression appliance; for informativepurposes only.

– syscontact: The name and contact details of the administrator or principal owner of thecompression appliance; for informative purposes only.

– Read Only Community: The information group with read-only security access. Thedefault community string is public.

– Low Free Memory Trap Interval: The interval (in seconds) between the “low freememory trap” alerts sent.

– Low Free Disk Space Trap Interval: The interval (in seconds) between the “low freedisk space” trap alerts sent.

– Fan Failed Trap Interval: The interval (in seconds) between the “fan failed trap” alertssent.

– Power Supply Failed Trap Interval: The interval (in seconds) between the “power supplyfailed” trap alerts sent.

– High Temperature Trap Interval: The interval (in seconds) between the hightemperature trap alerts sent.

– Disk Failed Trap Interval: The interval (in seconds) between the disk failed trap alertssent.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 112/168

98  Introduction to IBM Real-time Compression Appliances

3. Set the monitoring server parameters:

– Trap Destination: The IP address of the server that receives the SNMP traps.

– Trap Port: The port on which the server receives SNMP traps. The default port is port162.

– Trap Community: The information group to which the alerts are associated.

4. After the SNMP options have been configured, send a test SNMP trap by clickingSend SNMP Test. A test trap is sent to the configured trap hosts. Now connect to yourmanagement server and verify the test results.

5. To configure the SNMP protocol from CLI, use the SNMP command to set all the previousparameters as necessary. In addition, you can use the command to review the currentsettings of the SNMP protocol (see Example 8-13).

Example 8-13 Checking SNMP Status 

[email protected]> snmpSNMP Enabled Yessyslocation Computer roomsyscontactRead Only Community publicLow Free Memory Trap Interval (secs) 1800Low Free Disk Space Trap Interval (secs) 1800

Fan Failed Trap Interval (secs) 1800Power Supply Failed Trap Interval (secs) 1800High Temperature Trap Interval (secs) 1800Disk Failed Trap Interval (secs) 60

Trap Destination Trap Port (Default 162) Trap Community127.0.0.1 - public

Example 8-14 shows how to configure SNMP step by step using the CLI interface. Also, for anextensive help, you can use the SNMP help command.

Example 8-14 Configure SNMP using CLI 

//enable SNMP on RtCA [email protected]> snmp enable

//download the MIB file to a workstation - the download is not supported ininteractive SSH mode.bash> ssh [email protected] snmp mibs download > MIB_file.zip

//add an SNMP trap receiver to the system - management [email protected]> snmp trap add -i 9.155.66.190 -c public

SNMP: Default values for SNMP traps are as follows:

Low Free Memory Trap Interval: 1800s Low Free Disk Space Trap Interval: 1800s Fan Failed Trap Interval: 1800s Power Supply Failed Trap Interval: 1800s

High Temperature Trap Interval: 1800s Disk Failed Trap Interval: 1800s

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 113/168

Chapter 8. Administration99

//define the System Location in the [email protected]> snmp -l RightHere

//Define the interval between sending fan failure traps to 10 [email protected]> snmp -f 10

//test by sending a SNMP [email protected]> snmp test

8.7 Configuring LDAP

The LDAP (Lightweight Directory Access Protocol) option can be used to configure thecompression appliance to authorize administration users to log in to the web interface andCLI. The accounts that are configured in an LDAP directory service (that is, Active Directory)can be utilized in this way to log on and administrate the appliance.

8.7.1 Configure

In order to configure the LDAP protocol, proceed as follows

1. Go on the left panel and click the LDAP option under the “General” section. The new panelwill give you the possibility to choose and configure different LDAP parameters(Figure 8-23). The following parameters are available for configuration:

– LDAP: Choose whether LDAP authorization service is enabled or disabled. LDAP is

disabled by default.– type: The LDAP server type. Currently, only Microsoft Active Directory (Windows® 

2003/2008 - based) is supported.

– basedn: The LDAP directory base distinguished name (DN). Typically, the base DN isin the format DC=privatedomain, DC=com, where privatedomain.com is the ActiveDirectory fully-qualified domain name (FQDN).

– Anonymous bind: Choose if configuring anonymous LDAP bind requests. Thecompression appliance attempts to bind to the LDAP server without specifying anycredentials.

– binddn: Configure the bind domain name with a user name from the LDAP directory tosend login-based LDAP bind requests. In most cases, any user in the LDAP tree can

be used. LDAP searches do not usually require unique permissions. Use the followingformat:

CN=Administrator, OU=Users, DC=privatedomain, DC=com

– bindpw: Enter the password of the user name specified in the bind DN.

– Authorization filter: After configuring the LDAP, by default, all users in the basedirectory are allowed access to the compression appliance. If a restriction is imposed,you can limit the users allowed to log on by limiting the search of the RTCA in the LDAPdata base. In order to limit the compression appliance access to a specific section ofthe LDAP directory, configure the authorization filter. A user is usually added to a groupand the authorization filter is specified as a full FQDN (Example 8-15(,

Important: The LDAP option is used only for administrative connection purposes. It will notbe used for shares security or any other communication between the storage and theusers.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 114/168

100  Introduction to IBM Real-time Compression Appliances

Example 8-15 Authorization filter setting example 

memberOf=CN=STNUsers,DC=privatedomain,DC=com.

Figure 8-23 LDAP configuration 

2. After configuring the LDAP protocol, as the next step, add LDAP servers. To do that, fill in

the options from the bottom of the “LDAP” panel (Figure 8-23) with the name of the serverand the IP address. If you are using more than one server for authentication, you canchoose to give priority to the LDAP Server.

Tip: Selecting the Anonymous bind option causes the “binddn” and “bindpw” fields todisappear. The default Active Directory security policy does not accept anonymousbinds. However, Active Directory can be configured to accept anonymous binds.

User rights: The Priority parameter will give the order of querying the LDAP server inthe list. If one server is not accessible, the next one will be asked. If one server returns“user does not have rights” then the query is stopped and the “login failed” will bereturned to the user. The highest priority is 1 and the lowest is 9.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 115/168

Chapter 8. Administration101

Figure 8-24 Adding server to LDAP configuration 

3. If needed after adding the servers (Figure 8-24), change the basic parameters of LDAPcommunication (see Figure 8-25):

– Change the usage of simple LDAP authentication with use of LDAP over SSL - LDAPS.– Change the LDAP or LDAPS ports.

Figure 8-25 LDAP change server communication parameters 

Ports: By default, port number 3268 is used for LDAP and port number 3269 forLDAPS.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 116/168

102  Introduction to IBM Real-time Compression Appliances

4. To configure LDAP protocol and servers using the CLI, follow Example 8-16.

Example 8-16 Configuring LDAP using CLI 

//check LDAP [email protected]> ldapLDAP: Disabled

uri:base:LDAP Server Type:binddn:bindpw: ******anonymous bind: noauthorization filter:

//set LDAP [email protected]> ldap set type ActiveDirectoryLDAP type set to Active Directory

//set base domain

[email protected]> ldap set base DC=privatedomain,DC=tstLDAP basedn set

//set anonymous [email protected]> ldap set no_anonymous_bindNo anonymous bind set

//Set the user used to bind [email protected]> ldap set binddn CN=Admin,OU=RtCA,CN=privatedomain,CN=tst

//set password for user accesing the [email protected]> ldap set bindpw a1b2c3

//Restrict the groups that should be search to approve log [email protected]> ldap set filter memberOf=CN=RtCA,DC=privatedomain,DC=tstLDAP filter set

//Enable and check the [email protected]> ldap enableLDAP [email protected]> ldapLDAP: Enableduri:base: DC=privatedomain,DC=tstLDAP Server Type: ActiveDirectory

binddn: CN=Admin,OU=RtCA,CN=privatedomain,CN=tstbindpw: ******anonymous bind: noauthorization filter: memberOf=CN=RtCA,DC=privatedomain,DC=tst

//add server - prior to add a server you should check the DNS configuration - itmust be disabled

[email protected]> dnsDNS Enabled: yesDNS Domain: privatedomain.tst

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 117/168

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 118/168

104  Introduction to IBM Real-time Compression Appliances

Here is a description of the fields and kinds of information that you can find on this panel:

– LDAP Server Name: The name of the LDAP server as defined in the compressionappliance.

– LDAP Protocol: The configured LDAP protocol (LDAP or LDAPS) for the current server.

– Port: The TCP/IP port configured for communicating with the RTCA product.

– IP: The P address that is configured for the LDAP server.

– Ping Results: Returns results of the ping utility to the LDAP server, verifying theconnectivity to the server.

– nmap results: Output of nmap utility to the LDAP server to verify the open TCP/IP portson the LDAP server.

– Show rootDSE Results: Displays the root of the directory data tree on which thedirectory server configuration is.

– getent entries: Displays the result of the getent utility.

– Show ldap search: Lists the users passing the authorization filter. These users are ableto successfully log in to the compression appliance. If the authorization filter was not

configured, this lists all users in the LDAP directory - maximum number listed is 200entries.

2. To check for user credential availability, enter a user name in the “Get attributes forspecified user” field. The information for the specified user name is retrieved from theLDAP server and displayed on the page.

By using the CLI, you can run the server diagnostics by using the ldap serverdiagnostics command (see Example 8-17). The function for each parameter is describedin the GUI description.

Example 8-17 Diagnose LDAP using CLI 

//Diagnose ldap using the following parameters

[email protected]> ldap server diagnostics ldap1 -diagauthusers localcert ping rootdsesslgetent nmap rootdse sslclient

Definitions: 

nmap: A network security tool.

getent: UNIX command that queries administrative databases in UNIX.The following databases can be queried: password, groups, hosts, services,networks, or protocols.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 119/168

Chapter 8. Administration105

8.8 Miscellaneous tasks

For changing parameters that do not fit into previous categories, select the Miscellaneous page and choose the appropriate link for your task (see Figure 8-27).

Figure 8-27 Miscellaneous settings page 

8.8.1 Date and time settings

In order to change the date and time settings, choose the Date and Time Configuration option from the Miscellaneous panel (Figure 8-27). In the new panel, you can change the

date and time and also configure the NTP servers.

To set up from the CLI, you can use the date, nt, and timezone commands (Example 8-18).

Example 8-18 Setting date and time parameters 

//change the data and time settings - you must stop the engine first

[email protected]> date -d 2011-04-14 -t 16:59The date cannot be changed while the engine is running

//Stoping engine for time and date [email protected]> engine stopEngine stopped successfully

//set and check the time and [email protected]> date -d 2011-04-14 -t 16:[email protected]> dateThu Apr 14 16:59:41 CEST 2011

//set and check the ntp server

Tip: Before changing the RTCA date and time, you must turn off the compression engine.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 120/168

106  Introduction to IBM Real-time Compression Appliances

[email protected]> ntpThere are no ntp servers [email protected]> ntp add [email protected]> ntpServer: 192.168.0.190

//set and check the [email protected]> timezone set Europe/[email protected]> timezone currentCurrent timezone: Europe/Berlin

//restart the [email protected]> engine startEngine started successfully

8.8.2 Setting up the remote syslog servers

In order to set up the remote syslog servers, choose the Remote Syslog Configuration from

the Miscellaneous panel (Figure 8-27 on page 105). Enter the IP address of the server andchoose what kind of data do you want to save on it (Example 8-19).

Example 8-19 Changing the logs settings 

//add new syslog [email protected]> syslog server add 192.168.1.190Syslog server added

//enables the audit log to be send to the defined [email protected]> syslog changelog enablesSyslog audit enabled

//enables the messages log to be send to the defined [email protected]> syslog messages enableSyslog messages enabled

//enables the snmp to be send to the defined [email protected]> syslog snmp enableSyslog snmp enabled

//check the status of the system [email protected]> syslog

Remote Syslog Server: 192.168.1.190Send messages: yesSend changelog: yesSend sw_hw_snmp: yes

Remote logging: The syslog servers must be enabled to support remote logging.For example, on Red Hat Linux® servers, /etc/sysconfig/syslog must be edited to startsyslogd with -r.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 121/168

Chapter 8. Administration107

8.8.3 Resetting the compression statistics

To reset the RTCA statistics, choose Reset Statistics from Miscellaneous panel(Figure 8-27). When using the CLI, use the statistics reset command.

Example 8-20 Statistics view and reset 

[email protected]> statisticsSpace Saved: 40 MBCompression Ratio: 94 %

[email protected]> statistics resetStatistics reset successfully

[email protected]> statisticsSpace Saved: 0 MBCompression Ratio: 0 %[email protected]>

8.8.4 Web interface session timeout

To change the web interface timeout value, go to the Miscellaneous panel, SessionTimeout field, and change the value (Figure 8-27).

8.8.5 DNS server setup

When you are using DNS servers, select the DNS Configuration option from theMiscellaneous panel (Figure 8-27 on page 105).

To execute the previous tasks using the CLI, use the dns command as shown inExample 8-21.

Example 8-21 Changing DNS settings 

//verify DNS [email protected]> dnsDNS Enabled: noDNS Domain:DNS Search:

//set domain [email protected]> dns domain set privatedomain.tstSet DNS Domain privatedomain.tst

//set IP adress for DNS [email protected]> dns server add 192.168.0.190Added DNS Nameserver 192.168.0.190

//set the search DNS [email protected]> dns search set privatedomain.tstSet DNS Search privatedomain.tst

Tip: When the DNS is configured, you can use DNS host names when you configure the

SMTP, NTP, LDAP, and syslog servers.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 122/168

108  Introduction to IBM Real-time Compression Appliances

//check dns [email protected]> dnsDNS Enabled: noDNS Domain: privatedomain.tstDNS Search: privatedomain.tst

DNS server 192.168.0.190: up//enable [email protected]> dns enableDNS Enabled

8.9 Maintaining the compression appliances

This section focuses on maintenance tasks for the RTCA.

8.9.1 Reboot and shutdown

The RTCA must remain operational at all times to maintain access to the NAS storage server.Only perform a restart or shutdown in exceptional cases, such as for planned downtime.

On the Maintenance page you can find the two options Reboot and Shutdown (Figure 8-28).

Figure 8-28 Reboot and Shutdown 

To execute the reboot or the shutdown task, you need to enter the password of the user whois currently logged in. Optionally, you are able to enter a textual note regarding the reason forthe reboot or shutdown. This text appears in the audit log.

Important: It is best to stop the compression engine before shutting down the system.To stop the compression engine, click Stop Engine in the Network page.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 123/168

Chapter 8. Administration109

8.9.2 Backing up and restoring the configuration settings

You need to back up the RTCA configuration for recovery purposes and before doing anysystem upgrade. The configuration backup option enables you to export the configurationsettings to an external file, restore configuration settings from an external file previouslysaved, and restore factory default configuration settings (optional). To open the input area,

click the Configuration Backup option in the menu as shown in Figure 8-29.

Figure 8-29 Backup appliance configuration 

BackupClick Backup Configuration under the Administration section to open the ConfigurationBackup page. Click Save Settings Locally and select the location to save the configurationbackup file to. A windows will query for the location; simply enter the desired location and clickSave.

Restore

Any RTCA configuration settings that were previously backed up are available for restore.Open with Restore Settings under the Administration section the input area for the restore.Click Browse and locate the configuration backup file. Click Upload to restore. After asuccessful restore, a reboot of the RTCA is required as shown in Figure 8-30.

Tip: The option “Restore factory Defaults” is hidden by default. You can enable it with the

option “Allow user to set factory defaults” in the “System Options” menu.

Tip: To restore the configuration settings, it is necessary to stop the compression engine.To do this, click Stop Engine in the Network page.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 124/168

110  Introduction to IBM Real-time Compression Appliances

Figure 8-30 Restore of the configuration 

Restore factory defaults

Click Backup Configuration under the Administration section to open the Restore Factorydefaults page. To execute this task, you need to enter the password of the user who iscurrently logged in and click Accept as shown in Figure 8-31.

Figure 8-31 Maintenance: restore factory defaults 

Tip: To restore factory defaults, is necessary to stop the compression engine. To do this,click Stop Engine in the Network page.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 125/168

Chapter 8. Administration111

8.10 Software installation or upgrade

Currently, minor software release upgrades can be implemented without stopping the RTCA.For example, software updates for the web interface can be performed without stopping thecompression engine. Upgrades to other parts of the software might require restarting thecompression engine or rebooting the system.

Before you begin, make sure you have a valid configuration backup file; see “Backing up andrestoring the configuration settings” on page 109.

8.10.1 Installing/upgrade on a single RTCA

To install the software, log in to the web interface. Click Upgrade under the Administration

section. Click Browse and browse to the location where the software installation file is located(the installation file is named “IBM_Real-time_Compression_3.7.x.xx.stn”) and click Upgrade as shown in Figure 8-32.

Figure 8-32 Software upgrade 

Tip: To receive the installation file, download it from the following Web site:www.ibm.com/support/entry/portal or contact IBM Support.

Reboot: If a reboot of a single RTCA is required, the NAS storage server is not available

during the time of the reboot. You need to perform it in a planned downtime window.

Warning messages: The file upload can take up to 5 minutes to complete. Severalwarning messages might be displayed at this time and can safely be ignored.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 126/168

112  Introduction to IBM Real-time Compression Appliances

After the file has been uploaded successfully, you have to read and accept the licenseagreement (see Figure 8-33). Then you can click on Install to install the new software to theRTCA. The installation process will automatically stop the compression engine, upgrade thesoftware, and when the installation is complete, the appliance will reboot.

Figure 8-33 License agreement for upgrade 

If the software upgrade was executed successfully, the message “Upgrade Successful” willdisplay, as you can see in Figure 8-34.

Figure 8-34 Successful upgrade 

After the appliance has been completely rebooted, verify the software upgrade by reviewingthe version number on the Status page. Finally, click Management Port under theConfiguration section, and then Accept to update the SNMP configuration file.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 127/168

Chapter 8. Administration113

8.10.2 Installing/upgrade on a high availability RTCA

When installing the software in a high availability environment, ensure that the same versionis running on a partner RTCA. To avoid any downtime on a high availability environment, youshould install the software on one RTCA after another. Perform the same steps as describedfor installing on a single appliance. On the Status page, verify that the expected version is

running after the first appliance was rebooted. On a second appliance, perform the stepsdescribed for installing on a single appliance. On the Status page, verify that the expectedversion is running after the second appliance was rebooted.

8.10.3 Updating the hardware configuration file

The RTCA requires a valid hardware configuration file. Typically the appliance is pre-installedwith a proper hardware configuration file as part of the manufacturing process. However,there might be a need to update the hardware configuration file. The “Hardware ConfigurationFile” page enables updating of the compression appliance with details of the hardwareconfiguration file, which specifies the hardware identity of the components in the appliance.Among other information, the hardware configuration file includes the amount of memory inthe appliance, its serial number, and the hardware (MAC) addresses used in the networkinterfaces.

To Update the hardware configuration file, go to the HW Configuration File option under theAdministration section (see Figure 8-35). If a hardware configuration file is not installed orprovided, click Generate Hardware Configuration File Request first, save the file locallyand send the file to IBM Support. After IBM have provided the new hardware configurationfile, you can upload it by clicking Browse and searching for your hardware configuration file.When you have located the hardware configuration file, click Upload.

Figure 8-35 Hardware configuration file 

Tip: The bonds probe is displayed only when the system has configured bonds.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 128/168

114  Introduction to IBM Real-time Compression Appliances

8.11 Configuring system options

To modify general options for the IBM RTCA product, go on the System Options panel. It canbe found on the left in your GUI as shown in Figure 8-36.

Figure 8-36 System Options 

The following options are accessible:

WebGui: The default setting is normal mode. If you change to debug mode, additionaldebug information is displayed at the top of each page.

JavaScript: Choose Enable or Disable to activate or stop the use of JavaScript in the webinterface pages. JavaScript is mainly used for pop-ups when you use the web interface.The default setting is enabled.

Network Traffic Capture line: To see the status of the tcpdump network capture. This linewill only show the status of the “tcpdump” option while the activation of “tcpdump” is madefrom “Diagnostics” panel “Run tcpdump”

Enable modifying network interface broadcast address: This option allows you to enable ordisable the user from modifying the broadcast address for the management and bridgeinterfaces. By default, this option is disabled. If you enable this option, the Broadcast fieldon the Management Port and Modify Bridge pages is enabled (Figure 8-37).

Attention: The broadcast address is assigned automatically by the management interface;modifying the broadcast address is typically not required. Consult with your networkadministrator before you change the broadcast address.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 129/168

Chapter 8. Administration115

Figure 8-37 Broadcast field 

Allow user to set factory defaults: Prevents the user from restoring the IBM Real-timeCompression Appliance configuration to factory defaults. By default, this option isdisabled. If you enable this option, a “Restore Factory Defaults” link appears on the“Configuration Backup” panel (see Figure 8-38).

Figure 8-38 Restore to Factory Defaults option 

Attention: A restore to factory defaults will erase all your settings and stop the completetraffic through appliance. Also, such compressed data will became available after youconfigure back the RTCA.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 130/168

116  Introduction to IBM Real-time Compression Appliances

Allow multiple users: Enable or disable access to the web interface from multiple client IPaddresses. If this option is enabled (default), multiple users can log in and use the webinterface concurrently. If you disable this feature, when an additional client accesses theappliance, the following message is displayed on the login page: “Someone else on IPIPAddr is already logged in. Logging in will terminate the other session”.

Antivirus: Enable or disable support for storage server-based antivirus products. By

default, this option is enabled. Antivirus server IPs: Enable or disable support for specific McAfee virus scanning

products. By default, support is disabled. If this option is enabled, a new Antivirus ServerIP column appears on the Storage panel (Figure 8-39).

Figure 8-39 System Options - Change Antivirus Server IPs 

Watchdog: Enable or disable the hardware watchdog feature. By default, this option isenabled.

Guardian: Enable or disable the guardian process that automatically recovers from enginefailures. By default, this option is enabled.

Important: Contact IBM Support before you enable this option. This setting uses aworkaround for an issue with AV server disconnects that exists in McAfee Virus Scan Ent.for NetApp v7.1, 5.3.00 Scan Engine and McAfee Virus Scan Ent. for Storage v1.0 (basedon v8.7).

Important: The difference between “Guardian” and “Watchdog” features is that both ofthem will operate with traffic interruption, but the “Guardian” will only restart the processbased on ID when and if that process is hanging, whereas the Watchdog will issue acomplete restart and initialization of the hardware machine. Because both processesare disruptive, do not disable them unless instructed by IBM Support.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 131/168

Chapter 8. Administration117

CA Full Scan: Enable or disable the “Compression Accelerator” feature from the Storagepanel (Figure 8-39) that enables the user to compress existing data. By default, this optionis enabled. If you disable this feature you can end up with a volume both with compressedand uncompressed data. Do not disable this feature unless instructed by IBM Support.

LSM: Enable or disable the link status mirroring (LSM) feature described on Chapter 3.3.1,“Random Access Compression Engine: RACE” on page 18. By default, this feature is

enabled. Do not disable this feature unless instructed by IBM Support. Web GUI Access: Enable or disable the protocol used for GUI management. The http only

mode allows only standard HTTP (port 80) access to the web interface; https only allowsonly secured HTTP (port 443) access to the web interface; and http or https (the default)accepts either.

Task Affinity: Enable or disable the automatic tuning of CPU affinity. By default, this featureis enabled for highest performance as internal modules of the compression appliance arebalanced across the CPU cores using optimal CPU affinity. Do not disable this featureunless instructed by IBM Support.

HA gratuitous arp: Enable or disable support for passing gratuitous ARP messages.By default, this feature is enabled. Do not disable this feature unless instructed by IBMSupport.

HA arp mode refresh: Enable or disable support for high availability environments.By default, this feature is enabled. Do not disable this feature unless instructed by IBMSupport.

Extension Filters Mode: Choose Include or Exclude to configure the mode in which theextension filters are applied. By default, the extension filters that are configured and shown

at the bottom of the Compression Filters panel define which extensions are excluded fromcompression; this is the exclude mode. If Include is configured, the appliance compressesonly files with extensions that are defined in the list.

Unicast ARP Mangle: Enable or disable support for passing unicast ARP messages.By default, this feature is enabled. Do not disable this feature unless instructed by IBMSupport.

Vif Single Probe: Enable or disable support for Data ONTAP single vif configurations.By default, this feature is disabled. Do not enable this feature unless instructed by IBMSupport.

User Autosupport Scheduling: Allow or prevent the user from modifying the defaultschedule for Autosupport reports. By default, this feature is enabled.

Forced reboots: Enable or disable the forced reboots after frequent engine restarts. Thisoption is only applicable for high availability configurations (in single applianceconfigurations, frequent engine warm restarts eventually turn into cold restarts; in highavailability configurations the warm restarts will turn into forced reboots if the partnerappliance as well as its engine are up and running). By default, this option is enabled.

Tip: The web interface supports both HTTP and HTTPS. To configure HTTPScertificates, use the same procedure described in “Setting Up SSH Certificates” in theIBM Real-time Compression Appliances CLI Command Manual - Reference Version 3 

Release 7 .

Tip: For more information about vif configurations, see Chapter 6, “Implementationplanning” on page 37 and Chapter 9, “NAS / N series solution design” on page 123.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 132/168

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 133/168

Chapter 8. Administration119

ForcedReboots allowTriggersScheduling haArpRefreshModeprobeBonds smb2passthrusupport webguiLSM antivirus haGratuitousArpprobeDuplicateIPs taskAffinityVifSingleProbe avip javascriptprobeGateways unicastArpMangle

allowSelectCompressedMode extensionFiltersMode multipleUsers//Change desired [email protected]> option allowSetFactoryDefaults off

8.12 Diagnosing problems

Before contacting IBM Support, trigger a new Autosupport. To do so click Diagnostics, nextclick Configure Autosupport, and then click Sent Test Email. If there is any problem withAutosupport or if requested by IBM Support, collect a diagnostics package by clicking onDiagnostics, followed by clicking Collect Customer Support Diagnostics, and upload the

attachment to IBM as instructed by IBM Support.

For more information, see the IBM Real-time Compression Appliance Troubleshooting Guide .

8.13 Recovering files when appliance is unavailable

The compression appliance transparently and automatically compresses and decompressesdata in real-time.

If the compression appliance is unavailable for any reason, the IBM Real-time CompressionAppliance data recovery utility can recover files or directories that were previously

compressed by the compression appliance. For example, when you send files to a remote siteover a WAN, you can send the files in compressed form to save time and bandwidth usage.

If the remote site does not have a compression appliance installed, the IBM Real-timeCompression Appliance data recovery utility can decompress the files at the remote site inplace of the compression appliance. IBM Real-time Compression Appliance data recoveryutility can be used only on a workstation or server that is directly connected to the storagedevice (that is, not connected through the compression appliance). If the workstation orserver is connected through the compression appliance, the compression appliancerecompresses the files. The recovery utility is available as a GUI based as well as a CLI tool.

You can download this tool from the following website:

http://www.ibm.com/storage/support/rtc

8.13.1 Using the data recovery utility

You can define up to 99 tasks that control which files are processed and how they areprocessed. You can configure options to determine processing speed, error handling, and themessages log. After you configure the options and create, edit, or delete tasks to determinewhich files are decompressed, you can then run the tasks.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 134/168

120  Introduction to IBM Real-time Compression Appliances

IBM Real-time Compression Appliance data recovery utility options apply to all defined tasksand can be modified only when tasks are not running. For information about determiningwhether tasks are running or about stopping tasks, see “Running the data recovery utility.”

8.13.2 Recovery procedure

To perform a recovery, proceed as follows:

1. If the data recovery utility is not running, select the IBM Real-time Compression Appliancedata recovery utility from the appropriate Start menu folder (for example, Start ? Programs? Storwize ? Revert) or from the default installation directory:

c:\Program Files\IBM\Real Time Compression Appliance data recovery utility

The data recovery utility opens and by default, displays the Task List tab (Figure 8-40).

Figure 8-40 Recovery utility 

Attention: You need to configure options immediately after IBM Real-time CompressionAppliance data recovery utility installation.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 135/168

Chapter 8. Administration121

2. Select Options and Configuration from the menu. The Configuration window opens(see Figure 8-41).

3. Select the appropriate options according to the information. For a complete list of optionsand descriptions, see the IBM Real-time Compression Appliance Administration Guide .

Figure 8-41 RTCA recovery utility - edit task parameters 

8.13.3 Creating data-recovery tasks

The data recovery utility tasks specify which files are to be decompressed as well as the orderin which they are decompressed. Creating tasks includes defining source and destinationdirectories (which files are decompressed and where they are saved), priorities (the order inwhich the tasks are run), and additional task parameters.

You can create up to nine tasks. Because finished or aborted tasks are not deletedautomatically, you can delete them to create additional tasks, if necessary. Default settingsare applied to new tasks. To customize the new task default settings, configure a task's

parameters and click Save As Defaults in the Edit Task Parameters dialog box. For example,if Copy Attributes is selected and Copy All Files is deselected in your customized default taskparameters, these options remain selected or deselected when you create a new task.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 136/168

122  Introduction to IBM Real-time Compression Appliances

8.13.4 Running data-recovery tasks

When a task runs, its specified files are processed. Tasks are run in batch mode, according topriority and then task number. Tasks that have the priority “On Hold” do not run. Tasks can bestopped or resumed at any time. Information about the running tasks is displayed in theMessage Log tab, according to your configuration options.

Before running tasks, verify that you have sufficient free space on the volume, using thefollowing formula:

Number of threads (X) * the sum of the sizes of the X largest files * 3

For example, when three threads are configured and the size of the three largest files are10 GB, 15 GB, and 20 GB, the free space required for this operation is 405 GB(3*45*3=405 GB).

8.13.5 Viewing data-recovery logs

The Message Log tab displays a maximum of 300 messages. A complete list of messages is

recorded in the data recovery utility log in the IBM Real-time Compression Appliance datarecovery utility message log file.

You can use the log files to verify if your data recovery process has been performedsuccessfully.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 137/168

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 138/168

124  Introduction to IBM Real-time Compression Appliances

9.1 Terms and definitions

As an introduction to facilitate understanding of the design examples in this chapter, we showthe port assignment of the RTCA product (STN6500) and the N series (N5000) in Figure 9-1 and Figure 9-2.

Figure 9-1 STN6500 port assignment 

Figure 9-2 N series port assignment 

9.2 N series single node solutions

This section focuses on solutions using a single node N series controller.

9.2.1 N series and single RTCA product

The most basic configuration consists of a single NAS storage controller connected to a

single RTCA product.

In Figure 9-3 an N series single-node system is connected by a single link (from onboard porte0a) to the RTCA eth0 port, and eth1 is connected to the network switch. The ports eth0 andeth1 are configured as a bridge (br0), with a bridge IP address in the same subnet as e0a.

Interfaces: There can be more than a single interface connected between the NASstorage controller and the RTCA product. However, in this configuration, the interfaces areindependent of each other, and not aggregated for load balancing or redundancy.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 139/168

Chapter 9. NAS / N series solution design125

Being the simplest configuration possible, it does not provide any redundancy and is thereforenot desirable for production use. Any failure in the network path, be it the network switch, itsport, any of the network cables, the compression appliance ports, or the N series ports, willimpact service to users.

Figure 9-3 N series single node connected to a single RTCA product 

The port connectivity that belongs to the solution in Figure 9-3 is illustrated in Table 9-1.

Table 9-1 N series single node connected to a single RTCA product - port connectivity 

9.2.2 N series and single RTCA product, active/passive path

Similar to the configuration in the previous section, a single NAS controller is connected to asingle RTCA product in Figure 9-4. However, an additional link is added to provideredundancy to the networking path. The two links are aggregated into a single group. The Nseries single-node system is configured with an active/passive configuration, a single-modevirtual interface (vif).The compression appliance is configured with two active/passive bonds and a bridge thatconnects them. On the network switch side, the two ports are configured with the sameparameters, and most importantly, both must be in the same subnet.

In this configuration only one link is active at any particular time. If the NAS storage controllerdetects a fault in the active link, the standby link is activated and all traffic goes through thenewly activated link.

Switch/ 

port

RTCA/ 

port

Bond Bridge Bond RTCA/  

port

NAS port

SW1/ 9

STN1/ eth1

n/a br0 n/a STN1/  eth0

NAS1 e0a

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 140/168

126  Introduction to IBM Real-time Compression Appliances

Figure 9-4 N series single-node, a single RTCA product, active/passive path failover 

The port connectivity that belongs to the solution in Figure 10-2 is illustrated in Table 9-2.

Table 9-2 N series single-node, single RTCA product, active/passive path failover port connectivity 

The N series virtual interface configuration is illustrated in Example 9-1.

Example 9-1 Active/passive path failover for single systems - N series vif configuration 

NAS1> vif statusdefault: transmit 'IP Load balancing', VIF Type 'multi_mode', fail 'log'vif-s: 1 link, transmit 'none', VIF Type 'single_mode' fail 'default'

VIF Status Up Addr_setup:

  e0a: state up, since 31Mar2011 18:43:52 (00:00:23)mediatype: auto-1000t-fd-upflags: enabledinput packets 13, input bytes 1062output packets 4, output bytes 168output probe packets 4, input probe packets 0strike count: 4 of 10up indications 1, broken indications 0drops (if) 0, drops (link) 0indication: up at 31Mar2011 18:43:52

consecutive 22, transitions 1

Switch/ 

port

RTCA/ 

port

Bond Bridge Bond RTCA/  

port

NAS port/ 

vif

SW1/ 9

STN1/ eth1

bond0active/ passive

br0

bond1active/ passive

STN1/ eth0

NAS1 e0a/ vif-s

SW1/ 13

STN1/ eth5

bond0active/ passive

bond1active/ passive

STN1/ eth4

NAS1 e0c/ vif-s

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 141/168

Chapter 9. NAS / N series solution design127

down:  e0c: state down, since 31Mar2011 18:43:52 (00:00:23)

mediatype: auto-1000t-fd-upflags: enabledinput packets 0, input bytes 0output packets 13, output bytes 570

output probe packets 4, input probe packets 0strike count: 4 of 10up indications 1, broken indications 0drops (if) 0, drops (link) 0indication: up at 31Mar2011 18:43:52

consecutive 22, transitions 1

9.2.3 N series and active/passive path, RTCA product HA pair

By building on the previous examples and adding a compression appliance to theconfiguration, a single NAS storage controller is connected to two RTCA products inFigure 9-5. The N series single-node system is configured with an active/passive

configuration, a single-mode virtual interface (vif). A primary link is connected to one RTCAproduct, and the other, the passive link, is connected to the second RTCA product. The RTCAproducts are connected with a single link each to the switch. This setup adds redundancy tothe RTCA product itself. If any problem occurs, or maintenance is required, the service canfail over from the active RTCA product to the standby RTCA product. It is possible, andactually desirable, to connect each RTCA product to a separate network switch.

Figure 9-5 N series single-node, active/passive path failover to HA pair 

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 142/168

128  Introduction to IBM Real-time Compression Appliances

The port connectivity that belongs to the solution in Figure 9-5 is illustrated in Table 9-3.

Table 9-3 N series single-node, active/passive path failover to HA pair port connectivity 

The N series virtual interface configuration is illustrated in Example 9-2.

Example 9-2 Active/passive path failover to RTCA product HA pair- N series vif configuration 

NAS1> vif statusdefault: transmit 'IP Load balancing', VIF Type 'multi_mode', fail 'log'vif-s: 1 link, transmit 'none', VIF Type 'single_mode' fail 'default'

VIF Status Up Addr_set

up:  e0a: state up, since 31Mar2011 18:43:52 (00:00:23)mediatype: auto-1000t-fd-upflags: enabledinput packets 13, input bytes 1062output packets 4, output bytes 168output probe packets 4, input probe packets 0strike count: 4 of 10up indications 1, broken indications 0drops (if) 0, drops (link) 0indication: up at 31Mar2011 18:43:52

consecutive 22, transitions 1down:

  e0c: state down, since 31Mar2011 18:43:52 (00:00:23)mediatype: auto-1000t-fd-upflags: enabledinput packets 0, input bytes 0output packets 13, output bytes 570output probe packets 4, input probe packets 0strike count: 4 of 10up indications 1, broken indications 0drops (if) 0, drops (link) 0indication: up at 31Mar2011 18:43:52

consecutive 22, transitions 1

9.2.4 Active/passive path, RTCA product HA, EtherChannel/LACP bonds

The most common use of active/passive bonds is when they will combined with EtherChannelor LACP bonds. This provides the best combination of performance and high availability. InFigure 9-6, the N series single-node system is connected with two or more interfaces to theRTCA product—configured as a single port aggregate (virtual interface)—either anEtherChannel or 802.3ad (LACP) bond type.

Switch/ 

port

RTCA/ 

port

Bond Bridge Bond RTCA/  

port

NAS port/ 

vif

SW1/ 

9

STN1/ 

eth1

n/a br0 n/a STN1/  

eth0

NAS1 e0a/ 

vif-s

SW2/ 9

STN2/ eth1

n/a br0 n/a STN2/  eth0

NAS1 e0c/ vif-s

Tip: Make sure that all active links of the same link aggregation (LACP or EtherChannel)are connected to the same RTCA product.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 143/168

Chapter 9. NAS / N series solution design129

Similarly, a corresponding bond in the RTCA product is connected to the network switch. Anadditional bond is connected to a standby RTCA product in the same manner, and itscorresponding bond connected to the network switch – be it the same one or another switch(Figure 9-6).

Figure 9-6 N series single-node, active/passive path failover to HA pair, EtherChannel or LACP bonds 

The port connectivity that belongs to the solution in Figure 9-6 is illustrated in Table 9-4.

Table 9-4 N series single-node with EtherChannel or LACP bonds 

The virtual interfaces vifa and vifb are configured as dynamic multimode vif and are groupedby creating a second layer of vif, called vif1 as a single-mode vif. Either vifa or vifb is active.In this way, data will be transmitted through one RTCA product only and not at any timethrough both concurrently. The necessary configuration entries of the /etc/rc file are shown inExample 9-3.

Example 9-3 N series or LACP port aggregation configuration entry in /etc/rc 

vif create lacp vifa -b ip e0a e0cvif create lacp vifb -b ip e0b e0dvif create single vif1 vifb vifa

Switch/ 

port

RTCA/ 

port

Bond Bridge Bond RTCA/  

port

NAS port/ 

vif

SW1/ 9

STN1/ eth1

bond0LACP

br0

bond1LACP

STN1/ eth0

NAS1 e0a/ vifa

SW1/ 13

STN1/ eth5

bond0LACP

bond1LACP

STN1/ eth4

NAS1 e0c/ vifa

SW2/ 35

STN2/ eth9

bond0LACP

br0

bond1LACP

STN2/ eth8

NAS1 e0b/ vifb

SW2/ 41

STN2/ eth13

bond0LACP

bond1LACP

STN2/ eth12

NAS1 e0d/ vifb

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 144/168

130  Introduction to IBM Real-time Compression Appliances

The N series virtual interface configuration is illustrated in Example 9-4.

Example 9-4 N series single-node LACP virtual interface configuration 

NAS1> vif statusdefault: transmit 'IP Load balancing', VIF Type 'multi_mode', fail 'log'vifa: 2 links, transmit 'IP Load balancing', VIF Type 'lacp' fail 'default'

VIF Status Up Addr_settrunked: vif1  up:  e0c: state up, since 31Mar2011 18:50:30 (6+21:18:08)

mediatype: auto-1000t-fd-upflags: enabledactive aggr, aggr port: e0ainput packets 675437, input bytes 43010404input lacp packets 19841, output lacp packets 19841output packets 122521, output bytes 7139083up indications 2, broken indications 0drops (if) 0, drops (link) 0indication: up at 31Mar2011 18:50:30

consecutive 0, transitions 2  e0a: state up, since 31Mar2011 18:50:29 (6+21:18:09)

mediatype: auto-1000t-fd-upflags: enabledactive aggr, aggr port: e0ainput packets 43968, input bytes 6839259input lacp packets 19840, output lacp packets 19841output packets 147663, output bytes 10142065up indications 2, broken indications 0drops (if) 0, drops (link) 0indication: up at 31Mar2011 18:50:29

consecutive 0, transitions 2vifb: 2 links, transmit 'IP Load balancing', VIF Type 'lacp' fail 'default'

VIF Status Up Addr_settrunked: vif1

  down:  e0d: state up, since 31Mar2011 18:50:29 (6+21:18:09)

mediatype: auto-1000t-fd-upflags: enabledactive aggr, aggr port: e0binput packets 26427, input bytes 4709108input lacp packets 19841, output lacp packets 19841output packets 119029, output bytes 6626180up indications 2, broken indications 0drops (if) 0, drops (link) 0

indication: up at 31Mar2011 18:50:29consecutive 0, transitions 2  e0b: state up, since 31Mar2011 18:50:29 (6+21:18:09)

mediatype: auto-1000t-fd-upflags: enabledactive aggr, aggr port: e0binput packets 659358, input bytes 41114314input lacp packets 19841, output lacp packets 19841output packets 119029, output bytes 6626180up indications 2, broken indications 0drops (if) 0, drops (link) 0

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 145/168

Chapter 9. NAS / N series solution design131

indication: up at 31Mar2011 18:50:29consecutive 0, transitions 2

vif1: 1 link, transmit 'none', VIF Type 'single_mode' fail 'default'VIF Status Up Addr_set

  up:  vifa: state up, since 31Mar2011 18:50:29 (6+21:18:09)

mediatype: Enabled virtual interfaceflags: enabledinput packets 719405, input bytes 49849663output packets 270184, output bytes 17281148output probe packets 198378, input probe packets 198378strike count: 0 of 10up indications 1, broken indications 0drops (if) 0, drops (link) 0indication: up at 31Mar2011 18:50:29

consecutive 595085, transitions 1  down:  vifb: state down, since 31Mar2011 18:50:29 (6+21:18:09)

mediatype: Enabled virtual interface

flags: enabledinput packets 685785, input bytes 45823422output packets 238058, output bytes 13252360output probe packets 198378, input probe packets 198378strike count: 0 of 10up indications 1, broken indications 0drops (if) 0, drops (link) 0indication: up at 31Mar2011 18:50:29

consecutive 595085, transitions 1

9.3 N series dual node solutions

This section focuses on solutions using a single node N series controller.

9.3.1 Active/passive RTCA product on LACP bonds

The most common setup, which is illustrated in Figure 9-7, is one that provides complete highavailability for both the storage system and the RTCA product. This setup is an extension ofthe configuration that is described in the previous section “Active/passive path, RTCA productHA, EtherChannel/LACP bonds” on page 128.

Here we have a combination of two N series single-node systems, each with its ownactive/passive links configured to two RTCA products. It is important to make sure that the

basic configuration rules are applied—there can be only one specific RTCA product serving aspecific NAS controller at a time.

Tip: It is preferable to configure the links on the N series in such a way that a specificRTCA product is set as the primary, and another RTCA product is set as the secondaryusing the vif favor command.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 146/168

132  Introduction to IBM Real-time Compression Appliances

Figure 9-7 N series dual-node, active/passive RTCA product on LACP bonds 

The port connectivity that belongs to the solution in Figure 9-7 is illustrated in Table 9-5.

Table 9-5 N series dual-node with EtherChannel or LACP bonds 

9.3.2 Controller configurations

Both N series controllers are configured in the exact same manner. vifa and vifb areconfigured as dynamic multimode vif and are grouped by creating a second layer of vif, calledvif1 as a single-mode vif. Either vifa or vifb is active. In this way data will be transmittedthrough one RTCA product only and not at any time through both concurrently.

Switch/ 

port

RTCA/ 

port

Bond Bridge Bond RTCA/  

port

NAS port/ 

vif

SW1/ 9

STN1/ eth1

bond0LACP

br0

bond1LACP

STN1/ eth0

NAS1 e0a/ vifa

SW1/ 13

STN1/ eth5

bond0LACP

bond1LACP

STN1/ eth4

NAS1 e0c/ vifa

SW2/ 35

STN2/ eth9

bond0LACP

br0

bond1LACP

STN2/ eth8

NAS1 e0b/ vifb

SW2/ 41

STN2/ eth13

bond0LACP

bond1LACP

STN2/ eth12

NAS1 e0d/ vifb

SW1/ 35

STN1/ eth9

bond2LACP

br1

bond3LACP

STN1/ eth8

NAS2 e0b/ vifb

SW1/ 41

STN1/ eth13

bond2LACP

bond3LACP

STN1/ eth12

NAS2 e0d/ vifb

SW2/ 9

STN2/ eth1

bond2LACP

br1

bond3LACP

STN2/ eth0

NAS2 e0a/ vifa

SW2/ 13

STN2/ eth5

bond2LACP

bond3LACP

STN2/ eth4

NAS2 e0c/ vifa

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 147/168

Chapter 9. NAS / N series solution design133

The configuration entries of the /etc/rc file of both controllers are identical as described in theprevious section “Active/passive path, RTCA product HA, EtherChannel/LACP bonds” onpage 128 and shown in Example 9-3 on page 129. Similarly, the vif configuration is describedin the previous section “Active/passive path, RTCA product HA, EtherChannel/LACP bonds”on page 128 and shown in Example 9-4 on page 130.

9.4 N series MetroCluster solutions

IBM N series MetroCluster is a synchronous replication solution for combined high availability(HA) and disaster recovery (DR), protecting against site disasters within a campus ormetropolitan area with distances up to 100 km. Usually due to cabling and installationrequirements it is not possible to connect every N series controller of the HA pair with bothRTCA products at each site to provide the best redundancy and availability.

Generally you can configure the RTCA product in N series MetroCluster environments in adifferent manner:

One RTCA product at each site to connect one RTCA product with only one N series

controller in Figure 9-8 Two RTCA products at each site to connect one N series controller redundant to two

RTCA products in Figure 9-9

In the first option it is absolute necessary to configure the N series to failover to the partnersite in case of an RTCA product failure. Additionally it is preferable to connect each RTCAproduct to more than one switch, otherwise a network switch failure will also require anN series controller failover.

Figure 9-8 Single RTCA product design for MetroCluster 

Tip: To enable an automatic takeover if the N series controller detect failures in the networkinterfaces, set the option “cf.takeover.on_network_interface_failure” to “on”.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 148/168

134  Introduction to IBM Real-time Compression Appliances

With the RTCA product unsynchronized, MetroCluster site failover is problematic andtherefore an HA RTCA product setup at each site with active/passive configuration ispreferable, as illustrated in Figure 9-9.

Figure 9-9 Dual RTCA product design for MetroCluster 

In that architecture, STN1 and STN2 cannot see any shares of NAS1b, the remote clusterpartner of the local controller NAS1a. However it is necessary to create both storage serverobjects (for NAS1a and NAS1b) in all RTCA products at both sites. In such a configuration itis best to build a star topology for the configuration of HA Auto Sync, as you can see inFigure 9-10.

STN1 is configured as an HA pair with STN2, STN3, and STN4. The configuration ofcompression filters is performed only on one RTCA product, in this example STN1, to avoidsynchronization issues. In other words: STN1 acts as a master and is paired with STN2,STN3, and STN4. Now, you can modify the compression filter configuration and yourmodification will be replicated to all other RTCA products immediately after you apply thechanges.

If a compression filter is not defined as compressed in the compression filter list of all RTCAproducts in the same manner, data will not be accessible or corrupt after a cluster failoveroccurs and clients access the data through a logical bypass.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 149/168

Chapter 9. NAS / N series solution design135

Figure 9-10 RTCA star topology 

Depending on the architecture of a MetroCluster, a dual inter-site link failure can theoreticallyoccur. The Error message looks like the one shown in Figure 9-11.

Figure 9-11 Inter-site link failure, no route to partner 

Important: It is not desirable to disable HA auto sync temporarily to modify a compressionfilter configuration after an inter-site link failure occurs. If you have a link problem, resolve itfirst, then add or remove compression filters.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 150/168

136  Introduction to IBM Real-time Compression Appliances

In this case the HA auto synchronization will not work and the RTCA product does not let youadd or remove compression filters as shown in Figure 9-12. However, it is possible to overrideit by disabling HA auto synchronization temporarily. This will require either using manualexport/import, manual synchronization later, or performing the same task on all RTCAproducts.

Figure 9-12 RTCA products do not let you add/remove compression filters 

9.5 N series with MultiStore

The N series MultiStore® feature provides the ability to configure virtual filers within aphysical N series system. This feature is fully supported by the RTCA product, with eachvirtual filer (vfiler) configured as if it was a physical storage system. In other words, a vfiler is

 just another storage object in an RTCA configuration.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 151/168

Chapter 9. NAS / N series solution design137

9.5.1 Considerations for vfilers

There are no special considerations for vfilers other than configuring their IP addresses andfilters on all the RTCA products that might service them at any given time. This is mostlyimportant if vfilers are replicated between an N series cluster and another one, such as withthe DataMotion feature. In this environment there typically are four N series

controllers—NAS1a and NAS1b being the primary dual node system, and NAS2a andNAS2b, the secondary dual system, being the replica as illustrated in Figure 9-13.

9.5.2 Types of configurations

In the following sections we describe the various configurations possible.

RTCA product configurationSTN1 is configured as an HA pair with STN2, STN3, and STN4. All four RTCA products areconfigured with all the vfiler IP addresses. The configuration of compression filters isperformed only on one RTCA product, for example, STN1 to avoid synchronization issues. Insuch a configuration it is best to build a star topology for the configuration of HA Auto Sync, in

other words: STN1 is master and paired with STN2, STN3, STN4. The HA configuration issimilar to the RTCA product design in the MetroCluster example in Figure 9-10.

Port connectivityAny network configuration from the foregoing, typically a clustered NAS with active/passivefailover on EtherChannel/LACP bonds, is usable for MultiStore configurations.

Network configurationIf all vfilers share the same IP space, all vfilers can be connected through the same bridges.If you have to create a vfiler that belongs to different IP spaces, it is necessary to creatededicated bridges or in another way, use VLAN tagging.

Figure 9-13 RTCA products in a N series MultiStore environment 

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 152/168

138  Introduction to IBM Real-time Compression Appliances

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 153/168

 © Copyright IBM Corp. 2011. All rights reserved.139

Chapter 10. ProtecTIER solution design

In this chapter we explain how to combine IBM ProtecTIER® and RTCA. This will enable thereader to understand the benefits of combining real-time compression and deduplicationtechnologies.

10

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 154/168

140  Introduction to IBM Real-time Compression Appliances

10.1 Combining RTCA and IBM ProtecTIER deduplication

To understand the benefits of combining real-time compression and deduplication, it isimportant first to understand the difference in the technologies and where they fit in the overalldata optimization landscape.

Real-time Compression is designed to work transparently in front of your primary storage andreduce the size of every file you create up to five times depending upon file type. Applicationshave random, read-write access to compressed data while the physical capacity required tostore a file, or copies and permutations of a file are significantly reduced throughout the entirelife-cycle including backup. Because less data is written to disk, overall network and storageperformance and utilization can also be significantly enhanced.

Deduplication is designed to reduce the physical storage required to store redundant data. Inthe deduplication process, duplicate data is removed and replaced with a pointer to the maincopy, leaving only one copy of the data to be stored which is why it is well suited for backupdata where you typically have multiple data sets (daily/weekly) of mostly redundant data. Themore copies of redundant data you have, the higher your effective deduplication rate.

An example of the situation just described is illustrated in Figure 10-1. Hence real-timecompression and deduplication address different problems and are applicable at differentpoints within the data life-cycle. But, most importantly the two technologies arecomplementary and in particular deploying real-time compression with a random accesscompression engine significantly enhances the value and performance of deduplication.

Figure 10-1 The Data Optimization Landscape 

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 155/168

Chapter 10. ProtecTIER solution design141

10.2 Solution setup

For our test environment, as illustrated in Figure 10-2, the combination of the IBM Real-timeCompression and IBM ProtecTIER deduplication in an Oracle® database backupenvironment resulted in more than 96% savings on disk space and additional significant dataprotection benefits for organizations that perform regular backups of Oracle databases. While

each offers compelling benefits when implemented independently, the combination of bothtechnologies results in far greater space savings, significantly improved backup time, andresource utilization.

In the case of Oracle database backups, real-time compression provided:

82% immediate savings on initial write to disk. 96% overall data reduction when combined with deduplication Up to 71% reduction in backup time Less deduplication CPU utilization, less deduplication disk activity, and less deduplication

network traffic

The significant overall reduction in primary and backup data storage requirements coupled

with the dramatic improvement in deduplication CPU, Network and disk utilization illustratethe significant synergies between real-time compression and deduplication.

Running with RTCA compression and ProtecTier deduplication and compression reduced theused size by an additional 10%, and this is the preferable configuration.

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 156/168

142  Introduction to IBM Real-time Compression Appliances

Figure 10-2 RTCA and ProtecTIER test setup for Oracle environment 

Based on the ProtecTIER logs review, the RTCA absorbs all the small changes and preparesthe data for the ProtecTIER in a more linear way, allowing it to store the deduplicated datamuch more efficiently. We can see this in the distribution of common data segments that theProtecTIER sees (the columns headed 1024 to 16 MB).

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 157/168

 © Copyright IBM Corp. 2011. All rights reserved.143

ACL Access Control List

CLI Command Line InterfaceDR Disaster Recovery

GUI Graphical User Interface

HA High Availability

I/O Input/Output

IBM International Business MachinesCorporation

ILM Information Life-cycle Management

IPL Initial Program Load

IT Information Technology

ITSO International Technical Support

Organization

LACP Link Aggregation Control Protocol

LDAP Lightweight Directory AccessProtocol

LSM Link Status Mirroring

MIB Management Information Base

MRM Monitoring and Reporting Manager

MTU Maximum Transmission Unit

NAS Network Attached Storage

NNC No New Compression

RACE Random Access CompressionEngine

RTCA IBM Real-time CompressionAppliance

SNMP Simple Network ManagementProtocol

UNC Uniform Naming Convention

UPM Unified Protocol Manager

Abbreviations and acronyms

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 158/168

144  Introduction to IBM Real-time Compression Appliances

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 159/168

 © Copyright IBM Corp. 2011. All rights reserved.145

Related publications

The publications listed in this section are considered particularly suitable for a more detailed

discussion of the topics covered in this book.

IBM Redbooks publications

The following IBM Redbooks publications provide additional information about the topics inthis document. Note that some publications referenced in this list might be available insoftcopy only:

IBM System Storage Solutions Handbook, SG24-5250

IBM System Storage N series Software Guide, SG24-7129

Implementing IBM Storage Data Deduplication Solutions , SG24-7888

IBM System Storage N series MetroCluster, REDP-4259

IBM System Storage N series MetroCluster Planning Guide, REDP-4243

You can search for, view, or download Redbooks publications, Redpaper publications,Technotes, draft publications, and Additional materials, as well as order hardcopy Redbookspublications, at this Web site:

ibm.com/redbooks

Other publications

These publications are also relevant as further information sources:

Real-time Compression Appliances: Installation and Planning Guide, Version 3 Release 7,

GI13-1221-00

Real-time Compression Appliances: Administration Guide, Version 3 Release 7,

GI13-1221-00

Real-time Compression Appliances: CLI Command Reference, Version 3 Release 7 

IBM Real-time Compression Appliances Version 3 Release 7 - Release Notes 

Online resources

These Web sites are also relevant as further information sources:

IBM Real-time compression:

http://www-03.ibm.com/systems/storage/solutions/rtc/

IBM Real-time Compression Appliance STN6500:

http://www-03.ibm.com/systems/storage/network/rtc/stn6500/

IBM Real-time Compression Appliance STN6800:

http://www-03.ibm.com/systems/storage/network/rtc/stn6800/index.html

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 160/168

146  Introduction to IBM Real-time Compression Appliances

IBM RTCA Support overview:

http://www.ibm.com/storage/support/rtc

Reducing NAS Costs with Real-time Data Compression:

http://wikibon.org/wiki/v/Reducing_NAS_Costs_with_Real-time_Data_Compression

IBM Network attached storage (NAS):

http://www-03.ibm.com/systems/storage/network/

IBM System Storage N6000 series:

http://www-03.ibm.com/systems/storage/network/n6000/appliance/index.html

IBM ProtecTIER Deduplication Solutions:

http://www-03.ibm.com/systems/storage/tape/protectier/

Help from IBM

IBM Support and downloads:

ibm.com/support

IBM Global Services:

ibm.com/services

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 161/168

 © Copyright IBM Corp. 2011. All rights reserved.147

Index

Numerics

10 GbE ports 282452-650 262452-680 26802.3ad 55

AAC connectors 29Active-backup 55administration 69advantages, storage 24Amount of Changes 76antivirus 42, 116architectural planning 38ARJ utility 9autosupport 117

Bbackup 109

configuration 71, 109base model 26Bond 39, 53

command 57create 54modes 55

Bridge 43, 53command 61configuration 53

create 57parameters 60

bridge 39bypass 39

Ccable lock 29cables 39cabling 48challenges

high availability 2increasing data storage 2power, cooling and floor space 2

CIFS 82, 95, 118components

back 27front 27hardware 25software 25, 31

compress mode 79, 83–84changing 85

compressed traffic 35compression 2

benefits 2

history 8in real-time 17

post-processing optimization 12ratio 35real-time 12reversible 17statistics 107use cases 3

compression accelerator 17, 72monitoring 77settings 73shares 73status 77

compression filters 79CIFS 82exclude 86

NFS 83compression modes 79configuration

base model 26configure 50

Bond 55Bridge 58compression accelerator 72DNS 107high availability 62LDAP 99management port 51network 54security 52

SNMP 97system options 114

connecting the RTCA 48connecting to the web interface 71conserving file attributes 20copper ports 28CRC 22cyclic redundancy check. see CRC

Ddata deduplication 11data efficiency 9data integrity 22

data recovery utility 119database 141DataMotion 137date and time 105deduplication 11, 140deployment 47design

considerations 15N series 123NAS 123ProtecTIER 139

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 162/168

148  Introduction to IBM Real-time Compression Appliances

solutions 123device information 89diagnostics 71, 119direct connection 49direct management connection 48Directories to Ignore 76DNS 107

EEasy Tier

data allocation 10Easy Tiering 10environment 30EtherChannel 55

Ffactory defaults

defaults 110Fano, Robert 8file attributes

conserving 20Flash Copy 9Free Space Threshold 76front-panel 27

Ggrowth rate 38guardian process 116

Hhardware configuration file 71

update 113

high availability 62, 78import configuration 64panel 65synchronize automatically 65synchronize manually 63upgrade 113using CLI 67

history 8hostname 91Huffman coding 17

II/O 35IBM System Storage N series. see N seriesILM 11implementation 37industry requirement 1Information Life-cycle Management. see ILMinstallation steps 47integrity

at network level 22at protocol layer 23at storage layer 23

integrity of data 22inter-site link failure handling 135

Interval Between Files 76IP addresses 44irreversible data compression 12

Llayer

protocol 23storage 23LDAP 71, 99, 107

configure 99diagnose 103parameters 99port number 101type 99

Lempel, Abraham 8Lempel-Ziv algorithm 17Linear Tape Open. see LTOLink Status Mirroring. see LSMlogical interfaces 40login 51

LSM 20, 43LTO 13LZ 19LZ78 8LZH 9LZW 8

Mmaintenance 71management port 29Maximum Total Throughput 76MetroCluster 133mode

compress 79compression disabled 81transparent 79

monitoring 88Monitoring and Reporting Manager. see MRMMorse code 8MRM 18, 20MultiStore 136

NN series 123

active/passive path, RTCA HA pair 127DataMotion 137design for MetroCluster 133

dual node solutions 131dual-node, active/passive RTCA on LACP bonds 132LACP port aggregation configuration 129MetroCluster solutions 133MultiStore 136RTCA star topology 135single node solutions 124single RTCA, active/passive path 125single-node LACP virtual interface 130solution design 123

NAS 123

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 163/168

Index149

solution design 123NetApp FAS 83network interface ports 44network links 44network panel 54NFS 83, 95NTP 107

Ooperating environment 30optical ports 29options 71Oracle 141

database 141database backup 141

Pparallelism 35performance

best practices 34

considerations 21requirements 34response time 34scalability 34throughput 34

physical installation 48physical specifications 29PKZIP 8port aggregation 42ports 39post-processing optimization 12power supply unit 29ProtecTIER 139

Oracle environment 142solution design 140

protocol layer 23

RRACE 13, 18

logical overview 19rack considerations 38Random Access Compression Engine. see RACEread cache 34Real-time compression 12Real-time Compression Appliance. see RTCArear-panel 27reboot 108

recovery 119logs 122procedure 120tasks 121

Redbooks Web site 145Contact us xii

remote connection 49remote management connection 49response time 34restore 109

configuration 109

restore factory defaults 110reversible data compression 12, 17RTCA 33

administration 69advantages 24approach 16bridge 39

cabling 48configure 50connecting 48design 15logical interfaces 40menu 70network terminology 39overview 16performance 33STN6500 26STN6800 26

S

scalability 34scheduling 75security 71security configuration 52serial console port 29Shannon, Claude E. 8shutdown 108SMB2 118SMTP 107snapshots 20SNMP 71, 97

devault values 98monitoring parameters 98parameters 97

status check 98software 31

installation 111upgrade 111

solution design 123space efficient 9specifications 29

physical 29technical 30

SSH 52statistics 107status 71, 89

compression 95status display 89

STN6500 26, 38, 124STN6800 26, 38storage

status monitoring 94storage layer 23storage status 94storage system interfaces 44Streaming Lossless Data Compression 13supported clients and servers 30synchronizing high availability automatically 65synchronizing high availability manually 63syslog servers

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 164/168

150  Introduction to IBM Real-time Compression Appliances

remote setup 106system options 114

Ttechnical specifications 29–30terminology 39

throughput 34time and date 105timeout value 107transparent mode 79–80, 84transparent traffic 35

UUnified Protocol Manager. see UPMupgrade 71, 111UPM 18, 20use cases 3

Vvirtual interfaces 40VLAN ID 59VLAN tagging 44

Wwatchdog 116web interface 70Welch, Terry 8welcome screen 50

ZZiv, Jacob 8

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 165/168

 (   0 .2 ”   s  pi  n e )  

 0 .1 7 ”  <-> 0 .4 7  3 ”  

 9  0 <->2 4  9   p a g e s 

I  n  t  r  o  d  u  c  t  i    o n  t   o 

I  B M R  e  a l  - t  i   m e  C  o m p r  e  s  s i    o n A  p  p l  i    a n  c  e  s 

I  n  t  r  o  d  u  c  t  i    o n  t   o I  B M R  e  a l  - t  i   m e 

 C  o m p r  e 

 s  s i    o n A  p  p l  i    a n  c  e  s 

I  n  t  r  o  d  u 

 c  t  i    o n  t   o I  B M

 R  e  a l  - t  i   m e 

 C  o m p r  e  s  s i    o n A  p  p l  i   

 a n  c  e  s 

I  n  t  r  o  d  u  c  t  i    o n  t   o I  B M R  e  a l  - t  i   m e  C  o m p r  e  s  s i    o n A 

 p  p l  i    a n  c  e  s 

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 166/168

I  n  t  r  o  d  u 

 c  t  i    o n  t   o I  B M

 R  e  a l  - t  i   m e 

 C  o m p r  e  s  s i    o n A  p  p l  i   

 a n  c  e  s 

I  n  t  r  o  d  u 

 c  t  i    o n  t   o I  B M

 R  e  a l  - t  i   m e 

 C  o m p r  e  s  s i    o n A  p  p l  i   

 a n  c  e  s 

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 167/168

8/3/2019 Introduction to IBM Real-Time Compression Appliances

http://slidepdf.com/reader/full/introduction-to-ibm-real-time-compression-appliances 168/168

 ® 

INTERNATIONALTECHNICALSUPPORTORGANIZATION

BUILDING TECHNICALINFORMATION BASED OPRACTICAL EXPERIENC

Introduction to IBM

Real-time CompressionAppliances

See how seamless

compression

integrates into

storage environments

Get familiar with the

leading edge

real-time

compression solution

Continuing its commitment to developing and delivering

industry-leading storage technologies, IBM is introducing the IBM

Real-time Compression Appliances for NAS, an innovative new storage

offering that delivers essential storage efficiency technologies,

combined with exceptional ease of use and performance.

In an era when the amount of information, particularly in unstructured

files, is exploding, but budgets for storing that information are

stagnant, IBM Real-time Compression technology offers a powerful

tool for better information management, protection, and access.

IBM Real-time Compression can help slow the growth of storage

acquisition, reducing storage costs while simplifying both operations

Back cover