IBM Systems Storage Toolbox V4

8/11/2019 IBM Systems Storage Toolbox V4

1/44


2/44

2013 IBM Corporation Agenda Overview

Disclaimer

3 steps process

Perl scripting SSH & SCP

DS CLI

Directory and file structure

Scripts to gather raw data

Scripts to parse & format data

MS Excel files to import formatted data

Scripts to manage Copy services

Scripted Disaster recovery for VMware (SAN Volume Controller & Storwize V7000)

See also the presentation: Scripted-DR for VMware.pptx for more details

Taking multiple FlashCopy at the Disaster Recovery site

Other scripts Extract columns for CSV files

Gather VMware storage configuration (script created but do slides yet)

Send commands in parallel on multiple IBM/Brocade SAN switches

Collect an SVC snap on SVC and Storwize V7000

Collect an IBM/Brocade supportSave

Collect storage configuration on servers2

http://cattail.boulder.ibm.com/cattail/#[email protected]/files/09231B00432D3DDC8915631F093F23B6
http://cattail.boulder.ibm.com/cattail/http://cattail.boulder.ibm.com/cattail/http://cattail.boulder.ibm.com/cattail/


3/44

2013 IBM Corporation

OVERVIEW

3


4/44

2013 IBM Corporation Disclaimer

The tools (scripts and Excel files) provided in this toolbox have to be used AS IS

Do not call IBM support these are not official tools

Request for improvements, comments and debugging may be sent to my email address

([email protected]) and will be handled if possible and when possible

BAU is my priority

Any of your own improvements to this toolbox are welcomed

Before sending any request for help

Read carefully the man pages of each script as well as the syntax help

Read carefully this presentation

4
mailto:[email protected]:[email protected]


5/44

2013 IBM Corporation IBM Systems Storage Toolbox

5

Configuration Performance Copy Services

Storwize V7000 Unified

& SONAS

SAN Volume Controller

& Storwize V7000

DS3000, DS4000,

DS5000 & DCS3700

XIV & DS8000 support limited to configuration

IBM/Brocade/Cisco

SAN switches & directors


6/44

2013 IBM Corporation 3 steps process

1. Gatherconfiguration and/or performance files GatherCfg.cmdFor SVC and Storwize V7000 configuration files

GatherPerf.plFor SVC and Storwize V7000 performance files

sonasGatherCfg.plFor SONAS and Storwize V7000 Unified configuration & performance files

ds8kGatherCfg.cmd

For DS8000 configuration files xivGatherCfg.cmdFor XIV configuration files

ds5kGatherCfg.cmd& ds5kGatherCfg.shFor DS3000, DS4000, DS5000 & DCS3700 profile as well as

support Data

ds5kGatherPerf.cmd& ds5kGatherPerf.shFor DS3000, DS4000, DS5000 & DCS3700 profile &

performance statistics

2. ParseSplit the raw data by data type, then consolidate it to regroup

information from multiple clusters ParseCfg.plFor SVC and Storwize V7000 configuration files

ParsePerf.plFor SVC and Storwize V7000 performance files

ds8kParseCfg.plFor DS8000 configuration files

xivParseCfg.plFor XIV configuration files

ds5kParseCfg.plFor DS3000, DS4000, DS5000 & DCS3700 configuration files

ds5kParsePerf.plFor DS3000, DS4000, DS5000 & DCS3700 performance file

Note: For SONAS and Storwize V7000 Unified file modules, the output of the sonasGatherCfg.plis already well formatted

3. Import Formatted data is imported into Excel 2007 or 2010worksheets using macros

ImportCfg.xlsmFor SVC and Storwize V7000 configuration files

ImportPerf.xlsmFor SVC and Storwize V7000 performance files

sonasConfigImport.xlsmFor SONAS and Storwize V7000 Unified configuration & performance files

ds8kImportCfg.xlsmFor DS8000 configuration files

xivImportCfg.xlsmFor XIV configuration files

ds5kImportPerf.xlsm

For DS3000, DS4000, DS5000 & DCS3700 performance files Advanced macros to prepare performance charts and pivot tables under construction6

Gather

Parse

Import


7/44

2013 IBM Corporation Perl scripting

Most scripts are using Perl language to make them easily portable to other

operating systems

Install a Perl interpreter like Activeperl

http://www.activestate.com/activeperl/downloads

The system variable PATH should be point at the Perl bin directory

To simplify Perl scripting, modules are used

They can be downloaded from the following location:

http://www.cpan.org/modules/index.html

Usage of modules in perl scripting

Example in ParseCfg.pl

# Modules

#use strict;

use File::Path;

use Getopt::Long;

use XML::TreePP;

use Spreadsheet::WriteExcel;

use Text::CSV_XS;

To avoid complex module installation,

Only default standard modules are used by the gathering Perl scripts

Advanced (none standard) modules are only used by the parsing Perl scripts

The commandpod2textis being used by the man option and requires you to run thePerl scripts from their hosting directory7
http://www.activestate.com/activeperl/downloadshttp://www.cpan.org/modules/index.htmlhttp://www.cpan.org/modules/index.htmlhttp://www.activestate.com/activeperl/downloads


8/44

2013 IBM Corporation Command Line Interfaces to Storage Devices

SSH tools like Putty for SVC, Storwize V7000, SONAS, Storwize V7000 Unified

DS CLI for DS8000

xcli for XIV

DS Storage Manager CLI for DS3000, DS4000, DS5000 and DCS3700

8


9/44

2013 IBM Corporation SSH & SCP

To access SAN Volume Controller, Storwize V7000, Scale Out NAS, and Storwize

V7000 Unified using SSH & SCP

Depending on the code level, an SSH key might be required

Check the CLI users guide to learn about it

ftp://ftp.software.ibm.com/storage/san/sanvc/V6.2.0/SVC_and_V7000_Command_Line_Interface_Us

ers_Guide.pdf

ftp://ftp.software.ibm.com/storage/san/sanvc/V6.3.0/SVC_and_V7000_Command_Line_Interface_Users_Guide.pdf

A tool such as Putty should be installed

http://www.chiark.greenend.org.uk/~sgtatham/putty/download.html

Putty installer comes withplinkandpscp, two executables required by gathering scripts

A Putty session for each SVC and/or Storwize V7000 system should be created The system variable PATH should be pointing at the Putty installation directory

On Unix systems, OpenSSH could be used to replace Putty

9
ftp://ftp.software.ibm.com/storage/san/sanvc/V6.2.0/SVC_and_V7000_Command_Line_Interface_Users_Guide.pdfftp://ftp.software.ibm.com/storage/san/sanvc/V6.2.0/SVC_and_V7000_Command_Line_Interface_Users_Guide.pdfftp://ftp.software.ibm.com/storage/san/sanvc/V6.3.0/SVC_and_V7000_Command_Line_Interface_Users_Guide.pdfftp://ftp.software.ibm.com/storage/san/sanvc/V6.3.0/SVC_and_V7000_Command_Line_Interface_Users_Guide.pdfhttp://www.chiark.greenend.org.uk/~sgtatham/putty/download.htmlhttp://www.chiark.greenend.org.uk/~sgtatham/putty/download.htmlftp://ftp.software.ibm.com/storage/san/sanvc/V6.3.0/SVC_and_V7000_Command_Line_Interface_Users_Guide.pdfftp://ftp.software.ibm.com/storage/san/sanvc/V6.3.0/SVC_and_V7000_Command_Line_Interface_Users_Guide.pdfftp://ftp.software.ibm.com/storage/san/sanvc/V6.2.0/SVC_and_V7000_Command_Line_Interface_Users_Guide.pdfftp://ftp.software.ibm.com/storage/san/sanvc/V6.2.0/SVC_and_V7000_Command_Line_Interface_Users_Guide.pdf


10/44

2013 IBM Corporation DS CLI

DS8000 Command Line Interface MUST be installed for any script involving gathering

or monitoring the DS8000

Currently only the ds8kGatherCfg.cmdscript is using it

Download the code from here

Up to 4.3 code: http://www-01.ibm.com/support/docview.wss?uid=ssg1S4000641

From 6.0 up to 6.3 code: http://www-01.ibm.com/support/docview.wss?uid=ssg1S4000983

Directly from the FTP site:

ftp://ftp.software.ibm.com/storage/ds8000/updates/DS8K_Customer_Download_Files/CLI/

And get documentation from here

DS8000 InfoCentre: http://publib.boulder.ibm.com/infocenter/dsichelp/ds8000ic/index.jsp

DS CLI Users Guide: http://www-01.ibm.com/support/docview.wss?uid=ssg1S7002620

10
http://www-01.ibm.com/support/docview.wss?uid=ssg1S4000641ftp://ftp.software.ibm.com/storage/ds8000/updates/DS8K_Customer_Download_Files/CLI/ftp://ftp.software.ibm.com/storage/ds8000/updates/DS8K_Customer_Download_Files/CLI/http://publib.boulder.ibm.com/infocenter/dsichelp/ds8000ic/index.jsphttp://www-01.ibm.com/support/docview.wss?uid=ssg1S7002620http://www-01.ibm.com/support/docview.wss?uid=ssg1S7002620http://www-01.ibm.com/support/docview.wss?uid=ssg1S7002620http://www-01.ibm.com/support/docview.wss?uid=ssg1S7002620http://publib.boulder.ibm.com/infocenter/dsichelp/ds8000ic/index.jspftp://ftp.software.ibm.com/storage/ds8000/updates/DS8K_Customer_Download_Files/CLI/ftp://ftp.software.ibm.com/storage/ds8000/updates/DS8K_Customer_Download_Files/CLI/ftp://ftp.software.ibm.com/storage/ds8000/updates/DS8K_Customer_Download_Files/CLI/ftp://ftp.software.ibm.com/storage/ds8000/updates/DS8K_Customer_Download_Files/CLI/ftp://ftp.software.ibm.com/storage/ds8000/updates/DS8K_Customer_Download_Files/CLI/http://www-01.ibm.com/support/docview.wss?uid=ssg1S4000641http://www-01.ibm.com/support/docview.wss?uid=ssg1S4000641http://www-01.ibm.com/support/docview.wss?uid=ssg1S4000641


11/44

2013 IBM Corporation Directory and file structure examples

Root directory where scripts and tools are stored and executed

Raw configuration files

Could be coming from multiple Disk Subsystems, SVC and/or Storwize V7000 clusters

except for SONAS and Storwize V7000 Unified

GatherCfg.cmd & ds8kGatherCfg.cmdTarget directory

(TGTDIRvariable at line 22)

GatherPerf.pl & sonasGatherCfg.plTarget directory (--CfgDir option)

ParseCfg.pl& ds8kParseCfg.plSource directory (--SourceDir option)

Raw performance files

Should be coming from the same SVC and/or Storwize V7000 cluster

GatherPerf.plTarget directory (--StatsDir option)

ParsePerf.plSource directory (--SourceDir option)

Formatted configuration files

ParseCfg.pl& ds8kParseCfg.plTarget directory (--TargetDir option)

CSV format even if extension is .txt during import into Excel, .csv extensiondoes convert some elements as number: for example an HBA port WWPN with

no letter and only figures would be transformed

ImportCfg.xlsmSource CSV files (2- Import CSV files button and macro)

Formatted performance files

ParsePerf.plTarget directory (--TargetDir option)

ImportPerf.xlsmSource CSV files (2- Import CSV files button and macro)12


12/44


SCRIPTS TO GATHER RAW DATA

13


13/44

2013 IBM Corporation GatherCfg.cmd

This Windows command line script gathers SAN Volume Controller (SVC) and Storwize

V7000 the backup XML file of the configuration as well as some additional information

Prerequisite

Install Putty (with the plink and pscp executables)

Environment variables

If Putty installation directory is not in the PATH system variable, you may

want to uncomment (remove rem) and update the following line

rem cd c:\putty

You MUST provide a session name defined in Putty to access this SVC orStorwize V7000 cluster

set PUTTYSESSIONNAME=SVC1

You MUST specify a directory name where you need to save the output files

and backup configuration files gathered by this script

set TGTDIR=.\Raw_Cfg

You MUST define the SSH and SCP sessions will be opened with the target SVC

or Storwize V7000 cluster set SSH=plink -load %PUTTYSESSIONNAME% -l alexis

set PSCP=pscp -unsafe -load %PUTTYSESSIONNAME% [email protected]:

All output files will be renamed to contain the SVC or Storwize V7000 cluster

name to allow you to consolidate from here the configuration of multiple

systems

14

d k h f d
mailto:[email protected]:[email protected]


14/44

2013 IBM Corporation ds8kGatherCfg.cmd

This Windows command line script gathers DS8000 configuration information

Prerequisite

Install DS CLI (The DS8000 command line interface)

Environment variables If DS CLI installation directory is not in the PATH system variable, you may

want to uncomment (remove rem) and update the following line

rem cd c:\dscli

You MUST provide at least 1 Hardware Management Console IP address or hostname

for the DS8000 and if only 1 exist, you have to provide the same IP address or

hostname for the second HMC variable

set HMC1=9.188.68.200 set HMC2=9.188.68.200

You MUST specify a user ID and its password to access the HMC

set ID=admin

set PW=tuc3son

You MUST specify a directory name where you need to save the output files

and backup configuration files gathered by this script

set TGTDIR=.\Raw_Cfg

All output files will be renamed to contain the DS8000 HMC ID or Storage

Facility Image ID to allow you to consolidate from here the configuration of

multiple systems

15

h f l


15/44

2013 IBM Corporation sonasGatherCfg.pl

This Perl script gathers SONAS and Storwize V7000 Unified configuration &

performance statistics then consolidate them into CSV files

With Storwize V7000 Unified, only the file side of the configuration will be gathered

Requirements

Install Putty (with the plink executables)

To get help use the following syntax: ParseCfg.pl --help

To view the man page use the following syntax: ParseCfg.pl --man



This script requires several Perl modules but they should all be part of any Perl base

install packages

For Unix environment, update the $sshvariable in the script (line 229)

Configuration and performance information will be added to any existing files in

the target directoryTherefore the configuration and performance statistics of

multiple systems could be consolidated here

16

G h Cf l O i
http://www.activestate.com/activeperl/downloadshttp://www.activestate.com/activeperl/downloads


16/44

2013 IBM Corporation sonasGatherCfg.pl - Options Required Options

sonas: Specifies the SONAS or Storwize V7000 Unified cluster management

IP address or name (if defined in the DNS or hosts file)

Optional Options

user: Specifies the user name to access SONAS or Storwize V7000 Unified cluster

Default is "admin

pwd: Specifies the password for the above user name to

access SONAS or Storwize V7000 Unified cluster

Default is "admin

putty (Windows only): Specifies the PuTTY session name

for the SONAS or Storwize V7000 Unified cluster

This option is only available for Windows environment.

TargetDir: Specifies the directory to save the CSV files

Default is ./Raw_cfg/" for Linux and .\Raw_Cfg\" for Windows

perf: Specifies whether or not you want to

gather performance statistic

The window size can be provided (day, or week, or month, or year)

When "none" is specified, no performance statistics are gathered ("none" is also

the default value)

help: Shows help screen; Default is don't show

man: Shows man page; Default is don't show

debug: Sets debug mode; Debug mode displays all internal operations and leaves stats files in

scripts directory Default is no debug mode

17

G h P f l


17/44

2013 IBM Corporation GatherPerf.pl

This Perl script collects SVC and/or Storwize V7000 (storage module) cluster

performance statistics (IOSTATS) as well as a backup XML configuration file

generated by the command svcconfig backup, and stores them on local

directories

Requirements


To get help use the following syntax

> ParseCfg.pl --help

To view the man page use the following syntax

> ParseCfg.pl --man



This script requires several Perl modules but they should all be part of any Perl base

install packages

An IOSTAT file name is containing the node ID and timestamp Therefore the

performance statistics of multiple systems could be consolidated here

18

G th P f l P f fil


18/44

2013 IBM Corporation GatherPerf.plPerformance files

Nn_stats_NODE_Name_YYMMDD_HHMMSS for nodes statistics

Clearly some of the largest files because it contains CPU, Cache, Partition, Ports and

Nodes statistics.

Nv_stats_NODE_Name_YYMMDD_HHMMSS for VDisks statistics

With large environments, these files can be larger than Nodes because a massive number

of statistics combined with a massive number of objects.

You only have up to 8 nodes in an SVC or Storwize V7000 cluster, while you have dozens,hundreds or even thousands of VDisks.

Nm_stats_NODE_Name_YYMMDD_HHMMSS for MDisks statistics

Probably the smallest files because we always have a limited number of MDisks in a

system.

Nd_stats_NODE_Name_YYMMDD_HHMMSS for Drives statistics> Larger files than MDisks but still not as large as Nodes or VDisk statistics because limited

number of stats even when we have a large amount of hard disk drives.

19

G th P f l O ti (1/2)


19/44

2013 IBM Corporation GatherPerf.plOptions (1/2)

Required Options

svcs: Specifies the SVC or Storwize V7000 cluster management IP address or

name (if defined in the DNS or hosts file)

putty (Windows only): Specifies the PuTTY session name for the SVC cluster;This option is only available for Windows environment

Optional Options

user: Specifies the user name for the SVC cluster

Default is "admin

interval: Specifies the interval time (minute) for performance data collection You can specify from 1 up to 60 minutes, default is "10"

With an interval of "1", it means that for 24 hours we would have 1,440 minutes, and therefore 5,760 files

To avoid dealing with a huge amount of IOSTATS files,

> If you monitor over a period of 24 hours, try to keep the interval at 10 minutes or above

> If you monitor over a period of 12 hours, try to keep the interval at 5 minutes

> Only gather statistics with 1 up to 4 minutes when troubleshooting performance, and therefore targeting 1 to 6 hourswindow

> In large environments with many Virtual Disks and/or Managed Disks, the amount of performance statistics can use a

large capacity on disk and might bring challenges to transfer the data on the machine used to parse those files

Increase your interval

> When dealing with a large volume of files, you will need a lot of memory on the machine used to parse those statistics

help: Shows help screen; Default is don't show

man: Shows man page; Default is don't show20

G th P f l O ti (2/2)


20/44

2013 IBM Corporation GatherPerf.plOptions (2/2) Optional Options (cont)

nochange: Specifies this option if you don't want to change interval time, clear all current

iostats files in the SVC or Storwize V7000 cluster

By default it changes interval time to 5 minutes, and clears all current iostats files in the SVC or Storwize

V7000 cluster

iterations: Specifies the number of iterations for performance data collection;

When the number of iterations is set to "0", the script will run until you Ctrl+c it

Default is "0"

When the script is schedule to run periodically, be mindful that you do not want

the new kick-off be impacting the finishing one

> For example if you run an interval of 1 minutes, the last interval 1,440 of day 1 will

still run when the script is started on day 2 You should not request 1,440 intervals

to cover a day but 1439 intervals

> 10 minutes interval * 144 iterations for a dayyou need to request 143 intervals

if the script is schedule to run every day

> 5 minutes interval * 288 iterations for a dayyou need to request 287 intervals


> 1 minute interval * 1,440 iterations for a dayyou need to request 1,439 intervals


StatsDir: Specifies the directory to save iostats files

Default is "/tmp/scripts/iostats/" for Linux and AIX, and "C:\temp\scripts\iostats\

for Windows

The directory path can be short or long, but it MUST finish with \ on Windows and / on Unix

CfgDir: Specifies the directory to save the XML file with the backup of the

configuration

Default is "/tmp/scripts/config/" for Linux and AIX, and "C:\temp\scripts\config\" for Windows

The directory path can be short or long, but it MUST finish with \ on Windows and / on Unix21


21/44


SCRIPTS TO PARSE & FORMATDATA

22

P Cf l


22/44

2013 IBM Corporation ParseCfg.pl

This Perl script parse backup XML configuration files for SVC and Storwize V7000

clusters generated by the command svcconfig backup or gathered by scripts such

as GatherCfg.cmdor GatherPerf.pl

It then converts them to CSV format and will even by default consolidate those

into an Excel file

Because Excel would convert automatically the format of some values when importing

CSV files, the generated files are CSV format but kept with ".txt" extensions Requirements

To get help use the following syntax: ParseCfg.pl --help

To view the man page use the following syntax: ParseCfg.pl --man



This script requires several Perl modules:

Copy the file /Perl modules/


23/44

2013 IBM Corporation ParseCfg.pl - Options

Required Options

SourceDir: Specifies the source directory

where all XML and/or output of "svcinfo" commands (such as "svcinfo

lsfabric -delim ,") are stored

The XML files MUST have been created using the "svcconfig backup" command

or via the script GatherCfg.plor GatherPerf.pl

> The best is to rename those XML files from the original name "svc.config.backup.xml

to a new name ".xml

The directory path can be short or long, but it MUST finish with \ on Windows

and / on Unix

TargetDir: Specifies the target directory where all

output CSV files of this script will be stored

The directory will be deleted then recreated each time this script is running

The directory path can be short or long, but it MUST finish with \ on Windowsand / on Unix

Optional Options

help: Shows help screen

Default is don't show

man: Shows man page Default is don't show

24

ds8kParseCfg pl


24/44

2013 IBM Corporation ds8kParseCfg.pl

This Perl script parse output DS CLI files gathered using the script

ds8kGatherCfg.cmd

It then converts them to CSV format and will even by default consolidate those

into an Excel file

Because Excel would convert automatically the format of some values when importing

CSV files, the generated files are CSV format but kept with ".txt" extensions

Requirements To get help use the following syntax: ds8kParseCfg.pl --help

To view the man page use the following syntax: ds8kParseCfg.pl --man



This script requires several Perl modules: Copy the file \Perl_Modules\TreePP.pm into the directory \lib\XML\

Copy the directory \Perl_Modules\Spreadsheet\ in to the directory \lib\

25

ds8kParseCfg pl Options


25/44

2013 IBM Corporation ds8kParseCfg.pl - Options

Required Options

SourceDir: Specifies the source directory

where all DS CLI output files are stored

The output files MUST have been created using script ds8kGatherCfg.pl


and / on Unix

TargetDir: Specifies the target directory where all

output CSV files of this script will be stored

The directory will be deleted then recreated each time this script is running


and / on Unix

Optional Options

help: Shows help screen Default is don't show

man: Shows man page


26

ParsePerf pl


26/44

2013 IBM Corporation ParsePerf.pl

This Perl script parse all SVC and Storwize V7000 performance statistics (IOSTATS)

contained in a source directory and put them in a target directory in a CSV format

after

Averages were calculated when dealing with counters

And statistics added when the same object is defined across multiple nodes (Managed

Disks, Drives, Virtual Disks)

It then converts them to CSV format Because Excel would convert automatically the format of some values when importing

CSV files, the generated files are CSV format but kept with ".txt" extensions

Requirements

To get help use the following syntax: ParsePerf.pl --help

To view the man page use the following syntax: ParsePerf.pl --man Install a Perl interpreter like Activeperl


This script requires several Perl modules:

Copy the file \Perl_Modules\TreePP.pm into the directory \lib\XML\

27

2013 IBM C i ParsePerf pl Options


27/44

2013 IBM Corporation ParsePerf.pl - Options

Optional Options

SourceDir: Specifies the directory with the iostats

files gathered using the script GatherPerf.pl

Default is "/tmp/scripts/iostats/" for Linux and AIX,

and "C:\temp\scripts\iostats\" for Windows


and / on Unix

TargetDir: Specifies the directory where you want

to dump all the performance statistics calculated via this script

Default is "/tmp/scripts/output/" for Linux and AIX,

and "C:\temp\scripts\output\" for Windows


and / on Unix



man: Shows man page


debug: Sets debug mode; Debug mode displays all internal operations

Default is no debug mode28

2013 IBM C ti


28/44


MS EXCEL FILES TO IMPORTFORMATTED DATA

29

2013 IBM Corporation Microsoft Excel 2007 & 2010


29/44

2013 IBM Corporation Microsoft Excel 2007 & 2010

Steps are numbered in the file:

1. Delete existing worksheets

Will not delete the ones we need to keep (ie. STATS with performance statistics)

2. Import CSV files

Selecting CSV files generated by the ParseCfg.pl and ParsePerf.pl scripts

3. Format header

Only for performance statistics

Headers or the columns are formatted using the STATS worksheet

4. Select Performance Statistics

Only for performance statistics

To generate the charts and pivot tables

Links to generated worksheets are automatically created and another on top ofeach worksheet is created to return to the MAIN worksheet

With Excel 2007 & 2010, the maximum number of rows per worksheet is

"1,048,340

None of the Excel files and macros were created for old version of Excel

30

2013 IBM Corporation Example - ImportCfg xlsm


30/44

2013 IBM Corporation Example - ImportCfg.xlsm

1stuse the 1- Delete all worksheets to delete old configuration worksheets

If only the MAINworksheet exist, this step is not required

2nduse the 2- Import CSV files then select all the files formatted with the

ParseCfg.plscripts

In our sample output provided in the comment/notes of the slides GatherCfg.cmd and

ParseCfg.pl, we would be pointing at the directory

> C:\temp\Toolbox\SVC_SWV7000\Formatted_Cfg\

31

2013 IBM Corporation Summary worksheet and capacity by Pool


31/44

2013 IBM Corporation Summary worksheet and capacity by PoolIncluding Capacity History

32

New!

2013 IBM Corporation Example statistics generated by this tool


32/44

2013 IBM Corporation Example statistics generated by this tool

33

Total IOps per MDisk

Maximum Cache Fullness Percentage per node

CPU Utilisation Percentage per node

2013 IBM Corporation List of Excel files provided in the Toolbox


33/44

2013 IBM Corporation List of Excel files provided in the Toolbox To import SVC and Storwize V7000 configuration files

ImportCfg.xlsmImport output generated by the script ParseCfg.pl

To import SONAS and Storwize V7000 Unified file modules configuration and

performance files sonasImportCfg.xlsmImport output generated by the script sonasGatherCfg.pl

To import SVC and Storwize V7000 performance files

ImportPerf.xlsmImport output generated by the script ParsePerf.pl

To import DS8000 configuration files

ds8kImportCfg.xlsmImport output generated by the script ds8kParseCfg.pl

To import XIV configuration files

xivImportCfg.xlsmImport output generated by the scriptxivParseCfg.pl

To import XIV performance files

xivImportPerf.xlsmImport output from XIV GUI or CLI

To import DS3000, DS4000, DS5000 & DCS3700 configuration files

ds5kImportCfg.xlsmImport output generated by the script ds5kParseCfg.pl

To import DS3000, DS4000, DS5000 & DCS3700 performance files

ds5kImportPerf.xlsmImport output generated by the script ds5kParsePerf.pl

To import TPC exported performance statistics in CSV format with ALL columns

including header

tpcImportPerf.xlsm34



34/44


SCRIPTS TO MANAGE COPYSERVICES

35

2013 IBM Corporation Scripted Disaster Recovery for VMware


35/44

p

Site 1 - Datacentre 1

Powershell script written for SVC & Storwize V7000 in a VMware environment:

It performs Failover & Failback of Remote Copy (RC) consistency groups and optionally create

or reuse a FlashCopy (FC) consistency groups at the recovery site

When replicating from Site 1 to Site 2

Production on H1, Failover to H2

When replication from Site 2 to Site 1Production on H1, Failover to H2

Note: you could have a consistency group with its associated datastores replicating

from Site 1 to Site 2, while another consistency group with its associateddatastores is replicating from Site 2 to Site 1

Scripted Disaster Recovery for VMware

36

H1 H2 T2

H2 H1T2

Site 1 - Datacentre 1 Site 2 - Datacentre 2

Remote CopyFlashCopy

Production

Production

Practice (test)

Failover

Remote CopyFlashCopy

Practice (test)

Failover

Site 2 - Datacentre 2

2013 IBM Corporation MultiFCCG.pl


36/44

p MultiFCCG.pl

This Perl script was written for SVC & Storwize V7000 to create multiple

Consistency Points at the Disaster Recovery site using target Remote Copy

volumes

Requirements


To get help use the following syntax: MultiFCCG.pl --help

To view the man page use the following syntax: MultiFCCG.pl --man



This script requires several Perl modules but they

should all be part of any Perl base install packages

37

H1 H2

T2

Production

Remote Copy

FlashCopy

Production

Recovery Site

N

N-1

N-2

N-3

N-4

Please refer to the Business Continuity ArchitectureExample 4 of the slide deck IBM Storwize V7000-Overview-v7.2.pptx for the pros and cons of such solution

2013 IBM Corporation MultiFCCG.pl Options (1/2)


37/44

MultiFCCG.pl Options (1/2)

Required Options

svc: Specifies the SVC cluster management IP address or name (if defined

in the DNS or hosts file)

user: Specifies the user name for the SVC cluster

Default is "admin

putty (Windows only): Specifies the PuTTY session name for the SVC cluster

This option is only available for Windows environment.

rccg: Consistency Group re-grouping H1 to H2

remote copy relationships It should be a single Remote Copy Consistency Group name

fccg: Consistency Group re-grouping H2 to T2

FlashCopy mappings

There will be multiple FlashCopy Consistency Group

> VERSION_NUMBER will be defined based on the most recently used (most recent start_time) version and will notexceed the FC_CG_VERSIONS

versions: Number of FlashCopy Consistency Groups to keep.

It can also be considered as the recovery depth

Once you reach this version number limit, you return to version 1 and resycn (start) the FlashCopy

Consistency Group

38

2013 IBM Corporation MultiFCCG.pl Options (2/2)


38/44

MultiFCCG.pl Options (2/2)

Optional Options


Default is don't show.

man: Shows man page


debug: Sets debug mode

Debug mode displays all internal operations and leaves stats files in scripts directory

Default is no debug mode

39



39/44

OTHER SCRIPTS

40

2013 IBM Corporation ExtractColumnsCSV.pl


40/44

ExtractColumnsCSV.pl

This Perl script extracts columns from a CSV file

The goal is for very large environments with huge Vdisk performance statisitics to isolate

the important columns from the rest to reduce the size of the CSV file before

importing it

It would also allow to split a long period into multiple shorter periods

It can also split the output into multiple files when a certain number of intervals

have been reached This is done to avoid have more rows in Excel than actually supported

Output file(s) is(are) stored in the same source directory (where the source CSV

file is stored)

Always run the headeroption first to know what column numbers to extract

Required Options file: Specifies the source CSV file from which we need to extract

columns

It may contain the full path to the file

For example on Unix "--file /tmp/scripts/output/file.csv" or on Windows "--file

C:\temp\scripts\output\file.csv"

41

2013 IBM Corporation ExtractColumnsCSV.pl - Options


41/44

ExtractColumnsCSV.pl Options

Optional Options

columns: Specifies the columns number to extract

from the CSV file (should not be used with the option "--header")

User may want to first use the option "--header" to view the list of columns number for each

column header value.

For example "--columns 1,2,3,4,39,43".

header: Specifies that you want to view the list of columns number for each column

header value (should not be used with the option "--columns")

For example "header

intervals: Specifies the number of intervals to extract in each batch

Once this value is reached, a new output file is used

> It could be also compared to the granularity used to split rows into multiple files

By default all intervals are part of a single extract file by the using the default value of "0

With Excel 2007 & 2010, the maximum number of rows per worksheet is "1,048,340

> When you reach this limit, this script will fail and display the maximum number of intervals that you can have ina batch (extract)



man: Shows man page


42

2013 IBM Corporation More scripts not documented


42/44

p

GatherSvcsnap.pl

Generate and gather an svcsnap with or without livedump, on request or triggered by an

event ID

SAN switches & directors brcdExecCmd.pl

brcdExecCmdSupportSave.pl

brcdFciptunnel.pl

portperfshow2CSV.pl

Unix IOSTATS IOSTAT2CSV.pl

FlashCopy

sourceFlashcopy.ksh & targetFlashcopy.ksh

FCM4Exchange_Backup.cmd & CheckFcmSchedules.ps1

srcvssbkp.cmd & tgtvssbkp.cmd OS configuration

WIN_GatherStorageCfg.cmd & WIN_ParseStorageCfg.pl

AiX_GatherStorageCfg.sh

SOLARIS_GatherStorageCfg.ksh

VMW_GatherStorageCfg.ps143

Always use myperlscript.pl help to get

command syntax with any Perl script

C:\Toolbox\Config\SAN>brcdExecCmd.pl --user toolbox --password

mypassword --switches 10.2.20.6:10.2.20.9:10.2.20.11 --cmd

portperfshow --period 60 --TargetDir .\output\

brcdExecCmd.pl starts with the following options ...

User ID: toolbox

Password: *******

Switches: 10.2.20.6:10.2.20.9:10.2.20.11

Directory for output file: .\output\

FOS CLI command to execute: portperfshow

Operating System type:

Run command portperfshow on the switch 10.2.20.6

Run command portperfshow on the switch 10.2.20.9Run command portperfshow on the switch 10.2.20.11



43/44

44

innovation that matters

Question and Answer Time



44/44

Copyright 2012 by International Business Machines Corporation.

No part of this document may be reproduced or transmitted in any form without written permission from IBM Corporation.

Product data has been reviewed for accuracy as of the date of initial publication. Product data is subject to change without notice. This informationcould include technical inaccuracies or typographical errors. IBM may make improvements and/or changes in the product(s) and/or programs(s) atany time without notice. Any statements regarding IBM's future direction and intent are subject to change or withdrawal without notice, andrepresent goals and objectives only.

References in this document to IBM products, programs, or services does not imply that IBM intends to make such such products, programs orservices available in all countries in which IBM operates or does business. Any reference to an IBM Program Product in this document is notintended to state or imply that only that program product may be used. Any functionally equivalent program, that does not infringe IBM'sintellectually property rights, may be used instead. It is the user's responsibility to evaluate and verify the operation of any on-IBM product, programor service.

THE INFORMATION PROVIDED IN THIS DOCUMENT IS DISTRIBUTED "AS IS" WITHOUT ANY WARRANTY, EITHER EXPRESS OR IMPLIED.

IBM EXPRESSLY DISCLAIMS ANY WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE ORNONINFRINGEMENT. IBM shall have no responsibility to update this information. IBM products are warranted according to the terms andconditions of the agreements (e.g., IBM Customer Agreement, Statement of Limited Warranty, International Program License Agreement, etc.)under which they are provided. IBM is not responsible for the performance or interoperability of any non-IBM products discussed herein.

The provision of the information contained herein is not intended to, and does not, grant any right or license under any IBM patents or copyrights.Inquiries regarding patent or copyright licenses should be made, in writing, to:

IBM Director of Licensing

IBM Corporation

North Castle Drive

Armonk, NY 10504-1785

U.S.A.

Trademarks

The following terms are trademarks of International Business Machines Corporation in the United States, other countries, or both. Other company,product, and service names may be trademarks or service marks of others:

IBM, the IBM logo, ON (logo) DEMAND BUSINESS, DB2, Enterprise Storage Server, FlashCopy, POWER5, Tivoli, TotalStorage, TotalStorageProven, System Storage, System p, System i, System x, System z, AIX, eServer, xSeries, pSeries, iSeries, zSeries, and BladeCenter

Notice, Disclaimer, and Trademark Information

IBM Systems Storage Toolbox V4

Documents

Transcript of IBM Systems Storage Toolbox V4