TSM 6.3 Server_client Enhancements

download TSM 6.3 Server_client Enhancements

of 77

Transcript of TSM 6.3 Server_client Enhancements

  • 7/31/2019 TSM 6.3 Server_client Enhancements

    1/77

    Advanced Technical Skills (ATS) North America

    2012 IBM Corporation

    Tivoli Storage Manager

    Client and Server Enhancements for TSM V6.3

    IBM Advanced Technical Skills

  • 7/31/2019 TSM 6.3 Server_client Enhancements

    2/77

    Advanced Technical Skills (ATS) North America

    2012 IBM Corporation2

    TSM Advanced Technical Support Team

    Dave Canan [email protected]

    Dave Daun

    [email protected]

    Tom Hepner

    [email protected]

    Eric Stouffer

    [email protected]

  • 7/31/2019 TSM 6.3 Server_client Enhancements

    3/77

    Advanced Technical Skills (ATS) North America

    2012 IBM Corporation3

    Topics

    TSM For ERP Support For RMAN Incremental Backups

    AES Encryption

    Processor Value Unit (PVU) Estimate

    Linux Journal Based Backup (JBB)

    Linux Path Name Improvements

    Server Database Backup Improvements

    Automatic Client Deployment Features

    VTL Awareness

    HSM Improvements

    Miscellaneous Client Functions

  • 7/31/2019 TSM 6.3 Server_client Enhancements

    4/77

    Advanced Technical Skills (ATS) North America

    2012 IBM Corporation4

    TSM For ERP Support For RMAN Incremental Backups

  • 7/31/2019 TSM 6.3 Server_client Enhancements

    5/77

    Advanced Technical Skills (ATS) North America

    2012 IBM Corporation5

    Architectural Overview

    TSM for ERP

    integration performance

    transparency

    Oracle

    database backup/restore

    log archive/retrieve

    API

    Tivoli Storage Manager

    automation scalability enterprise-wide

    API

    DB

    TSM for ERP

    daemon

    TSM for ERP

    shared library

    TCP/IPOracle backup

    process

    TSM for ERP

    Admin. Assistant

    TSM ServerDB Server

  • 7/31/2019 TSM 6.3 Server_client Enhancements

    6/77

    Advanced Technical Skills (ATS) North America

    2012 IBM Corporation6

    Integrated FCM & Oracles RMAN Incremental Backup

    DS8k

    FlashCopy Manager

    FlashCopy / Snapshot Backup

    FlashCopy Restore

    FlashCopy Cloning

    TSM for ERP

    Log archive/retrieve, DB restore (PS)

    Offloaded tape backup to TSM (BS)

    Local Area Network

    Storage Area Network

    Database

    Server

    (production)

    Database

    Server

    (backup)

    FCM

    TSM for ERPTSM for ERP

    FCM

    Source

    Volumes Target

    Volumes

    TSM

    Server 1

    TSM

    Server 2

    In previous versions FCM invoked the SAP

    BRBACKUP command which only supportsFull backups.

    During the snapshot offload, V6.3 ERPInvokes RMANs INCREMENTAL BACKUP

  • 7/31/2019 TSM 6.3 Server_client Enhancements

    7/77

    Advanced Technical Skills (ATS) North America

    2012 IBM Corporation77

    AES Encryption

  • 7/31/2019 TSM 6.3 Server_client Enhancements

    8/77

    Advanced Technical Skills (ATS) North America

    2012 IBM Corporation88

    AES Encryption for authentication protocol

    Replacing older DES algorithm with AES algorithm

    56bit encryption vs 128bit encryption

    Specialized devices were capable of breaking DES 56, but AES 128 isorders of magnitude stronger

    The following components updated:

    Client, client API, Server, Storage Agent, Admin Center and Web clientGUI

    Local password stores still uses DES56

    Passwords between the Java GUI interface and dsmagentare transferred in the clear (web browser to the PID)

    Open node registration initial password is sent in the clear

    All components must be 6.3 or authentication will useDES56

  • 7/31/2019 TSM 6.3 Server_client Enhancements

    9/77

    Advanced Technical Skills (ATS) North America

    2012 IBM Corporation99

    Mutual Authentication Process

    1. Client creates session key and client token from random numbers

    2. Client reads password from disk file, decrypts it3. Client encrypts session key and client token using password, sends

    them to server

    4. Server decrypts session key and client token using password stored inits database

    5. Server generates server token from random number

    6. Server encrypts client token and server token using session key, sendsthem to client

    7. Client decrypts both tokens using session key, compares this clienttoken with original token

    8. Client encrypts server token using session key, sends it to server

    9. Server decrypts server token using session key, compares to originaltoken

    These steps have been upgraded from DES 56 to AES 128 Encryption

  • 7/31/2019 TSM 6.3 Server_client Enhancements

    10/77

    Advanced Technical Skills (ATS) North America

    2012 IBM Corporation1010

    Session Key

    Whenever a Session key is used, AES 128 isemployed

    A Session Key is used for:

    Used to encrypt all admin communications

    Used when BA client updates password

    No other client to server communications isencrypted with Session Key

  • 7/31/2019 TSM 6.3 Server_client Enhancements

    11/77

    Advanced Technical Skills (ATS) North America

    2012 IBM Corporation1111

    New Diagnostics

    Hidden parameter available for the server:

    ALLOWAES ON | OFF | AESONLY

    The default is on

    No query command exists to view the setting currently

    Use this parameter only for testing purposes

    Down-level client connection attempts (DES 56) wouldreveal an error message as follows:

    ANR0330W: Session session numberfor node node name (node platformortype) refused - invalid authentication protocol requested.

  • 7/31/2019 TSM 6.3 Server_client Enhancements

    12/77

    Advanced Technical Skills (ATS) North America

    2012 IBM Corporation12

    Processor Value Unit (PVU) Estimate

  • 7/31/2019 TSM 6.3 Server_client Enhancements

    13/77

    Advanced Technical Skills (ATS) North America

    2012 IBM Corporation13

    Agenda

    PVU Definition

    PVU Estimating Overview

    Value of this New Function

    Component Descriptions

    Commands and Output

    Exporting Data to a Spreadsheet

  • 7/31/2019 TSM 6.3 Server_client Enhancements

    14/77

  • 7/31/2019 TSM 6.3 Server_client Enhancements

    15/77

    Advanced Technical Skills (ATS) North America

    2012 IBM Corporation15

    PVU Classifications

    Client Backup/Archive/API clients that run on:

    MS Win7, MS WinXP Professional, and Apple systems

    Server Backup/Archive/API clients that run on:

    All systems other than MS Win7, MS WinXP Professional, and Applesystems

    Other Retired, test and single user

  • 7/31/2019 TSM 6.3 Server_client Enhancements

    16/77

    Advanced Technical Skills (ATS) North America

    2012 IBM Corporation16

    Client vs Server Device Role Override

    PVUs are not assigned to client-class devices, only to server-classdevices.

    Client-class devices are, in cases, single-user devices. Thisdistinction is difficult to determine programmatically.

    On a NODE definition, the ROLEOVERRIDE parameter allows theTSM administrator to override PVUESTIMATE assumptions. ROLEOVERRIDE arguments are CLIENT, SERVER, OTHER, USEREPORTED

    OTHER will allow the administrator to specify retired machines, test machines etc. thatshould be ignored

    USEREPORTED allows you to reset the field

  • 7/31/2019 TSM 6.3 Server_client Enhancements

    17/77

    Advanced Technical Skills (ATS) North America

    2012 IBM Corporation17

    Simple Example: TSM for MAIL on Server Device Node X

    TSM for Mail client running on Windows 2008 backing up a

    Notes Domino server to a TSM EE server

    Windows 2008 is running on an Intel Xeon processor model5500 quad core and reports 2 processors

    Per the IBM PVU table, an Intel Xeon model 5500 quad core is

    worth 70 pvu TSM for Mail uses the TSM API and thus requires 1 lan license

    plus 1 TDP license

    1 TSM EE lan license (for the api) * 70 * 2 = 140

    1 TSM for MAIL license * 70 * 2 = 140 Total PVUs 280

  • 7/31/2019 TSM 6.3 Server_client Enhancements

    18/77

    Advanced Technical Skills (ATS) North America

    2012 IBM Corporation18

    New Command: QUERY PVUESTIMATE

  • 7/31/2019 TSM 6.3 Server_client Enhancements

    19/77

    Advanced Technical Skills (ATS) North America

    2012 IBM Corporation19

    PVU Estimation Functions Advantages

    TSM clients already communicate and store data to a

    centralized database (TSM server)

    Collects the CPU description of the client machines andstores it in the centralized database

    Quickly provides a license estimate of the entire TSM

    environment Creates a simple PVU report to plan for future deployment

    d d h i l kill ( ) h i

  • 7/31/2019 TSM 6.3 Server_client Enhancements

    20/77

    Advanced Technical Skills (ATS) North America

    2012 IBM Corporation20

    PVU Counting - Limitations

    Meant for estimation only

    Does not provide complete ILMT (IBM License Metric Tool)function

    Does not address Sub-capacity (virtualization: VMware,wpar, lpar, etc.)

    Can not be used to determine license compliance

    TSM 6.3 clients only

    Tivoli Monitoring for Tivoli Storage Manager V6.3

    Expands upon PVU features in TSM base product e.g. graphicalreports

    Ad d T h i l Skill (ATS) N h A i

  • 7/31/2019 TSM 6.3 Server_client Enhancements

    21/77

    Advanced Technical Skills (ATS) North America

    2012 IBM Corporation21

    IBM Common Inventory Technology (CIT)

    Functionally a subset of ILMT

    Small footprint, transparent to TSM backup/archive clientusers

    Used in lots of IBM products today

    Scans computer for hardware and software components

    The TSM clients will install it and use it to collect CPU descriptions

    Scan takes time so will not be run every time the TSM clientisinvoked

    TSM Storage Agent can also install and use it for this purpose

    Ad d T h i l Skill (ATS) N th A i

  • 7/31/2019 TSM 6.3 Server_client Enhancements

    22/77

    Advanced Technical Skills (ATS) North America

    2012 IBM Corporation22

    IBM PVU Table

    Table that assigns PVU value to each CPU

    The table is available atftp://ftp.software.ibm.com/software/tivoli_support/misc/CandO/PVUTable/

    Resides in TSM server installation directory.

    The TSM server parses and loads data into TSMDB1PVUESTIMATE_DETAILS (triggered by Query PVUESTIMATE).

    The latest PVU table is supplied with the most current TSM release

    Ad d T h i l Skill (ATS) N th A i

  • 7/31/2019 TSM 6.3 Server_client Enhancements

    23/77

    Advanced Technical Skills (ATS) North America

    2012 IBM Corporation23

    Update NODE ROLEOVERRIDE= command

    Ad anced Technical Skills (ATS) North America

  • 7/31/2019 TSM 6.3 Server_client Enhancements

    24/77

    Advanced Technical Skills (ATS) North America

    2012 IBM Corporation24

    QUERY PVUESTIMATE f=d

    Advanced Technical Skills (ATS) North America

  • 7/31/2019 TSM 6.3 Server_client Enhancements

    25/77

    Advanced Technical Skills (ATS) North America

    2012 IBM Corporation25

    Export to Spreadsheet

    Method 1:

    dsmadmc comma select * from pvuestimate_details >

    pvudata20100702.csv

    Import comma separated variables format file into spreadsheet.

    Method 2:

    Run select * from pvuestimate_details in TSM Admin Center and thencut and paste results directly from browser into Excel spreadsheet.

    Advanced Technical Skills (ATS) North America

  • 7/31/2019 TSM 6.3 Server_client Enhancements

    26/77

    Advanced Technical Skills (ATS) North America

    2012 IBM Corporation26

    Reference Links

    Processor Value Unit [PVU] licensing for Distributed Software:

    http://www-01.ibm.com/software/lotus/passportadvantage/pvu_licensing_for_customers.html

    Sub-capacity licensing FAQs:

    http://www-01.ibm.com/software/lotus/passportadvantage/subcapfaqov.html#1

    Tivoli product license information:

    http://www-947.ibm.com/support/entry/portal/Overview/Software/Tivoli/IBM_License_Metric_Tool

    http://www-01.ibm.com/software/lotus/passportadvantage/pvu_licensing_for_customers.htmlhttp://www-01.ibm.com/software/lotus/passportadvantage/subcapfaqov.html#%20Tivoli%20Storage%20Manager%20Client%20and%20Server%20Enhancements%20for%20TSM%20V6.3%20http://www-01.ibm.com/software/lotus/passportadvantage/subcapfaqov.html#%20Tivoli%20Storage%20Manager%20Client%20and%20Server%20Enhancements%20for%20TSM%20V6.3%20http://www-01.ibm.com/software/lotus/passportadvantage/pvu_licensing_for_customers.html
  • 7/31/2019 TSM 6.3 Server_client Enhancements

    27/77

    Advanced Technical Skills (ATS) North America

    2012 IBM Corporation2727

    Journal Based Backup (JBB) for Linux

    Advanced Technical Skills (ATS) North America

  • 7/31/2019 TSM 6.3 Server_client Enhancements

    28/77

    Advanced Technical Skills (ATS) North America

    2012 IBM Corporation2828

    What is JBB? Change Journal (database) is used

    Journal of file system changes is maintained on the local client as the changes occur in real time

    TSM Journal Daemon process monitors changes and manages the journal

    When to use JBB? Incremental backups will query the local journal service and send only changed files / objects to

    the TSM server when an incremental backup is initiated

    Ideal for servers with low to moderate number of file system changes

    JBB for Linux has 4 components required Kernel module (filepath driver)

    Journal Daemon (process that will run continuously)

    Journal Database (resides on the local file system)

    TSM Client

    For more detailed information on TSM Journaling:

    http://www-01.ibm.com/support/docview.wss?uid=swg21155524

    Advanced Technical Skills (ATS) North America

    http://www-01.ibm.com/support/docview.wss?uid=swg21155524http://www-01.ibm.com/support/docview.wss?uid=swg21155524
  • 7/31/2019 TSM 6.3 Server_client Enhancements

    29/77

    Advanced Technical Skills (ATS) North America

    2012 IBM Corporation2929

    JBB for Linux Journal Based Backup

    Supports any local filesystem

    Except GPFS

    Similar to the existing JBB functionality on AIX but uses adifferent daemon startup script and interfaces with the OSkernel differently

    Architectures i/p Series Linux

    x Series Linux

    z Series Linux

    Distributions RHEL 5.5, 6.0 and SLES 10sp3, 11sp1

    filepath kernel extension can be shipped as source code

    Can be recompiled for your kernel

    Advanced Technical Skills (ATS) North America

  • 7/31/2019 TSM 6.3 Server_client Enhancements

    30/77

    Advanced Technical Skills (ATS) North America

    2012 IBM Corporation3030

    JBB for Linux

    Default install path is/opt/filepath. The script hastwo parameters, start andstop.

    Default installation runlevels are 3, 4, and 5.

    The /var/log/messages (or dmesg) output may be monitored to verify the Jbb driver loads successfully:

    Advanced Technical Skills (ATS) North America

  • 7/31/2019 TSM 6.3 Server_client Enhancements

    31/77

    Advanced Technical Skills (ATS) North America

    2012 IBM Corporation3131

    JBB for Linux Compatibility

    Attempts to install the filepath driver on unsupported Linux kernelwill result in the following type of error:

    Preparing... ########################################### [100%]

    1:TIVsm-filepath ########################################### [100%]

    insmod: error inserting 'filepath.ko': -1 Invalid module format

    ERROR: Failed to start filepath with error 1

    If none of the packages matches your Linux version, you mustcompile Filepath from source code. The Linux Filepath kernelmodule is licensed pursuant to the terms of the GNU General

    Public License ("GPL"). To request the Linux Filepath sourcecode, send an email to [email protected].

    mailto:[email protected]:[email protected]
  • 7/31/2019 TSM 6.3 Server_client Enhancements

    32/77

    Advanced Technical Skills (ATS) North America

    2012 IBM Corporation3232

    Linux Path Name Enhancements

    Advanced Technical Skills (ATS) North America

  • 7/31/2019 TSM 6.3 Server_client Enhancements

    33/77

    Advanced Technical Skills (ATS) North America

    2012 IBM Corporation3333

    Linux Path Name Enhancements

    Linux BA client now supports longer pathnames

    Previous limit was 1024 bytes New limit is 4096 bytes

    Once backed up using the 6.3+ TSM client, it is not possible to restore along path object using a previous version of the client

  • 7/31/2019 TSM 6.3 Server_client Enhancements

    34/77

    Advanced Technical Skills (ATS) North America

    2012 IBM Corporation34

    TSM Database Backup Enhancements

    Advanced Technical Skills (ATS) North America

  • 7/31/2019 TSM 6.3 Server_client Enhancements

    35/77

    d a ced ec ca S s ( S) o t e ca

    2012 IBM Corporation35

    TSM Database Backup with Multiple Streams

    TSM Server

    DB2

    TSM Database

    Backup/restore

    streams

    Parallel streams for backup/restore processing give improved throughput

    Reduced time for database backup/restore

    Increased scalability of TSM server without impacting database backup

    On Restore: TSM will attempt to match the number of streams that were used onbackup

    Advanced Technical Skills (ATS) North America

  • 7/31/2019 TSM 6.3 Server_client Enhancements

    36/77

    ( )

    2012 IBM Corporation36

    Server Command Changes SET DBRECOVERY

    New parameter: NUMStreams

    Default 1, max value of 4

    Used for all types of DB backups

    On Backup DB, this is examined along with DEVCLASS MOUNTLIMIT

    value

    If NUMSTREAMS < MOUNTLIMIT, then numstreams used if available and online

    If NUMSTREAMS > MOUNTLIMIT, then value of mountlimit used if available and

    online

    Remember that DB Backup is highest priority of preemption list.

    Advanced Technical Skills (ATS) North America

  • 7/31/2019 TSM 6.3 Server_client Enhancements

    37/77

    ( )

    2012 IBM Corporation37

    Server Command Changes BACKUP DB

    New parameter: NUMSTREAMS

    This is an optional parameter.

    The default value is 1 stream will be used.

    The maximum allowable value for this is 4.

    If specified, DB BACKUP will attempt to use the number of streams requested.

    If this value is greater then the actual number of drives available in the deviceclass, the backup will be limited to the number of drives. Available drivesindicates the number of drives defined to the device class (MOUNTLIMIT) orthe number of online drives for this device class.

    Advanced Technical Skills (ATS) North America

  • 7/31/2019 TSM 6.3 Server_client Enhancements

    38/77

    ( )

    2012 IBM Corporation38

    Server Command Changes BACKUP DB

    New parameter: NUMStreams

    This is an optional parameter.

    The default value is 1 stream will be used.

    The maximum allowable value for this is 4.

    If specified, DB BACKUP will attempt to use the number of streams requested.

    If this value is greater then the actual number of drives available in the deviceclass, this will be limited to the number of drives. Available drives indicates thenumber of drives defined to the device class (MOUNTLIMIT) or the number ofonline drives for this device class.

    Advanced Technical Skills (ATS) North America

  • 7/31/2019 TSM 6.3 Server_client Enhancements

    39/77

    ( )

    2012 IBM Corporation39

    Server Command Output Changes Q DB

    Q DB F=D

    ANR2017I Administrator SERVER_CONSOLE issued command: QUERY DB F=D

    Database Name: TSMDB1

    Total Size of File System (MB): 2,048,000

    Space Used by Database(MB): 12,576

    Free Space Available (MB): 1,574,486

    Total Pages: 983,044

    Usable Pages: 982,908

    Used Pages: 977,736

    Free Pages: 5,172Buffer Pool Hit Ratio: 98.4

    Total Buffer Requests: 928,387

    Sort Overflows: 0

    Lock Escalation: 0

    Package Cache Hit Ratio: 89.2

    Last Database Reorganization: 06/09/10 11:30:50

    Full Device Class Name: OUTFILE

    Number of Backup Streams: 4

  • 7/31/2019 TSM 6.3 Server_client Enhancements

    40/77

    2012 IBM Corporation40

    Server Command Output Changes Q Volhist

    Date/Time: 01/21/10 10:37:59

    Volume Type: BACKUPFULL

    Backup Series: 7Backup Operation: 0

    Volume Seq: 25

    Device Class: OUTFILE

    Volume Name: /lspace/tsmsrv1/fspace/64095693.DBV

    Volume Location:

    Command:

    Database Backup ID High: 0

    Database Backup ID LOW: 21,968,899Database Backup Home Position: 0

    Database Backup HLA: /NODE0000/

    Database Backup LLA: FULL_BACKUP.20100121103759.1

    Database Backup Total Data Bytes (MB) : 12,494.88

    Database Backup total Log Bytes (MB) : 220.11

    Database Backup Block Num High: -1

    Database Backup Block Num Low: -1

    Database Backup Stream Id: 1

  • 7/31/2019 TSM 6.3 Server_client Enhancements

    41/77

    Advanced Technical Skills (ATS) North America

    2012 IBM Corporation4141

    Automatic Client Deployment

    Advanced Technical Skills (ATS) North America

  • 7/31/2019 TSM 6.3 Server_client Enhancements

    42/77

    2012 IBM Corporation4242

    The Autodeployment Process

    To learn more: http://www-01.ibm.com/software/sysmgmt/products/support/supp_tech_exch.html Click Previous Webcasts tab, search for Automatic Client Deployment (use

    quotes)

    Advanced Technical Skills (ATS) North America

    http://www-01.ibm.com/software/sysmgmt/products/support/supp_tech_exch.htmlhttp://www-01.ibm.com/software/sysmgmt/products/support/supp_tech_exch.html
  • 7/31/2019 TSM 6.3 Server_client Enhancements

    43/77

    2012 IBM Corporation4343

    Automatic Client Deployment 6.3 Changes

    Customers with a large number of TSM clients need the ability toeasily manage the client distribution and updating of client code

    TSM 6.2 supports Windows only client maintenance distribution

    The goal of the TSM 6.3 design is to enable the Backup-Archiveclient deployment for non-Windows platforms

    The new design also enables automatic upgrade to latest releaseof 5.5.*.*, 6.1.*.*, 6.2.*.* or higher

    Previously, only an upgrade to the latest 6.2 release wassupported

    Advanced Technical Skills (ATS) North America

  • 7/31/2019 TSM 6.3 Server_client Enhancements

    44/77

    2012 IBM Corporation4444

    Auto Deployment Capabilities

    Using the TSM Administration Center:

    Automatically discover client maintenance levels available onthe FTP site

    Automatically retrieve packages required by clientmaintenance levels, store packages on the TSM server andmanage the packages (view, specify retention)

    Schedule distribution of maintenance levels to specific clientsor groups of clients

    Review the client distribution status

    Advanced Technical Skills (ATS) North America

  • 7/31/2019 TSM 6.3 Server_client Enhancements

    45/77

    2012 IBM Corporation4545

    Capabilities not covered in TSM 6.3

    Distribution of other TSM components (e.g., Storage Agent, DataProtection, HSM, etc)

    Client distribution of maintenance for downgrade/rollback scenarios(e.g., from 6.2.1.1 to 6.2.1.0)

    Client distribution of the initial installation.

    The ability to push update to clients that dont have the schedulerservice running

    The current design does not support cluster node deployment

    Ability to alter which installation components installed

    Advanced Technical Skills (ATS) North America

  • 7/31/2019 TSM 6.3 Server_client Enhancements

    46/77

    2012 IBM Corporation4646

    Upgrade Paths

    The key difference is that for Windows, automatic upgrade of 5.4 clients is supported.

    For non-Windows, only 5.5 and above may be automatically upgraded using the autodeployment functionality.

    Advanced Technical Skills (ATS) North America

  • 7/31/2019 TSM 6.3 Server_client Enhancements

    47/77

    2012 IBM Corporation4747

    Supported Platforms

    Advanced Technical Skills (ATS) North America

  • 7/31/2019 TSM 6.3 Server_client Enhancements

    48/77

    2012 IBM Corporation4848

    Prerequisites

  • 7/31/2019 TSM 6.3 Server_client Enhancements

    49/77

    Advanced Technical Skills (ATS) North America

    2012 IBM Corporation49

    Virtual Tape Library (VTL) Awareness

    Advanced Technical Skills (ATS) North America

  • 7/31/2019 TSM 6.3 Server_client Enhancements

    50/77

    2012 IBM Corporation50

    The Problem With Virtual Tape Libraries (VTLs)

    Multiple virtual drives offers configuration flexibility but can lead to manymore total drives configured that in physical configurations

    This causes drive allocation overhead to become a performance consideration

    Allocating a tape volume and a tape drive has several parts

    1. Device type determination

    2. Selecting a mount point

    3. Mounting a volume on the selected drive

    Step 2 requires:

    Each drive inspected to determine its read/write capabilities and device typecompatibility with the mount point request may be repeated several times during theentire process

    Validate each drive is online

    Validate each drive has a valid online path for this mount request

    Results in significant delays in drive selection

    Previously - Recommend library with fewer than 80 drives

    Interim fixes have raised this recommendation to 120

    See Technote: http://www-01.ibm.com/support/docview.wss?uid=swg21425849

    Advanced Technical Skills (ATS) North America

  • 7/31/2019 TSM 6.3 Server_client Enhancements

    51/77

    2012 IBM Corporation51

    Changes for TSM V6.3

    Create new LIBTYPE of VTL

    Same as LIBTYPE SCSI

    But with new function

    Internal processing changes

    Bypass mixed media analysis

    Reasonable to assume VTLs do not mix media

    Bypass some drive analysis

    Expect all VTL drives have paths to all servers

    If either of these characteristics are not true, the overallperformance can degrade to the same levels as the SCSI

    library type; especially during times of high stress when most

    drives are in use concurrently.

    Advanced Technical Skills (ATS) North America

  • 7/31/2019 TSM 6.3 Server_client Enhancements

    52/77

    2012 IBM Corporation52

    Changes in definitions

    DEFine LIBRary lib_name LIBType=VTL

    Must be a library which would otherwise be LIBT=SCSI

    RELABELSCRATCH defaults to YES for LIBT=VTL

    Other parameters are same as SCSI libraries

    UPDate LIBRary lib_name LIBType=VTL or SCSI New update command

    Can switch between VTL and SCSI library types

    Define paths for all servers to all drives

    This is already best practice for libraries

    Use device class MOUNTLIMIT setting to limit allocation by individual

    server sharing this library

    Advanced Technical Skills (ATS) North America

  • 7/31/2019 TSM 6.3 Server_client Enhancements

    53/77

    2012 IBM Corporation53

    New PERFORM LIBACTION command

    PERForm LIBACTion library_name

    ACTion=DEFine | DELete SOURCe=source_name

    DEVICE=device_name PREFIX=prefix

    Applies to libtype=SCSI and VTL

    Defines:

    Path to library

    All drives found in the library

    Paths to drives found in the library

    Non-local drives will be assigned UNDISCOVERED paths

    Requires SANDISCOVERY

  • 7/31/2019 TSM 6.3 Server_client Enhancements

    54/77

    Advanced Technical Skills (ATS) North America

    2012 IBM Corporation54

    Hierarchical Storage Management Enhancements

    Advanced Technical Skills (ATS) North America

  • 7/31/2019 TSM 6.3 Server_client Enhancements

    55/77

    2012 IBM Corporation55

    HSM Enhancements

    HSM for Windows - Stub moving tool

    HSM for Unix/Linux migrate/recall log

    HSM for Unix/Linux Tape optimized recall

    HSM for Unix/Linux - Multiple Server Support

    Advanced Technical Skills (ATS) North America

  • 7/31/2019 TSM 6.3 Server_client Enhancements

    56/77

    2012 IBM Corporation56

    Requirement No 1:Ability to move HSM for Windows stubs across volume

    boundaries without the need to recall them.

    Addressed with the stub moving tools (dsmmove / hsmtasks)

    Requirement No 2:Ability to change volume drive letters, computer name or toput a disk into another computer

    Addressed with a new HW mapping mechanism

    Note: Host name and drive letter are important for HSM forWindows. If host name or drive letter of a stub is changed,access to data may be lost.

    HSM for Windows Moving Migrated Data Without Recalling

  • 7/31/2019 TSM 6.3 Server_client Enhancements

    57/77

    Advanced Technical Skills (ATS) North America

  • 7/31/2019 TSM 6.3 Server_client Enhancements

    58/77

    2012 IBM Corporation58

    User or project is moving from one site to another (distant)

    site. Files should be transferred without recall to disk.Old file server (including HSM) will continue to work.

    Steps/Tools involved:a - move stub files to new file server (dsmmove command)b - move content to new TSM server (hsmtasks service)

    File Server A

    Site A

    File Server B

    Site BFile contenton TSM

    a - dsmmove

    b - hsmtasks

    Moving Stub Files to a Different Location

    Stub files infile system

    Advanced Technical Skills (ATS) North America

  • 7/31/2019 TSM 6.3 Server_client Enhancements

    59/77

    2012 IBM Corporation59

    Goal: attach disk storage to new file server

    A HW volume mapping can be configured in the HSM forWindows GUI to map the new drive name (like\\HSMSERV1\F$) back to the old name (like \\HSMSERV2\F$).

    Other examples:change the computer name or volume drive letter or add theexisting server to a cluster system

    SERVER1(Old)

    SERVER2(New)

    Renaming or Moving an HSM File Server Volume

    Advanced Technical Skills (ATS) North America

  • 7/31/2019 TSM 6.3 Server_client Enhancements

    60/77

    2012 IBM Corporation60

    Goal: attach disk storage to new file server

    A HW volume mapping can be configured in the HSM forWindows GUI to map the new drive name (like\\HSMSERV1\F$) back to the old name (like \\HSMSERV2\F$).

    Other examples:change the computer name or volume drive letter or add theexisting server to a cluster system

    SERVER1(Old)

    SERVER2(New)

    Renaming or Moving an HSM File Server Volume

    Advanced Technical Skills (ATS) North America

  • 7/31/2019 TSM 6.3 Server_client Enhancements

    61/77

    2012 IBM Corporation61

    Logging of HSM Migrate and Recall Operations

    All TSM for Space Management platforms (Unix and Linux)

    Purpose is to monitor normal operations Error conditions logged in appropriate error logs

    Same structure as error logs today

    For instance: format and pruning

    New options to configure the HSM log function: HSMLOGMAX

    HSMLOGEVENTFLAGS

    HSMLOGRETENTION

    HSMLOGNAME

    SONAS specific options:

    -logname=filespec on commandline

    File system configuration changes will be logged

    Advanced Technical Skills (ATS) North America

  • 7/31/2019 TSM 6.3 Server_client Enhancements

    62/77

    2012 IBM Corporation62

    Controlling the Logging of Events

    SYSTEM

    start/stop fail over/back

    task execution

    FS (filesystem)

    add, remove, update

    threshold migration, demand migration, reconciliation

    scan, quota, statistics

    FILE

    premigration, migration

    recall, partial recall, stream recall stub restore, orphaned

    Default is no events are tracked

    Use HSMLOGEVENTFLAGS option to enable logging

    Advanced Technical Skills (ATS) North America

  • 7/31/2019 TSM 6.3 Server_client Enhancements

    63/77

    2012 IBM Corporation63

    HSM for Unix/Linux Tape Optimized Recall

    Objective is provide optimized recall processing of a list of files

    Previously files in a list were recalled independently

    Recall tool will sort a list of files by tape volume and location

    Generates a collection of sorted file lists

    One output list per tape volume, plus one for non-tape

    dsmrecall [-PREView] -FILEList=

    -FILEList= User provided list of fully qualified filenames

    fsname filesystem where files reside

    -PREView Generate lists and collectionbut does not start the recall process

    New option: HSMMAXREcalltapedrives

    Advanced Technical Skills (ATS) North America

    i

  • 7/31/2019 TSM 6.3 Server_client Enhancements

    64/77

    2012 IBM Corporation64

    Input FILELIST Requirements

    1. Each entry must be a fully qualified path to a file or a relative path

    2. Each entry must be on a new line3. No entry contains wild card characters

    4. Each entry results in the processing of only one file object

    5. The file name can be enclosed in quotes if the file name containsany spaces

    6. The HSM client ignores any entry that is not valid files are skipped with a warning

    1. No directories are included in the file list

    2. Each entry in the list must be from the same file system which isspecified with the dsmrecall command

    Any files from other file systems will be skipped and written to anunprocessed list stored in the .SpaceMan/tapeOptimizedRecall/directory with the name filelist.unprocessed.

    Advanced Technical Skills (ATS) North America

    S i

  • 7/31/2019 TSM 6.3 Server_client Enhancements

    65/77

    2012 IBM Corporation65

    FILELIST Processing

    1. Recall tool reads input filelist

    2. Queries TSM server retrieving:

    Migration Status

    Volume ID and location

    3. Sorts by volume ID and location

    4. Generates ordered filelists for each volume ID

    Advanced Technical Skills (ATS) North America

    C ll i P i

  • 7/31/2019 TSM 6.3 Server_client Enhancements

    66/77

    2012 IBM Corporation66

    Collection Processing

    d s m r e c a l l

    w o r k e r 1 w o r k e r 2

    F i l e L i s t

    F i l e L i s t . o r d e r e d . T a p e 1

    F i l e L i s t . o r d e r e d . T a p e 2

    T S M S e r v e r

    R e c a l l

    T a p e 2

    R e c a l l

    T a p e 1

    F i l e L i s t . o r d e r e d . C o l l e c t i o n

    r e a d s

    r e a d s

    1. Recall tool reads input collection file

    2. Starts worker thread for each sorted filelist

    Up to maximum option

    Plus one thread for the non-tape filelist

    3. Worker thread invokes file recall for file in the sorted filelist

    Advanced Technical Skills (ATS) North America

    N R di T O i i d R ll

  • 7/31/2019 TSM 6.3 Server_client Enhancements

    67/77

    2012 IBM Corporation67

    Notes Regarding Tape Optimized Recall

    Transparent recall unchanged

    Transparent recall has no priority

    Recall is queued with other requests

    Maximum concurrent recalls is minimum of:

    Number of sorted lists

    HSMMAXREcalltapedrives setting

    Plus 1 if there is a list for non-tape

    Can use -PREVIEW option to manipulate recalls

    resequence collection list to modify order of tape usage

    Advanced Technical Skills (ATS) North America

    HSM f U i /Li M lti l S S t

  • 7/31/2019 TSM 6.3 Server_client Enhancements

    68/77

    2012 IBM Corporation68

    HSM for Unix/Linux - Multiple Server Support

    The objective of this feature is to

    enhance the TSM HSM client to be

    able to handle multiple TSM Serverinstances for each single file

    system.

    With this new feature the HSM client

    can scale with the number of TSM

    servers used for migration and recall

    operations.

    Useful for very large file systems to

    enhance scalability and

    performance of HSM operations.

    The feature is available for GPFS

    environments only on Linux x86 andAIX. GPFS Version 3.4 and above.

    GPFS

    TSM server 1 TSM server 3TSM server 2

    Migration / Recall / Reconciliation

  • 7/31/2019 TSM 6.3 Server_client Enhancements

    69/77

    Advanced Technical Skills (ATS) North America

  • 7/31/2019 TSM 6.3 Server_client Enhancements

    70/77

    2012 IBM Corporation70

    Adding TSM Servers to an Existing Managed Filesystem

    First upgrade to multiple server support

    Update options with HSMMULTISERVER YES

    Add existing TSM server as first server in the server list

    dsmmigfs addmultiserver -server=

    Run dsmMultiServerUpgrade .pl script.

    This script will couple all existing managed files with themanaging TSM server the file system is managed against

    Add additional TSM servers to server list

    dsmmigfs addmultiserver -server=

    When new files are migrated HSM will round-robin through the

    available servers

    Query environment with

    dsmmigfs querymultiserver

  • 7/31/2019 TSM 6.3 Server_client Enhancements

    71/77

    Advanced Technical Skills (ATS) North America

    2012 IBM Corporation71

    Miscellaneous Client Functions

    Advanced Technical Skills (ATS) North America

    New 64 bit Clients

  • 7/31/2019 TSM 6.3 Server_client Enhancements

    72/77

    2012 IBM Corporation72

    New 64-bit Clients

    64-bit native Linux Intel (x64)

    For x64 Linux, the environments supported in TSM 6.3 are: Sles 10and 11 and RH 5 and 6

    Solaris (SPARC)

    For Solaris the environments supported in TSM 6.3 are: Solaris 10 forSPARC Update 1 or higher

    Macintosh (Intel)

    For MacIntosh Intel, the environments supported in TSM 6.3 are:

    MacOS 10.6 and 10.7

    Advanced Technical Skills (ATS) North America

    Miscellaneous Backup/Archive Client Updates

  • 7/31/2019 TSM 6.3 Server_client Enhancements

    73/77

    2012 IBM Corporation73

    Miscellaneous Backup/Archive Client Updates

    Linux now supports upgrade installation

    rpm U

    Simplified configuration of client in an MSCS cluster

    New Back/Archive Client configuration wizard for cluster support

  • 7/31/2019 TSM 6.3 Server_client Enhancements

    74/77

    Advanced Technical Skills (ATS) North America

    Cluster Configuration Wizard Select Group

  • 7/31/2019 TSM 6.3 Server_client Enhancements

    75/77

    2012 IBM Corporation75

    Cluster Configuration Wizard Select Group

  • 7/31/2019 TSM 6.3 Server_client Enhancements

    76/77

    Advanced Technical Skills (ATS) North America

  • 7/31/2019 TSM 6.3 Server_client Enhancements

    77/77

    Questions ?