© Copyright 2015 BMC Software, Inc. 1
—
BMC SoftwareSeptember 16-17, 2015
Matteo Ferrari
Simplifying DB2 Data Management with BMC Next Generation Technology Utilities
© Copyright 2015 BMC Software, Inc. 2
DB2 Then and Now
• A few Gigabytes
Database Size
• Tens of thousands of rows
• Max: A few million rows
Table Size
• Low Hundreds
Number of Objects
• Under 100
Transactions per second
DB2 2010sDB2 1980s
• 70+ Terabytes
Database Size
• Tens of millions of rows
• Max: A few Billion rows
Table Size
• Tens of Thousands
Number of Objects
• Over 10,000
Transactions per second
© Copyright 2015 BMC Software, Inc. 3
DB2 Utility Architecture Then and Now
• Unload
• SORT
• Load
• Rebuild Indexes
DB2 Reorg
Reorg 1980s
• Unload
• Decompress
• SORT
• Recompress
• Load
• Iterative Log Apply
• Rebuild Indexes
DB2 Reorg
Reorg 2010s
1. Unload/Decompress (double its size) 22. Sort (6 – 9 passes) x73. Reload/Recompress (half its size) +2
16 passes
Plus the Index Buildwhich is significant;
and Risky!
© Copyright 2015 BMC Software, Inc. 5
BMC and CDB integration – a new Paradigm
BMC Heritage
IntegrationCode
CDB Heritage
NGT
Utilities
Utilities
UtilitiesRecover
Performance…more
Best of Breed
© Copyright 2015 BMC Software, Inc. 6
NGT Utilities – Unique technology
Boost performance and resource savings
© Copyright 2015 BMC Software, Inc. 7
1 3 2 4 6 5
NGT Reorg – Patented NO SORT technology
1 2 3 4 5 5
NGT REORG Engine
• Read CLIX
• Read original data, write reorganized
• Parallel Optimized R-W of Ixs;
Take advantage of DB2 CLIX information to check and fully reorg IX and dataNO external SORT, NO data DECOMPRESS/COMPRESS, read & write data once
Original CLIX Original TS
Shadow CLIX Shadow TS
© Copyright 2015 BMC Software, Inc. 8
NGT Server Technology
Server
JobServer
JobServer
Job
SYSPLEX
NODE
NGT PROCESSES
Server
JobServer
JobServer
Job
Master
Job
Server
JobServer
JobServer
Job
SYSPLEX
NODE
© Copyright 2015 BMC Software, Inc. 9
NGT Utilities – Unique features
• NGT REORG uses enhanced Delta Change Apply (no Log read)
• NGT REORG takes SHRLEVEL REFERENCE copies
• NGT LOAD and REORG NPIs always fully reorg NPIs• Better DB2 applications perfomance, lower MLC costs
• NGT LOAD and UNLOAD use internal zIIP-eligible eSORT• NO SORTworks used
• NGT UNLOAD natively interprets more data select conditions• Scalar functions and subselects are executed outside DB2
© Copyright 2015 BMC Software, Inc. 11
NGT Utilities - Expected savings
0
20
40
60
80
100
120
CPU Elapsed DASD
IBM BMC Classic NGT
70%Reduction in CPU Time*
66%Reduction in Elapsed Time*
85%DASDReduction**
*Preliminary BMC Benchmarks** NGT Customer Benchmark
No Application Outages
© Copyright 2015 BMC Software, Inc. 12
NGT Utilities – Zero JCL maintenance
Simplifying DB2 Data Management
© Copyright 2015 BMC Software, Inc. 13
NGT Utilities – JCL simplification
//PAYRRG01 JOB ...
//JOBLIB DD DISP=SHR,DSN=BMC.NGT.LOAD
//NGTUSTEP EXEC PGM=CDBUTIL,PARM=‘TST8,,RESTART'
//SYSPRINT DD SYSOUT=*
//UTPRINT DD SYSOUT=*
//CDBEXEC DD DISP=SHR,DSN=NGT.AUTO.BMCEXEC
//SYSIN DD *
REORG TABLESPACE PAYROL%.%
The only answer to DB2’s growing complexity is simplification
Restart Parameter
• RESTART
• NORESTART
• QUICKEXIT
© Copyright 2015 BMC Software, Inc. 14
NGT Utilities - JCL transparent to Business logic
NGT UTILITY
STATEMENTS
UTILITY
PROCESSING
XCPYDYNM
COPY and work dataset logic
XSUTALLO
DB2 VSAM alloc logic
XSUTXERR
Error management logic
XSUTPOST
Post utility logic
CDBEXEC DDVariables passed
each way
• REXX Automation internal to all NGT utilities makes JCL ‘transparent’ to business logic• Your shop’s rules and logic are used to make real-time, dynamic decisions to automate
your entire DB2 utility processing
Align your utility operations to your business rules
DB2 objects
© Copyright 2015 BMC Software, Inc. 15
NGT LOBMaster – Simplify LOB Management
• Verify if the LOB Index is valid
CHECK IX
• Verify the internal structure of the LOB
CHECK LOB
• Verify that the ID fields in the base TS are in the LOB Index
CHECK DATA
• Separate from base tablespace Reorg
• Requires unload of the LOB data
• Utility JOB JCL change
REORG
REORG TABLESPACE DBASE.%
A single command checks for integrity and reorganizes
“Free” Integrity checking (It does not increase Reorg time)
Online 100% of the time
AUX
© Copyright 2015 BMC Software, Inc. 16
NGT Utilities – Zero downtime
Keeping data available
© Copyright 2015 BMC Software, Inc. 17
NGT Reorg - Availability
• With NGT, Data is Never Unavailable- Not even for a Second- No transaction Failures
Is a 1 minute downtime almost as good as no downtime?
60 seconds 1000 tx/sec60,000 failures
60,000dissatisfied customers
© Copyright 2015 BMC Software, Inc. 18
NGT Load – Non destructive RESUME YES
HURBA
IndexesShadow Indexes
Write new DataWrite new Keys
Successful completion: move HURBA and rename the index datasets
Unsuccessful: QUICKEXIT to delete the index shadow copy and start RW. NO RECOVERY TIME
Tablespace Stopped during Load
Risk Mitigation
Improved Productivity
© Copyright 2015 BMC Software, Inc. 19
NGT Utilities – Zero Time to decision
Making Data Management Autonomic
© Copyright 2015 BMC Software, Inc. 20
Traditional DB2 Utility Automation
0
25
50
Mon Tue Wed Thu Fri Sat Sun
Basic Utility Automation effect on Application performance
CPU Elapsed
Object Needs Reorg
MonRun Stats
WedGenerate
JobThu
Verify JCL
ScheduleFri
Run Util
Sat•Correct errors
•RerunSun
No Action
Tue
Not corrected until Saturday!
Immediate Application Performance Degradation and increased costs
© Copyright 2015 BMC Software, Inc. 21
NGT Utility Manager
DBASE1
REORG TABLESPACE DBASE1.% RTS
Force or exclude?
Can it run now?
Does it need to run?
NGT Exception
Table
NGT CriteriaTable
UTMgr logic
NGT Schedule
Table
TS1
© Copyright 2015 BMC Software, Inc. 22
NGT Utility Manager
UtilDone
MonUtilskip
WedUtil
DoneThu
Utilskip
FriUtil
doneSat
Utilskip
SunUtilSkip
Tue
0
25
50
Mon Tue Wed Thu Fri Sat Sun
Real Time Utility Automation effect on Application Performance
CPU Elapsed
Objects are intelligently processed every day based on Business and Technical policiesApplication performance and response time are kept optimized
© Copyright 2015 BMC Software, Inc. 23
NGT Utilities – Zero time to reaction
Making Data Management Unattended
© Copyright 2015 BMC Software, Inc. 24
Traditional DB2 utilities restartability
• Standard DB2 utilities require DBA knowledge and experience
• In case of problems, restartability or termination require an analisys of the utility and object status and in some cases, manual actions
• This approach requires attended operations; correlated jobs must wait for the problem to be solved
REORG DB.TS1
REORG DB.TS2
REORG DB.TS3REORG DB.% ERROR
Human AnalisysRestart or TERM?Manual actions
TERM? only 2 objects reorged
RESTART? possible impact on SLA?
© Copyright 2015 BMC Software, Inc. 25
NGT Utilities – Embedded intelligence
• NGT utilities have embedded intelligence to govern execution and termination
• In case of problems, QUICKEXIT automatically finds the quickest way to cleanuputility, delete unnecessary datasets and make data available
• Objects in error can be ‘skipped’ and execution can continue with NO manualintervention; automation can provide info to Operations
REORG DB.TS1
REORG DB.TS2
REORG DB.TS3REORG DB.TS4
REORG DB.TS5REORG DB.%
ERROR
WTOMail
Auto utility CleanupObject RW
4 objects reorged1 object skippedNO impact on SLAs
© Copyright 2015 BMC Software, Inc. 26
NGT Utilities in Summary…
Unique technology
Reduced CPU, time and resources
Zero JCL Maintenance
DB2 Data Management simplification
Zero Downtime
Risk mitigation and preserved SLAs
Zero Time to reaction
Built-in intelligence for unattended Ops
Lower cost of DB2 Data Management and Applications
© Copyright 2014 BMC Software, Inc. 27Internal Use Only
Bring IT to Life.TM
It’s time to Rethink DB2 Data Management
Top Related