Application Tuning for CA Datacom Environments Part I
-
Upload
ca-technologies -
Category
Technology
-
view
39 -
download
1
Transcript of Application Tuning for CA Datacom Environments Part I
World®’16
ApplicationTuningforCADatacomenvironments– PartIKevinShuma,VPProductManagementCATechnologies
MFX67EA
MAINFRAMEANDWORKLOADAUTOMATION
2 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Abstract
ThisisatwopartsessionthatdescribesthevarioustechniquesusedtotuneaCADatacomapplicationforthebestpossibleperformance.Includedwillbediscussionsonavailablemonitoringtools.
ThissessionisprimarilyfocusedontheapplicationdeveloperwhoiswritingapplicationsfortheCADatacom®/DBdatabase.
KevinShuma
CATechnologiesVP,ProductManagement
3 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Agenda
THEAPPLICATIONESTATE
THEAPPLICATIONARCHITECTURE
WHYWOULDINEEDTODOTUNING?
APPLICATIONTUNINGWITHOUTCHANGINGTHEAPPLICATION
APPLICATIONTUNINGWITHOUTCHANGINGTHEAPPLICATION
SUMMARY(FORPARTI)
1
2
3
4
5
6
4 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Theapplicationestate
§ ITdepartmentsvaryinsizeandscope
§ Applicationactivitydiffersineachsite
§ Applicationplatformsvary
§ Programmerskillsvary
§ Soifeverythingisvarying,whatisconsistent?
UnderstandingthetypicalCADatacomapplicationdevelopmentenvironment
5 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
The“RealWorld”– Today’sMainframeITrequirement
§ ReducingtheTCOofthemainframe– Doingmorewithless– Everynew"businessbenefit"application/changemustbecostjustified
§ Utilizeexistingstaffandresourcedtoachievethisgoal
Theconsistenttheme
6 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
The“RealWorld”– Today’senvironment
§ MajorEuropeanretailer– Datacom/Ideal/MetaCOBOL+runsalmostallmissioncriticalsystems– 0.6ofaDatacomDBA(average3daysperweek)– 6mainframedevelopers– Cappedat24MSU’s(downfrom37MSUsin2years)
§ Financialinstitution– Datacom/Idealrunsalmostallmissioncriticalapplications– 0.25ofaTechnicalConsultant(average5dayspermonth)– 3mainframedevelopers– Cappedat100MIPS
MuchsmallerITdepartment– typicallywithverysmallDBAstaffs
7 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Wherecanwegetthebiggestbangforthebuck
§ “Fromaproductperspective,addinganenhancementthatimprovestheefficiency/productivityofapplicationandprogrammercanhavealargepositiveimpactonthebusiness.– Improvementstoapplicationperformanceresultsin
§ Improvedproductivityofend-users/operationsstaff§ DevOps – Theclue’sinthename!§ Businessgrowth.Employment.§ ReducedTotalCostofOwnership(orperceived“overhead”)ofthemainframe”
Excerptfromawell-knownCADatacomconsultantandDBA
8 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Improvingtheefficiency/productivityofapplications
§ ApplicationTuningincludes– Identifyingandeliminatingredundant/inefficientprocessing– Eliminatingunnecessaryoutages/resourceconflicts– Makingfulluseofhardware/infrastructurechanges– Implementingenhancementsthatimprovebusinessproductivity
9 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Theapplicationarchitecture
10 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Theapplicationarchitecture
§ RAAT– Recordatatime– Typically“verychatty”withthedatabase
§ Manysmallrequestsandresponses– BatchdoeshaveGSETx commandsforlargerrequests/responses
§ SAAT– Setatatime– Typically“lesschatty”withthedatabase
§ Smallernumberofrequestswithlargerdatabaseprocessingrequirements– UsedbyIdeal,DQRYandSQLunderthecovers
UnderstandingthetypicalCADatacomapplicationenvironment- APIs
11 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Theapplicationarchitecture(cont’d)
§ SQL– StandardQueryLanguage– Typically“lesschatty”withthedatabase
§ Smallernumberofrequestswithlargerdatabaseprocessingrequirements§ Requestcanincludevariousdatarefinementprocessing
– Unique,Groupby,Union,etc.§ UsesSAATatthedatarowretrievalmethod
§ AllthreeAPIsrequireaURT
UnderstandingthetypicalCADatacomapplicationenvironment- APIs
12 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Theapplicationarchitecture(cont’d)Batchaddressspace
zOSLPAR
• Start-upparameters• Executingcode• Sharedmemory(buffers)• Dataspacesattachedasneeded
DatabasesubsystemandPCCallsinstalledduringCAS9(CACommonServices)initiation
CXX
LXX
FXX
PXX
RXX
DD0002
DDD0015
SQL0016
TTM0017
CBS0006
HEUR1006
DST1000
STA1018
SNP1019
DEL1020
PRM0004
ACCT0005
HR0001
OE0010
DQ0003
URT
UserProgramCallDBNTRYCallDBSQLE
UserDBIDs
BatchURT• Needstobeloadedinthe
addressspace(typicallinkedwithprogram)
• ProvidestheinterfacetotheMUFaddressspace
• ForRAAT/SAATselectstablestobeaccessed
• CanholdadditionalbufferareaforspecialGSETx commands
Interface
BatchAddressSpaceMUFAddressSpace
13 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Theapplicationarchitecture(cont’d)CICSaddressspace
zOSLPAR
• Start-upparameters• Executingcode• Sharedmemory(buffers)• Dataspacesattachedasneeded
CXX
LXX
FXX
PXX
RXX
DD0002
DDD0015
SQL0016
TTM0017
CBS0006
HEUR1006
DST1000
STA1018
SNP1019
DEL1020
PRM0004
ACCT0005
HR0001
OE0010
DQ0003
UserProgramCallDBNTRYCallDBSQLE
UserDBIDs
CICSServices• LoadsmultithreadedinterfacetoMUF• LoadsapoolofURTsforallCICStransactions
• ForRAAT/SAATselectstablestobeaccessed• DefaultURT020providedforSQLaccess
• ProvidesasetofCICStransactionstomanagetheinterfaceandURTs
URT URT
InterfaceDatabasesubsystemandPCCallsinstalledduringCAS9(CACommonServices)initiation
UserProgramCallDBNTRYCallDBSQLE
URT URT URT URTInterface
CICSAddressSpace BatchAddressSpaceMUFAddressSpace
14 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Theapplicationarchitecture(cont’d)Serveraddressspace
zOSLPAR
• Start-upparameters• Executingcode• Sharedmemory(buffers)• Dataspacesattachedasneeded
CXX
LXX
FXX
PXX
RXX
DD0002
DDD0015
SQL0016
TTM0017
CBS0006
HEUR1006
DST1000
STA1018
SNP1019
DEL1020
PRM0004
ACCT0005
HR0001
OE0010
DQ0003
UserProgramCallDBNTRYCallDBSQLE
UserDBIDs
Server• LoadsmultithreadedinterfacetoMUF• LoadsURTstubforbasicsupport• Providesasetofcommandstomanagethe
interface• ProvidesinteractiveSQLprocessorfor
clientODBC/JDBCrequests
URT URT
InterfaceDatabasesubsystemandPCCallsinstalledduringCAS9(CACommonServices)initiation
UserProgramCallDBNTRYCallDBSQLE
URT URT URT URTInterface
CICSAddressSpace BatchAddressSpaceMUFAddressSpace
Interface
URT
InteractiveSQLprocessor
ODBC/JDBCServerclient
15 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
WhywouldIneedtodotuning?
16 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
WhywouldIneedtodoapplicationtuning?
§ Backwhentheywerewritten– WewerebalancingCPUvsIOvslimitedrealstorage– DASDwasexpensive– Howmuchrealstoragedidyourmainframehave
§ Howmuchdoesithavenow?– Howmuchdatadidyourapplicationprocess
§ Howmuchdoesithavenow?
§ Bottomline– Theapplicationsmaynothavechangedbuttheenvironmentsurelyhas
Myapplicationshavenotchanged
17 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Recent“gamechanger”
§ ForzOSsiteswithzIIPprocessors– 90%+MUFCPUcanbeoffloadedtozIIP
§ UserapplicationCPUcannotrunonzIIP– PerIBMlicensetousezIIP
§ MakeuseofopportunitiestoswapfromapplicationCPU(expensive)toMUFCPU(inexpensiveonzIIP)
IBMzSystemsIntegratedInformationProcessor(zIIP)
18 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
ApplicationTuningwithoutchangingtheapplication
19 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
ApplicationTuningwithoutchangingtheapplication
§ Manyapplicationissuescanbemitigatedbyadjustingthedatabaseenvironment
§ Noteveryissuecanberesolvedthisway– InpartII,wewilldiscussapplicationspecificcorrections
§ Thissessionwilladdresswaystoimproveapplicationprocessingwithoutchangingtheapplicationcode
WhatIspentalargepartofmyDBAcareerdoing
20 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Aslongasthegeometryoftherowdoesnotchange,theapplicationswillnotneedtobechanged§ ReplacingphysicalIOwithmemoryprocessing(DBAtuning)
– IncreasethenumberofIXX,DXXandDATAbuffers– ConsiderusingMRDFCOVERED
§ Dependingonprocessingapreloadmayhelp– Changethedatablocksizeto1/3trackor1/2track
§ Requiresanadjustmentofdatabufferpools– DATANO,DATANO2orspecialDATApools
§ Requiresanoutage(fornow,comingsoonTM24)– IfzIIPavailable
§ ImplementcompressionusingTA24
21 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Aslongasthegeometryoftherowdoesnotchange,theapplicationswillnotneedtobechanged(cont’d)§ AddkeystoimproveCBS/SQLefficiency
– Willaddoverheadonrowaddsanddeletes– WillonlytakeaffectwithoutapplicationchangeforSAATorSQL– LocateCBSorSQLrequeststhatarebuildingtempindexes
MUFEOJ,AUTOINFO,AUTOCOLLECT,
ALL_INFO_REPORTAccountingTables
MUFlevelCBSindexstatisticsfortotals Useaccountingtocapturespecificjobs,transactions
22 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Aslongasthegeometryoftherowdoesnotchange,theapplicationswillnotneedtobechanged(cont’d)§ Removeunusedkeys(overheadoneveryadd/delete)
– WillonlytakeaffectwithoutapplicationchangeforSAATorSQL– Locatekeysthatarenotused
§ DSTDIR_KEY(onlyshowsstatssinceMUFstartup)
SELECTDBID,TABLE_NAME,KEY_NAME,KEY_ID,NATIVE,MASTER,NIL,DIRECT,KEY_LENGTH,CBS_IGNORE,USES_RAAT,USES_SAAT,USES_SQL
FROMSYSADM.DIR_KEYWHEREDBID>19ANDDBID<1000;
23 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
DBUTLTYtuning
§ ManybatchapplicationjobstreamsincludeDBUTLTYjobs– ThefasterDBUTLTYrunsthefasterthejobstreamcompletes
§ DBUTLTYfunctionslikeDEFRAGandOLREORGcansignificantlyimproveperformanceofapplications
Utilityprocessingcanaffectapplicationperformance
24 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
DBUTLTYtuning(cont’d)
§ REGION=0MonJCLEXECinz/OS
§ Largepartition(50M)inz/VSE
§ MasterlistIXX/DXX/Databuffers(especiallyinz/VSE)
§ Half-trackblockingforDataAreas
§ Arealevelcontrols– Eliminatenegativedependencies– Sometimesappropriate,sometimesnot
Utilityprocessingcanaffectapplicationperformance
25 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
DBUTLTYtuning(cont’d)
§ BLKSIZE=nnnnn forBACKUP/EXTRACT(z/VSEornon-SMS)
§ LOAD/RETIXparameters– KBYTES=9999– OPTIMIZE=YES– OPTION1=‘(I)’andreviewsortmessages– SORT=#indexentries (SORT=1forz/VSE)– SORTDFT(newin14.0– greatifusedwisely)
Utilityprocessingcanaffectapplicationperformance
26 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
DBUTLTYtuning(cont’d)
§ ReplacemostRETIXwithDEFRAG– DEFRAGisonlineactivityandisoftenfaster– UseFIRSTKEY/LASTKEYonEXTRACTwhereappropriate
§ INITIXXOLDEP=NO
§ DBIN1PR/SYSIN1STtoapplydefault/overrides– NewDEFAULT/FORCEoptionsplannedfor15.1
§ DBUTLTYtuningsavedseveralelapsedhoursfrommanyjobs– Simplechanges1hr+savedfromoverallbatchcriticalpath
Utilityprocessingcanaffectapplicationperformance
27 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
DBUTLTYtuning(cont’d)
§ Stopperformingunnecessaryreorgs– Trulyrandomprocessingwillnotbenefitfromreorg– NewDATANEreportshowsNativeSequenceEfficiency– Historydatabaseshowssequentialactivity
§ ReorgOptions– TraditionalBACKUPSEQ=NATIVE+LOAD
§ Considerarea-levelcontrolsifonlyaminorityofareasneedreorg§ Ifreorganising wholedatabase,usedatabase-levelBACKUP+INITIXX+database-levelLOAD
Utilityprocessingcanaffectapplicationperformance
28 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
DBUTLTYtuning(cont’d)
§ ParallelREORG– stillanoutagerequired,butquicker– Backuponlyoptionforquickerbackups
§ OLREORG– REFGROUP=nn– REFGROUP=0
§ CurrentlyplannedforV15.1– TM24
§ Considerpartitioningwhereappropriatetominimizereorgeffort
Utilityprocessingcanaffectapplicationperformance
29 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Changingthephysicaldatabasestructure
§ Splitupdataareasthathave2ormoreheavilyusedtables
§ Splituplargedatabasesthathavemultipletables– URToptionforDBIDremapping– Improvesbackup/load/reorg/recoveryprocessing– MultipleDBIDs=Multiple(smaller)indexes
§ Reducedlevelsofindex§ MoreopportunitiestouseMRDFcovering
Requiresanoutagetoimplement
30 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Changingthephysicaldatabasestructure(cont’d)
§ Splituplargetablesusingtablepartitioning– Existingapplicationsrununchangedatlogical(parent)level– Betterbackup/load/reorg/recoveryoptionswithmultipleareas– MorepossibilitiesforMRDFcovering
§ Busierpartitionscanbecovered– Newoptionsforapplicationprocessingatpartition(child)level
Requiresanoutagetoimplement
@CAWORLD#CAWORLD ©2016CA.AllRIGHTSRESERVED.31 @CAWORLD#CAWORLD ©2016CA.AllRIGHTSRESERVED.31
MainframeandWorkloadAutomation
FormoreinformationonMainframeandWorkloadAutomation,pleasevisit:http://cainc.to/9GQ2JI
32 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
RecommendedSessionsSESSION# TITLE DATE/TIME
MFX92S StrategyandVisionforCADatacomandCAIdeal 11/16/2016at12:45pm
MFX93S What’snewinCADatacom 11/16/2016at1:45pm
MFX94S ReducingTCOwithDatacomCompression(Presspack) 11/16/2016at3:00pm
MFX95SA ModernizingtheCADatacomdata – SQLAccessPartI 11/16/2016at3:45pm
MFX95SB ModernizingtheCADatacomdata – SQLAccessPartII 11/16/2016at4:30pm
MFX96S CADatacom/ADInstallation/UpgradeandMaintenance 11/17/2016at12:45pm
MFX97S CADatacom/ADReportUtilization,andinformationgatherforSupport 11/17/2016at1:45pm
MFX98SUsingSysview tomonitorandmeasureyourCADatacomenvironment– ADandDB
11/17/2016at3:00pm
MFX99S BirdsofaFeather/StumptheTechie! 11/17/2016at3:45pm
33 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Questions?
34 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Thankyou.
Stayconnectedatcommunities.ca.com
35 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
©2016CA.Allrightsreserved.Alltrademarksreferencedhereinbelongtotheirrespectivecompanies.
Thecontentprovidedinthis CAWorld2016presentationisintendedforinformationalpurposesonlyanddoesnotformanytypeofwarranty. The informationprovidedbyaCApartnerand/orCAcustomerhasnotbeenreviewedforaccuracybyCA.
ForInformationalPurposesOnlyTermsofthisPresentation