Case Study: American Family Insurance Best Practices for Automating Guidewire functional, regression...

World®’16

CaseStudy:AmericanFamilyInsuranceBestPracticeforAutomatingGuidewireTestingSanket Shah- TestAutomationArchitect- AmericanFamilyInsurance

DO5X20S

DEVOPS

2 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

©2016CA.Allrightsreserved.Alltrademarksreferencedhereinbelongtotheirrespectivecompanies.

Thecontentprovidedinthis CAWorld2016presentationisintendedforinformationalpurposesonlyanddoesnotformanytypeofwarranty. The informationprovidedbyaCApartnerand/orCAcustomerhasnotbeenreviewedforaccuracybyCA.

ForInformationalPurposesOnlyTermsofthisPresentation


Abstract

Sanket Shah(LeadTestAutomationEngineer)discusseshowhis30membertestautomationteamfacilitatesGuidewire functional andregressiontestingaswellasbestpractices.

Automationisanaccelerator,whichfuelsconsistency,robustnessandreliabilityinanenvironmentwheretasksaretoberepeated.Oneofthekeyadvantagesofitisinautomatedregressiontesting,whichsavesalotofeffortincarryingoutthesametestingactivitiesrepeatedly.Identifyinganyimpactedintegratedsystemsorthesourcesystemduetochange(s)infeatures/functionalityand/oradditionoffeature/functionalityinasoftwareproduct,wouldbeadauntingtaskifcarriedoutmanually(especiallywhenwewantconsistencyandwhentheAUTisintegratedwithseveralservicesattheapplicationservicelayer).

LeveragingautomatedregressiontestingwouldtakethebuildingupofAPItoawholenewlevel,thusacceleratingtheuser’sjourneythroughtheirwebapplication.

SanketShahAmericanFamilyInsuranceTestAutomationArchitect


Agenda

CASEBACKGROUND

CHALLENGESFACED

Q&A

INITIALSOLUTION

DRAWBACK

ULTIMATESOLUTION

1

2

3

4

5

6


CaseBackground


BillingandPolicyThemesatAmfam

StrategictotheBusiness

OptimizesCustomerExperience

Transformationaltothebusiness

Supportsasophisticatedpricingmodel

EnhancesAmfam'sbrandandmarketleadership


AutoandPropertyCasualtyPolicyandBillingTestingGoals

POLICY§ Reduceunderwritingcostsby

optimizingtestcaseefficiencies

§ Improveapplicationquality/reduceriskandimpactofdefects

BILLING§ Optimizecustomere-Commerceand

Agentapplicationexperience(i.e.,ensureahighqualityuserexperience)

§ Reducetestingriskandduration:Buildautomatedtestcasestosupportthemyriadofbusinessprocesses(e.g.,billingplans,exceptionhandling,etc.)


CurrentLegacySystems

Auto+

Property+

CustomerBillingSystem(CBS)

POLICYMANAGEMENT BILLING


MigratingLegacySystemstoOpenSystems

Auto+andProperty+ CustomerBillingSystem(CBS)


GuidewirePolicyCenter

Issuance

Changes(charges/credits)

Cancellations(non-pay/insured)

Reinstates

Rewrites

Renewals


GuidewireBillingCenter

§ Generateandbillinvoices§ Schedulinginvoices§ Acceptingandapplyingpayments§ Paymentreversals§ Cancellationinitiation(non-pay)§ Delinquencies§ Thirdpartyinterestbilling

management§ Disbursements


APolicy’sLifespan

6to12months

12months


PolicyCenter-BillingCenter Integration(Pre-Prod/Prod)

PolicyCenter BillingCenter

Database

Integration1Integration2

Integration3

Integration4

Integration5

Integration6 Integration7

Integration8

Integration9


ChallengesFaced


…inTestingBillingCenter inPre-prodTiers

Differentteamstestingdifferentapplicationfunctionalities/

themesatthesametime,whichareclockdependent.

Testscenariostotestapolicy’sstateatagivenpointintime.

ClockdependencyofBCinpre-prod


InitialSolution


…toTestClockDependentScenariosinBillingCenter

BC(deployedonlocal)Simulator

(simulatingPCtransactionsusingspreadsheetsasdatasourceandsetofbatchfilestoloadthem)

LOCAL

H2


StepsInvolved


…inSettingUpBillingCenter onLocalforTestingEachScenario

StopBCifstarted DropDB StartBC Loadinitialdata

Executetestcase

(~2-3sec) (~1sec) (~5min)

(~2min)

(Repeattheflowforeachsubsequenttestscenario)


Drawback


…forSettingUponLocal

Executiontimeforeachscenario:

~9-10min

Executiontimefor100scenarios:

~15-16min


Solutionà RetesterFramework


WhatisRetester

§ In-housedevelopedautomationregressionframework

§ In-depthverificationofbillinglifecycleofapolicy

§ SimulationofpolicytransactionsthroughAPIs

§ Businessfriendlydataentryforms

§ Productionsimulationofareallifebusinesstransaction

§ Alayerofsoliditybeforerollingouttolargeraudience

§ Robust,fast,consistent,repeatable


…aComprehensiveBillingCenter ApplicationTestingTool

MSAccessformstoenterscenarios

Oracletostorescenariosdataand

results

Automationtoolasmastercontroller


RetesterFramework– Highlevelworkflow

STARTGetlistofbusinessscenariostobe

executed

Executepre-batcheventsforcurrentday- allscenarios

Validatedatafortheeventspre-batchandlog

result

Advanceclockandrunbatch

Executepost-batcheventsforcurrentday– all

scenarios

Validateddatafortheevents

executedpost-batchandlog

results

Logeventsresultandvalidateresultin

adatabaseandcontinuewithnext

day

EndofTest?

No

Yes

Atendofthetest,sendcompletion

emailwithpassed/failstats

Logeventsresult,validateresultindatabaseand

continuewithnextday

END


RetesterFramework– DetailFlowSTART Initializeday

counter

No

Yes

GetnewtestIDforeachexecution

Getmaxnumberofdaystoexecute

currDay =currDay+1

GettotalscenarioscountforcurrDay

ScenariosexistforcurrDay?

EndofDays?

Initializescenariocounter

currSce =currSce +1 A

A

EndofscenariosforcurrDay?

Gettotalpre-batcheventsforcurrDay andcurrSce

Pre-batcheventsexist?

Initializeeventcounter

*

*

currEve =currEve+1

A

AdvanceclockandrunEOD

batchNo

Yes

ScenariosExist?

No

No

GettotalpostbatcheventsforcurrDay andcurrSce

Yes

Post-batcheventsexist? No

Yes

Yes

B

END


DevTestfromCAandRetesterFramework

UsesPolicyCenter/BillingCenter APIstoinitiatetransactions

CustomizedAPIstovalidatedataontheBillingCenterapplication

Creatingnewscenariosisassimpleasfillingupaform

Cyclesthrough100sofscenariosin<2hrs.Gainof85%


Questions?


RecommendedSessions

SESSION# TITLE DATE/TIME

DO5T02PLeadershipPanel:DevOpsLeadersDiscusstheJourneytoContinuousDelivery

11/16/2016at01:45pm

DO5T03PLeadershipPanel:ContinuousDeliveryintheFinancialServicesIndustry

11/16/2016at04:30pm

DO5T14SContinuousDelivery:MakingDevOpsAwesomeNicoleForsgren– Theater5

11/17/2016at10:30am


MustSeeDemos

ModernizeAppDeliveryIntegratedCDTheater5- DOV501P

DeliverTestDataFasterTestDataManagerTheater5- DOV511P

DeliverBetterAppsServiceVirtualizationTheater5- DOV507P

OrchestrateYourReleaseReleaseAutomationTheater5- DOV513P


Stayconnectedatcommunities.ca.com

Thankyou.


DevOps– ContinuousDelivery

FormoreinformationonDevOps– ContinuousDelivery,pleasevisit:http://cainc.to/PiTFpu

Case Study: American Family Insurance Best Practices for Automating Guidewire functional, regression...

Technology

Transcript of Case Study: American Family Insurance Best Practices for Automating Guidewire functional, regression...