Test Automation: Agile Enablement for Data Warehousing and ... › 2625872 › Test...

©2016byWinterboerAgileAnaly4cs�www.WinterboerAgileAnaly4cs.com

Test Automation: Agile Enablement for Data Warehousing and Business Intelligence Teams

PresentedtotheSo>wareQualityAssocia4onofDenver(SQuAD)March8,2016Denver,ColoradoLynnWinterboer,AgileAnaly4csEducatorandCoach,@AgileLynnBradEwald,DW/BISolu4onArchitect,@JBEwald


Agenda

• Whyistestautoma4onimportantforagiledatateams?

• Whyaren’talldatateamsautoma4ngtheirteststoday?

• Whatisthepathtotestautoma4on?

• WhatdoessimpleDWtestautoma4onlooklike?


Why is test automation important to agile data teams?

©2016byWinterboerAgileAnaly4cs�www.WinterboerAgileAnaly4cs.com©KenCollier,2016,AllRightsReserved

Agile Demands Something Different Agilecallsforsmallincrementsof“poten4allyshippablecode”.ThatmeansQAisessen4alonaregular,frequentbasis.

Howcanwebesurethatsomethingwedo

here

Doesn’tbreaksomethingwedidback

here

Test Suite Test Suite Test

Suite Test Suite Test

Suite Test Suite Test

Suite

Manualtes4ngquicklybecomesinfeasible.Thetestsuitegrowslargereachitera4on.


Testing is Central to Agile

AgileBIdevelopmentisdrivenbytests

Acceptancecriteriaarethedefini4onof“done”

Passingtestsarethemeasureof“done”

Regressiontestsarethemeasureof“s4lldone”


Agile Teams Understand…

 …thattestautoma4onis  akeytechnicalenabler

 to“beingagile”


Why aren’t all data teams automating their tests

today?


DW/BI Test Automation Challenges Dataindustrydoesnotfocusontes4ngasmuchasotherdisciplines:

Educa4onTeamMembers

Skills&Discipline


DW/BI Test Automation Challenges Exis4ngtoolsarenoteasilyadaptedtothedataworld:

DevelopmentLanguages

WebandMobileFocus


DW/BI Test Automation Challenges Goodtestdatasetsarehardtocomeby:

Largevolumes(onsmallenvironments)

SharedtestenvironmentsDatasensi4vity

Smallsetsneedextraplanninganddesign


What is the path to test automation?


Agile Testing Perspectives

HighQualityDW/BISystem

3) Tools & Automa/on

1) A2tudes & Culture

2) Skills & Prac/ces

Tes4ngisaTeamSportLearningCultureBuildQualityIn

Tes4ngSkillsTestDesign,Organiza4on&MaintenanceRepeatableTestsFeedbackLoopsBusinessDomain

TestEnvironmentBuildAutoma4onTestDataSetsTestAutoma4onTool


Test Automation Pyramid

AppTests

AcceptanceTests

Unit&ComponentTests

ManualTests

Lisa Crispin & Janet Gregory, Agile Tes6ng: A Prac6cal Guide for Testers and Agile Teams

Pushasmanytestsaspossibletothislayer

Writetheseinbusinessdomainlanguage

BrifleteststhatareaffectedbyUIchanges

Subjec4veuserfeedbackisessen4al


Where to Start?

Wheredoesithurtthemost?


Where Does It Hurt the Most? Painfultestsetup?

Deployinganewbuild?

Breaksinproduc4on?

Regressiontes4ng?

Tes4ngnewfeatures?

Pronetomanualtesterror?


Where to Start?

Whatisthesmallest,simplestwayyoucouldrelievethatpain?


What does simple data warehousing test automation

look like?


Basic Approach

Sta4cTestData

ExpectedResults

TestQueries

loadtestdata

compareresults

executetests

Componentundertest

SourceSchema

TargetSchema

ActualResults

TestData

TestRunner

Setup Execute Test Report CleanUp


Demonstration


Testing Framework Func4onality•  Screensfordescribingandcrea4ngtestcases•  Proceduresthatexecutetestsandcreateexpected

results•  BIReportsandDashboardsformonitoringComponents•  SQLServerandRelatedModel•  Microso>Access(inputscreens)•  SQLServerStoredProcedures(testexecu4on)•  PowerShellscripts(batchexecu4on)•  MSPowerBIforRepor4ng


What Constitutes a Test?

ActualResult(orDataset)

ExpectedResult(orDataset)


Testing Demo


Session Intent

 1)Why:   TestAutoma9oniskeytoDW/BIagilesuccess

 2)How:   Automateasolidtes9ngprac9ce;don’tautomatechaos

 3)Show:   DW/BItestautoma9onisnotthathard


Thank You!

Lynn Winterboer Agile Analy/cs Educator & Coach

www.lynnwinterboer.com [email protected]

@agilelynn

Brad Ewald DW/BI Solu/on Architect [email protected]

@jbewald


DW/BI Test Automation Tools Tool Descrip,on

DBFithfp://dbfit.github.io/dbfit/

Opensourcedatabasetes4ngtool

iCEDQhfp://icedq.com

AunifiedplajormforETLtes4nganddatamigra4ontes4ng

Analy,xDataServiceshfp://analy4xds.com

EnterprisedatamappingandETLcodeautoma4on,includingnewautoma4cgenera4onofreusabletestcasesassociatedwithSourcetoTargetMappings

WhereScapehfps://www.wherescape.com

Datawarehouseautoma4onso>ware,includingatestharnessframeworkwithuser-configurableprofilingmethods.

Tricen,sToscahfp://www.tricen4s.com/tricen4s-tosca-testsuite/

DW-friendlytestautoma4ontool


DW/BI Test Automation References Reference Descrip,on

AgileAnaly*cs:AValue-DrivenApproachtoBusinessIntelligenceandDataWarehousingbyDr.KenCollier

Chapter7:Test-DrivenDataWarehouseDevelopment

AgileDataWarehousingfortheEnterprise:AGuideforSolu9onArchitectsandProjectLeadersByRalphHughes

PartV:AgileEDWQualityManagementPlanning

AutomatedDataWarehouseTes*ng:Beginner’sStep-by-StepGuidebyG.Suden

Java-basedtestautoma4onforsimpledatawarehousingtests

AgileTes*ng:APrac9calGuideforTestersandAgileTeamsbyLisaCrispinandJanetGregory

Greatintroduc4ontoagiletes4ngforanytypeofdevelopment

MoreAgileTes*ng:LearningJourneysfortheWholeTeambyLisaCrispinandJanetGregory

Includesseveralchaptersontestautoma4onaswellasonededicatedtoagiletes4ngforDW/BI

Test Automation: Agile Enablement for Data Warehousing and ... › 2625872 › Test...

Documents

Transcript of Test Automation: Agile Enablement for Data Warehousing and ... › 2625872 › Test...