Test Automation: Agile Enablement for Data Warehousing and ... › 2625872 › Test...

Test Automation: Agile Enablement for Data Warehousing and Business Intelligence Teams

PresentedtotheSo>wareQualityAssocia4onofDenver(SQuAD)March8,2016Denver,ColoradoLynnWinterboer,AgileAnaly4csEducatorandCoach,@AgileLynnBradEwald,DW/BISolu4onArchitect,@JBEwald

Agenda

• Whyistestautoma4onimportantforagiledatateams?

• Whyaren’talldatateamsautoma4ngtheirteststoday?

• Whatisthepathtotestautoma4on?

• WhatdoessimpleDWtestautoma4onlooklike?

Why is test automation important to agile data teams?

Agile Demands Something Different Agilecallsforsmallincrementsof“poten4allyshippablecode”.ThatmeansQAisessen4alonaregular,frequentbasis.

Howcanwebesurethatsomethingwedo

Doesn’tbreaksomethingwedidback

Test Suite Test Suite Test

Suite Test Suite Test

Manualtes4ngquicklybecomesinfeasible.Thetestsuitegrowslargereachitera4on.

Testing is Central to Agile

AgileBIdevelopmentisdrivenbytests

Acceptancecriteriaarethedefini4onof“done”

Passingtestsarethemeasureof“done”

Regressiontestsarethemeasureof“s4lldone”

Agile Teams Understand…

 …thattestautoma4onis  akeytechnicalenabler

 to“beingagile”

Why aren’t all data teams automating their tests

today?

DW/BI Test Automation Challenges Dataindustrydoesnotfocusontes4ngasmuchasotherdisciplines:

Educa4onTeamMembers

Skills&Discipline

DW/BI Test Automation Challenges Exis4ngtoolsarenoteasilyadaptedtothedataworld:

DevelopmentLanguages

WebandMobileFocus

DW/BI Test Automation Challenges Goodtestdatasetsarehardtocomeby:

Largevolumes(onsmallenvironments)

SharedtestenvironmentsDatasensi4vity

Smallsetsneedextraplanninganddesign

What is the path to test automation?

Agile Testing Perspectives

HighQualityDW/BISystem

3) Tools & Automa/on

1) A2tudes & Culture

2) Skills & Prac/ces

Tes4ngisaTeamSportLearningCultureBuildQualityIn

Tes4ngSkillsTestDesign,Organiza4on&MaintenanceRepeatableTestsFeedbackLoopsBusinessDomain

TestEnvironmentBuildAutoma4onTestDataSetsTestAutoma4onTool

Test Automation Pyramid

AppTests

AcceptanceTests

Unit&ComponentTests

ManualTests

Lisa Crispin & Janet Gregory, Agile Tes6ng: A Prac6cal Guide for Testers and Agile Teams

Pushasmanytestsaspossibletothislayer

Writetheseinbusinessdomainlanguage

BrifleteststhatareaffectedbyUIchanges

Subjec4veuserfeedbackisessen4al

Where to Start?

Wheredoesithurtthemost?

Where Does It Hurt the Most? Painfultestsetup?

Deployinganewbuild?

Breaksinproduc4on?

Regressiontes4ng?

Tes4ngnewfeatures?

Pronetomanualtesterror?

Where to Start?

Whatisthesmallest,simplestwayyoucouldrelievethatpain?

What does simple data warehousing test automation

look like?

Basic Approach

Sta4cTestData

ExpectedResults

TestQueries

loadtestdata

compareresults

executetests

Componentundertest

SourceSchema

TargetSchema

ActualResults

TestData

TestRunner

Setup Execute Test Report CleanUp

Demonstration

Testing Framework Func4onality•  Screensfordescribingandcrea4ngtestcases•  Proceduresthatexecutetestsandcreateexpected

results•  BIReportsandDashboardsformonitoringComponents•  SQLServerandRelatedModel•  Microso>Access(inputscreens)•  SQLServerStoredProcedures(testexecu4on)•  PowerShellscripts(batchexecu4on)•  MSPowerBIforRepor4ng

What Constitutes a Test?

ActualResult(orDataset)

ExpectedResult(orDataset)

Testing Demo

Session Intent

 1)Why:   TestAutoma9oniskeytoDW/BIagilesuccess

 2)How:   Automateasolidtes9ngprac9ce;don’tautomatechaos

 3)Show:   DW/BItestautoma9onisnotthathard

Thank You!

Lynn Winterboer Agile Analy/cs Educator & Coach

www.lynnwinterboer.com lynn@lynnwinterboer.com

@agilelynn

Brad Ewald DW/BI Solu/on Architect brad.ewald@gmail.com

@jbewald

DW/BI Test Automation Tools Tool Descrip,on

DBFithfp://dbfit.github.io/dbfit/

Opensourcedatabasetes4ngtool

iCEDQhfp://icedq.com

AunifiedplajormforETLtes4nganddatamigra4ontes4ng

Analy,xDataServiceshfp://analy4xds.com

EnterprisedatamappingandETLcodeautoma4on,includingnewautoma4cgenera4onofreusabletestcasesassociatedwithSourcetoTargetMappings

WhereScapehfps://www.wherescape.com

Datawarehouseautoma4onso>ware,includingatestharnessframeworkwithuser-configurableprofilingmethods.

Tricen,sToscahfp://www.tricen4s.com/tricen4s-tosca-testsuite/

DW-friendlytestautoma4ontool

DW/BI Test Automation References Reference Descrip,on

AgileAnaly*cs:AValue-DrivenApproachtoBusinessIntelligenceandDataWarehousingbyDr.KenCollier

Chapter7:Test-DrivenDataWarehouseDevelopment

AgileDataWarehousingfortheEnterprise:AGuideforSolu9onArchitectsandProjectLeadersByRalphHughes

PartV:AgileEDWQualityManagementPlanning

AutomatedDataWarehouseTes*ng:Beginner’sStep-by-StepGuidebyG.Suden

Java-basedtestautoma4onforsimpledatawarehousingtests

AgileTes*ng:APrac9calGuideforTestersandAgileTeamsbyLisaCrispinandJanetGregory

Greatintroduc4ontoagiletes4ngforanytypeofdevelopment

MoreAgileTes*ng:LearningJourneysfortheWholeTeambyLisaCrispinandJanetGregory

Includesseveralchaptersontestautoma4onaswellasonededicatedtoagiletes4ngforDW/BI

Test Automation: Agile Enablement for Data Warehousing and ... › 2625872 › Test...

Documents

Transcript of Test Automation: Agile Enablement for Data Warehousing and ... › 2625872 › Test...

Scaling Agile Data Warehousing with the Scaled Agile Framework (SAFe)

CII - Institute of Logistics - Omni-Channel Enablement - must ......distribution, e-commerce logistics, freight forwarding, multimodal logistics, contract logistics & 3PL, warehousing,

Agile Enterprise Data Warehousing - download.101com.comdownload.101com.com/pub/tdwi/files/2_Agile_DW_BI_TDWI_SouthFL... · Agile Enterprise Data Warehousing ... DW/BI: From Chaos

Applying SOA for Agile Service Delivery in Communications & Media Jaron Cohen Asia-Pacific Service Enablement Solution Specialist.

Agile Data Warehousing

by Dr. Ken Collier, Senior Consultant, Cutter Cutter Agile ... · Agile Data Warehousing: Incorporating Agile Principles by Dr. Ken Collier, Senior Consultant, Cutter Consortium;

Agile Enterprise Data Warehousing

Agile Data Warehousing - The Agilist

AIN SBB Network Enablement Overview (CUSTOMER) · CUSTOMER DSC Network Enablement ∞ SAP Digital Supply Chain, Network Enablement July 22nd, 2019 SBB Asset Intelligence Network Enablement

Aligning Enablement Activities with Partner Operational ... · BUSINESS ENABLEMENT –MOVE BEYOND THE PRODUCT SALES ENABLEMENT –FOUNDATIONAL SKILLS THE PRIORITY TECHNICAL ENABLEMENT

Agile Data Warehousing with Production Sandboxing · PDF fileAgile Data Warehousing with Production Sandboxing Stephen Brobst Chief Technology Officer Teradata Corporation Oliver Ratzesberger

Company Presentation - Unisys · Agile & DevOps Transformation Services s Cloud and Infrastructure •Infrastructure Transformation •Hybrid Cloud Enablement •Empowering the Digital

SAP User Groups Knowledge Transfer Webinar How Big Data and … · 2019-05-23 · Agile analytics, agile Data Warehousing, agile BI Introducing Agile Analytics: A Value-Driven Approach

DATA WAREHOUSING & BUSINESS INTELLIGENCE€¦ · DATA WAREHOUSING & BUSINESS INTELLIGENCE SUMMIT 2019 Big Data, Agile Datawarehouse Design, Analytics & Data Science, Dimensional Modeling,

Test Automation for DWBI teams Agile 2016 …schd.ws/hosted_files/agile2016/0e/Test Automation for DWBI teams... · Data Warehousing and Business Intelligence Teams Presented to Agile

Agile Data Warehousing for the Enterprise

Enablement CERT - Community Enablement & Reablement Team.

2018 1015 Combined Building a Sustainable Sales Enablement ... · defined sales enablement charter Agreed they achieved sales enablement objectives Set sales enablement priorities

Agile Methods and Data Warehousing:

Test Automation: Agile Enablement for Data Warehousing and ... · Test Automation: Agile Enablement for Data Warehousing and Business Intelligence Teams Presented to Agile 2016 July