Role of Automation in Testing

ROLE OF AUTOMATION IN TESTING

Anand Bagmar

Test Practice Lead

@BagmarAnand about.me/anand.bagmar

ABOUT ME

Money / Value

Time

Quality

ORGANIZATION OBJECTIVE

Typical Process in Agile Teams

Story Planning Session

BUSINESS BA

Write Story & Scenarios

BA

Implement Automated Acceptance Tests

TESTER

TESTER DEV

Implement Functionality

Regular BA/QA Demo

DEV DEV

TESTER DEV BA

TESTER DEV BA

Story Testing

Showcase to Business

STARTS HERE

SYSTEM TESTING

START DEVELOPMENT ITERATION

END DEVELOPMENT ITERATION

DEVELOPMENT ENGINE

STORY PLANNING SESSION

BUSINESS BA TESTER

TESTER

BA / QA Signoff on Dev Box


BUSINESS BA


BA


TESTER

TESTER DEV


Regular BA/QA Demo

DEV DEV

TESTER DEV BA

TESTER DEV BA




DEVELOPMENT ENGINE

STORY WRITING

BUSINESS BA TESTER

TESTER

STARTS HERE

SYSTEM TESTING


Story Testing


BUSINESS BA


BA


TESTER

TESTER DEV


Regular BA/QA Demo

DEV DEV

TESTER DEV BA

TESTER DEV BA




DEVELOPMENT ENGINE

AUTOMATE ACCEPTANCE TESTS

BUSINESS BA TESTER

TESTER

STARTS HERE

SYSTEM TESTING


Story Testing


BUSINESS BA


BA


TESTER

TESTER DEV


Regular BA/QA Demo

DEV DEV

TESTER DEV BA

TESTER DEV BA




DEVELOPMENT ENGINE

IMPLEMENT FUNCTIONALITY

BUSINESS BA TESTER

TESTER

STARTS HERE

SYSTEM TESTING


Story Testing


BUSINESS BA


BA


TESTER

TESTER DEV


Regular BA/QA Demo


DEV DEV

TESTER DEV BA

TESTER DEV BA




DEVELOPMENT ENGINE

BA & QA SIGNOFF

BUSINESS BA TESTER

TESTER

STARTS HERE

SYSTEM TESTING

Story Testing


BUSINESS BA


BA


TESTER

TESTER DEV


Regular BA/QA Demo

DEV DEV

TESTER DEV BA

TESTER DEV BA

BUSINESS BA


TESTER



DEVELOPMENT ENGINE

STORY TESTING

TESTER

STARTS HERE

SYSTEM TESTING


Story Testing


BUSINESS BA


BA


TESTER

TESTER DEV


Regular BA/QA Demo


DEV DEV

TESTER DEV BA

TESTER DEV BA

BUSINESS BA


TESTER



DEVELOPMENT ENGINE

SHOWCASE TO BUSINESS

TESTER

STARTS HERE

SYSTEM TESTING

Story Testing

Test Automation

A PRACTICE THAT MAKES TEAMS SUCCESSFUL?

Test Automation

A PRACTICE THAT MAKES TEAMS UNSUCCESSFUL?

What is Test Automation?

Automation -

A Safety Net

Value

IDEAL TEST AUTOMATION PYRAMID

Manual / Exploratory

Technology-facing Tests

Business-facing Tests

Cost

Time

UI

Web Service

View

JavaScript

Integration

Unit

REALITY

ICE-CREAM CONE ANTI PATTERN


UI

Web Service

View

JavaScript

Integration

Unit

Web Service

View

JavaScript

Integration

Unit

Developers Test Pyramid QA Team Test Pyramid

DUAL TEST PYRAMID ANTI-PATTERN


UI

Web Service

CUP-CAKE ANTI-PATTERN

TYPES OF TEST AUTOMATION FRAMEWORKS

Modular

Data-driven

Keyword-driven Model-based

Hybrid

? ? ?

Understand the system(s) / product(s) you need to test!!

REMEMBER …

TEST AUTOMATION FRAMEWORK DESIGN CRITERIA

Maintainable

Scalable

Browser / Device support

Support features of Product-under-test

Easy to Use

Different Environments

Parallel Execution

Tool support

Reports & Metrics

Support the types of testing required

Operating System & Database support

Run locally & remotely

Language / tool restrictions

PRINCIPLES FOR TEST AUTOMATION FRAMEWORK

Design Patterns

Abstraction Layers

Headless executing

Evolve

Code Quality

Take Screenshots

Refactor

Tools & Utilities

Extensible

Run via CI

Logging

Video Recording

Test Data

FRAMEWORK ABSTRACTION LAYERS

QA Capabilities & Skills

Are We Building the Correct Product

& ….

If so, are we building it correctly?

QA CAPABILITIES

Continuous Delivery

Coaching Enabling

Sales

Bridging The Communication Gap

Tech Debt

Trainings

Writing Blogs

Raising Risks

Prioritization

Facilitation

Stakeholder Management

Speaking At QA Conferences

QA SKILLS

Domain

Functional Analysis & Testing

Process Improvements

Automation

Testing Mindset

Accessibility Testing

Showcases

UAT

Defect Management

Security Testing

Performance Testing

Usability Testing

Facilitation

[email protected]

[email protected]

@BagmarAnand

about.me/anand.bagmar

THANK YOU

Role of Automation in Testing

Software

Transcript of Role of Automation in Testing