StickyMinds.com and Better Software magazine presents… How to Build a Testing Center of Excellence...

StickyMinds.com and Better Software magazine presents…

How to Build a Testing Center of Excellence

Sponsored by Cognizant

This event aired on July 8, 2008.

Testing centers of Excellence

Building

© 2007, Cognizant Technology Solutions. Confidential

TC

OE


Agenda

Testing CoE

Voice of Customers TCoE Models

Scope Activities Critical Success Factors Key Considerations

TCoE EcosystemQ&A


Testing is time-consuming

No testing value-adds

Increasing Business User Demand,

Diversified Technologies and

locations with different approaches

Lack of standards, tools, metrics,templates for quality assessment, comparison across projects

Testing in one group is high

Inconsistency in testing approach

BAs perform the role of QATesting is expensive


Testing Process CoE

• Definition | Development | Maintenance of test processes, standards & templates• Facilitation of Test Management Community• Metrics Reporting & Management• Test Process Training• Continuous Process Improvement (CPI)

• Provision | Administration | Support of Test Infrastructure and Test Tools

• Provision of NFT Services & Test Automation Services• Technical Test Consultancy

• Provision of Functional, UAT & liaison services• Flexible resource pool creation• Provision of specialized testing services

Testing Tools/

Infrastructure CoE

NFT & Automation CoE

Shared Testing Team

Decentralizedcentralized


• Process definitions & Roll-out• Process facilitation & maintenance• Process Compliance Audit• Facilitation of Test management community • Continuous process improvement

Services

• Assessment of existing process assets • Define/Refine and standardize processes • Institute metrics framework• Usage guidelines and communication plan • Establish centralized process framework

Pre

Setu

p

Activities

• Organizational strategy alignment• Effective Communication & Training • Effective Piloting and Evaluation• Process compliance review mechanism

Critical Success Factors

• Representation of key stakeholders from various groups

• Seed change agents to facilitate propagation

• Closed loop feedback mechanism

Key Considerations

Testing Process CoE

• Communicating, Piloting & Training • Process audits • Change management • Industry benchmarking Po

st S

etup


• Tool evaluation• Testing tools technical support• Test tool license management & administration• Tool process standardization• Tool optimization

Services

• Tools inventory • Tool evaluation• Capacity planning & Platform optimization • ROI Analysis• Tool licensing & procurement policy

Pre

Setu

p

Activities

• Clear understanding of opportunities for operational efficiencies• Demand forecasting mechanism• Tool/Infrastructure utilization & Optimization• Service Level Agreements


• Tool standardization for testing activities such as requirement management, defect management etc.

• Leverage vendor organization’s tool partnership

• Tool set integration

• Alternative tool pricing model

Key Considerations

Infrastructure & Tools CoE

• Maintain tools inventory• Tool administration, upgrades, license management & tools training• Monitoring & maintenance• Incident management workflow

Post

Set

up


• Review/Refine & publish scripting standards and guidelines

• Resource sharing & allocation models

• ROI Analysis

• Team identification

Pre

Setu

p

Activities

• Uniform Automation/Performance Testing guidelines & scripting standards

• Reusable Automation/Performance testing framework & work load models

• Defined Non Functional/automation testing requirements


• Scope for Regression & Test Automation based on scheduled releases• Utilize Tools CoE for standards & guidelines definition• Utilize Process CoE for propagation of best practices

Key Considerations

NFT & Automation CoE

• Feasibility analysis & Proof of concepts

• Construct reusable frameworks

• Technical Training/Support

• Technical test consulting

Post

Set

up

Services• Performance testing• Security testing • Usability testing• Workload Modeling

NFT

• Test Automation• Framework design and Implementation

Automation

Value-Adds• Technical consultancy• Feasibility analysis


• Establish test management office• Scope analysis & demand forecasting• Engagement & Sourcing model• Institute training program • KPI definition

Pre

Setu

p

Activities

• Identification of core vs. non-core business functions.

• Strong Governance Model

• KPI identifications

• Management by Metrics


• Tracking mechanism to measure achievements over period of time against established goals

• Cross-functional training

• Effective collaboration of Business Analysts and QA

Key Considerations

Shared Testing Team

• Resource allocation• Skill assessment and training• Test program management • Construct knowledge assetsPo

st S

etup

Services• Functional testing• System testing/SIT• Acceptance testing

Basic

Specialized

Support & Consultancy

• Defect Management• Test Life Cycle modeling

• Test Strategy conceptualization

• Compliance testing• DW testing• Agile testing • SOA testing• Product/Package testing



Piloting for Success

Shared Testing Tools

Defined basic processes Standardized tool management

Defined scope and schedule Tool licensing & procurement policySystem Testing

System Integration Testing

UAT support

3-6 months 4-8 weeks

High MediumData Generation & Sanitization Reporting utilities, portletsKnowledge RepositoryDash-boardsIncreased Test Coverage TraceabilityEstablished Quality gates Effective defect managementObjective Go/No-Go decisionsImproved productivity & test effectivenessReduced defect leakageCycle time reductionQuality GainsNew project OR AVM Project Existing projects

Pilot Accelerators

Project types

Bene

fit R

ealiz

ation

Test Management

Management by metrics

Short-term

Long Term

Pre-requisites

Scope

Pilot Length

Business Disruption


Piloting for Success

Automation Non-functional testingDefined automation scripting standards &guidelines

Defined NFT requirements

Tools Inventory Defined NFT scripting standards & guidelinesTool Evaluation Feasibility analysisTool licensing & procurement policyFeasibility AnalysisROI Analysis PerformanceProof of Concepts Security (Application Vulnerability Assessment & Reusable framework Usability

Proof of conceptsMinimum 4 releases per year 6-8 weeks

Low MediumAutomation framework Tool driven testingSkilled resources Leveraging existing labs

Skilled resourcesConsistency Identifying bottlenecks & vulnerabilitiesImproved Coverage

Reusability Enhanced user experienceReduced maintenance Customer retentionCost Savings

Release-based New projects AND Web-based

Short-term

Long Term

Pre-requisites

Scope

Pilot Length

Business Disruption

Pilot Accelerators

Project types

Bene

fit R

ealiz

ation

Test Planning & Estimation

Test Design &

Build

Test Execution &Management

Test Reporting

Test Metrics

Management

TestProgram

Management

Testing Center of Excellence

Infrastructure & Tools COE

Tool Maintenance &

Support

Test Automation

Tool Implementation

Tool Provision

Process COE

Process Maintenance

Process Definition

Metrics Program

Test Process Training

Continuous Process

Improvement

Best Practice

implementation

>

>

T e s t i n g C e n t e r O f E x c e l l e n c e

Service Spectrum

System TestingSystem

Integration testing

Regression Testing

Test Automation

UAT

Core – Flexibleresourcing

Standard process& Frameworks

Common Tools,Infrastructure &

Automation

SolutionAccelerations/Best practices

Governancestructure

>

TCoE Ecosystem


Good LuckGood Luckon your TCOE Journey


Have a question for the speaker? Ask now.

Q & A

StickyMinds.com and Better Software magazine presents… How to Build a Testing Center of Excellence...

Documents

Transcript of StickyMinds.com and Better Software magazine presents… How to Build a Testing Center of Excellence...