AppLabs confidential and restricted circulation 1
Testing Centre of ExcellenceMyth or Reality
22nd October 2008
Ian Londesbrough
AppLabs confidential and restricted circulation 3
Agenda
» Understand business drivers for TCoE
» Identify the building blocks of the TCoE
» How to build the TCoE
» Assessing TCoE against the Testing Lifecycle
» Deploying the TCoE solution
» Improving and expanding the service
» Build the Business Case
» Summary
AppLabs confidential and restricted circulation 4
Why TCoE? Business Drivers
» Increased business user demand» Complex changes
» Time to market» Multiple releases in a year» Dynamic business changes
» Lack of uniform testing processes» Every project having its own testing process» More people dependant and not process dependant
» Testing is time consuming» Inadequate Automation & usage of tools» No key Accelerators / Frameworks
» Effectiveness of testing» No measurements / metrics
AppLabs confidential and restricted circulation 5
Test Center ofExcellence
Project Support
ExpertiseBuilding
ProcessImprovement
KnowledgeManagement
Methodologies
Tools
Benchmark metrics
Templates
External, internal training
Test Automation tool certifications
Accelerators
Internal projects
Prototypes
Functional, technical support for projects
Problem resolution
Capture experiences
White papers
Best practice repository
Re usable components
The Building Blocks
Complete FormalTest
Review
AppLabs confidential and restricted circulation 6
Proof of conceptBring in Applabs rich experience,
from Testing industry specific Best Practices
Test tools and technology competencyAccess to the latest tools and technologies like
automation tools, scripting languages, databases
Knowledge managementIntegrated knowledge management system to help leverage our learning
Reusable test suites & frameworks Proven & Structured Process Models. Design &
implement best-of-breed solutions & technology
Deepening of skillsThrough training & prototype
development
Measurement & ContinuousImprovementMetrics to ensure enterprise wide implementationRegular check points to evaluate process maturity & Feedback
Strategy definitionLeverage on internal and external knowledge base to define objectives and scope of TCoE Assimilation
Creating a knowledge base through Testingbest practices
AwarenessBuilding a roadmap and vision for the Center of Excellence
DeploymentUsing capabilities and components that the CoE generates, deploy across enterprise
ImprovementImproving value by repeated use – continuously refining the components
Test Center
of Excellence
Building a TCoE
AppLabs confidential and restricted circulation 7
TCoE – AssimilationLooking at every step of the Testing lifecycle
Test LifecycleManagement
TestStrategy
TestPlanning
TestCase
Design
TestExecution
DefectReport
Analysis&
Reports
Test strategydocument
Test plan document
Traceabilitymatrix
Test Scripts
Defect reports
Test summaryreports
R
R
R
Analysis reports
Test case document
R Indicates review point Indicates testing processIndicates test artifacts
StudyRequire-
-ment
Feedback
Test Organization
Test Environment
TestData
TestTools
Test Metrics
ReleaseManagement
ReviewProcess
SoftwareDevelopment
Lifecycle
ConfigurationManagement
ChangeManagement
AppLabs confidential and restricted circulation 8
System Tests
Testing effectiveness
THE “MOSAIC” Assimilation - Spot your candidates for TCoE
Key business element
Packages & Technology enablers
Architecture
Testing Imperative
Strategies
EAI
Cycle time reduction
Data Migration
SOA
Data Integrity
Regression
SAP
WebServices
Performance
Test automation
POS framework
Oracle
DW
Test Process Improvement
Packaged app testing
Bus
ines
sP
artn
ers
IT T
echn
olog
y gr
oups
Lev
erag
e
Platform J2EE .NET AS/400Mainframes
Unix/LinuxWindows
Process & Techniques WIP-CAFÉ OrthogonalArray
Pro
cess
R
ele
van
ceB
usi
nes
s R
ele
van
ceS
yste
ms
Rel
eva
nce
CRM Finance HR Systems Inventory Sales & Marketing
Manugistics JDA Software Seibel
Client/Server
Reliability Modeling
AppLabs confidential and restricted circulation 9
TCoE - Deployment
Step 3
» Environment Planning» Hardware
» Software
Step 1
» People Planning» Test organization» Training
Step 2
» Processes Planning» Management processes» Communication processes» Automation / Tools
AppLabs confidential and restricted circulation 10
TCoE - DeploymentProject Testing Life Cycle
RegressionTest
Test case Design
Integration Test
Fix theDefects
System Test
Fix the Defects
Regression Test UAT
Performance Operations
Testing
Final Regression
Pre-Release Testing
Implement Testing practises
TCoE team working with Project Managers /
Process and Change team
Final Fix
AppLabs confidential and restricted circulation 11
Process and Change Team
Business
Area 1
Define &
improve
Deployment Timelines
Test consultingTransformation level
Test executionTactical level
Execute&
Feed back
Testing Center of Excellence (TCOE)
Business
Area 2
Business
Area 3
Business
Area 4
Business
Area n……
• Improve project quality, reduce costs & delays
• Measure improvement and establish benchmarks
• Define a customized testing framework based on best practices
• Educate people• Consistent logistics, automation and
resources usage
TCoE - Improvement
AppLabs confidential and restricted circulation 12
Path to Success - Build a Business Case
» Define key objectives and scope» What are my the key issues that the TCoE aims to solve» What are the priorities of these issues
» Engagement model with other departments and project teams» To ensure its own success, the TCoE must set rules around how and when
it will provide services to project teams. » Clearly defined entry and exit criteria for its operation
» Quantifiable benefits» What is the ROI on this?» How do I select and measure success criteria
» Where will the funding come from? » For many enterprises, TCoE usually remains a model without powers of
enforcement because they do not have a mechanism to understand the ROI of implementing a COE strategy
» Chargeback or direct from business budget
AppLabs confidential and restricted circulation 13
Summary
» Fully understand what you are trying to achieve through the TCoE – don’t overestimate or oversell the solution
» Plan accordingly by outlining a sensible and pragmatic roadmap to success – bite size chunks are the best approach
» Position the TCoE as an evolutionary process – it’s about continual improvement, refinement and execution (not a one-off)
» Define a well thought-out and structured business case – use metrics and evidence from process improvement initiatives to show the value of the TCoE
» Ensure you have sponsorship at all levels – Business and IT
Questions to: [email protected]
Top Related