Listen | Challenge | Understand | Interpret | Create
Private & Confidential Experimentus Ltd 17a Dorset Square London NW1 6QB T: +44 (0)207 871 2300 www.experimentus.com
Test Maturity Model integration (TMMi) e-Survey
v0.4
Copyright © 2012 Experimentus Ltd
Content
About TMMi
TMMi Structure
TMMi Levels
e-Survey guidance
2
Copyright © 2012 Experimentus Ltd
Test Maturity Model Integration
Developed by the TMMi Foundation (http://www.tmmifoundation.org/)
Based on a wide variety of public domain industry sources
– including the TMM framework originally developed by Illinois Institute of Technology
5 levels of test maturity (staged model)
– Complements the existing CMMI framework
Empirically validated
The worlds only independent test process measurement method
Describes the processes needed to ensure a well planned and controlled test organisation
3
Copyright © 2012 Experimentus Ltd
TMMi Structure
4
MaturityLevel
ProcessAreas
containsindicates
Testing Processcapability
Goals
achieves
Implementation
describes
Specific &Generic Practices
contains
Copyright © 2012 Experimentus Ltd5
1 – Initial
2 – Managed•Test Policy & Strategy•Test Planning•Test Monitoring & Control
•Test Design & Execution•Test Environment
3 – Defined•Test Organisation•Test Training Programme•Test Life Cycle & Integration
•Non-Functional Testing•Peer Reviews
4 – Management and Measurement•Test Measurement•Product Quality Evaluation
•Advanced Reviews
5 - Optimisation•Defect Prevention•Test Process Optimisation
•Quality Control1 – Initial
2 – Managed
3 – Defined
4 – Quantitatively Managed
5 - Optimizing
TMMi Maturity Levels
Copyright © 2012 Experimentus Ltd
Level 2 - Managed
The status of the work products and the delivery of testing services are visible to management, however testing may still start relatively late in the development life cycle
Testing is multileveled, i.e. there are unit, integration, system and acceptance test levels
The main objective of testing in a TMMi level 2 organisation is to verify that the product satisfies the specified requirements
Process Areas
2.1 Test Policy & Strategy
2.2 Test Planning
2.3 Test Monitoring & Control
2.4 Test Design & Execution
2.5 Test Environments
6
Copyright © 2012 Experimentus Ltd
Level 3 - Defined
Testing is fully integrated into the development life cycle
The organisations test standards are established and improved over time and test process improvement is fully institutionalised
A specific organisation test training programme exists and testing is perceived as being a profession and test professionals are involved with reviews of requirements
Process Areas
3.1 Test Organisation
3.2 Test Training Program
3.3 Test Lifecycle & Integration
3.4 Non Functional Testing
3.5 Peer Reviews
7
Copyright © 2012 Experimentus Ltd
TMMi Reference Material
For more information on TMMi, visit the TMMi foundation website
www.tmmifoundation.org
8
Copyright © 2012 Experimentus Ltd
The TMMi e-Survey
9
Copyright © 2012 Experimentus Ltd10
Browser based
Sections:
1. Testing trends & non-TMMi
2. TMMi Process Area rating
3. Optional Comments
Features
– Simple scoring method
– Focuses on areas pertinent to your role
– “Save & Continue Survey Later”
The e-Survey
Copyright © 2012 Experimentus Ltd11
Completing the e-Survey
Should take between 30 mins and 1 hour to complete
Process areas presented based on your role in the organisation
– You can select to complete all process areas if you like
For each process area there are two elements:
1. Statement scores against the model
2. Process implementation effectiveness
Copyright © 2012 Experimentus Ltd12
Completing the e-Survey
Statement scores against the model
– Review each statement, then select a score between 0 and 10 based on how much you agree that the statement is true for your organisation
– If you don’t have an opinion, please leave the score blank
Copyright © 2012 Experimentus Ltd13
Completing the e-Survey
Process implementation effectiveness
– For each process area, select a star ranking for:
How well you feel the organisation has approached the definition of the process area
How well you feel the organisation has deployed changes in the process area
How good you think the results of deployed process changes for the process area are
Copyright © 2012 Experimentus Ltd14
Completing the e-Survey
Testing Trends and non-TMMi section
– Obtains a personal view of testing progress in your organisation over the last 2 years
– Contains statements on areas outside of TMMi that may still impact your organisations test process effectiveness
Copyright © 2012 Experimentus Ltd15
Completing the e-Survey
Your views are important: please answer honestly
No preparation is required
Do not use reference material to help you answer questions
Your first answer is most often the right answer
Please make time to complete the survey!
Copyright © 2012 Experimentus Ltd16
“Save and continue survey later”
Use this if you can’t complete the e-Survey in one session
Allows you to save what you have entered and return later
Only saves data entered on submitted pages
Copyright © 2012 Experimentus Ltd17
Things to note
Responses are completely confidential
Assessment Team only will see individual data
Important: this should be a personal perspective:
– Please do not collaborate with colleagues or management
– Responses should be based on experience, not research
– Do not spend too much time trying find the “right” response
– Your first answer is generally the best answer
Copyright © 2012 Experimentus Ltd
Next steps
18
Copyright © 2012 Experimentus Ltd
Wrap-up and Next steps
The survey must be completed within the requested time frame
Results will be consolidated, analysed and summarised
The final findings analysis is presented back to the sponsor
19
Copyright © 2012 Experimentus Ltd20
Questions & Concerns
For queries, please contact the Assessment Team Lead
Alternatively, contact your TMMi assessment contact
Details for both are provided in the invitation email
Copyright © 2012 Experimentus Ltd21
Thank you
www.experimentus.com
+44 (0) 207 871 2300
[email protected] : @experimentus
Top Related