IndigoCube - a peek at the future of software testing by Polteq, Ruud Teunissen
Lee Copeland - Polteq, passie voor testen€¦ · Trends and Innovations • Process −...
Transcript of Lee Copeland - Polteq, passie voor testen€¦ · Trends and Innovations • Process −...
![Page 2: Lee Copeland - Polteq, passie voor testen€¦ · Trends and Innovations • Process − Context-driven School − Checking vs. Testing − Crowdsourced Testing − The Weekend Testers](https://reader033.fdocuments.in/reader033/viewer/2022060221/5f0769747e708231d41cdacd/html5/thumbnails/2.jpg)
What Is An Innovation?
• in·no·va·tion (ĭn'ə-vā'shən)
1. Something new or different
2. Something newly introduced or adopted
3. A creation (a new device or process) resulting from study and experimentation
2
![Page 3: Lee Copeland - Polteq, passie voor testen€¦ · Trends and Innovations • Process − Context-driven School − Checking vs. Testing − Crowdsourced Testing − The Weekend Testers](https://reader033.fdocuments.in/reader033/viewer/2022060221/5f0769747e708231d41cdacd/html5/thumbnails/3.jpg)
Are All Innovations?
• For some of you – Yes
• For others -- No
3
![Page 4: Lee Copeland - Polteq, passie voor testen€¦ · Trends and Innovations • Process − Context-driven School − Checking vs. Testing − Crowdsourced Testing − The Weekend Testers](https://reader033.fdocuments.in/reader033/viewer/2022060221/5f0769747e708231d41cdacd/html5/thumbnails/4.jpg)
Trends and Innovations
• Process
• From Agile
• Education
• Technology and Tools
• Process Improvement
4
![Page 5: Lee Copeland - Polteq, passie voor testen€¦ · Trends and Innovations • Process − Context-driven School − Checking vs. Testing − Crowdsourced Testing − The Weekend Testers](https://reader033.fdocuments.in/reader033/viewer/2022060221/5f0769747e708231d41cdacd/html5/thumbnails/5.jpg)
Trends and Innovations
• Process
− Context-driven School
− Checking vs. Testing
− Crowdsourced Testing
− The Weekend Testers
− Exploratory Testing
5
![Page 6: Lee Copeland - Polteq, passie voor testen€¦ · Trends and Innovations • Process − Context-driven School − Checking vs. Testing − Crowdsourced Testing − The Weekend Testers](https://reader033.fdocuments.in/reader033/viewer/2022060221/5f0769747e708231d41cdacd/html5/thumbnails/6.jpg)
Context-Driven School
• Testing groups exist to provide testing-related services. They do not run the development project; they serve
• It is entirely proper for different test groups to have different missions. A core practice in the service of one mission might be irrelevant or counter-productive in the service of another
• There are NO BEST PRACTICES – there are, however, good practices in specific contexts
6
![Page 7: Lee Copeland - Polteq, passie voor testen€¦ · Trends and Innovations • Process − Context-driven School − Checking vs. Testing − Crowdsourced Testing − The Weekend Testers](https://reader033.fdocuments.in/reader033/viewer/2022060221/5f0769747e708231d41cdacd/html5/thumbnails/7.jpg)
Trends and Innovations
• Process
− Context-driven School
− Checking vs. Testing
− Crowdsourced Testing
− The Weekend Testers
− Exploratory Testing
7
![Page 8: Lee Copeland - Polteq, passie voor testen€¦ · Trends and Innovations • Process − Context-driven School − Checking vs. Testing − Crowdsourced Testing − The Weekend Testers](https://reader033.fdocuments.in/reader033/viewer/2022060221/5f0769747e708231d41cdacd/html5/thumbnails/8.jpg)
Checking vs. Testing
• Checking is something that we do with the motivation of confirming existing beliefs
• Checking is a process of confirmation, verification, and validation. When we already believe something to be true, we verify our belief by checking
• Checking is a highly automatable process
8
Michael Bolton
http://www.developsense.com/blog/2009/08/testing-vs-checking/
![Page 9: Lee Copeland - Polteq, passie voor testen€¦ · Trends and Innovations • Process − Context-driven School − Checking vs. Testing − Crowdsourced Testing − The Weekend Testers](https://reader033.fdocuments.in/reader033/viewer/2022060221/5f0769747e708231d41cdacd/html5/thumbnails/9.jpg)
Checking vs. Testing
• Testing is something that we do with the motivation of finding new information
• Testing is a process of exploration, discovery, investigation, and learning. When we configure, operate, and observe a product with the intention of evaluating it, or with the intention of recognizing a problem that we hadn’t anticipated, we’re testing
• Testing is not automatable. It’s using our brain in real time, and it’s really fun
9
![Page 10: Lee Copeland - Polteq, passie voor testen€¦ · Trends and Innovations • Process − Context-driven School − Checking vs. Testing − Crowdsourced Testing − The Weekend Testers](https://reader033.fdocuments.in/reader033/viewer/2022060221/5f0769747e708231d41cdacd/html5/thumbnails/10.jpg)
Trends and Innovations
• Process
− Context-driven School
− Checking vs. Testing
− Crowdsourced Testing
− The Weekend Testers
− Exploratory Testing
10
![Page 11: Lee Copeland - Polteq, passie voor testen€¦ · Trends and Innovations • Process − Context-driven School − Checking vs. Testing − Crowdsourced Testing − The Weekend Testers](https://reader033.fdocuments.in/reader033/viewer/2022060221/5f0769747e708231d41cdacd/html5/thumbnails/11.jpg)
Crowdsourced Testing
• If virtualization makes sense for hardware, why not for test teams?
• Crowd testing is using a virtual test team rather than, or in addition to, an organization’s dedicated team
• Your organization defines a set of test requirements (types of testing, scenarios, environments, platforms, etc.)
11
![Page 12: Lee Copeland - Polteq, passie voor testen€¦ · Trends and Innovations • Process − Context-driven School − Checking vs. Testing − Crowdsourced Testing − The Weekend Testers](https://reader033.fdocuments.in/reader033/viewer/2022060221/5f0769747e708231d41cdacd/html5/thumbnails/12.jpg)
Crowdsourced Testing
• A crowd test vendor (utest.com, mob4hire.com, …) identifies a pool of qualified testers, creates a test project, assigns the work to testers, monitors the progress, and reports defects
• The crowd test vendor compensates testers and evaluates their performance
• Testers receive “Pay Per Bug” and also “Pay Per Valuable Feedback”
12
![Page 13: Lee Copeland - Polteq, passie voor testen€¦ · Trends and Innovations • Process − Context-driven School − Checking vs. Testing − Crowdsourced Testing − The Weekend Testers](https://reader033.fdocuments.in/reader033/viewer/2022060221/5f0769747e708231d41cdacd/html5/thumbnails/13.jpg)
Trends and Innovations
• Process
− Context-driven School
− Checking vs. Testing
− Crowdsourced Testing
− The Weekend Testers
− Exploratory Testing
13
![Page 14: Lee Copeland - Polteq, passie voor testen€¦ · Trends and Innovations • Process − Context-driven School − Checking vs. Testing − Crowdsourced Testing − The Weekend Testers](https://reader033.fdocuments.in/reader033/viewer/2022060221/5f0769747e708231d41cdacd/html5/thumbnails/14.jpg)
The Weekend Testers
• The Weekend Testers began with a group of people in India who wanted to learn to test better
• A typical weekend session consists of registration, facilitation, a testing session, and a follow-up discussion
• It’s all done through a Gmail chat group. The facilitator provides product download details, test mission, and one hour time limit
14
![Page 15: Lee Copeland - Polteq, passie voor testen€¦ · Trends and Innovations • Process − Context-driven School − Checking vs. Testing − Crowdsourced Testing − The Weekend Testers](https://reader033.fdocuments.in/reader033/viewer/2022060221/5f0769747e708231d41cdacd/html5/thumbnails/15.jpg)
The Weekend Testers
• At the end of the time limit, testers participate in a group discussion for the next hour
• They share experiences, challenges, defects found, traps they got caught in, and other ideas
• Testers not only hone their skills, but share and learn new test ideas, strategies, and tools
• Want to join, or form your own group?
www.weekendtesting.com
15
![Page 16: Lee Copeland - Polteq, passie voor testen€¦ · Trends and Innovations • Process − Context-driven School − Checking vs. Testing − Crowdsourced Testing − The Weekend Testers](https://reader033.fdocuments.in/reader033/viewer/2022060221/5f0769747e708231d41cdacd/html5/thumbnails/16.jpg)
Trends and Innovations
• Process
− Context-driven School
− Checking vs. Testing
− Crowdsourced Testing
− The Weekend Testers
− Exploratory Testing
16
![Page 17: Lee Copeland - Polteq, passie voor testen€¦ · Trends and Innovations • Process − Context-driven School − Checking vs. Testing − Crowdsourced Testing − The Weekend Testers](https://reader033.fdocuments.in/reader033/viewer/2022060221/5f0769747e708231d41cdacd/html5/thumbnails/17.jpg)
Exploratory Testing
17
Learning
Test Design Test Execution
simultaneous
![Page 18: Lee Copeland - Polteq, passie voor testen€¦ · Trends and Innovations • Process − Context-driven School − Checking vs. Testing − Crowdsourced Testing − The Weekend Testers](https://reader033.fdocuments.in/reader033/viewer/2022060221/5f0769747e708231d41cdacd/html5/thumbnails/18.jpg)
Exploratory Testing
18
“The classical approach to test design is like playing ‘20 Questions’ by writing out all the questions in advance.”
- James Bach
![Page 19: Lee Copeland - Polteq, passie voor testen€¦ · Trends and Innovations • Process − Context-driven School − Checking vs. Testing − Crowdsourced Testing − The Weekend Testers](https://reader033.fdocuments.in/reader033/viewer/2022060221/5f0769747e708231d41cdacd/html5/thumbnails/19.jpg)
Exploratory Testing
19
“Exploratory Testing, as I practice it, usually proceeds according to a conscious plan. But not a rigorous plan … it is not scripted in detail.”
“To the extent that the next test we do is influenced by the result of the last test we did, we are doing exploratory testing. We become more exploratory when we can’t tell what tests should be run in advance of the test cycle.”
- James Bach
![Page 20: Lee Copeland - Polteq, passie voor testen€¦ · Trends and Innovations • Process − Context-driven School − Checking vs. Testing − Crowdsourced Testing − The Weekend Testers](https://reader033.fdocuments.in/reader033/viewer/2022060221/5f0769747e708231d41cdacd/html5/thumbnails/20.jpg)
Exploratory Testing
• Exploratory testing can be concurrent with product development and test execution
• Based on implicit as well as explicit (if they exist) specifications as well as the “as built” product
• Starts with a conjecture as to correct behavior, followed by exploration for evidence that it works/does not work
20
![Page 21: Lee Copeland - Polteq, passie voor testen€¦ · Trends and Innovations • Process − Context-driven School − Checking vs. Testing − Crowdsourced Testing − The Weekend Testers](https://reader033.fdocuments.in/reader033/viewer/2022060221/5f0769747e708231d41cdacd/html5/thumbnails/21.jpg)
Trends and Innovations
• From Agile
− Test-First Development
− Acceptance Test-driven Development
(ATDD)
21
![Page 22: Lee Copeland - Polteq, passie voor testen€¦ · Trends and Innovations • Process − Context-driven School − Checking vs. Testing − Crowdsourced Testing − The Weekend Testers](https://reader033.fdocuments.in/reader033/viewer/2022060221/5f0769747e708231d41cdacd/html5/thumbnails/22.jpg)
Test-First Development
Then,
TDD = TFD + Refactoring
Developers “refuse to add even a single line of code
until a test exists for it.”
- Scott Ambler
22
![Page 23: Lee Copeland - Polteq, passie voor testen€¦ · Trends and Innovations • Process − Context-driven School − Checking vs. Testing − Crowdsourced Testing − The Weekend Testers](https://reader033.fdocuments.in/reader033/viewer/2022060221/5f0769747e708231d41cdacd/html5/thumbnails/23.jpg)
Test-First Development
• Goals
− Accurate specifications
− Useful specifications
− Focus the mind
− Write clean code
− Prevent the creation of an “inventory” of things that don’t work
23
![Page 24: Lee Copeland - Polteq, passie voor testen€¦ · Trends and Innovations • Process − Context-driven School − Checking vs. Testing − Crowdsourced Testing − The Weekend Testers](https://reader033.fdocuments.in/reader033/viewer/2022060221/5f0769747e708231d41cdacd/html5/thumbnails/24.jpg)
Trends and Innovations
• From Agile
− Test-first Development
− Acceptance Test-driven Development
(ATDD)
24
![Page 25: Lee Copeland - Polteq, passie voor testen€¦ · Trends and Innovations • Process − Context-driven School − Checking vs. Testing − Crowdsourced Testing − The Weekend Testers](https://reader033.fdocuments.in/reader033/viewer/2022060221/5f0769747e708231d41cdacd/html5/thumbnails/25.jpg)
ATDD
25
• Acceptance Test Driven Development (ATDD) is the equivalent of TDD but at the functional level rather than the unit level
• Acceptance tests are often written by users (with the guidance of professional testers) using frameworks such as FitNesse
![Page 26: Lee Copeland - Polteq, passie voor testen€¦ · Trends and Innovations • Process − Context-driven School − Checking vs. Testing − Crowdsourced Testing − The Weekend Testers](https://reader033.fdocuments.in/reader033/viewer/2022060221/5f0769747e708231d41cdacd/html5/thumbnails/26.jpg)
Trends and Innovations
• Education
− Really Good Books
− (Big) Testing Conferences
− (Small) Testing Workshops
− Freedom of the Press
26
![Page 27: Lee Copeland - Polteq, passie voor testen€¦ · Trends and Innovations • Process − Context-driven School − Checking vs. Testing − Crowdsourced Testing − The Weekend Testers](https://reader033.fdocuments.in/reader033/viewer/2022060221/5f0769747e708231d41cdacd/html5/thumbnails/27.jpg)
Really Good Books
• A Practitioner's Guide to Software
Test Design – Copeland
• Secrets of a Buccaneer Scholar – Bach
• Perfect Software and Other Illusions about Testing – Weinberg
• Systematic Software Testing ─ Craig and Jaskiel
27
![Page 28: Lee Copeland - Polteq, passie voor testen€¦ · Trends and Innovations • Process − Context-driven School − Checking vs. Testing − Crowdsourced Testing − The Weekend Testers](https://reader033.fdocuments.in/reader033/viewer/2022060221/5f0769747e708231d41cdacd/html5/thumbnails/28.jpg)
Really Good Books
• Lessons Learned in Software Testing ─ Kaner, Bach, and Pettichord
• Testing Computer Software ─ Kaner
• How to Break Software ─ Whittaker
• The Craft of Software Testing ─ Marick
• Managing the Testing Process ─ Black
28
![Page 29: Lee Copeland - Polteq, passie voor testen€¦ · Trends and Innovations • Process − Context-driven School − Checking vs. Testing − Crowdsourced Testing − The Weekend Testers](https://reader033.fdocuments.in/reader033/viewer/2022060221/5f0769747e708231d41cdacd/html5/thumbnails/29.jpg)
Trends and Innovations
• Education
− Really Good Books
− (Big) Testing Conferences
− (Small) Testing Workshops
− Freedom of the Press
29
![Page 30: Lee Copeland - Polteq, passie voor testen€¦ · Trends and Innovations • Process − Context-driven School − Checking vs. Testing − Crowdsourced Testing − The Weekend Testers](https://reader033.fdocuments.in/reader033/viewer/2022060221/5f0769747e708231d41cdacd/html5/thumbnails/30.jpg)
(Big) Testing Conferences
• STAREAST and STARWEST
• EUROSTAR
• ANZTB in New Zealand
• STeP-IN in India
• JaSST in Japan
30
![Page 31: Lee Copeland - Polteq, passie voor testen€¦ · Trends and Innovations • Process − Context-driven School − Checking vs. Testing − Crowdsourced Testing − The Weekend Testers](https://reader033.fdocuments.in/reader033/viewer/2022060221/5f0769747e708231d41cdacd/html5/thumbnails/31.jpg)
(Big) Testing Conferences
• Generalized focus and Lecture style
− Attendance solicited throughout the community
− Unlimited participants
− Focus on a large set of topics
− Participation is not generally required
− Presentations are collected, published, and available to all participants
31
![Page 32: Lee Copeland - Polteq, passie voor testen€¦ · Trends and Innovations • Process − Context-driven School − Checking vs. Testing − Crowdsourced Testing − The Weekend Testers](https://reader033.fdocuments.in/reader033/viewer/2022060221/5f0769747e708231d41cdacd/html5/thumbnails/32.jpg)
Trends and Innovations
• Education
− Really Good Books
− (Big) Testing Conferences
− (Small) Testing Workshops
− Freedom of the Press
32
![Page 33: Lee Copeland - Polteq, passie voor testen€¦ · Trends and Innovations • Process − Context-driven School − Checking vs. Testing − Crowdsourced Testing − The Weekend Testers](https://reader033.fdocuments.in/reader033/viewer/2022060221/5f0769747e708231d41cdacd/html5/thumbnails/33.jpg)
(Small) Testing Workshops
• Specialized focus and Participatory style
− Attendance by application and/or invitation
− Limited to 15-20 participants
− Focus on a small set of topics
− Participation is required; challenging presenters is encouraged
− Learnings are collected, published, and available to all participants
33
![Page 34: Lee Copeland - Polteq, passie voor testen€¦ · Trends and Innovations • Process − Context-driven School − Checking vs. Testing − Crowdsourced Testing − The Weekend Testers](https://reader033.fdocuments.in/reader033/viewer/2022060221/5f0769747e708231d41cdacd/html5/thumbnails/34.jpg)
(Small) Testing Workshops
• Examples are:
− Austin Workshop on Test Automation
− London Exploratory Workshop in Testing
− Los Altos Workshop on Software Testing
− Workshop on Heuristic and Exploratory Techniques
− Workshop on Open Certification of software Testers
− Workshop On Performance and Reliability
− Workshop on Teaching Software Testing
34
![Page 35: Lee Copeland - Polteq, passie voor testen€¦ · Trends and Innovations • Process − Context-driven School − Checking vs. Testing − Crowdsourced Testing − The Weekend Testers](https://reader033.fdocuments.in/reader033/viewer/2022060221/5f0769747e708231d41cdacd/html5/thumbnails/35.jpg)
Trends and Innovations
• Education
− Really Good Books
− (Big) Testing Conferences
− (Small) Testing Workshops
− Freedom of the Press
35
![Page 36: Lee Copeland - Polteq, passie voor testen€¦ · Trends and Innovations • Process − Context-driven School − Checking vs. Testing − Crowdsourced Testing − The Weekend Testers](https://reader033.fdocuments.in/reader033/viewer/2022060221/5f0769747e708231d41cdacd/html5/thumbnails/36.jpg)
Freedom of the Press
• “Freedom of the press is limited to those who own one.” ─ A.J. Liebling
(American Journalist)
• Today’s “press” (and lots of people own these)
36
![Page 37: Lee Copeland - Polteq, passie voor testen€¦ · Trends and Innovations • Process − Context-driven School − Checking vs. Testing − Crowdsourced Testing − The Weekend Testers](https://reader033.fdocuments.in/reader033/viewer/2022060221/5f0769747e708231d41cdacd/html5/thumbnails/37.jpg)
Freedom of the Press
• Blogs
– James Bach www.satisfice.com/blog
– Michael Hunter blogs.msdn.com/michael
– Jonathan Kohl www.kohl.ca/blog
– Antony Marcano www.testingreflections.com
– Brian Marick www.exampler.com/blog
– Elisabeth Hendrickson www.testobsessed.com/category/ruminations
– many others …
37
![Page 38: Lee Copeland - Polteq, passie voor testen€¦ · Trends and Innovations • Process − Context-driven School − Checking vs. Testing − Crowdsourced Testing − The Weekend Testers](https://reader033.fdocuments.in/reader033/viewer/2022060221/5f0769747e708231d41cdacd/html5/thumbnails/38.jpg)
Freedom of the Press
• Open Source Training
– Black Box Software Testing (Kaner & Bach)
– http://www.testingeducation.org/BBST/
38
![Page 39: Lee Copeland - Polteq, passie voor testen€¦ · Trends and Innovations • Process − Context-driven School − Checking vs. Testing − Crowdsourced Testing − The Weekend Testers](https://reader033.fdocuments.in/reader033/viewer/2022060221/5f0769747e708231d41cdacd/html5/thumbnails/39.jpg)
Trends and Innovations
• Technology and Tools
− Open-source tools
− Virtualization
− Testing in the Cloud
39
![Page 40: Lee Copeland - Polteq, passie voor testen€¦ · Trends and Innovations • Process − Context-driven School − Checking vs. Testing − Crowdsourced Testing − The Weekend Testers](https://reader033.fdocuments.in/reader033/viewer/2022060221/5f0769747e708231d41cdacd/html5/thumbnails/40.jpg)
Open Source Tools
Development
Eclipse
Unit Testing
xUnit Cobertura
NCover
System Testing
FIT FitNesse
Watir Selenium
Performance Testing
OpenSTA JMeter
40
![Page 41: Lee Copeland - Polteq, passie voor testen€¦ · Trends and Innovations • Process − Context-driven School − Checking vs. Testing − Crowdsourced Testing − The Weekend Testers](https://reader033.fdocuments.in/reader033/viewer/2022060221/5f0769747e708231d41cdacd/html5/thumbnails/41.jpg)
Trends and Innovations
• Technology and Tools
− Open-source tools
− Virtualization
− Testing in the Cloud
41
![Page 42: Lee Copeland - Polteq, passie voor testen€¦ · Trends and Innovations • Process − Context-driven School − Checking vs. Testing − Crowdsourced Testing − The Weekend Testers](https://reader033.fdocuments.in/reader033/viewer/2022060221/5f0769747e708231d41cdacd/html5/thumbnails/42.jpg)
Virtualization
• Definition
• Vendors include Microsoft, Surgient, VMLogix, and VMWare
42
![Page 43: Lee Copeland - Polteq, passie voor testen€¦ · Trends and Innovations • Process − Context-driven School − Checking vs. Testing − Crowdsourced Testing − The Weekend Testers](https://reader033.fdocuments.in/reader033/viewer/2022060221/5f0769747e708231d41cdacd/html5/thumbnails/43.jpg)
Virtualization
• Benefits
− Rapid provisioning (30%-50% of testing is environmental setup time)
− System state capture (capture/replay in its finest form)
− Reduced costs (purchase, maintenance, space, power)
43
![Page 44: Lee Copeland - Polteq, passie voor testen€¦ · Trends and Innovations • Process − Context-driven School − Checking vs. Testing − Crowdsourced Testing − The Weekend Testers](https://reader033.fdocuments.in/reader033/viewer/2022060221/5f0769747e708231d41cdacd/html5/thumbnails/44.jpg)
Trends and Innovations
• Technology and Tools
− Open-source tools
− Virtualization
− Testing in the Cloud
44
![Page 45: Lee Copeland - Polteq, passie voor testen€¦ · Trends and Innovations • Process − Context-driven School − Checking vs. Testing − Crowdsourced Testing − The Weekend Testers](https://reader033.fdocuments.in/reader033/viewer/2022060221/5f0769747e708231d41cdacd/html5/thumbnails/45.jpg)
Testing in the Cloud
• Rent as many servers as you like for as long as you like
– Need a thousand servers for performance load generation?
– Need multiple servers, each with a different configuration to simultaneously test your product?
45
![Page 46: Lee Copeland - Polteq, passie voor testen€¦ · Trends and Innovations • Process − Context-driven School − Checking vs. Testing − Crowdsourced Testing − The Weekend Testers](https://reader033.fdocuments.in/reader033/viewer/2022060221/5f0769747e708231d41cdacd/html5/thumbnails/46.jpg)
Testing in the Cloud
• Usage rates (US$):
– $0.10/hour – small machine
– $1.00/hour – extra large machine
– $2.00/can at the hotel
46
![Page 47: Lee Copeland - Polteq, passie voor testen€¦ · Trends and Innovations • Process − Context-driven School − Checking vs. Testing − Crowdsourced Testing − The Weekend Testers](https://reader033.fdocuments.in/reader033/viewer/2022060221/5f0769747e708231d41cdacd/html5/thumbnails/47.jpg)
Trends and Innovations
• Improvement
− TPI
− TMMI
47
![Page 48: Lee Copeland - Polteq, passie voor testen€¦ · Trends and Innovations • Process − Context-driven School − Checking vs. Testing − Crowdsourced Testing − The Weekend Testers](https://reader033.fdocuments.in/reader033/viewer/2022060221/5f0769747e708231d41cdacd/html5/thumbnails/48.jpg)
TPI
• Created by Tim Koomen and Martin Pol based on their experience at the Dutch software company IQUIP.
• The TPI model was defined in 1997 and a book was published in Dutch that same year.
• The English translation was published in 1998.
48
![Page 49: Lee Copeland - Polteq, passie voor testen€¦ · Trends and Innovations • Process − Context-driven School − Checking vs. Testing − Crowdsourced Testing − The Weekend Testers](https://reader033.fdocuments.in/reader033/viewer/2022060221/5f0769747e708231d41cdacd/html5/thumbnails/49.jpg)
TPI
49
Levels Levels
Key Areas
Checkpoints Improvement Suggestions
Test Maturity Matrix
![Page 50: Lee Copeland - Polteq, passie voor testen€¦ · Trends and Innovations • Process − Context-driven School − Checking vs. Testing − Crowdsourced Testing − The Weekend Testers](https://reader033.fdocuments.in/reader033/viewer/2022060221/5f0769747e708231d41cdacd/html5/thumbnails/50.jpg)
TPI
50
• Twenty key areas cover the testing process:
– Test strategy
– Life-cycle model
– Moment of involvement
– Estimating and planning
– Test specification techniques
– Static test techniques
– Metrics
– Test tools
– Test environment
– Office environment
– Commitment and motivation
– Test functions and training
– Scope of methodology
– Communication
– Reporting
– Defect management
– Testware management
– Test process management
– Evaluation
– Low-level testing
![Page 51: Lee Copeland - Polteq, passie voor testen€¦ · Trends and Innovations • Process − Context-driven School − Checking vs. Testing − Crowdsourced Testing − The Weekend Testers](https://reader033.fdocuments.in/reader033/viewer/2022060221/5f0769747e708231d41cdacd/html5/thumbnails/51.jpg)
TPI
51
KEY AREA 0 1 2 3 4 5 6 7 8 9 10 11 12 13
Test strategy A B C D
Life-cycle model A B
Moment of involvement A B C D
Estimating and planning A B
Test specification techniques A B
Static test techniques A B
Metrics A B C D
Test tools A B C
Test environment A B C
Office environment A
Commitment and motivation A B C
Test functions and training A B C
Scope of methodology A B C
Communication A B C
Reporting A B C D
Defect management A B C
Testware management A B C D
Test process management A B C
Evaluation A B
Low-level testing A B C
Controlled Efficient Optimizing
![Page 52: Lee Copeland - Polteq, passie voor testen€¦ · Trends and Innovations • Process − Context-driven School − Checking vs. Testing − Crowdsourced Testing − The Weekend Testers](https://reader033.fdocuments.in/reader033/viewer/2022060221/5f0769747e708231d41cdacd/html5/thumbnails/52.jpg)
Trends and Innovations
• Improvement
− TPI
− TMMi
52
![Page 53: Lee Copeland - Polteq, passie voor testen€¦ · Trends and Innovations • Process − Context-driven School − Checking vs. Testing − Crowdsourced Testing − The Weekend Testers](https://reader033.fdocuments.in/reader033/viewer/2022060221/5f0769747e708231d41cdacd/html5/thumbnails/53.jpg)
TMMi
• The Test Maturity Model Integration has been developed to complement the existing CMMI framework
• It provides a structured presentation of maturity levels, allowing for standard TMMi assessments and certification, enabling a consistent deployment of the standards and the collection of industry metrics
53
![Page 54: Lee Copeland - Polteq, passie voor testen€¦ · Trends and Innovations • Process − Context-driven School − Checking vs. Testing − Crowdsourced Testing − The Weekend Testers](https://reader033.fdocuments.in/reader033/viewer/2022060221/5f0769747e708231d41cdacd/html5/thumbnails/54.jpg)
TMMi
• “TMMi has a rapidly growing uptake across Europe, Asia and the USA and owes its popularity to being the only independent test process measurement method”
54
www.tmmifoundation.org
![Page 55: Lee Copeland - Polteq, passie voor testen€¦ · Trends and Innovations • Process − Context-driven School − Checking vs. Testing − Crowdsourced Testing − The Weekend Testers](https://reader033.fdocuments.in/reader033/viewer/2022060221/5f0769747e708231d41cdacd/html5/thumbnails/55.jpg)
TMMI
55
Level 2: Managed • Test Policy and Strategy • Test Planning • Test Monitoring and Control • Test Design and Execution • Test Environment
Level 3: Defined • Test Organization • Test Training Program • Test Life Cycle and Integration • Non-functional Testing • Peer Reviews
Level 4: Management & Measurement • Test Measurement • Software Quality Evaluation • Advanced Peer Reviews
Level 1: Initial
Level 5: Optimization • Defect Prevention • Test Process Optimization • Quality Control
![Page 56: Lee Copeland - Polteq, passie voor testen€¦ · Trends and Innovations • Process − Context-driven School − Checking vs. Testing − Crowdsourced Testing − The Weekend Testers](https://reader033.fdocuments.in/reader033/viewer/2022060221/5f0769747e708231d41cdacd/html5/thumbnails/56.jpg)
Trends and Innovations
• Process
• From Agile
• Education
• Technology and Tools
• Process Improvement
56
![Page 57: Lee Copeland - Polteq, passie voor testen€¦ · Trends and Innovations • Process − Context-driven School − Checking vs. Testing − Crowdsourced Testing − The Weekend Testers](https://reader033.fdocuments.in/reader033/viewer/2022060221/5f0769747e708231d41cdacd/html5/thumbnails/57.jpg)
Future Innovations?
?
57
![Page 58: Lee Copeland - Polteq, passie voor testen€¦ · Trends and Innovations • Process − Context-driven School − Checking vs. Testing − Crowdsourced Testing − The Weekend Testers](https://reader033.fdocuments.in/reader033/viewer/2022060221/5f0769747e708231d41cdacd/html5/thumbnails/58.jpg)
Future Innovations?
• My personal event horizon is very short
circa 1969
58
![Page 59: Lee Copeland - Polteq, passie voor testen€¦ · Trends and Innovations • Process − Context-driven School − Checking vs. Testing − Crowdsourced Testing − The Weekend Testers](https://reader033.fdocuments.in/reader033/viewer/2022060221/5f0769747e708231d41cdacd/html5/thumbnails/59.jpg)
Future Innovations?
“The best way to predict the future is to invent it.”
– Alan Kay
59
![Page 60: Lee Copeland - Polteq, passie voor testen€¦ · Trends and Innovations • Process − Context-driven School − Checking vs. Testing − Crowdsourced Testing − The Weekend Testers](https://reader033.fdocuments.in/reader033/viewer/2022060221/5f0769747e708231d41cdacd/html5/thumbnails/60.jpg)
Thank You
• Thanks for joining with me today. I greatly appreciate the invitation to speak
• If I can be of assistance, or if you’d just like to chat, please contact me at
• And remember, … keep on innovating
My thanks to: James Bach, Jon Bach, Rex Black, Bob Galen, Andy Glover, Dorothy Graham, Cem Kaner, Harry Robinson, Rob Sabourin, and James Whittaker
60
![Page 61: Lee Copeland - Polteq, passie voor testen€¦ · Trends and Innovations • Process − Context-driven School − Checking vs. Testing − Crowdsourced Testing − The Weekend Testers](https://reader033.fdocuments.in/reader033/viewer/2022060221/5f0769747e708231d41cdacd/html5/thumbnails/61.jpg)
61