New Model for Testing @paul_gerrard Paul Gerrard [email protected] gerrardconsulting.com...
-
Upload
judith-dryden -
Category
Documents
-
view
214 -
download
0
Transcript of New Model for Testing @paul_gerrard Paul Gerrard [email protected] gerrardconsulting.com...
New Model for Testing
@paul_g
erra
rd
Paul [email protected]
gerrardconsulting.com
Programme Chair 2014
Agenda
• A New Model for Testing
• What does the Model imply with regards to skills?
• Where next?
Overview
• In this session, Paul will present a refined list of both technical and impersonal skills and map these to the capabilities that testers in the new world must have
• The goal of the session is to discuss and refine this list of skills and mappings to capabilities to create perhaps a new 'Tester Skills Manifesto'.
The old ways won't work in the future
We need a New Model of Testing (free from logistics)
Forget Logistics(for the time being)
Document or not?Automated or manual?
Agile v waterfall?Planned v exploratory?This technology v that
technology?
ALL Testing is Exploratory
We explore sources of knowledge ...
... to build test models ...... that inform our testing.
All Testing is Based on Models
Examples of models
Models are innate, essential, human
Judgement, exploring and testing
Testing(the system)
Our model(s) are adequate
Our model(s) are not adequate
Exploring (sources) Judgement
Creates testmodels
Uses testmodels
We explore sources of knowledge to build test models that inform our testing
BTW – Do Developers explore the same way? I think so.
Exploration process
ExplorationDefinitions specs/stories
People(& you)
Sources
Require-ments
TestModels
Enquiring
Challenging
Sources:People, documents,experience, system under test
Modelling
Test Models:Can be documented
or mental models
Predicting
System under test
Testing process
TestingSystem
Under Test
Refining
Informing Applying
Interpreting
TestModels
Revise the System
Logging Revi
sing
More exploring Reporting
New Model Testing
Paper: http://dev.sp.qa/download/newModel
Consequences of the model
• ALL technologies, methods and logistics• Aligns with/supports (tentatively):
– Waterfall, Agile, Continuous Delivry, TDD/BDD etc.
– The Context-Driven View– Functional, (Possibly all) Non-Functional types
• A different perspective on:– "Testing v Checking"– Developer Testing, Embedded Testers, Shift Left– Test automation– Skills, capabilities and Certification
Capabilities
Enquiring, Modelling, Predicting, Challenging
Informing, Applying, Interpreting, Refining
Reporting and Logging
Some Possible 'Structures' for Capabilities and
Skills
New Model and Skills
• The 'New Model suggests that the core skills of testers are somewhat different– Somewhat different to those promoted
by 'thought leaders'– Very different to those promoted by the
certification schemes
• Of course interpersonal skills are, perhaps, the most critical.
• Analysis, enquiry and elicitation• Modelling• Creation of custom models, using
heuristics, guesses, brainstorming, ideation, creative thinking
• Custom test design techniques• Comparison of models, value,
advantages, disadvantages, compromises
• Identification, validation and use of oracles
• Predicate logic and proof• Hypothesis and inference• Socratic method• Rapid Review and Inspection
techniques• Test case design• Test models and the meaning of
coverage• Testing as controlled experiment• Observation, Note taking,
recording
A very different skillset• Basic data analysis and statistics• Decision-making with
incomplete data• Computer forensics• Fault tree analysis• Failure diagnosis• Bug advocacy, triage processes
and negotiation• Meaningful software and test
metrics• Visual presentation of data• Reporting and presentation skills• Understanding stakeholders• Test analytics• Risk management, risk-based
testing and decision-making• Critical Thinking• Interpersonal skills• Dealing with
uncertainty/fallibility
Testing Career Development(speculative)
Foundations
Technical
Management
Strategic
Test Strategy Project Intelligence
Test Assurance
Exploration Forensics Interpretation
Scripting/Programming
Test Automation Technical (Excel, SQL, OS utils etc)
Stakeholder management
Analytics & visualisation
Managing uncertainty
Critical Thinking
ISTQB etc...
Supplier Management
Test Process Management
Methodology
People Skills for Better BusinessSusan Windsor's interpersonal skills perspective ([email protected])
Foundations
Specialist
Management
Strategic
Critical Thinking
Supplier Selection and Management
Stakeholder Identification
Creating Shared Goals
Collaborative Team Working
Managing Cultural Differences
Managing Challenging Conversations
Enhance Your Communication Style
Managing Self Assessment
Define Team Qualities and Competencies
Implementing Assurance
Karen Johnson (US)EuroSTAR Tutorial
Thinking Skills - Bridging Skills from Theory to Practical Use, © 2014, Karen Johnson
What could we do now?
• Abandon. Nooooo! • Create a "Skills Framework", "Tester
Development Scheme", whatever...• Use TMF as a vehicle to develop and promote
a Skills Framework and "open source" it– Put pressure on Certification Schemes– (Training providers) Build courses to align
• Create a competitive Certification Scheme???
• Other ideas?