Result Driven Testing - BCS · Result Driven Testing Changing the test policy at Rabobank...
Transcript of Result Driven Testing - BCS · Result Driven Testing Changing the test policy at Rabobank...
![Page 1: Result Driven Testing - BCS · Result Driven Testing Changing the test policy at Rabobank International . Rabobank Organisation . Rabobank International . Information Systems &Development](https://reader031.fdocuments.in/reader031/viewer/2022022508/5ad0253a7f8b9ad24f8d55d7/html5/thumbnails/1.jpg)
Result Driven Testing Changing the test policy at Rabobank International
![Page 2: Result Driven Testing - BCS · Result Driven Testing Changing the test policy at Rabobank International . Rabobank Organisation . Rabobank International . Information Systems &Development](https://reader031.fdocuments.in/reader031/viewer/2022022508/5ad0253a7f8b9ad24f8d55d7/html5/thumbnails/2.jpg)
Rabobank Organisation
![Page 3: Result Driven Testing - BCS · Result Driven Testing Changing the test policy at Rabobank International . Rabobank Organisation . Rabobank International . Information Systems &Development](https://reader031.fdocuments.in/reader031/viewer/2022022508/5ad0253a7f8b9ad24f8d55d7/html5/thumbnails/3.jpg)
Rabobank International
![Page 4: Result Driven Testing - BCS · Result Driven Testing Changing the test policy at Rabobank International . Rabobank Organisation . Rabobank International . Information Systems &Development](https://reader031.fdocuments.in/reader031/viewer/2022022508/5ad0253a7f8b9ad24f8d55d7/html5/thumbnails/4.jpg)
Information Systems &Development IS&D Global
Services & IT Risk Management
Strategy & Architecture
Business Management
GFM IT 7 Testers
GFM Operations IT 17 Testers
Corporate Banking IT 22 Testers
Risk IT 26 Testers
Finance IT 11 Testers
![Page 5: Result Driven Testing - BCS · Result Driven Testing Changing the test policy at Rabobank International . Rabobank Organisation . Rabobank International . Information Systems &Development](https://reader031.fdocuments.in/reader031/viewer/2022022508/5ad0253a7f8b9ad24f8d55d7/html5/thumbnails/5.jpg)
Previous testing policy
TMap, TPI en TAKT was the basis of the previous strategy
With a minor influence by ISTQB standards
![Page 6: Result Driven Testing - BCS · Result Driven Testing Changing the test policy at Rabobank International . Rabobank Organisation . Rabobank International . Information Systems &Development](https://reader031.fdocuments.in/reader031/viewer/2022022508/5ad0253a7f8b9ad24f8d55d7/html5/thumbnails/6.jpg)
Process oriented
• Lots of process oriented information
• Definitions
• Role descriptions
• Document descriptions
• What to do and what not to do
(and sometimes in which order…)
![Page 7: Result Driven Testing - BCS · Result Driven Testing Changing the test policy at Rabobank International . Rabobank Organisation . Rabobank International . Information Systems &Development](https://reader031.fdocuments.in/reader031/viewer/2022022508/5ad0253a7f8b9ad24f8d55d7/html5/thumbnails/7.jpg)
Diversity
• Uniformity was created while respecting business line differences
• As a consequence testing was done in many diverse variations
• Little exchange of practical ideas
![Page 8: Result Driven Testing - BCS · Result Driven Testing Changing the test policy at Rabobank International . Rabobank Organisation . Rabobank International . Information Systems &Development](https://reader031.fdocuments.in/reader031/viewer/2022022508/5ad0253a7f8b9ad24f8d55d7/html5/thumbnails/8.jpg)
So did it work?
• The policy contained a lot of information but was difficult to follow in practice
• As a response templates were developed. These were used most of the time (…as use was mandatory)
Usage did however not mean that theire content was adhered to or understood
• Testers felt the policy did not connect to everyday reality
• But testing they did…
![Page 9: Result Driven Testing - BCS · Result Driven Testing Changing the test policy at Rabobank International . Rabobank Organisation . Rabobank International . Information Systems &Development](https://reader031.fdocuments.in/reader031/viewer/2022022508/5ad0253a7f8b9ad24f8d55d7/html5/thumbnails/9.jpg)
Change
![Page 10: Result Driven Testing - BCS · Result Driven Testing Changing the test policy at Rabobank International . Rabobank Organisation . Rabobank International . Information Systems &Development](https://reader031.fdocuments.in/reader031/viewer/2022022508/5ad0253a7f8b9ad24f8d55d7/html5/thumbnails/10.jpg)
Agile OpenUP
![Page 11: Result Driven Testing - BCS · Result Driven Testing Changing the test policy at Rabobank International . Rabobank Organisation . Rabobank International . Information Systems &Development](https://reader031.fdocuments.in/reader031/viewer/2022022508/5ad0253a7f8b9ad24f8d55d7/html5/thumbnails/11.jpg)
Ok and then? Practices:
• Risk Value Lifecycle • Continuous re-evaluate what you do?
• Iterative development • Whole team • Agile dashboard • Requirements from a user perspective
• Prioritize requirements before implementation • Create a shared understanding of the domain • Test Driven Development • Evolutionary Architecture • Concurrent Testing • Continous Integration
• Embrace and manage change • Measure progress objectively
![Page 12: Result Driven Testing - BCS · Result Driven Testing Changing the test policy at Rabobank International . Rabobank Organisation . Rabobank International . Information Systems &Development](https://reader031.fdocuments.in/reader031/viewer/2022022508/5ad0253a7f8b9ad24f8d55d7/html5/thumbnails/12.jpg)
Training
![Page 13: Result Driven Testing - BCS · Result Driven Testing Changing the test policy at Rabobank International . Rabobank Organisation . Rabobank International . Information Systems &Development](https://reader031.fdocuments.in/reader031/viewer/2022022508/5ad0253a7f8b9ad24f8d55d7/html5/thumbnails/13.jpg)
Workgroups The new practices were (partly) implemented by forming a number of workgroups
![Page 14: Result Driven Testing - BCS · Result Driven Testing Changing the test policy at Rabobank International . Rabobank Organisation . Rabobank International . Information Systems &Development](https://reader031.fdocuments.in/reader031/viewer/2022022508/5ad0253a7f8b9ad24f8d55d7/html5/thumbnails/14.jpg)
Testing Dojo
What is a testing dojo? A testing dojo is a gathering of software testings with the intend to work or learn from a challenge
Purpose of testing dojo
• Focus on a specific subject or problem
• To evaluate tooling
• Learn, learn, learn
Testing dojo themes
• Session based test management
• Exploratory Testing
![Page 15: Result Driven Testing - BCS · Result Driven Testing Changing the test policy at Rabobank International . Rabobank Organisation . Rabobank International . Information Systems &Development](https://reader031.fdocuments.in/reader031/viewer/2022022508/5ad0253a7f8b9ad24f8d55d7/html5/thumbnails/15.jpg)
The rules
The environment surounding testing however stays more or less the same. It still is a bank with ever increasing regulation.
![Page 16: Result Driven Testing - BCS · Result Driven Testing Changing the test policy at Rabobank International . Rabobank Organisation . Rabobank International . Information Systems &Development](https://reader031.fdocuments.in/reader031/viewer/2022022508/5ad0253a7f8b9ad24f8d55d7/html5/thumbnails/16.jpg)
A new test policy
Basics Testing is performed concurrently with all roles
and by all members of a ‘cross-functional’ team
Testing is based on risk analysis prioritization
Test results are traceable to
requirements and change requests
Testers are involved in all software development and configuration activities
Testing is to be automated as much as possible
but only if it is efficient and/or enhances the quality of testing
![Page 17: Result Driven Testing - BCS · Result Driven Testing Changing the test policy at Rabobank International . Rabobank Organisation . Rabobank International . Information Systems &Development](https://reader031.fdocuments.in/reader031/viewer/2022022508/5ad0253a7f8b9ad24f8d55d7/html5/thumbnails/17.jpg)
A new policy
Strategy and planning • Strategy
• Product Risk Analysis
• Test Product Breakdown
• Acceptance Criteria
• Mitigation
• Planning
• Generic Test Agreement – Test Plan
• Master Test Plan – Test Plan
![Page 18: Result Driven Testing - BCS · Result Driven Testing Changing the test policy at Rabobank International . Rabobank Organisation . Rabobank International . Information Systems &Development](https://reader031.fdocuments.in/reader031/viewer/2022022508/5ad0253a7f8b9ad24f8d55d7/html5/thumbnails/18.jpg)
A new policy
Testing • Purpose
• To deliver information
• Focussed on the discovery of differences between the demands, expectations and the actual behavior of the product or its results
• Design • Based on, but not limited to, the test strategy
• Scripts, scenarios or charters related to a test object
• Results • Test results have to be informative to the stakeholders
• Test results have to be traceable and reproducable
![Page 19: Result Driven Testing - BCS · Result Driven Testing Changing the test policy at Rabobank International . Rabobank Organisation . Rabobank International . Information Systems &Development](https://reader031.fdocuments.in/reader031/viewer/2022022508/5ad0253a7f8b9ad24f8d55d7/html5/thumbnails/19.jpg)
A new policy
Reporting • Throughout the whole project
• Not only at the end
• Contains information about the product • What does it do / what doesn’t it do
• Information is stakeholder specific
• Contains information about testing • Deviations of the test strategy / problems / successes
• Influences on testing results
• Information about the ‘quality’ of the product • In relation to the (stakeholder specific) acceptance criteria
![Page 20: Result Driven Testing - BCS · Result Driven Testing Changing the test policy at Rabobank International . Rabobank Organisation . Rabobank International . Information Systems &Development](https://reader031.fdocuments.in/reader031/viewer/2022022508/5ad0253a7f8b9ad24f8d55d7/html5/thumbnails/20.jpg)
The future…
![Page 21: Result Driven Testing - BCS · Result Driven Testing Changing the test policy at Rabobank International . Rabobank Organisation . Rabobank International . Information Systems &Development](https://reader031.fdocuments.in/reader031/viewer/2022022508/5ad0253a7f8b9ad24f8d55d7/html5/thumbnails/21.jpg)
Many of the new ideas in the test policy were based on:
Context-Driven Testing principles
• The value of any practice depends on
its context. • There are good practices in context,
but there are no best practices. • People, working together, are the most
important part of any project’s context. • Projects unfold over time in ways that
are often not predictable. • The product is a solution. If the
problem isn’t solved, the product doesn’t work.
• Good software testing is a challenging intellectual process.
• Only through judgment and skill, exercised cooperatively throughout the entire project, are we able to do the right things at the right times to effectively test our products.
Agile Principles
• …to satisfy the customer through early and continuous delivery of valuable software.
• Welcome changing requirements, even late in development. Agile processes harness change …
• Deliver working software frequently, …. • Business people and developers must work
together daily throughout the project. • Build projects around motivated individuals…. • …face-to-face conversation. • Working software is the primary measure… • Agile processes promote sustainable
development…. • Continuous attention to technical excellence
and good design enhances agility. • Simplicity is essential. • The best architectures, requirements, and
designs emerge from self-organizing teams.
• At regular intervals, the team reflects …..
![Page 23: Result Driven Testing - BCS · Result Driven Testing Changing the test policy at Rabobank International . Rabobank Organisation . Rabobank International . Information Systems &Development](https://reader031.fdocuments.in/reader031/viewer/2022022508/5ad0253a7f8b9ad24f8d55d7/html5/thumbnails/23.jpg)
Sources
• http://www.rabobankgroep.nl
• http://www.tmap.net
• http://context-driven-testing.com/
• http://agilemanifesto.org/principles.html
• Agility and Discipline Made Easy; Practices from OpenUP and RUP by Per Kroll en Bruce MacIsaac (ISBN 0-321-32130-8)