Performance Testing in Agile and DevOps Environments
11
W7 Session 10/26/2016 11:30:00 AM Performance Testing in Agile and DevOps Environments Presented by: Syed Hossain QA Consultants Brought to you by: 350 Corporate Way, Suite 400, Orange Park, FL 32073 888---268---8770 ·· 904---278---0524 - [email protected] - http://www.starcanada.techwell.com/
Transcript of Performance Testing in Agile and DevOps Environments
W7 Session 10/26/2016 11:30:00 AM
Performance Testing in Agile and DevOps Environments
Presented by:
Syed Hossain
QA Consultants
Brought to you by:
350 Corporate Way, Suite 400, Orange Park, FL 32073 888---268---8770 ·· 904---278---0524 - [email protected] - http://www.starcanada.techwell.com/
Syed Hossain QA Consultants Syed Hossain is a proven test management consultant with more than twelve years of experience in top-tier retail, financial, and workforce industries. At QA Consultance he provides consulting services in designing and implementing performance testing solutions. Syed has successfully developed, managed, and executed QA programs and projects that helped clients deliver optimized solutions to meet business needs. He is skilled in designing tests that reduce business risk. Syed engages effectively with senior management, business, technology, and vendors to plan, negotiate, and execute plans. He is experienced in building and implementing testing practices, standards, and methodology.
10/17/2016
1
AGILE PERFORMANCE TESTING
AGENDA
• Why Performance Testing in AGILE is a ‘brave new world’
• The role you will play
• When to conduct performance testing
• How to optimize performance testing
10/17/2016
2
ABOUT QA CONSULTANTS
QA Consultants helps companies maintain strong QA Consultants helps companies maintain strong
reputations for building software products and systems.
QA Consultants accomplish this by conducting
comprehensive software testing. p g
WHY PERFORMANCE TESTING IN AGILE IS A ‘BRAVE NEW WORLD’
10/17/2016
3
WHAT IS DONE?
SCRUM FRAMEWORK & PERFORMANCE TESTING
Use Story 1User Stories
Product Backlog
Use Story 1User Stories
Sprint Backlog
Use Story 1User Stories
Use Story 1Tasks to Deliver User Stories
Shippable Product Increment
2 – 4 Week Sprints
Scrum Meetings & Re-prioritization
DONE
10/17/2016
4
AGILE MANIFESTO & TESTING
Individuals and interactions over processes and tools
- Product quality is whole cross-functional team’s responsibility
Working software over comprehensive documentation
- Test requirements from user stories, examples and interactions
Customer collaboration over contract negotiation
- Testing requirements developed with customer engagement
Responding to change over following a plan
- Enables continuous improvement of the testing process
http://agilemanifesto.org
THE ROLE YOU WILL PLAY
10/17/2016
5
TEAMS AND MANAGER RESPONSIBILITIES
• Teams self manage
• Team is responsible for delivery and quality
• Performance test manager focuses on enabling the performance testers
• Organizational standards & governance models
• ToolingTooling
• Best practices
THE ‘TRADITIONAL MINDSET’
• All or nothing
• Require documentation
• Too slow
• Preparation
• Execution
• Test early, test often• Code level• Component level
• Build performance acceptance into user stories• Preparation
• Scripting – tools like neoload, SOASTA, Taurus
• Isolated Environment – envExecution
• Functionality unstable
• Time pressed
Isolated Environment envvirtualizaion
• Test Data – stub, service virtualizaion, autonomous tests
• Execution• Automated test execution,
analysis & reporting
• Utilize coding standards that helps build script robustness – e.g. use unique identifiers• Incorporate separate sprints for long
running or end-to-end tests
10/17/2016
6
WHEN TO CONDUCT PERFORMANCE TESTING
WHEN TO CONDUCT PERFORMANCE TESTSDELIVERY MODELS – STAGGERED SPRINTS AKA N-1
Hardening Sprints
FeatureSprint Team
FeatureSprint Team
PerformancePerformanceSprint Team
10/17/2016
7
DELIVERY MODELS – TARGETED SPRINTS / SPIKES
Hardening Sprints
FeatureSprint Team
FeatureSprint Team
PerformancePerformanceSprint Team
DELIVERY MODELS – IN SPRINT
Hardening Sprints
FeatureSprint Team
FeatureSprint Team
PerformancePerformanceSprint Team
10/17/2016
8
HOW TO OPTIMIZE PERFORMANCE TESTING
CONTINUOUS PERFORMANCE TESTING DEMO
10/17/2016
9
SUMMARY
• The ‘brave new world’
• The role of Managers and Team
• Timing options: Staggered, Targeted, and ‘In sprint’
• Leveraging the latest automation tools
AGILE PERFORMANCE TESTING
