Building a Strategy for Mobile Test Automation Success
-
Upload
lee-barnes -
Category
Technology
-
view
24 -
download
0
Transcript of Building a Strategy for Mobile Test Automation Success
![Page 1: Building a Strategy for Mobile Test Automation Success](https://reader030.fdocuments.in/reader030/viewer/2022032620/55cda6fbbb61eb12148b4585/html5/thumbnails/1.jpg)
© Utopia Solutions
Building a Strategy for Mobile Test Automation Success
Lee Barnes, CTO Utopia Solutions
![Page 2: Building a Strategy for Mobile Test Automation Success](https://reader030.fdocuments.in/reader030/viewer/2022032620/55cda6fbbb61eb12148b4585/html5/thumbnails/2.jpg)
© Utopia Solutions
Agenda
• What is the end goal? • Why do we need a strategy? • What do we need to consider? • What should a strategy look like?
Test Automation Strategy Overview
![Page 3: Building a Strategy for Mobile Test Automation Success](https://reader030.fdocuments.in/reader030/viewer/2022032620/55cda6fbbb61eb12148b4585/html5/thumbnails/3.jpg)
© Utopia Solutions 3
WIFI / Carrier Networks
Ultimate Goal
Automation Framework
Test Cases
Backend System
Single set of test cases executing across a diverse set of real devices
![Page 4: Building a Strategy for Mobile Test Automation Success](https://reader030.fdocuments.in/reader030/viewer/2022032620/55cda6fbbb61eb12148b4585/html5/thumbnails/4.jpg)
© Utopia Solutions 4
Test Automation Success Criteria
• Issue detection and recovery • Accurate verification • Unattended execution
Reliable
• Minimum sensitivity to application and test case changes
• Test case maintenance separate from automation code maintenance
Maintainable
• Test coverage expanded efficiently • Automated test cases created by non-automation
resources Scalable
![Page 5: Building a Strategy for Mobile Test Automation Success](https://reader030.fdocuments.in/reader030/viewer/2022032620/55cda6fbbb61eb12148b4585/html5/thumbnails/5.jpg)
© Utopia Solutions
SECTION 2 Why Do We Need a Strategy?
![Page 6: Building a Strategy for Mobile Test Automation Success](https://reader030.fdocuments.in/reader030/viewer/2022032620/55cda6fbbb61eb12148b4585/html5/thumbnails/6.jpg)
© Utopia Solutions 6
Test Automation Challenges
• Defining appropriate scope • Integrating with SDLC • Addressing technical issues • Reliability, maintainability, scalability
General
• Platform diversity • Device diversity • Device Access • Lack of skilled resources • Rate of technology change • Rapid development cycles
Mobile Specific
![Page 7: Building a Strategy for Mobile Test Automation Success](https://reader030.fdocuments.in/reader030/viewer/2022032620/55cda6fbbb61eb12148b4585/html5/thumbnails/7.jpg)
© Utopia Solutions 7
Why Test Automation Fails
Organizational • Lack of support • Unrealistic expectations • Disjointed org structure • Missing skill sets
Process • Immature testing process • Segregated processes • Lack of test environment / data
control
Technical • Poor tool support for AUT • Under or over design automation
approach
![Page 8: Building a Strategy for Mobile Test Automation Success](https://reader030.fdocuments.in/reader030/viewer/2022032620/55cda6fbbb61eb12148b4585/html5/thumbnails/8.jpg)
© Utopia Solutions
SECTION 3 What Do We Need to Know First?
![Page 9: Building a Strategy for Mobile Test Automation Success](https://reader030.fdocuments.in/reader030/viewer/2022032620/55cda6fbbb61eb12148b4585/html5/thumbnails/9.jpg)
© Utopia Solutions 9
Are We Ready?
![Page 10: Building a Strategy for Mobile Test Automation Success](https://reader030.fdocuments.in/reader030/viewer/2022032620/55cda6fbbb61eb12148b4585/html5/thumbnails/10.jpg)
© Utopia Solutions 10
Mobile Test Automation Readiness Assessment
People
• Structure • Support • Goals and
Expectations • Resources and Skills
Process
• Test Maturity • Test Assets • Process Integration • Test Environment /
Data
Tech
• Mobile Platforms • Device Access • AUT Technology • AUT / Tool
Integration
Assessment Topics
![Page 11: Building a Strategy for Mobile Test Automation Success](https://reader030.fdocuments.in/reader030/viewer/2022032620/55cda6fbbb61eb12148b4585/html5/thumbnails/11.jpg)
© Utopia Solutions
Where Do We Get the Information?
Assessment Input
Stakeholders
Existing Assets
Target Applications
![Page 12: Building a Strategy for Mobile Test Automation Success](https://reader030.fdocuments.in/reader030/viewer/2022032620/55cda6fbbb61eb12148b4585/html5/thumbnails/12.jpg)
© Utopia Solutions
SECTION 5 What Does a Strategy Look Like?
![Page 13: Building a Strategy for Mobile Test Automation Success](https://reader030.fdocuments.in/reader030/viewer/2022032620/55cda6fbbb61eb12148b4585/html5/thumbnails/13.jpg)
© Utopia Solutions 13
Start With a Plan
Scope
OS/Device Selection
Test Case Selection
Non-Testing Tasks
Technical Challenges
Device Access
Platform/Device Diversity
Object Identification
Process Integration
Type of Dev Cycle
Test Suite Maintenance
Execution & Analysis
![Page 14: Building a Strategy for Mobile Test Automation Success](https://reader030.fdocuments.in/reader030/viewer/2022032620/55cda6fbbb61eb12148b4585/html5/thumbnails/14.jpg)
© Utopia Solutions 14
Mobile Test Strategy Topics
Mobile Test Automation
Strategy
Process & Organization
Environment
Technical Resources
Scope & Roadmap
![Page 15: Building a Strategy for Mobile Test Automation Success](https://reader030.fdocuments.in/reader030/viewer/2022032620/55cda6fbbb61eb12148b4585/html5/thumbnails/15.jpg)
© Utopia Solutions 15
Automation Strategy – Process and Organization
• Political and financial support • Realistic expectations • Centralized automation function
Key Organizational Components
• Test objectives and coverage goals • Integration with SDLC → proactive
maintenance
Key Process Components
![Page 16: Building a Strategy for Mobile Test Automation Success](https://reader030.fdocuments.in/reader030/viewer/2022032620/55cda6fbbb61eb12148b4585/html5/thumbnails/16.jpg)
© Utopia Solutions 16
Automation Strategy – Environment and Technical
• Dedicated environment for execution • Controlled test data • Controlled code migration
Key Environmental Components
• Robust (and timely) test tool support for mobile platforms
• Efficient device access
Key Technical Components
![Page 17: Building a Strategy for Mobile Test Automation Success](https://reader030.fdocuments.in/reader030/viewer/2022032620/55cda6fbbb61eb12148b4585/html5/thumbnails/17.jpg)
© Utopia Solutions 17
Automation Strategy – Resources
• Roles • Skills • Time
Key People Components
• AUT test environment(s) • Test suite development • Test suite execution
Key Hardware Components
• Test tool • Supporting utilities
Key Software Components
![Page 18: Building a Strategy for Mobile Test Automation Success](https://reader030.fdocuments.in/reader030/viewer/2022032620/55cda6fbbb61eb12148b4585/html5/thumbnails/18.jpg)
© Utopia Solutions 18
Automation Strategy – Scope
• Test data setup • AUT / environment preparation • Complex / tedious results verification
Test Support Tasks
• Applications built on common technology • Applications with frequent releases & friendly UI’s
Application Selection
• Frequently tested • High test case to UI ratio • Predictable results • Easy to automate
Test Case Selection
![Page 19: Building a Strategy for Mobile Test Automation Success](https://reader030.fdocuments.in/reader030/viewer/2022032620/55cda6fbbb61eb12148b4585/html5/thumbnails/19.jpg)
© Utopia Solutions 19
Automation Strategy – Roadmap
• Begin with required organizational and process changes • Overlap with base framework and minimal coverage • Enhance and add test coverage over small iterations
Create Implementation Timeline
Phase n Phase 1
Continuous Process & Organizational Improvements
Base Framework
Initial Coverage
AUT 1
Framework Enhancements
Expand Coverage
Initial Coverage
Phase 2
AUT 2
Expand Coverage
Expand Coverage
Initial Coverage
Phase 3
AUT 3
![Page 20: Building a Strategy for Mobile Test Automation Success](https://reader030.fdocuments.in/reader030/viewer/2022032620/55cda6fbbb61eb12148b4585/html5/thumbnails/20.jpg)
© Utopia Solutions 20
Questions…
…. and Answers!
Direct future questions to: Lee Barnes Founder and CTO Utopia Solutions, Inc. Email: [email protected] Twitter: @USI_LeeBarnes LinkedIn: linkedin.com/in/leebarnes Blog: http://utopiasolutions.com/blog/