Usability Testing: Personas, Scenarios, Use Cases, and Test Cases
Assure End User Experience By Testing In Real World Scenarios
Transcript of Assure End User Experience By Testing In Real World Scenarios
![Page 1: Assure End User Experience By Testing In Real World Scenarios](https://reader031.fdocuments.in/reader031/viewer/2022030213/589d63e71a28abd91d8b4909/html5/thumbnails/1.jpg)
Assure End User Experience byTesting In Real World Scenarios
Kaushik NathHead of Product Strategy, 99tests
Bharath SDirector of Operations,
99tests
![Page 2: Assure End User Experience By Testing In Real World Scenarios](https://reader031.fdocuments.in/reader031/viewer/2022030213/589d63e71a28abd91d8b4909/html5/thumbnails/2.jpg)
About 99tests
![Page 3: Assure End User Experience By Testing In Real World Scenarios](https://reader031.fdocuments.in/reader031/viewer/2022030213/589d63e71a28abd91d8b4909/html5/thumbnails/3.jpg)
99tests - In A Nutshell
UsabilityTesting
SecurityTesting
Functional ExploratoryTesting
AutomationTesting
LocalisationTesting
AuFnUx LnSc
150+Countries
20000+Testers
Test Case DrivenTesting
Tc
![Page 4: Assure End User Experience By Testing In Real World Scenarios](https://reader031.fdocuments.in/reader031/viewer/2022030213/589d63e71a28abd91d8b4909/html5/thumbnails/4.jpg)
99tests Advantage
Save money & time
Access to top notch professional testers
across globe
App testing in thereal world
Easy integration
Flexible Engagement Models
Testers with Domain-Specific
Knowledge
![Page 5: Assure End User Experience By Testing In Real World Scenarios](https://reader031.fdocuments.in/reader031/viewer/2022030213/589d63e71a28abd91d8b4909/html5/thumbnails/5.jpg)
How we work?
Requirement gathering & analysis + Test strategy creation
( Through a personalized requirement discussion, Testing needs & plans are
chalked out )
Project creation & launch Within 24 hours( Testers & validators are assigned to the projects )
Monitoring Project progress( Bug logging, Bug Validation & Testing
coverage analysis )
Project delivery( Sharing bug reports, Test Summary
Reports & Recommendations )
![Page 6: Assure End User Experience By Testing In Real World Scenarios](https://reader031.fdocuments.in/reader031/viewer/2022030213/589d63e71a28abd91d8b4909/html5/thumbnails/6.jpg)
Crowd Testing - Relevance
![Page 7: Assure End User Experience By Testing In Real World Scenarios](https://reader031.fdocuments.in/reader031/viewer/2022030213/589d63e71a28abd91d8b4909/html5/thumbnails/7.jpg)
Testing For Customer Experience
![Page 8: Assure End User Experience By Testing In Real World Scenarios](https://reader031.fdocuments.in/reader031/viewer/2022030213/589d63e71a28abd91d8b4909/html5/thumbnails/8.jpg)
Real World Network Conditions
![Page 9: Assure End User Experience By Testing In Real World Scenarios](https://reader031.fdocuments.in/reader031/viewer/2022030213/589d63e71a28abd91d8b4909/html5/thumbnails/9.jpg)
Wide Variety in Screen Size
![Page 10: Assure End User Experience By Testing In Real World Scenarios](https://reader031.fdocuments.in/reader031/viewer/2022030213/589d63e71a28abd91d8b4909/html5/thumbnails/10.jpg)
Device coverage
![Page 11: Assure End User Experience By Testing In Real World Scenarios](https://reader031.fdocuments.in/reader031/viewer/2022030213/589d63e71a28abd91d8b4909/html5/thumbnails/11.jpg)
Massive variety of OS versions+
Customization of OS by manufacturers
100+ Companies
![Page 12: Assure End User Experience By Testing In Real World Scenarios](https://reader031.fdocuments.in/reader031/viewer/2022030213/589d63e71a28abd91d8b4909/html5/thumbnails/12.jpg)
Difficulty to test in a distributed environment
![Page 13: Assure End User Experience By Testing In Real World Scenarios](https://reader031.fdocuments.in/reader031/viewer/2022030213/589d63e71a28abd91d8b4909/html5/thumbnails/13.jpg)
Real People In Real Condition
Google map vs. Apple map
![Page 14: Assure End User Experience By Testing In Real World Scenarios](https://reader031.fdocuments.in/reader031/viewer/2022030213/589d63e71a28abd91d8b4909/html5/thumbnails/14.jpg)
Challenges In Customer Experience Testing
![Page 15: Assure End User Experience By Testing In Real World Scenarios](https://reader031.fdocuments.in/reader031/viewer/2022030213/589d63e71a28abd91d8b4909/html5/thumbnails/15.jpg)
The Process
• Clients give broad requirements.
• Users, from the crowd, as they are like real users, are able to expand to large variety of end user expectations and requirements.
• How do we choose the crowd in such case – We carefully choose with a broad demographics and expertise
• Exploratory → Test Case (Carefully Designed) → Usability Testing with Non-Testers (Real Users).
![Page 16: Assure End User Experience By Testing In Real World Scenarios](https://reader031.fdocuments.in/reader031/viewer/2022030213/589d63e71a28abd91d8b4909/html5/thumbnails/16.jpg)
The 99tests Process
Exploratory Test caseCarefully Designed - Maximum Coverage
Usability
![Page 17: Assure End User Experience By Testing In Real World Scenarios](https://reader031.fdocuments.in/reader031/viewer/2022030213/589d63e71a28abd91d8b4909/html5/thumbnails/17.jpg)
Case Study - Increasing The Review Rating
A mid sized travel segment clientNo testing team, agile process, with 15 days release cycleRegular bug fixes and new features added to the applicationWeb and Mobile Web Application
What 99tests provided25 testers across the globe with a mix of travel domain expertiseCoverage of up to 50 devicesExploratory testing followed by regression cycles
Results:Reduced the number of issues identified by their actual usersIncrease the quality index of the application from 4.2 to 4.8
User Review Rating
![Page 18: Assure End User Experience By Testing In Real World Scenarios](https://reader031.fdocuments.in/reader031/viewer/2022030213/589d63e71a28abd91d8b4909/html5/thumbnails/18.jpg)
Case Study - Enhanced End User ExperienceFor A Leading Airline Service Enterprise In The APJ Region
Large Enterprise Airline Booking PlatformHuge testing teamWeb, Android and iOS applicationMonthly release cycle
What 99tests provided50 testers across the globe with a mix of travel and ticketing expertiseCoverage of more than 50 configurationsExploratory testing followed by regression cycles
Results:Critical bugs identified before release and reported to the clientIncrease of (Internal) Quality Index from 3.8 to 4.4
![Page 19: Assure End User Experience By Testing In Real World Scenarios](https://reader031.fdocuments.in/reader031/viewer/2022030213/589d63e71a28abd91d8b4909/html5/thumbnails/19.jpg)
Bugathon
![Page 20: Assure End User Experience By Testing In Real World Scenarios](https://reader031.fdocuments.in/reader031/viewer/2022030213/589d63e71a28abd91d8b4909/html5/thumbnails/20.jpg)
THANK YOU