Post on 12-May-2015
description
Practical Usability Testing Session in Association with
techgig.com / Nimbuzz
Ravindran AntonysamyQA Head, Nimbuzz
http://www.techgig.com/expert-speak/Practical-Usability-Testing-432
1
Before we fall in love with our own designs, lets find out what ‘really’ our users are thinking about it !!
2
Who Am ITarget AudienceWhat is Usability testing ?PET – Persuasion / Emotion / Trust ISO 9241How to hire usability testers ?Screener / Consent form / recording Test protocol Execution / PrototypesPresenting ReportsMobileQAZone.comLinks (tools / videos)Nimbuzz !!
12/04/2023 Go get Nimbuzz from http://get.nimbuzz.com
3
Usability testing largely misunderstood with User acceptance testing which we do with customers (UAT). Usability testing is NOT UAT. This webinar will give you the basics of Usability testing. This webinar will give you the types of usability testing (Hallway testing, Remote usability testing, Expert review, Automated Expert review and A/B testing).
Usability testing measures the usability, or ease of use, of a specific object or set of objects, whereas general human-computer interaction studies attempt to formulate universal principles.Why Usability test your product? How to conduct usability testing? What is a Screener? How to recruit users? What is a test protocol and why you need to make it, who should make it?
12/04/2023 Go get Nimbuzz from http://get.nimbuzz.com
4
How to conduct the usability testing with appropriate users? What to focus on, when recruiting users? How to reward them or motivate them?What are all the challenges when conducting usability testing with real users? How to tackle them?
What is the hardware and software requirements when conducting usability testing?
This webinar addresses all, to help you kick-start your usability testing initiative!
12/04/2023 Go get Nimbuzz from http://get.nimbuzz.com
5
Key Discussion Points:
Types of Usability testingHow to perform usability testing in practical?How to present the data to the Product Management ?How to follow up the usability test results helps or transforms into business?
Who Should Attend?Mobile Application Testers, Mobile Handheld Testers, Mobile Usability testers, Product Managers, Test and Tech Leads
12/04/2023 Go get Nimbuzz from http://get.nimbuzz.com
6
Who Am I & What I love
12/04/2023 Go get Nimbuzz from http://get.nimbuzz.com
7
Who Am I & What I love
12/04/2023 Go get Nimbuzz from http://get.nimbuzz.com
Robotics
Renewable Energy
Open Source
All testing types
8
Hallway testingRemote Usability TestingExpert reviewAutomated expert reviewA/B Testing
Best testing types
9
Few Famous methodologies, and why we should use or why we should not use them:
Hallway testing: set of people invited to test the product. Engaged in the early stages of design / product. We shall invite new nimbuzz employees to perform this test. This is a pilot test before performing the actual usability testing (this will evaluate our test protocol and test methodology)
Other formats such as Expert review, automated expert review, A/B testing shall not be engaged at this point (considering the cost involved for tools and resources)
Moderated Usability testing : We shall hire usability testers / real users via social media channels / friends circles. Evaluate them. Invite them to Nimbuzz. Follow the test protocol reviewed by Kapil, Harsh and approved Jammy + Respective PM. Conduct the test and circulate the results.
Buzz about Sample Size
10
According to the industry, the more number of users we use, great possibility is that they will come across the same kind of usability problems. So we shall use 5 test samples in the beginning. At the max, we shall use 7 or 10 people for this.
More users, Same
problem
Test Execution Method
11
- Participant evaluation sheet shared with the PM and he/she provide inputs for selecting the relevant participants.- On Scheduled test day, participant arrives to the test lab, briefed about the product he/she will be using- Usability test session conducted by Test moderator and an Observer is present to observe the events as It happens.- Moderator follows the test protocol (Reviewed by Functional team and
approved by Product manager) and request the tester to perform those actions. - User / usability tester “think aloud “ and speaks as he/she performs actions on
the specific task.- User / usability testers face & tapping action & think aloud voice recorded as it
goes (prior consent had been obtained in written form from the tester)- The Data then presented to the Product management with a easy to use –
decision making format (PPT presentation + consolidated videos of facial and finger tapping along with voice)
Features for Usability
Testing
12
- Go with Core Features- Go with mostly visible to the user- Go with the feature that you want the user to focus on when entering /
navigating in your product - Go with features that fetches money
Test Protocol
13
Task / Question Expected Reply / User Action (User think aloud when performing this)
Problems faced by the User
Comments by the Moderator
You downloaded Nimbuzz client and you do not have an username. Please create a Nimbuzz account in this phone.
- User opens Application and touches I am a new user
- Feeding the number is mandatory ?
- Can I skip this ?- How much time I have
to wait for an SMS ?- Can I use call me
Option now ?- Do I have to Use
numbers in the password ?
- Allowing Phone book upload is mandatory ?
* Sample test protocol. Usability test moderator will carry a print of this to the usability test lab (or wherever the usability test been executed) and use this as a key to request the user to perform various test actions. We shall have 10 – 15 tests during one usability session with a user – maximum duration 1 hour to 1.5 hours.
Resource / Tools and Costs
14
For Hiring Resources, in Indian context, we shall pay 1K per user. Considering we hire 5 people for Phase 1, we spend 5K.
In International context, upto 100 USD / 100 EURO’s paid. Some times companies issue gift cards / gift vouchers / calling cards
Phase 1 Usability testing – 5 users : 5000 Rs (90 USD)One time purchase of tools (http://www.techsmith.com/morae.html) – Ex for Windows : 15,000 Rs (or 299 USD)
Heatmap tools : http://www.testing-web-sites.co.uk/2013/01/23/20-heatmap-tools-for-testing-your-websites-usability/
Screener
To Inform the consultancy company or Human resources team to get
the right people
15
PersonaPersonas
The purpose of personas is to create reliable and realistic representations of your key audience segments for reference. These representations should be based on qualitative and some quantitative user research and web analytics. Remember, your personas are only as good as the research behind them.
http://www.usability.gov/how-to-and-tools/methods/personas.html
16
Participants
17
1. Engineers2. Non Engineers3. Government Employees4. Kids5. Students (College / School)6. Travelers7. Low / High economical backgrounds8. Plumbers, Doctors, Labors
19
Should user Cam to record user expressions and voice, separate cam for recording user actions (such as tapping on the product). If required we will procure some simple stands to keep the mobile / cam.
20
21
22
Website Heat map
23
Mobile Heat map
24
Paper Prototype
25
Paper Prototype
26
Presentation / Report Format
27
User (1 to n) Data will be presented with a video (of the user when performing action, video of the Device under test during the test, audio recoding when they “think aloud”.
Humm…Now I am trying to create an
account
Details: User is really comfortable in
downloading the app. But she faced trouble in receiving the pin and feeding
in. Please watch 2:35 min in the video.
-Sample-
Overall Execution Path
28
Initial test plan created &
circulated to Product Leadership and management
Execution Plan and Test Protocol
Approved by Product
Leadership and Management
Resource cost + Tools cost
approved by management
Hiring resources, Scheduling & Lab setup completed
Test Execution & video editing / analysis report
created
Final Presentation to
Product Leadership* and
Management
Links:
Documents / Info : http://www.usability.govEye Tracking : http://www.tobii.com/en/eye-tracking-research/global/research/Usability testing of a Fruit : http://www.youtube.com/watch?v=3Qg80qTfzgU7 Principles : http://www.youtube.com/watch?v=0oS-tvCUbBs10 AB testing tools : http://www.practicalecommerce.com/articles/4133-10-A-B-Testing-Tools-for-Small-Businesses
Remote Usability testing and UX Research Tools : http://remoteresear.ch/tools/PET : http://www.slideshare.net/QuiffBoy/pet-designing-for-persuasion-emotion-and-trust
http://www.nngroup.com/ and http://www.nngroup.com/books/designing-web-usability/ http://www.amazon.in/dp/0321344758/?tag=googinhydr2506-21 (DON’T make me think – steve krug)
29
Thanks, time for QAConnect with me ra2012vi@gmail.com if required..
Youtube Link of this Session : http://www.youtube.com/watch?v=XXNXNSrlZcs
Nimbuzz Chat ID : ravindran2454Get Nimbuzz Mobile Application for Android, iPhone, Windows Phone, PC,
Symbian, Java Phones from http://get.nimbuzz.com or www.nimbuzz.com
30