User Interface Evaluation Usability Testing Methods.
-
Upload
arthur-carpenter -
Category
Documents
-
view
224 -
download
1
Transcript of User Interface Evaluation Usability Testing Methods.
![Page 1: User Interface Evaluation Usability Testing Methods.](https://reader035.fdocuments.in/reader035/viewer/2022062408/56649e3a5503460f94b2c3db/html5/thumbnails/1.jpg)
User Interface Evaluation
Usability Testing Methods
![Page 2: User Interface Evaluation Usability Testing Methods.](https://reader035.fdocuments.in/reader035/viewer/2022062408/56649e3a5503460f94b2c3db/html5/thumbnails/2.jpg)
Usability Testing Methods Conduct experiments to find specific information
about a design and/or product.
Basis comes from experimental psychology.
Uses statistical data methods Quantitative and Qualitative
![Page 3: User Interface Evaluation Usability Testing Methods.](https://reader035.fdocuments.in/reader035/viewer/2022062408/56649e3a5503460f94b2c3db/html5/thumbnails/3.jpg)
Usability Testing Methods During usability testing, users work on specific
tasks using the interface/product and evaluators use the results to evaluate and modify the interface/product.
Widely used in practice, but not appropriately used.
Often abused by developers that consider themselves to be usability experts.
Can be very expensive and time consuming.
![Page 4: User Interface Evaluation Usability Testing Methods.](https://reader035.fdocuments.in/reader035/viewer/2022062408/56649e3a5503460f94b2c3db/html5/thumbnails/4.jpg)
Usability Testing Methods
Performance Measurement
Thinking-aloud Protocol
Question-asking Protocol
Coaching Method
![Page 5: User Interface Evaluation Usability Testing Methods.](https://reader035.fdocuments.in/reader035/viewer/2022062408/56649e3a5503460f94b2c3db/html5/thumbnails/5.jpg)
Usability Testing Methods
Co-discovery Learning
Teaching Method
Retrospective Testing
Remote Testing
![Page 6: User Interface Evaluation Usability Testing Methods.](https://reader035.fdocuments.in/reader035/viewer/2022062408/56649e3a5503460f94b2c3db/html5/thumbnails/6.jpg)
Performance Measurement
Applicable Stages: Design, Code, Test & Deployment
Personnel Usability Experts, approximately 1. Developers, 0. Users, 6.
![Page 7: User Interface Evaluation Usability Testing Methods.](https://reader035.fdocuments.in/reader035/viewer/2022062408/56649e3a5503460f94b2c3db/html5/thumbnails/7.jpg)
Performance Measurement Usability Issues Covered
Effectiveness: Yes Efficiency: Yes Satisfaction: No
Quantitative Data is collected.
Can NOT be conducted remotely.
Can be used on any system.
![Page 8: User Interface Evaluation Usability Testing Methods.](https://reader035.fdocuments.in/reader035/viewer/2022062408/56649e3a5503460f94b2c3db/html5/thumbnails/8.jpg)
Performance Measurement What is it?
Used to collect quantitative data.
Typically, you will be looking for benchmark data.
Objectives MUST be quantifiable 75% of users shall be able to complete the basic task
in less than 30 minutes.
![Page 9: User Interface Evaluation Usability Testing Methods.](https://reader035.fdocuments.in/reader035/viewer/2022062408/56649e3a5503460f94b2c3db/html5/thumbnails/9.jpg)
Performance Measurement How can I do it?
Define the goals that you expect users to perform
![Page 10: User Interface Evaluation Usability Testing Methods.](https://reader035.fdocuments.in/reader035/viewer/2022062408/56649e3a5503460f94b2c3db/html5/thumbnails/10.jpg)
Performance Measurement How can I do it?
Quantify the goals The time users take to complete a specific task. The Ratio between successful interactions and errors. The time spent recovering from errors. The number of user errors. The number of commands or other features that were
never used by the user. The number of system features the user can remember
during a debriefing after the test. The proportion of users who say that they would prefer
using the system over some specified competitor.
![Page 11: User Interface Evaluation Usability Testing Methods.](https://reader035.fdocuments.in/reader035/viewer/2022062408/56649e3a5503460f94b2c3db/html5/thumbnails/11.jpg)
Performance Measurement How can I do it?
Get participants for the experiments
Conduct very controlled experiments All variables must remain consistent across users
![Page 12: User Interface Evaluation Usability Testing Methods.](https://reader035.fdocuments.in/reader035/viewer/2022062408/56649e3a5503460f94b2c3db/html5/thumbnails/12.jpg)
Performance Measurement Problems With Performance Measurement
No qualitative data.
![Page 13: User Interface Evaluation Usability Testing Methods.](https://reader035.fdocuments.in/reader035/viewer/2022062408/56649e3a5503460f94b2c3db/html5/thumbnails/13.jpg)
Thinking-aloud Protocol Applicable Stages:
Design, Code, Test & Deployment
Personnel Usability Experts, approximately 1. Developers, 0. Users, 4.
![Page 14: User Interface Evaluation Usability Testing Methods.](https://reader035.fdocuments.in/reader035/viewer/2022062408/56649e3a5503460f94b2c3db/html5/thumbnails/14.jpg)
Thinking-aloud Protocol Usability Issues Covered
Effectiveness: Yes Efficiency: No Satisfaction: Yes
Quantitative Data is NOT collected.
Can NOT be conducted remotely.
Can be used on any system.
![Page 15: User Interface Evaluation Usability Testing Methods.](https://reader035.fdocuments.in/reader035/viewer/2022062408/56649e3a5503460f94b2c3db/html5/thumbnails/15.jpg)
Thinking-aloud Protocol What is it?
Technique where the participant is asked to vocalize his or her thoughts, feelings, and opinions while interacting with the product. .
![Page 16: User Interface Evaluation Usability Testing Methods.](https://reader035.fdocuments.in/reader035/viewer/2022062408/56649e3a5503460f94b2c3db/html5/thumbnails/16.jpg)
Thinking-aloud Protocol How can I do it?
Select the participants, who will be involved?
Select the tasks and design scenarios.
Ask the participant to perform a task using the software.
![Page 17: User Interface Evaluation Usability Testing Methods.](https://reader035.fdocuments.in/reader035/viewer/2022062408/56649e3a5503460f94b2c3db/html5/thumbnails/17.jpg)
Thinking-aloud Protocol How can I do it?
During the task, ask the user to vocalize Thoughts, opinions, feelings, etc.
http://www.cs.umd.edu/~zzj/ThinkAlo.htm
![Page 18: User Interface Evaluation Usability Testing Methods.](https://reader035.fdocuments.in/reader035/viewer/2022062408/56649e3a5503460f94b2c3db/html5/thumbnails/18.jpg)
Thinking-aloud Protocol Problem With Thinking-Aloud Protocol
Cognitive Overload Can you walk & chew gum at the same time? Asking the participants to do too much.
![Page 19: User Interface Evaluation Usability Testing Methods.](https://reader035.fdocuments.in/reader035/viewer/2022062408/56649e3a5503460f94b2c3db/html5/thumbnails/19.jpg)
Question-asking Protocol Applicable Stages:
Design, Code, Test & Deployment
Personnel Usability Experts, approximately 1. Developers, 0. Users, 4.
![Page 20: User Interface Evaluation Usability Testing Methods.](https://reader035.fdocuments.in/reader035/viewer/2022062408/56649e3a5503460f94b2c3db/html5/thumbnails/20.jpg)
Question-asking Protocol Usability Issues Covered
Effectiveness: Yes Efficiency: No Satisfaction: Yes
Quantitative Data is NOT collected.
Can NOT be conducted remotely.
Can be used on any system.
![Page 21: User Interface Evaluation Usability Testing Methods.](https://reader035.fdocuments.in/reader035/viewer/2022062408/56649e3a5503460f94b2c3db/html5/thumbnails/21.jpg)
Question-asking Protocol What is it?
Similar to Thinking-aloud protocol.
Instead of participant saying what they are thinking, the evaluator prompts the participant with questions while using the system.
![Page 22: User Interface Evaluation Usability Testing Methods.](https://reader035.fdocuments.in/reader035/viewer/2022062408/56649e3a5503460f94b2c3db/html5/thumbnails/22.jpg)
Question-asking Protocol How can I do it?
Select the participants, who will be involved?
Select the tasks and design scenarios.
Ask the participant to perform a task using the software.
![Page 23: User Interface Evaluation Usability Testing Methods.](https://reader035.fdocuments.in/reader035/viewer/2022062408/56649e3a5503460f94b2c3db/html5/thumbnails/23.jpg)
Question-asking Protocol How can I do it?
During the task, ask the user to questions about the product Thoughts, opinions, feelings, etc.
http://www.cs.umd.edu/~zzj/Question.htm
![Page 24: User Interface Evaluation Usability Testing Methods.](https://reader035.fdocuments.in/reader035/viewer/2022062408/56649e3a5503460f94b2c3db/html5/thumbnails/24.jpg)
Question-asking Protocol
Problem With Thinking-Aloud Protocol
Cognitive Overload++ Can you walk, chew gum & talk at the same time? Asking the participants to do too much. Added pressure when the evaluator asks questions. Can be frustrating on novice users.
![Page 25: User Interface Evaluation Usability Testing Methods.](https://reader035.fdocuments.in/reader035/viewer/2022062408/56649e3a5503460f94b2c3db/html5/thumbnails/25.jpg)
Coaching Method Applicable Stages:
Design, Code, Test & Deployment
Personnel Usability Experts, approximately 1. Developers, 0. Users, 4.
![Page 26: User Interface Evaluation Usability Testing Methods.](https://reader035.fdocuments.in/reader035/viewer/2022062408/56649e3a5503460f94b2c3db/html5/thumbnails/26.jpg)
Coaching Method Usability Issues Covered
Effectiveness: Yes Efficiency: No Satisfaction: Yes
Quantitative Data is NOT collected.
Can NOT be conducted remotely.
Can be used on any system.
![Page 27: User Interface Evaluation Usability Testing Methods.](https://reader035.fdocuments.in/reader035/viewer/2022062408/56649e3a5503460f94b2c3db/html5/thumbnails/27.jpg)
Coaching Method What is it?
A system expert sits with the participant and acts as a coach.
Expert answers the participant’s questions.
The evaluator observes their interaction.
![Page 28: User Interface Evaluation Usability Testing Methods.](https://reader035.fdocuments.in/reader035/viewer/2022062408/56649e3a5503460f94b2c3db/html5/thumbnails/28.jpg)
Coaching Method How can I do it?
Select the participants, who will be involved?
Select the tasks and design scenarios.
Ask the participant to perform a task using the software in the presence of a coach/expert.
![Page 29: User Interface Evaluation Usability Testing Methods.](https://reader035.fdocuments.in/reader035/viewer/2022062408/56649e3a5503460f94b2c3db/html5/thumbnails/29.jpg)
Coaching Method How can I do it?
During the task, the user will ask the expert questions about the product
http://www.cs.umd.edu/~zzj/Coaching.htm
![Page 30: User Interface Evaluation Usability Testing Methods.](https://reader035.fdocuments.in/reader035/viewer/2022062408/56649e3a5503460f94b2c3db/html5/thumbnails/30.jpg)
Coaching Method Problem With Coaching Method
In reality, there will not be a coach present.
This is good for creating a coaching system, but not for evaluating the interface.
![Page 31: User Interface Evaluation Usability Testing Methods.](https://reader035.fdocuments.in/reader035/viewer/2022062408/56649e3a5503460f94b2c3db/html5/thumbnails/31.jpg)
Co-Discovery Learning
Applicable Stages: Design, Code, Test & Deployment
Personnel Usability Experts, approximately 1. Developers, 0. Users, 6.
![Page 32: User Interface Evaluation Usability Testing Methods.](https://reader035.fdocuments.in/reader035/viewer/2022062408/56649e3a5503460f94b2c3db/html5/thumbnails/32.jpg)
Co-Discovery Learning Usability Issues Covered
Effectiveness: Yes Efficiency: No Satisfaction: Yes
Quantitative Data is NOT collected.
Can NOT be conducted remotely.
Can be used on any system.
![Page 33: User Interface Evaluation Usability Testing Methods.](https://reader035.fdocuments.in/reader035/viewer/2022062408/56649e3a5503460f94b2c3db/html5/thumbnails/33.jpg)
Co-Discovery Learning What is it?
Two test users attempt to perform tasks together while being observed.
They are to help each other in the same manner as they would if they were working together to accomplish a common goal using the product.
They are encouraged to explain what they are thinking about while working on the tasks. Thinking Aloud, but more natural because of partner.
![Page 34: User Interface Evaluation Usability Testing Methods.](https://reader035.fdocuments.in/reader035/viewer/2022062408/56649e3a5503460f94b2c3db/html5/thumbnails/34.jpg)
Co-Discovery Learning How can I do it?
Select the participants, who will be involved?
Select the tasks and design scenarios.
Ask the participants to perform a task using the software.
![Page 35: User Interface Evaluation Usability Testing Methods.](https://reader035.fdocuments.in/reader035/viewer/2022062408/56649e3a5503460f94b2c3db/html5/thumbnails/35.jpg)
Co-Discovery Learning How can I do it?
During the task, the users will help each other and voice their thoughts by talking to each other.
http://www.cs.umd.edu/~zzj/Codiscov.htm
![Page 36: User Interface Evaluation Usability Testing Methods.](https://reader035.fdocuments.in/reader035/viewer/2022062408/56649e3a5503460f94b2c3db/html5/thumbnails/36.jpg)
Co-Discovery Learning Problem With Co-Discovery Learning
Neither is an expert The blind leading the blind.
![Page 37: User Interface Evaluation Usability Testing Methods.](https://reader035.fdocuments.in/reader035/viewer/2022062408/56649e3a5503460f94b2c3db/html5/thumbnails/37.jpg)
Teaching Method Applicable Stages:
Design, Code, Test & Deployment
Personnel Usability Experts, approximately 1. Developers, 0. Users, 4.
![Page 38: User Interface Evaluation Usability Testing Methods.](https://reader035.fdocuments.in/reader035/viewer/2022062408/56649e3a5503460f94b2c3db/html5/thumbnails/38.jpg)
Teaching Method Usability Issues Covered
Effectiveness: Yes Efficiency: No Satisfaction: Yes
Quantitative Data is NOT collected.
Can NOT be conducted remotely.
Can be used on any system.
![Page 39: User Interface Evaluation Usability Testing Methods.](https://reader035.fdocuments.in/reader035/viewer/2022062408/56649e3a5503460f94b2c3db/html5/thumbnails/39.jpg)
Teaching Method
What is it?
You have 1 participant use the system.
Ask the participant to teach a new novice participant how to use the system.
![Page 40: User Interface Evaluation Usability Testing Methods.](https://reader035.fdocuments.in/reader035/viewer/2022062408/56649e3a5503460f94b2c3db/html5/thumbnails/40.jpg)
Teaching Method
How can I do it?
Select the participants, who will be involved?
Select the tasks and design scenarios.
Ask the 1st participant to perform a task using the software.
Ask the 1st participant to teach a new participant.
![Page 41: User Interface Evaluation Usability Testing Methods.](https://reader035.fdocuments.in/reader035/viewer/2022062408/56649e3a5503460f94b2c3db/html5/thumbnails/41.jpg)
Teaching Method How can I do it?
Observe their interactions.
http://www.cs.umd.edu/~zzj/Teaching.htm
![Page 42: User Interface Evaluation Usability Testing Methods.](https://reader035.fdocuments.in/reader035/viewer/2022062408/56649e3a5503460f94b2c3db/html5/thumbnails/42.jpg)
Teaching Method Problem With Teaching Method
Neither is an expert The blind leading the blind. Possible to discover some interesting things about the
learn-ability of your interfaces.
![Page 43: User Interface Evaluation Usability Testing Methods.](https://reader035.fdocuments.in/reader035/viewer/2022062408/56649e3a5503460f94b2c3db/html5/thumbnails/43.jpg)
Retrospective Testing Applicable Stages:
Design, Code, Test & Deployment
Personnel Usability Experts, approximately 1. Developers, 0. Users, 4.
![Page 44: User Interface Evaluation Usability Testing Methods.](https://reader035.fdocuments.in/reader035/viewer/2022062408/56649e3a5503460f94b2c3db/html5/thumbnails/44.jpg)
Retrospective Testing Usability Issues Covered
Effectiveness: Yes Efficiency: Yes Satisfaction: Yes
Quantitative Data can be collected.
Can NOT be conducted remotely.
Can be used on any system.
![Page 45: User Interface Evaluation Usability Testing Methods.](https://reader035.fdocuments.in/reader035/viewer/2022062408/56649e3a5503460f94b2c3db/html5/thumbnails/45.jpg)
Retrospective Testing What is it?
A videotape of the session is observed by the usability expert and the participants.
![Page 46: User Interface Evaluation Usability Testing Methods.](https://reader035.fdocuments.in/reader035/viewer/2022062408/56649e3a5503460f94b2c3db/html5/thumbnails/46.jpg)
Retrospective Testing How can I do it?
Select the participants, who will be involved?
Select the tasks and design scenarios.
Use one of the usability testing methods that we have discussed.
Videotape the session.
![Page 47: User Interface Evaluation Usability Testing Methods.](https://reader035.fdocuments.in/reader035/viewer/2022062408/56649e3a5503460f94b2c3db/html5/thumbnails/47.jpg)
Retrospective Testing How can I do it?
Review the videotape with the users.
http://www.cs.umd.edu/~zzj/Retrospe.htm
![Page 48: User Interface Evaluation Usability Testing Methods.](https://reader035.fdocuments.in/reader035/viewer/2022062408/56649e3a5503460f94b2c3db/html5/thumbnails/48.jpg)
Retrospective Testing Problem With Retrospective Testing
Extremely time consuming!
![Page 49: User Interface Evaluation Usability Testing Methods.](https://reader035.fdocuments.in/reader035/viewer/2022062408/56649e3a5503460f94b2c3db/html5/thumbnails/49.jpg)
Remote Testing Applicable Stages:
Design, Code, Test & Deployment
Personnel Usability Experts, approximately 1. Developers, 0. Users, 5.
![Page 50: User Interface Evaluation Usability Testing Methods.](https://reader035.fdocuments.in/reader035/viewer/2022062408/56649e3a5503460f94b2c3db/html5/thumbnails/50.jpg)
Remote Testing Usability Issues Covered
Effectiveness: Yes Efficiency: Yes Satisfaction: Yes
Quantitative Data can be collected.
Can be conducted remotely.
Can be used on any system.
![Page 51: User Interface Evaluation Usability Testing Methods.](https://reader035.fdocuments.in/reader035/viewer/2022062408/56649e3a5503460f94b2c3db/html5/thumbnails/51.jpg)
Remote Testing
What is it?
The participants are separated from the evaluators.
No formal observation.
No usability lab.
![Page 52: User Interface Evaluation Usability Testing Methods.](https://reader035.fdocuments.in/reader035/viewer/2022062408/56649e3a5503460f94b2c3db/html5/thumbnails/52.jpg)
Remote Testing How can I do it?
Give the product/software to participants.
Collect information about how they use your software/product.
Methods Same-Time Different Place Different-Time Different Place
![Page 53: User Interface Evaluation Usability Testing Methods.](https://reader035.fdocuments.in/reader035/viewer/2022062408/56649e3a5503460f94b2c3db/html5/thumbnails/53.jpg)
Remote Testing How can I do it?
Camtasia, Look@Me, SnagIt
Usability Logger http://www.usabletools.com/
Journaled Sessions
http://www.cs.umd.edu/~zzj/Retrospe.htm
![Page 54: User Interface Evaluation Usability Testing Methods.](https://reader035.fdocuments.in/reader035/viewer/2022062408/56649e3a5503460f94b2c3db/html5/thumbnails/54.jpg)
Remote Testing
Problem With Remote Testing
The evaluator is not there.
Can’t observe facial expressions.
Great for Web based systems.
![Page 55: User Interface Evaluation Usability Testing Methods.](https://reader035.fdocuments.in/reader035/viewer/2022062408/56649e3a5503460f94b2c3db/html5/thumbnails/55.jpg)
Usability Testing MethodsSelect the method that works best for you.
Select the method that fits your implementation.
Be thorough during your experiments.
The more data, the better.
![Page 56: User Interface Evaluation Usability Testing Methods.](https://reader035.fdocuments.in/reader035/viewer/2022062408/56649e3a5503460f94b2c3db/html5/thumbnails/56.jpg)
Usability Testing MethodsHawthorne Effect
The tendency for people to improve their performance after any change when they know their performance is being studied.