Yahoo Mail Fail – An Interactive Approach To Designhkhaki/HCI-Research/IAT201_YahooMail.pdf ·...
Transcript of Yahoo Mail Fail – An Interactive Approach To Designhkhaki/HCI-Research/IAT201_YahooMail.pdf ·...
Yahoo Mail Fail – An Interactive Approach
To Design
Nilou Kou 301158837
Hasti Khaki 301156456
Alicia Wong 301187621
John Nguyen 301186883
Table of content
Chapter One: Introduction 2 -15
Abstract 2
Introduction 3
Motivation and Purpose
Problem Statement and User Goals 3 - 4
Redesign Objectives
Users
Description of User Base 4 - 5
Persona 5 - 6
Context of Use, Scenario & Task
Heuristic Evaluation 6 - 8
User Study
Goals, Questions/Hypothesis Addressed 9
Methods 10 - 11
Materials & Procedures 11 - 14
Results 13 - 14
Requirements Statement
Functional Requirement 14 - 15
Non-Functional Requirement 15
Chapter Two: Design 16 - 20
Prioritization Worksheet 17
Design Inspirations and Comparison 18
Conceptual Design A 19
Overview & Description
Design Hypothesis
Interaction Paradigm
Conceptual Design B 20
Overview & Description
Design Hypothesis
Interaction Paradigm
Comparison of Conceptual Designs A & B 21
Chapter Three: Prototyping 22 - 32
Illustration of Task Pursued 22 - 29
Insights & lesson Learned 30
Storyboard 31 - 32
Chapter Four : Evaluation 33 - 47
Goals of Evaluation Study 33
Questions, Hypothesis Addressed
Design Evaluation Methods 34
Participants
Materials
Instructions & Task Description 35 - 36
Experimental Design & Procedure 36
Results 37 - 44
Quantitative Data
Qualitative Data 45 - 46
Comparative Data
Discussion & Conclusion - Implications for Future Design 47
Abstract
Two overall issues we as group noticed with Yahoo Mail is its design and functionality. In the
issue with design, we found that the Yahoo Mail homepage is seemingly unorganized and layered
with ambiguous icons. And in terms of its functionality we feel that Yahoo Mail is lacking in providing
a more efficient interface to manage multiple emails in a timely manner.
It is with the notions of design and functionality that we took into consideration when conducting our
two part user study; the study was executed by way of observation where users were given a list of
pre-‐determined tasks to be followed and then the users were interviewed about their overall
experience.
In our study, we found that in general, those that are not familiar with using different email
interface’s took more time than those who are in completing the given tasks.
These were examples of a few findings that came about our user study; it highlights overall that there
are some issues with the layout and design which users do not find easily navigable. In the last
section of our interview we has ask users what were some areas in which Yahoo Mail could improve
on. One user, a Teacher Assistant felt that she was unable to efficiently manage her emails to
students in a timely manner.
What our findings had revealed is that the majority our participants voiced the opinion that
Yahoo Mail does have much room to improve its usability and interface design.
Introduction
The interface that my group members and I have decided to re evaluate and redesign is Yahoo Mail,
one of the first popular free email service to be widely used. Today, the number of current users
stands at over 200 million users worldwide. The primary operation of Yahoo Mail is to provide an
electronically asynchronous communication outlet. This involves the ability for users to compose,
send and receive electronic mail (email) and data at any given time; furthermore, the interface
provides a digital space to manage and organize the users’ information.
Motivation and purpose
Problem Statement
Lack of innovation in design has made Yahoo’s email lack in efficiency and user appeal. Problems
with the current interface stems from an arbitrary hierarchy in layout and ambiguity of icons. For
example, there are more icons/tabs, of which are too subjective than need be. Icons and tools are
similar in design and layout which makes for its functions indistinct from others. In combination
with its two tone gray/purple colour scheme Yahoo Mail is uniformly bland and uninviting. In such,
we feel that users are more likely not to engage with the possibilities of the tools that are provided.
Redesign Objectives
Our redesign objective is to create a more efficient email interface that enables users to
compose and receive mail in a more timely manner. In terms of visibility, we find that Yahoo Mail
lacks reorganize and re-‐map its interface for it to be more navigable. In contrast to its current
interface, we will implement a design that will encourage users to make use of the current tools
available but are rarely used enough such as the ‘folder’ tool. Simple but critical tasks such as to
sign-‐out and compose an email need to be more apparent than it is currently. Our aim is to create
distinct and visible design that will invite users to take advantage of the possible tools at hand. The
two tone color of Yahoo Mail layers itself as another detriment to users as it causes an unnecessary
uniformity between icons and tabs where we feel that colour coded icons may result in a more
recognizable and distinctive layout.
Users
As each generation has become more tech savvy, the use of email by users of different
background and age has increase as well. It is nearly a ubiquitous tool today. From public school
students in elementary to high school, university students and companies, email serves a number of
purposes for different groups. It can be fair to note that email use at the younger ages would be
primarily for social purposes. Teenagers in high school and university students will find themselves
contacting a more variety of individuals. For example this is the age where along with social
purposes students will be emailing their teachers, counsellors and also potential employers. And for
any business venture to succeed, it can be argued that email use is a must. In such, the user base of
emails varies across a range of individuals in terms of age, sex, ethnicity etc. And considering at what
stage one is in their lives their use of emails will be likely either for social or professional purposes.
As mentioned earlier, email use has become a near ubiquitous tool in the new media age.
Personas
Persona 1
Kim is a 21 years old business student at Simon Fraser University and is currently interning as
a PR with Blackberry. Not only does Kim juggle homework and work but also involves herself as the
president of the SFU Business Club which has 47 members and volunteers at a youth clinic on the
weekends. She’s highly driven by the desire to succeed and thus time management is critical. There
are always deadlines to be met and meetings not only to attend to but arrange as well. With these
responsibilities Kim finds herself constantly on the move communicating with colleagues, classmates
and club members; her main communication device, the Samsung galaxy receives over 100 emails
and messages on a given day. With the high rate of communicating via emails and text messages, Kim
sometimes confuses between the vast number of contacts she receives messages from and replies
to. Therefore what Kim needs in her life at the moment is a way to improve her time management
and organization. And being able to effectively communicate with others is pivotal for her future
growth in success.
Persona 2
At the age of 55, Frank has been able to retire at a young and able age after 30 years of
teaching High School students. He lives at home with his wife and between his 2 daughters and 3 sons
who have all moved out Frank has 10 grandchildren between the ages of 3 -‐ 9.
Besides traveling, leisure for Frank consists of gardening with his wife, fishing, hiking and golfing if
the weather permits. Frank is old school and up until this year has not used an email account nor does
he communicate with text messaging. But with some of his grandchildren nearing the age of having
phones and using email, Frank felt that he wants the ability to communicate with them more often
since they all live out the province. He has created an email account in past but as someone who does
not regularly engage with new communication technology found it confusing and difficult to
navigate. Therefore what Frank wants is an email interface that is easy to learn and navigate for him
to compose his email.
Context of Use, Scenario and Task
One important and common scenario is the use of Yahoo Mail by college students with part
time jobs and or internships which means there are many branches of different groups you are in
regular contact with. Along with eating breakfast checking emails is one of the first tasks a student
does when they wake up. Emails from your Faculty major, volunteer coordinators, internship
opportunities, friends, classmates, professors, employers etc are common and routine. And with a
high volume of email coming in, one may find themselves composing and sending a fair amount of
emails out to a wide range of individuals as well.
Heuristic Evaluation
Heuristic name Location Severity* Recommendations
Visibility Compose Email –
Reply, Forward, Reply
All Buttons
High All three options are
represented by arrow icons.
These keys are one of the main
features in email interfaces;
they should be less ambiguous.
Visibility Sign out button Medium The Sign out button should be in
a more visible location, instead
of requiring clicking username
Visibility Compose Email key Medium The Compose key should be
more apparent, stand-‐out and
accessible even when the user is
on another tab in yahoo mail.
Feedback Deleting Email High Yahoo Mail should display a
notification to users, telling the
users that an email(s) has moved
to the trash folder.
Constraints Adding grouped
contacts into
recipients while
composing new email
Medium There should be a “select all”
option for users to click in case
of very long / huge contact list
Affordance
(Help and
documentation)
Composing email – cc
and bcc
Low Yahoo Mail should provide a
feature, and option, where users
can toggle a hint box with a
message that teaches users
about how cc and bcc work.
Error Prevention Contacts High When multiple contacts are
selected, the “edit detail”
feature is grey, hinting that it’s
not an available feature;
however, if user double clicks it,
it will lead you to a broken link,
and it cannot be fixed by clicking
“contacts” again. It can only be
fixed by refreshing the whole
page. Yahoo should fix this error;
perhaps by removing the “edit
detail” option when multiple
contacts or selected.
Constraints Adding contacts
while composing
new email
Low There should be an option for
users to edit the grouped
contacts in the tab where users
add contacts to the recipients
while composing a new email.
Constraints
(efficiency of use)
Adding attachment Low User should be able to drag and
drop when adding attachment
Constraints
(efficiency of use)
Send / Save Draft
option while
Composing Email
Medium There should be Send and Save
Draft options at the bottom of
the page where user compose
email.
Visibility Inbox Medium Emails with attachment should
show attachment size on the
inbox menu.
Visibility Inbox -‐ Folder Medium The option of deleting the folder
should be available beside the
folder name.
Visibility Folder – email filter Medium Filter option is in Mail options,
which is quite invisible to new
users. This option should be
available in both Folder and
Inbox.
User study
Hypothesis
Due to Yahoo Mail’s current interface users suffer from an inefficient email service with
irrational layout design, and the multitude of ambiguous icons being the underlying issues. After
completing the user study we found that there were significant evidence that displayed issues in our
participants ability to complete in a timely manner the simple tasks given. For the participants, we
created two sets of tasks and measured the amount of time to complete each set. In conjunction
with the quantitative measure we used direct observation and took note of the change in behaviour
while each tasks is being completed.
To test our hypothesis as accurately possible we created two sets of tasks, basic uses and settings that
most users are likely to be familiar with and followed up with nine questions and ended with a
one-‐one interview.
Tasks
Basic uses
1. Compose an email
2. Upload an (or multiple) attachment)
3. Check in box -‐ open mail -‐ send a bcc/cc -‐ reply/ forward the mail
4. Move to next unread email. Without going back to the inbox
5. Forward an email with an attachment but not include attachment when forwarding
6. Reply to a message
7. Omitting a contact from group email
8. Save draft mail
Settings
9. Create a new contact
10. Block an email
11. Change PW
12. Change settings. (e.g.: theme color)
13. Change Display picture
14. Sign out
The use of email is a near ubiquitous tool used in new media age. With that said the primary
users of this interface that we aimed our redesign towards are teenagers, students and professionals.
Therefore, we decided to include a variety of participants from different backgrounds varying in age,
gender and profession to get a more general picture of those who use email. The results of choosing
a broad scope of participants provides an insightful outlook into our hypothesis.
User study questions
1. What email interface do you primarily use?
2. What is your purpose of using email mostly? (connect with friends / homework / work /
read subscription etc.)
3. How often do you check your e-‐mail (on computer or phone)? (At least once a day / Once
every other day / Once a week / Never)
4. Have you ever used Yahoo email?
5. Did you encounter any problems/obstacles when performing your task? If yes, please
describe.
6. How did you feel about the functions / placement of the icons of Yahoo mail?
7. What do you like about the Yahoo email interface?
8. What do you dislike about the Yahoo email interface
9. Would you consider using Yahoo mail? Why or why not?
The Users Study
The content of the interview covers two main fundamental parts of a public written
correspondence that can be divided into “Design” and “Functionality” category. While users were
asked to do certain tasks we were recorded not only the time but also took note of any significant
change in behaviour and motion such as facial expressions, physical reactions and counting number
of times that they refresh the page or click on the home page.
In our findings what had been revealed is that overall, our participants nearly all agreed that
Yahoo Mail does have much room to improve its usability and interface design.
Users, who did not have an extensive background in using different email interfaces were
more likely to have issues and take more time to complete the given tasks than those who were
known to have experience in using different forms of email have helped us with noticing how a little
lack of hierarchy and consistency can confuse them with their choice. The reactions observed and
recorded from our users led us to the assumption that there are few elements which needs to be
more clear. Thus we followed up with an interview to explore further; for example, when we asked
users who have had basic knowledge of computer to reply or forward an email they some had said
they did not know which icon is for which function.
Before we started our user study with users who were comfortable with working with
different emails including Yahoo, we were under the wrong assumption that we would not observe
significant patterns of use when completing the tasks. Contrary to our initial assumption this group
greatly provided information on what functions are needed to improved Yahoo Mail. For example,
after completing a task like creating new a folder or adding specific emails into that folder, we asked
the user to delete and create a folder but they were unable to. From one participants personal
experience they said “its ok we keep it like this and we will rename the folder later on if I need a new
folder” .
Overall the user study has opened our eyes to recurring issues participants have and in such
invites our group to look into different avenues of solution. After we listened to the needs of users
and discussion that we have had in our group, we have come up with few ideas to how to make this
email server even more efficient. For example, one of our users who is a TA was telling us how she
has difficulty with managing her time and sending out some emails to students at the particular time.
She told us that one day she was suppose to release an email which had a content of assignment
description to all the student and release the email on the given time by the prof, but for some
emergency reason she left her house and did not get back home on the right time so she had to send
the assignments with delay. When we discussed all the user case study in our group we even came up
with a functionality idea such as having an option which will automatically send out emails to the
receiver at the specific time which has been set by user from before.
Number Gender Age Background Reason For Selection
1 F 55
Not very familiar with Yahoo or
other email servers
Uses Yahoo on IPhone
Generation
Gender
Knowledge of
technology
2M 15
Only familiar with basic
functions of Yahoo
Uses Yahoo on PC
Generation
Gender
Occupation
Technology used
3F 25
Familiar with Gmail and Yahoo
Uses both on PC and IPhone
Knowledge of different
email serves
Occupation
4F 38
Only familiar with Yahoo
Uses Yahoo on MacBook Air
Level of comfort with
email servers
Purpose of using email
5M 40
Not familiar with Yahoo at all but
is Gmail user
Uses MacBook
Age
Email servers used
Requirement statement
Functional Requirements
Yahoo! Mail, as an e-‐mail system, is a webmail that offers free e-‐mail services to its users. A
typical e-‐mail system, like that of Yahoo! Mail, is supposed to be able grant the users access to
sending and receiving incoming e-‐mails, and being able to access them with an interface provided
alongside it. In other words, the functional requirements of a webmail are to be able to provide the
users with interfaces that would allow them to receive incoming e-‐mails, send/reply e-‐mails to a
certain or various recipients, and be able to open , view and delete these acquired or delivered
messages as long as they are within access of the user. Even though saving contacts and creating
contact lists are not required functions for a webmail, all webmail services nowadays do possess this
function. Without the presence of any of these requirements, Yahoo! Mail will not be considered as
an e-‐mail system at all.
Non-‐Functional Requirements
The non-‐functional requirements are what make a webmail unique from other e-‐mail service
providers and differentiate it from the others. For instance, Yahoo! Mail has the ability to distinguish
users on the system; it is able to filter incoming e-‐mails according to users’ preference – setting it to
be much like having a specific inbox for messages received from specific addresses. Another
non-‐functional requirement that Yahoo! Mail possess is security throughout the different functions
of the webmail-‐ security against both incoming and outgoing e-‐mails. Yahoo! Mail offers more
features such as: the calendar function which allows users to setup events and reminders for
deadlines and meetings, the yahoo messenger, a customizing features for users to change Yahoo!
Mail’s theme, Email functions such as allowing one or more file attachments, organizing sent e-‐mails,
allowing shortcuts for users to forward or reply to e-‐mails, sending e-‐mails to multiple users, and so
forth.
Prioritization Worksheet
Item Description Business Importance User Importance Technical Feasibility Recourse Availability
Home page layout
Removing Removing the tabs that open Low Medium High High Tabs ĞĂĐŚƟŵĞƚŚĞƵƐĞƌĐůŝĐŬƐŽŶĂůŝŶŬ
Feedback ĚĚŝŶŐĨĞĞĚďĂĐŬƐƵĐŚĂƉŽƉƵƉ ,ŝŐŚ ,ŝŐŚ DĞĚŝƵŵ ,ŝŐŚ ƐŚĂƉĞƚŚĂƚĂƉƉĞĂƌƐǁŚĞŶƚŚĞƵƐĞƌ ĚĞůĞƚĞƐƐŽŵĞƚŚŝŶŐ
Adding more dŚĞŝŵƉŽƌƚĂŶƚƚĂƐŬƐƐƵĐŚĂƐƚŚĞ High High High Highhierarchy ĐŽŵƉŽƐĞďƵƩŽŶǁŝůůďĞǀŝƐŝďůĞďLJĐŚĂŶŐŝŶŐŝƚ ƐĐŽůŽƌĂŶĚƐŚĂƉĞ
Icon Design ŚĂŶŐŝŶŐƚŚĞƌĞƉůLJĂŶĚĨŽƌǁĂƌĚ >Žǁ ,ŝŐŚ DĞĚŝƵŵ ,ŝŐŚ ŝĐŽŶƐƚŽŵŽƌĞĐůĞĂƌŝĐŽŶƐ
Adding ĞůĞƟŶŐǁŝůůďĞĐŽŶƐŝƐƚĞŶƚ >Žǁ ,ŝŐŚ ,ŝŐŚ ,ŝŐŚ Consistency
Bubble ĚĚŝŶŐĂďƵďďůĞůĂLJŽƵƚĨŽƌ DĞĚŝƵŵ DĞĚŝƵŵ DĞĚŝƵŵ ,ŝŐŚlayout ŵĞƐƐĂŐĞƐĞŶƚďĂĐŬĂŶĚĨŽƌƚŚ with the same subject
Changing the home page High High Medium MediumůĂLJŽƵƚƚŽŵƵůƟƉůĞǁŝŶĚŽǁƐƚŚĂƚƌĞƉƌĞƐĞŶƚŝŵƉŽƌƚĂŶƚĨƵŶĐƟŽŶƐƐƵĐŚĂƐĐŽŵƉŽƐĞŝŶďŽdžŵĞƐƐĂŐĞƐĞƚĐ
1
Chapter Two: Design
ƐĨŽƌƚŚĞŽŶǀĞƌƐĂƟŽŶsŝĞǁĨƵŶĐƟŽŶŝƚǁĂƐŝŶƐƉŝƌĞĚďLJƚŚĞƉƉůĞ ƐŵĂŝůŝŶƚĞƌĨĂĐĞǁŚĞƌĞŝŶĞͲŵĂŝůƐĨƌŽŵƚŚĞƐĂŵĞƌĞĐŝƉŝĞŶƚ;ƐͿĂŶĚƚŚĞƐĂŵĞƐƵďũĞĐƚǁŝůůďĞĐůƵƐƚĞƌĞĚƚŽŐĞƚŚĞƌĂŶĚĚŝƐƉůĂLJĞĚĂƐĂůŝƐƚƐŝŵŝůĂƌƚŽŚŽǁĐŽŶǀĞƌƐĂƟŽŶƐĂƌĞĚŝƐƉůĂLJĞĚtŝƚŚƚŚŝƐĨƵŶĐƟŽŶƵƐĞƌƐĐĂŶǀŝĞǁƚŚĞĞŶƟƌĞĐŽŶƚĞdžƚŽĨĂƐŝŶŐůĞĞͲŵĂŝůƚŚƌĞĂĚďĞŝŶŐĚŝƌĞĐƚĞĚƚŽƚŚĞĐŽŶƚĞŶƚƐŝŶŽƚŚĞƌƌĞůĂƚĞĚĞͲŵĂŝůƐǁŝƚŚŽƵƚŶĞĞĚŝŶŐƚŽƐĞĂƌĐŚƵƐŝŶŐƚŚĞƐĞĂƌĐŚďĂƌŽƌƐĐƌŽůůŝŶŐƚŚƌŽƵŐŚƚŚĞŝŶďŽdžƚŽĮŶĚƚŚĞƌĞůĂƚĞĚŵĞƐƐĂŐĞƐĐŚƌŽŶŽůŽŐŝĐĂůůLJhŶĨŽƌƚƵŶĂƚĞůLJ ŽŶǀĞƌƐĂƟŽŶsŝĞǁŝƐŶŽƚĚĞƐŝŐŶĞĚĨŽƌŵĂŶƵĂůƐĞĂƌĐŚŝŶŐĂŶĚŶĂǀŝŐĂƟŽŶĂƐŝƚŚĂƐƚŚĞƚĞŶĚĞŶĐLJƚŽƐƚĂĐŬĞŵĂŝůƐǁŝƚŚƉƌĞǀŝŽƵƐŽŶĞƐ;ƉƌŽǀŝĚĞĚƚŚĞLJĐŽŵĞĨƌŽŵƚŚĞƐĂŵĞƐĞŶĚĞƌͿdŚŝƐǁŝůůƌĞƐƵůƚŝŶƚŽŵĂŬŝŶŐƚŚĞƵƐĞƌ ƐŝŶďŽdžůŽŽŬŽƌŐĂŶŝnjĞĚĂŶĚŶĞĂƚďƵƚĨŽƌƉĞŽƉůĞǁŚŽǁŝůůĮŶĚƚŚĂƚĨĞĂƚƵƌĞŝŶĐŽŶǀĞŶŝĞŶƚƐƟůůǁĞŚĂǀĞƉƌŽǀŝĚĞĚĂŶŽƉƟŽŶĨŽƌƚŚĞŵƚŽƐǁŝƚĐŚŽīŽŶǀĞƌƐĂƟŽŶsŝĞǁ
Design Inspirations, Prior Work & Comparison to Other Existing Interfaces
KƵƌŶĞǁĚĞƐŝŐŶĨŽƌzĂŚŽŽDĂŝůŝƐŝŶƐƉŝƌĞĚŵŽƐƚůLJďLJtŝŶĚŽǁƐϴ ƐĚĞƐŬƚŽƉŝŶƚĞƌĨĂĐĞdŚĞĂďŝůŝƚLJƚŽĚƌĂŐĂŶĚĚƌŽƉŝĐŽŶƐĂŶĚƚŽĐƵƐƚŽŵŝnjĞƚŚĞƐŝĚĞŵĞŶƵĨƌĞĞůLJďĂƐĞĚĨƌŽŵƚŚĞƵƐĞƌƐůŝŬŝŶŐƐĂŶĚƉƌĞĨĞƌĞŶĐĞǁĂƐŝŶƐƉŝƌĞĚďLJďŽƚŚƚŚĞtŝŶĚŽǁƐϴ ƐĚĞƐŬƚŽƉŝŶƚĞƌĨĂĐĞĂŶĚƚŚĞŚŽŵĞͲƐĐƌĞĞŶŝŶƚĞƌĨĂĐĞŽĨŵŽƐƚƐŵĂƌƚͲƉŚŽŶĞƐtŝŶĚŽǁƐϴ ƐĚĞƐŬƚŽƉŝŶƚĞƌĨĂĐĞŝƐĨƌĞĞůLJĐƵƐƚŽŵŝnjĂďůĞůŝŬĞƚŚĞŚŽŵĞͲƐĐƌĞĞŶƐŝŶƚĞƌĨĂĐĞƐŽĨƚŚĞƐŵĂƌƚͲƉŚŽŶĞƐǁĞŚĂǀĞŶŽǁŝĐŽŶƐĐĂŶďĞĞĂƐŝůLJŵŽǀĞĚŐƌŽƵƉĞĚŽƌŐĂŶŝnjĞĚĂŶĚĚĞůĞƚĞĚďLJƐŝŵƉůĞĂĐƟŽŶƐƐƵĐŚĂƐĚƌĂŐŐŝŶŐĂŶĚĚƌŽƉƉŝŶŐ&ŽƌŽƵƌŝĐŽŶƐŶĞǁĚĞƐŝŐŶƐtŝŶĚŽǁƐϴŝŶƐƉŝƌĞĚƵƐƚŽŵĂŬĞƚŚĞŵƐŝŵƉůĞĞůĞŐĂŶƚĂŶĚĐŽŶƐŝƐƚĞŶƚŝŶƚĞƌŵƐŽĨŝƚƐŶĂǀŝŐĂƟŽŶĂŶĚĐŽŶƚƌŽůƐ/ƚƐĚĞƐŝŐŶǁŝůůďĞǀĞƌLJŝŶǀŝƟŶŐƚŽĂŶLJƚLJƉĞŽĨƵƐĞƌƐ
Windows 8
Apple Mail
hƐĞƌƐƉƌĞĨĞƌŵŽƌĞĐƵƐƚŽŵŝnjĂďůĞƐŝŵƉůĞƌĂŶĚŵŽƌĞĐŽŶǀĞŶŝĞŶƚĨĞĂƚƵƌĞƐǁŚĞŶŝƚĐŽŵĞƐƚŽŝŶƚĞƌĨĂĐĞƐŶƐƵƌŝŶŐĞĂƐLJŶĂǀŝŐĂƟŽŶĨŽƌƚŚĞƐĞŵĂŝůŝŶƚĞƌĨĂĐĞƐǁŽƵůĚĂƩĞŶĚƚŽƚŚŝƐĚĞŵĂŶĚŽĨƚŚĞƵƐĞƌƐĂƐĞĚŽŶƚŚĞĚĞƐŝŐŶŝŶƐƉŝƌĂƟŽŶĨƌŽŵtŝŶĚŽǁƐϴĂŶĚƉƉůĞŵĂŝůǁĞĚĞƐŝŐŶĞĚĂŇĞdžŝďůĞŝŶƚĞƌĨĂĐĞǁŚŝĐŚĐĂƚĞƌƐƚŽƚŚĞƐŽĐŝĂůĂŶĚƉƌŽĨĞƐƐŝŽŶĂůŶĞĞĚƐŽĨĞĂĐŚŝŶĚŝǀŝĚƵĂůƵƐĞƌ
2
Conceptual Design A
dŚĞĐŽƌĞŝĚĞĂŽĨŽƵƌƌĞĚĞƐŝŐŶŽďũĞĐƟǀĞŝƐƚŽƐŝŵƉůŝĨLJzĂŚŽŽDĂŝůŝŶƚŽĂŵŽƌĞƐŽƵŶĚĂŶĚĞĸĐŝĞŶƚĞŵĂŝůŝŶƚĞƌĨĂĐĞŵĞĂŶŝŶŐĮƌƐƚďLJŝŵƉƌŽǀŝŶŐĞŵĂŝů ƐŵŽƐƚďĂƐŝĐĂŶĚĞƐƐĞŶƟĂůĨƵŶĐƟŽŶͲƚŽĐŽŵƉŽƐĞĂŶĚƌĞĐĞŝǀĞĞŵĂŝůĂŶĚƐĞĐŽŶĚůLJ ƚŽŝŶĐƌĞĂƐĞƚŚĞƵƐĞƌĂƚĞŽĨƚŚĞĨŽůĚĞƌƐƐƚĂƌƌĞĚĂŶĚƐƉĂŵƚŽŽůƐ <ĞLJƚŽĂĐĐŽŵƉůŝƐŚŝŶŐƚŚŝƐǁĂƐƚŚĞƌĞĚĞƐŝŐŶŽĨƚŚĞŚŽŵĞƉĂŐĞůĂLJŽƵƚtŚĂƚƵƐĞƌƐǁŝůůĮƌƐƚŶŽƟĐĞĂďŽƵƚĐŽŶĐĞƉƚĚĞƐŝŐŶŝƐƚŚĂƚŽŶƚŚĞĞŵĂŝůŚŽŵĞƉĂŐĞЬŽĨƚŚĞƐĐƌĞĞŶŝƐĂƉƉƌŽƉƌŝĂƚĞĚĨŽƌƚŚĞůĞŌƉĂŶĞůĂŶĚвŝƐƉƌŽǀŝĚĞĚĨŽƌƚŚĞ/ŶďŽdžWƌŽǀŝĚĞĚŵŽƌĞƐƉĂĐĞƚŚĞŝŶĐƌĞĂƐĞĚƉĂŶĞůƐŝnjĞǁŝůůŝŶĚŝĐĂƚĞĂŵŽƌĞƐŝŐŶŝĮĐĂŶƚĨƵŶĐƟŽŶƚŽƚŚĞŝŶƚĞƌĨĂĐĞtŝƚŚŝŶƚŚĞůĞŌƉĂŶĞůƚŚĞĐŽŵŵŽŶƚĂďƐƚŽŽůƐͲ/ŶďŽdžƐƚĂƌƌĞĚƌĂŌ^ĞŶƚDĂŝů/ŵƉŽƌƚĂŶƚ:ƵŶŬ^ƉĂŵͲǁŝůůďĞƉƌŽǀŝĚĞĚďƵƚƌĂƚŚĞƌƚŚĂŶũƵƐƚƚĞdžƚƚŚĞŝĐŽŶƐǁŝůůďĞƉƌĞƐĞŶƚŝŶƚŚĞĨŽƌŵŽĨƐƋƵĂƌĞďŽdžĞƐǁŝƚŚŝĐŽŶƐĂŶĚƚĞdžƚƉƌŽĚƵĐŝŶŐŵŽƌĞǀŝƐŝďůĞĂŶĚƌĞĐŽŐŶŝnjĂďůĞƐLJŵďŽůƐ
Design Hypothesis Email versatility - WƌŽǀŝĚĞĚĂŵŽƌĞǀĞƌƐĂƟůĞĂŶĚĐƵƐƚŽŵŝnjĂďůĞŝŶƚĞƌĨĂĐĞƵƐĞƌƐǁŝůůŵŽƌĞĨƌĞƋƵĞŶƚůLJ ĐŽŵŵŝƚĂŶĚŵĂŬĞƵƐĞŽĨƚŚĞĨƵŶĐƟŽŶƐƚŽŽůƐƉƌĞƐĞŶƚ^ĞĐŽŶĚůLJ ǁŝƚŚƚŚĞĂďŝůŝƚLJƚŽĚŽƐŽƵƐĞƌƐǁŝůůĚĞǀŝƐĞĂŶŝŶƚĞƌĨĂĐĞƚŚĂƚďĞƐƚƐƵŝƚƐŽŶĞ ƐƐŽĐŝĂůĂŶĚƉƌŽĨĞƐƐŝŽŶĂůƌĞƋƵŝƌĞŵĞŶƚƐ
Text Messanger EmailͲ/ŶƚƌŽĚƵĐŝŶŐĂƚĞdžƚŵĞƐƐĞŶŐĞƌĞŵĂŝůĨŽƌŵĂƚͲǁŚĞƌĞŵĞƐƐĂŐĞƐĞŶƚĂŶĚƌĞĐŝĞǀĞĂƌĞĐůĞĂƌĂŶĚĚŝƐƟŶŐƵŝƐŚĞĚďLJĂƚĞdžƚďŽdžƉƌŽĚƵĐĞƐĂŵŽƌĞĐŽŶǀĞƌƐĂƟŽŶĂůĂŶĚĂƐLJŶĐƌŽŶŽƵƐĞdžƉĞƌŝĞŶĐĞĨŽƌƵƐĞƌƐ
Large, Distinct Icons -/ŶĐŽŶƚƌĂƐƚƚŽƚŚĞƐƚĂŶĚĂƌĚůŝƐƚĂůŽŶŐƚŚĞůĞŌƉĂŶĞůƵŶŝƋƵĞƐƋƵĂƌĞƐŚĂƉĞŝĐŽŶƐƉƌĞƐĞŶƚƐƚŚĞƚŽŽůƐĨƵŶĐƟŽŶƐĂƐŵŽƌĞĚŝƐĐĞƌŶŝďůĞĂŶĚǁŝůůŝŶĐƌĞĂƐĞƵƐĞĨƌĞƋƵĞŶĐLJ
Drop Shadow & Corner Slits - WƌŽǀŝĚĞƐƚŚĞǀŝƐƵĂůĐůƵĞƚŚĂƚƚŚĞŝĐŽŶƐĂƌĞĂďůĞƚŽƐŚŝŌƉůĂĐĞŵĞŶƚĂŶĚĂůƐŽƚŽďĞƌĞƐŝnjĞĚ
Drag & Drop Function - WƌŽǀŝĚĞƐĂŵŽƌĞƉƌŽĚƵĐƟǀĞŽƉƟŽŶƚŚĂƚŝƐŽĨĂŵŽƌĞŶĂƚƵƌĂůƚƌĂŶƐŝƟŽŶǁŚŝĐŚĞůŝŵŝŶĂƚĞƐƵŶŶĞĐĞƐƐĂƌLJƐƚĞƉƐƚŽĂĚĚƌĞŵŽǀĞŝƚĞŵ
Colour Contrast -/ŶƐƚĞĂĚŽĨƚŚĞƚǁŽƚŽŶĞƐŽĨŐƌĞLJĐƵƌƌĞŶƚůLJƵƐĞĚďůĂĐŬƚĞdžƚĂŶĚǁŚŝƚĞďĂĐŬŐƌŽƵŶĚǁŝůůďĞŝŶƉůĂĐĞĨŽƌĐŽŶĐĞƉƚĚĞƐŝŐŶǁŚŝĐŚĐƌĞĂƚĞƐĂŵŽƌĞĚŝƐƟŶĐƟǀĞǀŝƐŝďŝůŝƚLJŽĨƚŚĞůĂLJŽƵƚ
Interaction Paradigm & Interface Metaphors for Design A
dŚĞŝŶƚĞƌĂĐƟŽŶƉĂƌĂĚŝŐŵŽŶǁŚŝĐŚǁĞďĂƐĞĚŽƵƌĚĞƐŝŐŶĐŽŵĞƐĨƌŽŵƚŚĞĚĞƐŝŐŶĂŶĚƵƐĞŽĨƚŽƵĐŚƐĐƌĞĞŶƐŵĂƌƚƉŚŽŶĞƐͲƚŚĞĚŝƐƟŶŐƵŝƐŚĂďůĞĂŶĚƵŶŝƋƵĞŝĐŽŶƐĂŶĚƚŚĞŶĂƚƵƌĂůĨĞĞůŽĨŶĂǀŝŐĂƟŽŶtĞǀĞĂĐĐŽŵƉůŝƐŚƚŚŝƐďLJĂůůŽǁŝŶŐƵƐĞƌŇĞdžŝďŝůŝƚLJ ŝŶƚĞƌŵƐŽĨĐƵƐƚŽŵŝnjĂƟŽŶĂŶĚĂƚƚŚĞƐĂŵĞƟŵĞƌĞĚĞƐŝŐŶŝŶŐŝĐŽŶƐǁŝƚŚĂĐůĞĂŶĂŶĚŵŽĚĞƌŶĞĚŐĞ^ŝŵŝůĂƌƚŽƚŚĞĐŚĂŶŐĞŝŶƚŚĞƵƐĞƌĨĂĐĞƚŚĂƚƉƌŽĚƵĐĞĚtŝŶĚŽǁƐϴŽƵƌĚĞƐŝŐŶƚĂŬĞƐĂůĞĂƉĨŽƌǁĂƌĚŝŶĐŚĂůůĞŶŐŝŶŐLJĞĂƌƐŽĨƐƚĂŶĚĂƌĚƐŝŶĞŵĂŝůĞƟƋƵĞƩĞƐ DƵĐŚŵŽƌĞĚLJŶĂŵŝĐĨƌŽŵƚŚĞŽůĚŝŶƚĞƌĨĂĐĞĐŽŶĐĞƉƚĐŚĂůůĞŶŐĞƐƚŚĞĐƌĞĂƚĞĚĂŶĚƐƚĂƟĐŶŽƌŵƐŝŵŝůĂƌƚŽǁŚĂƚƚŚĞƵƉĚĂƚĞĚƚŽtŝŶŽǁƐϴĚŝĚ
3
Concept Design B
/ŶƚĞƌĨĂĐĞĂůƚŚŽƵŐŚƐŝŵŝůĂƌŝŶƚŚĞƐƚĂŶĚĂƌĚůĂLJŽƵƚŽĨĞŵĂŝůƐͲƐŵĂůůůĞŌŚĂŶĚƉĂŶĞůĂůŽŶŐǁŝƚŚŽƉĞŶĚŝƐƉůĂLJŽĨƚŚĞŝŶďŽdžͲŝƐŵŽƌĞĞĐŽŶŽŵŝĐĂůŝŶŝƚƐĚĞƐŝŐŶĂŶĚŵĂŬĞƐďĞƩĞƌƵƐĞŽĨƚŚĞůĂLJŽƵƚƐƉĂĐĞ/ŶƚĞƌŵƐŽĨĂŵŽƌĞĞĐŽŶŽŵŝĐƵƐĞŽĨƐƉĂĐĞŝŶƚĞƌĨĂĐĞǁŝůůŽŶůLJĂůůŽǁĨŽƌŽŶĞƚĂďƚŽďĞŽƉĞŶĞĚĂƚŽŶĞƟŵĞůƐŽĨŽĐƵƐŝŶŐŽŶƚŚĞǀŝƐŝďŝůŝƚLJŽĨŽǀĞƌĂůůůĂLJŽƵƚŵĞĂŶƚĨŽƌĂĐŽŵƉůĞƚĞƌĞĚĞƐŝŐŶŽĨƚŚĞŝĐŽŶƐƚŚĂƚĂƌĞĚŝƐƟŶĐƚ^ƵĐŚŝĐŽŶƐĂƐ&ŽůĚĞƌƐǁŝůůďĞƐLJŵďŽůŝnjĞĚďLJĂŶŝŵĂƚĞĚĚƌĂǁŝŶŐƐŝŶƐƚĞĂĚŽĨƚĞdžƚĨĞĞĚďĂĐŬďĂƌĨŽƌǁŚĞŶĂƵƐĞƌĚĞůĞƚĞƐĂŵĞƐƐĂŐĞǁŝůůĂƉƉĞĂƌǁŝƚŚŝŶĂŚŽƌŝnjŽŶƚĂůďĂƌŵŽŵĞŶƚĂƌŝůLJƚŚĞŶŐŽŽīƐĐƌĞĞŶϱƐĞĐŽŶĚƐ
Design Hypothesis
Overall standard email layoutͲWƌĞƐĞŶƚƐĂŵŽƌĞĨĂŵŝůŝĂƌĚĞƐŝŐŶĂŶĚŝŶƚƵƌŶĂŵŽƌĞĞĂƐLJƚƌĂŶƐŝƟŽŶĨŽƌƵƐĞƌƐƚŽĂĚũƵƐƚĂŶĚƚŚƵƐŝŶĐƌĞĂƐĞĞĸĐŝĞŶĐLJŝŶƵƐĞďLJĚĞǀĞůŽƉŝŶŐŽīƚŚĞƐƚĂŶĚĂƌĚůĂLJŽƵƚ
Unique Icon redesignͲDŽƌĞĂƉƉĞĂůŝŶŐŝĐŽŶƐǁŝůůƐƚĂŶĚŽƵƚĂŶĚŝŶǀŝƚĞƵƐĞƌƐƚŚĞƌĞĨŽƌĞŝŶĐƌĞĂƐŝŶŐĨƌĞƋƵĞŶĐLJin use
Single tab windows Ͳ/ŶƐƚĞĂĚŽĨƚŚĞĂďŝůŝƚLJƚŽŽƉĞŶŵƵůƟƉůĞƚĂďƐŽŶůLJďĞŝŶŐĂďůĞƚŽŽƉĞŶŽŶĞƚĂďĞŶĂďůĞƐƵƐĞƌďĞŵŽƌĞĞĸĐŝĞŶƚĂŶĚĨŽĐƵƐŽŶƚŚĞƚĂƐŬĂƚŚĂŶĚ
User Feedback functionͲ/ŵƉŽƌƚĂŶƚĞdžĞĐƚƵƚĞĚƚĂƐŬͲŝĞŵŽǀŝŶŐůŽĐĂƟŽŶŽĨĮůĞƐͲǁŝůůƚƌŝŐŐĞƌĂŵŽŵĞŶƚĂƌLJ;ϱƐĞĐŽŶĚƐͿŶŽƟĮĐĂƟŽŶƉŽƉƵƉ
Interaction Paradigm & Interface Metaphors for Design B
dŚĞŝŶƚĞƌĂĐƟŽŶƉĂƌĂĚŝŐŵƐĞĞŬƐƚŽĞdžƉůŽŝƚƚŚĞƉĞƌĐĞŝǀĞĚŬŶŽǁůĞĚŐĞŽĨƚŚĞƵƐĞƌƐĞdžƉĞƌŝĞŶĐĞǁŝƚŚŽƚŚĞƌĞŵĂŝůƐĞƌǀŝĐĞƐLJĞƚĂƚƚŚĞƐĂŵĞƟŵĞĞĂƐŝůLJĚĞǀĞůŽƉĂƐŬŝůůƐĞƚĨŽƌŶĞǁƵƐĞƌƐƚŚĞƌĞĨŽƌĞĚĞƐŝŐŶǁŝůůĂƚŝƚƐĐŽƌĞƌĞƚĂŝŶŝƚƐŽƉĞƌĂƟŽŶƐŝŵŝůĂƌƚŽƚŚĞƐƚĂŶĚĂƌĚƐŽĨĞŵĂŝůůĂLJŽƵƚƐĞĐĂƵƐĞƚŚĞĨƌĂŵĞŽĨƚŚĞŶĞǁŝŶƚĞƌĨĂĐĞŝƐƐŝŵŝůĂƌŝŶƐŚĂƉĞƚŽƚŚĞŽůĚƚŚĞŵĞƚĂƉŚŽƌƚŚĂƚďĞƐƚĚĞƐĐƌŝďĞƐŝƐůŝŬĞŚĂǀŝŶŐĂŶŽůĚŚĞĂǀLJŵŽƵŶƚĂŝŶďŝŬĞƚŽƌŝĚĞĂƌŽƵŶĚŝŶƚŚĞĐŝƚLJĂŶĚƵƉŐƌĂĚŝŶŐƚŽĂďƌĂŶĚŶĞǁƌŽĂĚďŝŬĞƚŚĞďŝŬĞ ƐĨƌĂŵĞŝƐůŝŐŚƚŝŶǁĞŝŐŚƚĂŶĚŚĂƐůĞƐƐŐĞĂƌƐǁŚŝĐŚƐƵŝƚƐƚŚĞĐŽŵŵƵƚĞŽŶƚŚĞĐŝƚLJƌŽĂĚdŚĞŵŽƵŶƚĂŝŶďŝŬĞŽŶĂĐŝƚLJƌŽĂĚŝƐǁŚĂƚƚŚĞŽůĚzĂŚŽŽDĂŝůǁĂƐƚŽƵƐĞƌƐͲƚŽŽŵĂŶLJƵŶĞĐĞƐƐĂƌLJĨĞĂƚƵƌĞƐŽƉƟŽŶƐǁŚĞƌĞĂƐĂƌŽĂĚďŝŬĞƐŝŵƉůĞLJĞƚĞdžĂĐƚůLJǁŚĂƚŽŶĞŶĞĞĚƐŽŶƚŚĞƌŽĂĚŝƐŚŽǁŝŶƚĞƌĨĂĐĞƉĞƌĨŽƌŵƐ
4
Comparison of Conceptual Design A and B
Aspect to compare Concept Design A Concept Design B
Overall Web Layout A unique layout, with emphasis on the use A economic use of space in standard ŽĨƚŚĞƚŽŽůƐƉƌŽǀŝĚĞĚďLJĚĞƐŝŐŶĂƟŶŐŵŽƌĞĞŵĂŝůůĂLJŽƵƚ/ĐŽŶƐŽŶƚŚĞůĞŌƉĂŶĞůĂƌĞ ƐƉĂĐĞĨŽƌƚŚĞůĞŌƉĂŶĞůĂŶĚŝƚƐƚĂďƐůŝƐƚĞĚ
User Flexibility hƐĞƌƐĂƌĞĂďůĞƚŽŐƌŽƵƉĂĚĚĚĞůĞƚĞƚĂďƐ>ŽĐĂƟŽŶĂŶĚƐŝnjĞŽĨƚĂďƐĂƌĞƉƌĞƐĞƚ ƚŽŽŶĞƐŽǁŶƉƌĞĨĞƌĞŶĐĞ ƚŽĚĞĨĂƵůƚƐĞƫŶŐ
Icon Design Large unique icons within squares Small unique icons within squares
User Feedback A momentary message will appear - message sent to trash - when an important ĂĐƟŽŶͲĚĞůĞƚĞĞŵĂŝůŝƐĞdžĞĐƵƚĞĚ
Text Messenger Email DĞƐƐĂŐĞƐƌĞĐĞŝǀĞĚĂŶĚƐĞŶƚǁŝůůďĞŝŶƚŚĞĨŽƌŵĂƚƐŝŵŝůĂƌƚŽƚŚĂƚŽĨƚĞdžƚŵĞƐƐĂŐĞƐŽŶŽŶĞƐƉŚŽŶĞ ǁŚĞƌĞĐŽŶǀĞƌƐĂƟŽŶďƵďďůĞƐĚŝƐƟŶŐƵŝƐŚƚŚĞƚǁŽ
Preattentive Processing
ĐĐŽƌĚŝŶŐƚŽŽůŝŶtĂƌĞĞǀĞŶďĞĨŽƌĞĐŽŶƐĐŝŽƵƐĂǁĂƌĞŶĞƐƐĐĞƌƚĂŝŶƐŚĂƉĞƐĂŶĚĐŽůŽƵƌƐƉŽƉŽƵƚĨƌŽŵƚŚĞďĂĐŬŐƌŽƵŶĚĂŶĚŝƚŵŽƐƚƵƐĞĨƵůƚŽŚĂǀĞƚŚŝŶŐƐƐŚŽǁĂƚĂŐůĂŶĐĞ dŽŝŶƐƚĂŶƚůLJƌĞĐŽŐŶŝnjĞĂĚĞƐŝƌĞĚŽďũĞĐƚĨƵŶĐƟŽŶŝƚƐŚŽƵůĚďĞƉƌĞĂƩĞŶƟǀĞůLJĚŝīĞƌĞŶƚĨƌŽŵŽƚŚĞƌƐdĂŬĞŶŝŶƚŽĐŽŶƐŝĚĞƌĂƟŽŶƚŚĞĐŽŶĐĞƉƚŽĨƉƌĞĂƩĞŶƟǀĞƉƌŽĐĞƐƐŝŶŐĂŶĚĨŽƌŵƐƚŚĂƚĂƌĞŬŶŽǁŶƚŽďĞƉƌĞĂƩĞŶƟǀĞůLJƉƌŽĐĞƐƐĞĚƐƵĐŚĂƐĐŽůŽƌ ŝŶƚĞŶƐŝƚLJĂŶĚƐƉĂƟĂůƉŽƐŝƟŽŶŝƐĂƉƉůŝĞĚƚŽƚŚĞƌĞĚĞƐŝŐŶŽĨƚŚĞŝĐŽŶƐĂĐŚŝŶĚŝǀŝĚƵĂůĨƵŶĐƟŽŶͲĨŽůĚĞƌ ƐƚĂƌƌĞĚƚƌĂƐŚĞƚĐͲŚĂǀĞƵŶŝƋƵĞƐLJŵďŽůƐďƵƚĂƌĞĂůůĐŽŶƚĂŝŶĞĚǁŝƚŚŝŶĂƉƵƌƉůĞƐƋƵĂƌĞƚĂďƚĂŐůĂŶĐĞƚŚĞŝĐŽŶƐĂƌĞŐƌŽƵƉĞĚŝŶƐŝŵŝůĂƌĨŽƌŵƐǁŝƚŚŝŶƐƋƵĂƌĞƚĂďƐďƵƚĞĂĐŚĚĞůŝŶĞĂƚĞƐĨƌŽŵƚŚĞŽƚŚĞƌƚŚĂƚŝƐƐƵďƚůĞLJĞƚĚŝƐƟŶĐƚĂŶĚƐƚĂŶĚƐŽƵƚ
Figure - Ground & Proximity
dŽĞdžĞĐƵƚĞĂŵŽƌĞĐůĞĂƌŝŶƚĞƌĨĂĐĞďŽƚŚŽƵƌĚĞƐŝŐŶƐŝŶƚŚĞŝƌďĂůĂŶĐĞŝŶƌĂƟŽďĞƚǁĞĞŶŝĐŽŶƐĨƵŶĐƟŽŶƐ;ŽďũĞĐƚͿĂŶĚǁŚŝƚĞƐƉĂĐĞ;ďĂĐŬŐƌŽƵŶĚͿĞdžĞŵƉůŝĨLJƚŚĞƉƌŝŶĐŝƉůĞŽĨĂďĂůĂŶĐĞŝŶĮŐƵƌĞŐƌŽƵŶĚƌĞůĂƟŽŶƐŚŝƉ'ĞƐƚĂůƚƐƚĂƚĞƐ that when similar elements are placed close together, they are seen as a group rather than individual ĨƌĂŐŵĞŶƚƐƐŽǁŝƚŚƐƋƵĂƌĞƚĂďƐĂŶĚŝĐŽŶƐǁĞŚĂǀĞŐƌŽƵƉĞĚŬĞLJƚŽŽůƐĨƵŶĐƟŽŶƐŝŶĐůŽƐĞƉƌŽdžŝŵŝƚLJƚŽŽŶĞĂŶŽƚŚĞƌ Continuation and Closure
dŚĞĚĞƐŝŐŶŽĨƚŚĞŝĐŽŶƐƚĂŬĞƌĞĨĞƌĞŶĐĞƚŽƚǁŽ'ĞƐƚĂůƚƉƌŝŶĐŝƉůĞƐŽŶƟŶƵĂƟŽŶĂŶĚůŽƐƵƌĞdŚĞŝĐŽŶƐĂƌĞĚĞƐŝŐŶĞĚƚŽĞŶŐĂŐĞƚŚĞĞLJĞƚŽŵŽǀĞĐŽŶƟŶƵĂůůLJƚŚƌŽƵŐŚĂŶŽďũĞĐƚĂŶĚĂƚƚŚĞƐĂŵĞƟŵĞƚŚĞŝĐŽŶ ƐĨĞĂƚƵƌĞƐĂƌĞůĞŌŝŶĐŽŵƉůĞƚĞďƵƚĚŝƐĐĞƌŶŝďůĞĨŽƌƵƐĞƌƐƚŽƐĞĞĂƐǁŚŽůĞ
Re!ection: Designing for Humans
5
Compose
Inbox draft
sentfolders
YAHOO! MAIL search webmail
Hi, Kim!
contact calendertrash spam
Sort by date Page 1
SFU User Study Date
sign out
Move Spam ActionsDelete
Compose
Inbox draft
sentfolders
YAHOO! MAIL search webmail
Hi, Kim!
contact calendertrash spam
Sort by date Page 1
SFU User Study Date
sign out
Move Spam ActionsDelete
Compose
Inbox Draft
SentFolders
Sign outYAHOO! MAIL Search WebMail
Hi, Kim!
Contact CalenderTrash Spam
SFU Date
Date
User Study
Hi,The user study questions and heuristic evaluation is attached below.
Thanks
Move Spam ActionsDelete
Hi,Thanks, I think one of the attachments is missing.
Thanks
Me
ReplyForward
Compose
Inbox Draft
SentFolders
Sign outYAHOO! MAIL Search WebMail
Hi, Kim!
Contact CalenderTrash Spam
To:SFU
From: IAT 201Cc+ Bcc
This is where the user has the text edit otions
Hi,The missing file is attached now.
Thanks
IAT201
Send Save Draft
Send Save Draft
YAHOO ! MAIL
Inbox
Sent
Draft
Spam
Trash
Conversations
Folders
Applications
Hi, Kim
Sign Out
Email Search Web Search
Delete Move Spam Actions
Sort By Date
SFU IAT 201 Date
Page1
YAHOO ! MAIL
Inbox
Sent
Draft
Spam
Trash
Conversations
Folders
Applications
Hi, Kim
Sign Out
Email Search Web Search
Delete Move Spam Actions
Sort By Date
SFU IAT 201 Date
Page1
YAHOO ! MAIL
Inbox
Sent
Draft
Spam
Trash
Conversations
Folders
Applications
Hi, Kim
Sign Out
Email Search Web Search
Delete Move Spam Actions
From:SFU
To:IAT 201
Hi,
The user study quetions are attached below.
Thanks
Date
YAHOO ! MAIL
Inbox
Sent
Draft
Spam
Trash
Conversations
Folders
Applications
Hi, Kim
Sign Out
Email Search Web Search
To:IAT 201
Subject: User Study Questions
Hi,
Thanks, one of the attachments is missing.
Thanks
Date
Attachments This the text edit area for the user
Save Draft
+ CC BCC
Send
Re!ection: Insights & Lessons Learned
Insights From User Testing, Feedback & Discussion
ĂƐĞĚŽŶŽƵƌƵƐĞƌƐƚƵĚLJŝŶƚŚĞƉƌĞǀŝŽƵƐĐŚĂƉƚĞƌ ŝƚŝƐĐůĞĂƌƚŚĂƚŵĂŶLJƵƐĞƌƐͲŽŌĞŶƚŚŽƐĞŶŽƚĨĂŵŝůŝĂƌǁŝƚŚƵƐŝŶŐĚŝīĞƌĞŶƚĞŵĂŝůƉƌŽǀŝĚĞƌƐͲĮŶĚzĂŚŽŽDĂŝůĚŝĸĐƵůƚƚŽŶĂǀŝŐĂƚĞĂŶĚĞdžĞĐƵƚĞďĂƐŝĐƚĂƐŬƐdŚĞƌĞǁĞƌĞŵƵůŝƉůĞĐĂƐĞƐǁŚĞƌĞƚŚĞƉĂƌƟĐŝƉĂŶƚƐŝŵƉůLJĚŝĚŶŽƚŬŶŽǁŚŽǁƚŽĞdžĞĐƵƚĞƚŚĞƚĂƐŬƐĂƚŚĂŶĚdŚĞƌĞĨŽƌĞĨŽƌŽƵƌĚĞƐŝŐŶƐƚƌĂƚĞŐLJǁĞǁƌŽƚĞŽŶĂďůĂĐŬďŽĂƌĚĮƌƐƚǁŚĂƚǁĞĂƐĂŐƌŽƵƉƚŚŽƵŐŚƚŽĨĂƐƚŚĞKE^ŽĨzĂŚŽŽDĂŝůĂŶĚƐĞĐŽŶĚůLJ ǁŚĂƚŝƐƐƵĞƐĚŝĚƚŚĞƉĂƌƟĐŝƉĂŶƚƐĮŶĚĚƵƌŝŶŐƵƐĞƌƐƚƵĚLJ/ƚǁĂƐŝŶƚŚŝƐǀŝĞǁŽƵƌƉĞƌĐŝĞǀĞĚĂŶĚƚŚĞĂĐƚƵĂůŝƐƐƵĞƐͲĨƌŽŵƚŚĞǀŝĞǁŽĨƚŚĞƉĂƌƟĐŝƉĂŶƚƐͲǁŝƚŚzĂŚŽŽDĂŝůƚŚĂƚĚƌŽǀĞƚŚĞĚĞƐŝŐŶƐƚƌĂƚĞŐLJŽĨ/Ϯ
Insights From Prototyping
tŝƚŚĨŽĐƵƐŽŶŚŝĞƌĂƌĐŚLJĂŶĚŝĐŽŶĚĞƐŝŐŶǁĞĂŝŵĞĚƚŽƚŽƐŝŵƉůŝĨLJƚŚĞƚŽŽůƐĂƚŚĂŶĚŽƵƌƉůĂŶǁĂƐƚŽƉƌŽǀŝĚĞƵƐĞƌƐŽůĚĂŶĚŶĞǁĂĨĂƐƚĞƌĞŵĂŝůŝŶƚĞƌĨĂĐĞǁŚŝůĞďĞŝŶŐǀŝƐƵĂůůLJĞŶŐĂŐŝŶŐdŚĞƌĞƐƵůƚŽĨŽƵƌƌĞƐĞĂƌĐŚĚĞƐŝŐŶĂŶĚĞdžĞĐƵƟŽŶŽĨďŽƚŚƉƌŽƚŽLJƉĞĂŶĚǁĂƐĂƐƵĐĐĞƐƐŝŶǁŚŝĐŚŽƵƌƉƌŝŵĂƌLJƌĞĚͲĚĞƐŝŶŐŐŽĂůƐǁĞƌĞƌĞĂĐŚĞĚdŚŽƵŐŚƐŝŐŶŝĮĐĂŶƚůLJĚŝīĞƌĞŶƚŝŶƚŚĞŝƌůĂLJŽƵƚĂŶĚŝƐĚĞƐŝŐŶĞĚǁŝƚŚĂďĂůĂŶĐĞŝŶƚŚĞŚŝĞƌĂƌĐŚLJƚŽƉƌŽǀŝĚĞĂĐůĞĂƌŝŶƚĞƌĨĂĐĞƚŚĂƚŚĂƐƌĞĚƵĐĞĚƚŚĞƐƚĞƉƐĂŶĚƟŵĞƐƉĞŶƚƚŽĐŽŵƉůĞƚĞďĂƐŝĐƚĂƐŬƐƐƵĐŚĂƐĐŽŵƉŽƐŝŶŐĂŶĞŵĂŝů
Storyboard For Project Video
A
B
C
Chapter Four: Evaluation
Goals of Evaluation Study
dŚĞŐŽĂůŽĨƚŚŝƐĞǀĂůƵĂƟŽŶƐƚƵĚLJǁĂƐƚŽŐŝǀĞŶƚŚĞĚĞƐŝŐŶŽĨƚŚĞƚǁŽƉƌŽƚŽƚLJƉĞƐĚĞƚĞƌŵŝŶĞƚŚĞďĞƐƚƉŽƐƐŝďůĞĂůƚĞƌŶĂƟǀĞƚŽƚŚĞĐƵƌƌĞŶƚzĂŚŽŽDĂŝůŝŶƚĞƌĨĂĐĞWƌŽƚŽƚLJƉĞǁĂƐĂƌĞƐƵůƚŽĨƉůĂŶƐƚŽŝŶƚƌŽĚƵĐĞĂŵŽƌĞŇĞdžŝďůĞĞŵĂŝůŝŶƚĞƌĨĂĐĞƚŚĂƚƐƵŝƚƐƵƐĞƌƐŝŶĚŝǀŝĚƵĂůŶĞĞĚƐdŚŝƐĂŝŵůĞĚƚŽĂĚƌĂƐƟĐƌĞĚĞƐŝŐŶŽĨƚŚĞzĂŚŽŽDĂŝůůĂLJŽƵƚtŚĞƌĞĂƐǁŝƚŚWƌŽƚŽƚLJƉĞƚŚĞŝŶƚĞƌĨĂĐĞǁĂƐĚĞƐŝŐŶĞĚŝŶĂŵĂŶŶĞƌƐŝŵŝůĂƌƚŽƚŚĞƐƚĂŶĚĂƌĚĞŵĂŝůůĂLJŽƵƚdŚĞůŽŐŝĐďĞŝŶŐĂůŽŶŐǁŝƚŚŽƵƌĚĞƐŝŐŶĂĚũƵƐƚŵĞŶƚƐƵƐĞƌĨĂŵŝůŝĂƌŝƚLJƉƌŽǀŝĚĞƐĂŵŽƌĞĞīĞĐƟǀĞĞŵĂŝůĞdžƉĞƌŝĞŶĐĞ/ƚǁĂƐǁŝƚŚŝŶƚŚĞĨƌĂŵĞǁŽƌŬŽĨŽƵƌŐŽĂůƐĨŽƌĞĂĐŚƉƌŽƚŽƚLJƉĞƚŚĂƚǁĞŚĂĚĚĞǀŝƐĞĚƚŚĞĨŽůůŽǁŝŶŐĞǀĂůƵĂƟŽŶ
Questions & Hypothesis Addressed by the Evaluation
Prototype A
;ĂͿdŚĞůĂƌŐĞƌĞĚĞƐŝŐŶĞĚŝĐŽŶƐƌĞƐƵůƚƐŝŶŚŝŐŚǀŝƐŝďŝůŝƚLJĂŶĚŝŶĐƌĞĂƐĞƐƌĂƚĞŽĨƵƐĞ
;ďͿdŚĞĐŽŶǀĞƌƐĂƟŽŶďƵďďůĞǀŝĞǁƉƌŽǀŝĚĞƐĂůĞƐƐĐůƵƩĞƌĞĚůĂLJŽƵƚĂŶĚĂůůŽǁƐƵƐĞƌƐƚŽĚŝƐƟŶŐƵŝƐŚŵŽƌĞ ĐůĞĂƌůLJďĞƚǁĞĞŶƐĞŶƚĂŶĚƌĞĐŝĞǀĞĚĞŵĂŝůƐ ;ĐͿZĂƚŚĞƌƵƐŝŶŐƌŝŐŚƚĐůŝĐŬƚŚĞĚƌĂŐĂŶĚĚƌŽƉĨƵŶĐƟŽŶŝŶĚĞƐŝŐŶĂůůŽǁƐĂŵŽƌĞŶĂƚƵƌĂůĂŶĚŇĞdžŝďůĞ ƚƌĂŶƐŝƟŽŶƚŽĐŽŵƉůĞƚĞƚĂƐŬƐ
Prototype B
;ĂͿdŚĞƐƚĂŶĚĂƌĚĨĂŵŝůŝĂƌůĂLJŽƵƚŽĨĚĞƐŝŐŶƉƌŽǀŝĚĞƐĂŵŽƌĞŶĂǀŝŐĂďůĞŝŶƚĞƌĨĂĐĞƚŚĂŶĚĞƐŝŐŶ
;ͿůůŽǁŝŶŐƵƐĞƌƐƚŽŽƉĞŶŽŶĞƚĂďĂƚĂƟŵĞĞŶĂďůĞƐƵƐĞƌƐƚŽďĞŵŽƌĞĞĸĐŝĞŶƚďLJĨŽĐƵƐŝŶŐŽŶƚŚĞƚĂƐŬ ĂƚŚĂŶĚ
Design Evaluation Methods
/ŶƚŚĞƚĂďůĞďĞůŽǁƵƐĞƌƐĂƌĞůŝƐƚĞĚŝŶƚŚĞŽƌĚĞƌŝŶǁŚŝĐŚƚŚĞLJƉĂƌƟĐŝƉĂƚĞĚŝŶƚŚĞƐƚƵĚLJdŚĞƵƐĞƌƐƚƵĚLJƚŽŽŬƉůĂĐĞŝŶƚŚĞƐƉĂŶŽĨƌŽƵŐŚůLJϮŚŽƵƌƐĂƚ^&hƐƵƌƌĞLJ
WĂƌƟĐŝƉĂŶƚ 'ĞŶĚĞƌŐĞ ZĞĂƐŽŶĨŽƌ^ĞůĞĐƟŽŶ
1 M 19 Represents frequent users of email - University student who ŵĂŶĂŐĞƐŵƵůƟƉůĞĞŵĂŝůƐĚĂŝůLJ
Ϯ & ϯϬZĞƉƌĞƐĞŶƚƐĨƌĞƋƵĞŶƚƵƐĞƌƐŽĨĞŵĂŝůͲWƌŽĨĞƐƐŝŽŶĂůǁŚŽƌŽƵƟŶĞůLJ ůŝĂŝƐŽŶƐďĞƚǁĞĞŶĐůŝĞŶƚƐĂŶĚĐŽůůĞĂŐƵĞƐƉƌŝŵĂƌŝůLJǀŝĂĞŵĂŝů
3 F 28 Represents moderate users of email - Email is used primarily for social purposes only: sending and recieving emails to and from friends and family
4 M 28 Represents frequent users of email - A professional who is familiar with using up to date technology; relies on computer, phone and ĞŵĂŝůĨŽƌǁŽƌŬ
5 F 36 Represents moderate/low users of email - Not experienced in using ĐƵƌƌĞŶƚƚĞůĞĐŽŵŵƵŶŝĐĂƟŽŶƚĞĐŚŶŽůŽŐLJWƌŝŵĂƌLJƵƐĞŝƐĨŽƌƐĞŶĚŝŶŐ and receiving emails from family and friends
6 M 18 Represents frequent users of email - College student, who is ĨĂŵŝůŝĂƌĂŶĚĞdžƉĞƌŝĞŶĐĞĚŝŶƵƐŝŶŐĂǀĂƌŝĞƚLJŽĨƚĞůĞĐŽŵŵƵŶŝĐĂƟŽŶ technology, ie: instant and text messaging, skype, and emails
Materials
>ŽĐĂƟŽŶŽĨƐƚƵĚLJǁĂƐĐŽŵƉůĞƚĞĚŝŶƚǁŽůŽĐĂƟŽŶƐŽĨƚǁŽŐƌŽƵƉŵĞŵĞďĞƌƐdŚĞŵĂƚĞƌŝĂůƐǁĞƵƐĞĚĐŽŶƐŝƐƚĞĚŽĨĂŶŽƚĞƉĂĚƉĞŶĂŶĚƟŵĞƌ ĞĨŽƌĞƚŚĞƐƚĂƌƚŽĨƚŚĞƚĂƐŬKŶĞŐƌŽƵƉŵĞŵďĞƌǁŽƵůĚŐŝǀĞĂŐĞŶĞƌĂůŽǀĞƌǀŝĞǁŽĨƚŚĞƵƉĐŽŵŝŶŐƚĂƐŬdŚĞĮƌƐƚƚŚƌĞĞƉĂƌƟĐŝƉĂŶƚƐůŝĐŝĂ ƐĨĂŵŝůLJŵĞŵďĞƌƐďĞŐĂŶƚŚĞƐƚƵĚLJďLJĐŽŵƉůĞƟŶŐĞƐŝŐŶĨŽůůŽǁĞĚďLJĞƐŝŐŶdŚĞŽƌĚĞƌĨŽƌƚŚĞůĂƩĞƌƚŚƌĞĞƉĂƌƟĐŝƉĂŶƚƐĨƌŝĞŶĚƐĂŶĚĨĂŵŝůLJŵĞŵďĞƌƐŽĨ:ŽŚŶ ƐǁĞƌĞƌĞǀĞƌƐĞĚǁŝƚŚĞƐŝŐŶďĞŝŶŐĐŽŵƉůĞƚĞĚĮƌƐƚ
ĂƚĂŽůůĞĐƟŽŶ &ŽƌĞĂĐŚƉĂƌƟĐŝƉĂŶƚƚŚĞƌĞǁĞƌĞƚŚƌĞĞĂĐƟǀĞŐƌŽƵƉŵĞŵďĞƌƐŵĞĂƐƵƌŝŶŐƚŚĞĨŽůůŽǁŝŶŐ ϭdŝŵĞƚŽĐŽŵƉůĞƚĞĞĂĐŚƚĂƐŬ ϮĞŚĂǀŝŽƌ ϯEƵŵďĞƌŽĨƚŽƚĂůĐůŝĐŬƐ &ƵƌƚŚĞƌŵŽƌĞƉĂƌƚĐŝƉĂŵƚƐǁĞƌĞĂƐŬƚŽƐƉĞĂŬĂůŽƵĚĂŶĚďƌŝĞŇLJĚĞƐĐƌŝďĞĂŶLJŝƌƌĞŐƵůĂƌŝƚĞƐ
Instructions and Task Description
Tasks
The following tasks were presented to participants on a sheet of paper, which they were able to revert back to if necessary.
Task One:
Search for an e-mail which its content is about “the most recent changes made in the recent ƉƌŽũĞĐƚŶĂŵĞĚ/dϮϬϭ;hƐĞƌƐǁŝůůŽŶůLJďĞŐŝǀĞŶƚŚŝƐŝŶĨŽƌŵĂƟŽŶǁĞǁŝůůŶŽƚƚĞůůƚŚĞŵƚŚĞƐĞŶĚĞƌŽĨƚŚĞ e-mail and possible keywords which are in the contents of the e-mail)
Task Two:
ZĞƉůLJƚŽĂůů/dϮϬϭ'ƌŽƵƉŵĂƚĞƐ ĞdžĐĞƉƚ^ĂŶĚLJ ǁŝƚŚƚŚĞŵĞƐƐĂŐĞ/ŐŽƚŝƚƚŚĂŶŬLJŽƵ
Task Three:
DŽǀĞĂůůĞͲŵĂŝůƐƚŚĂƚĂƌĞƟƚůĞĚϮϬϭƚŽƚŚĞƉƌŽũĞĐƚ/dϮϬϭ ŝŶĐůƵĚŝŶŐƚŚĞĞͲŵĂŝůŝŶƚŚĞƉƌĞǀŝŽƵƐƚĂƐŬ ƚŽĨŽůĚĞƌŶĂŵĞĚ,ŽŵĞǁŽƌŬ;^ŚŽƵůĚďĞϳͲŵĂŝůƐŝŶƚŽƚĂůϯĞͲŵĂŝůĨŽƌƉƌŽƚŽƚLJƉĞͿ
Task Four:
DŽǀĞƚŽŶĞdžƚƵŶƌĞĂĚĞͲŵĂŝůǁŝƚŚŽƵƚŐŽŝŶŐďĂĐŬƚŽƚŚĞŝŶďŽdžƌĞƉůLJƚŽƚŚĞĞͲŵĂŝůǁŝƚŚƚŚĞŵĞƐƐĂŐĞ /ŐŽƚŝƚƚŚĂŶŬLJŽƵ
Task 5:
CŽŵƉŽƐĞĂŶĞǁĞͲŵĂŝůhƉůŽĂĚĂŶĂƩĂĐŚŵĞŶƚĂŶĚƐĞŶĚƚŚĞĞͲŵĂŝů
YƵĞƐƟŽŶŶĂŝƌĞ
ŌĞƌƚŚĞƚĂƐŬƐĨŽƌďŽƚŚƉƌŽƚŽƚLJƉĞƐǁĞƌĞĐŽŵƉůĞƚĞĚƵƐĞƌƐǁĞƌĞĂƐŬĞĚƚŽĐŽŵƉůĞƚĞƚŚĞĨŽůůŽǁŝŶŐƋƵĞƐƟŽŶƐ
ϭZĂƚĞƚŚĞůĞǀĞůŽĨĚŝĸĐƵůƚLJƚŽĐŽŵƉůĞƚĞƚŚĞƌĞƋƵŝƌĞĚƚĂƐŬƐĨŽƌ
Prototype A: Very Easy 1 2 3 4 5 sĞƌLJŝĸĐƵůƚ Prototype B: Very Easy 1 2 3 4 5 sĞƌLJŝĸĐƵůƚ
ϮZĂƚĞƚŚĞǀŝƐŝďŝůŝƚLJŽĨƚŚĞŝĐŽŶƐƚŽŽůƐŝŶƚŚĞůĞŌĐŽůƵŵŶĨŽƌ
Prototype A: Very Poor 1 2 3 4 5 džĐĞůůĞŶƚ Prototype B: Very Poor 1 2 3 4 5 džĐĞůůĞŶƚ
ϯZĂƚĞƚŚĞŽǀĞƌĂůůĂĞƐƚŚĞƟĐƐŽĨƚŚĞŝĐŽŶƐ
Prototype A: Very Poor 1 2 3 4 5 džĐĞůůĞŶƚ Prototype B: Very Poor 1 2 3 4 5 džĐĞůůĞŶƚ
ϰZĂƚĞƚŚĞĂĞƐƚŚĞƟĐƐŽĨƚŚĞŽǀĞƌĂůůǁĞďůĂLJŽƵƚĨŽƌ
WƌŽƚŽƚLJƉĞ Very Poor 1 2 3 4 5 Excellent WƌŽƚŽƚLJƉĞ Very Poor 1 2 3 4 5 Excellent
ϱKƵƚŽĨWƌŽƚŽƚLJƉĞĂŶĚWƌŽƚŽƚLJƉĞǁŚŝĐŚĚŽLJŽƵĮŶĚŵŽƐƚǀŝƐƵĂůůLJĂƉƉĞĂůŝŶŐ
WƌŽƚŽLJƉĞ WƌŽƚŽƚLJƉĞ
ϲKƵƚŽĨWƌŽƚŽƚLJƉĞĂŶĚWƌŽƚŽLJƉĞǁŚŝĐŚĚŝĚLJŽƵĮŶĚŵŽƌĞĞĂƐLJƚŽƵƐĞĂŶĚƚŽĐŽŵƉůĞƚĞĞĂĐŚƚĂƐŬ
WƌŽƚŽLJƉĞ WƌŽƚŽƚLJƉĞ
ϳtŚĂƚĞŵĂŝůŝŶƚĞƌĨĂĐĞĚŽLJŽƵĮŶĚŝŶŐĞŶĞƌĂůŝƐƚŚĞďĞƐƚŽǀĞƌĂůů
WƌŽƚŽƚLJƉĞ WƌŽƚŽƚLJƉĞ
ϴ&ƌŽŵƚŚĞĂŶƐǁĞƌƉƌŽǀŝĚĞĚŝŶƋƵĞƐƟŽŶϳǁŽƵůĚLJŽƵĐŽŶƐŝĚĞƌƵƐŝŶŐƚŚŝƐWƌŽƚŽƚLJƉĞŽŶĂƌĞĨŐƵůĂƌďĂƐŝƐ
zĞƐ EŽ
Experimental Design & Procedure
ϭ&ŝůůŽƵƚŝŶĨŽƌŵĞĚĐŽŶƐĞŶƚĨŽƌŵ ϮdžƉůĂŶĂƟŽŶĂŶĚŽǀĞƌǀŝĞǁŽĨƚŚĞƚĂƐŬƐhƐĞƌƐĂƌĞŶŽƟĮĞĚƚŚĞLJǁŝůůďĞĐŽŵƉůĞƟŶŐƚĂƐŬƐ ĨŽƌĞĂĐŚƉƌŽƚŽƚLJƉĞ (a) Speak out loud ;ďͿ/ĨƚŚĞƌĞĂŶLJƋƵĞƐƟŽŶƐƉůĞĂƐĞĂƐŬŶŽǁ ;ĐͿ/ĨƚŚĞƌĞĂƌĞĂŶLJƋƵĞƐƟŽŶƐĚƵƌŝŶŐƚŚĞƐƚƵĚLJƐĂLJdŝŵĞĂŶĚƟŵĞƌǁŝůůƐƚŽƉ ;ĚͿhƐĞƌƐǁŝůůĐŽŵƉůĞƚĞĂϴͲƋƵĞƐƟŽŶƐƵƌǀĞLJĂŌĞƌƚĂƐŬĨŽƌďŽƚŚƉƌŽƚŽƚLJƉĞƐĂƌĞĚŽŶĞ
ĞůŽǁŝƐŽŶĞĞdžĂŵƉůĞŽĨƚŚĞĚĂƚĂƌĞĐŽƌĚĞĚĨŽƌƉĂƌƟĐƉĂŶƚϰĐŽŵƉůĞƟŶŐƚŚĞƚĂƐŬƐĨŽƌWƌŽƚŽƚLJƉĞΘWƌŽƚŽƚLJƉĞ
Participant 4 Protoype A Prototype B
Task 1 ^ĞĂƌĐŚĞĚ/dϮϬϭ ,ĞĨŽƵŶĚƚŚĞĐŽŶƚĞŶƚďLJ ^ĞĂƌĐŚĞĚ/dϮϬϭ >ŽŽŬĞĚŝŶĞŵĂŝůƐϭďLJhƐĞĚďĂĐŬ ƐĐƌŽůůŝŶŐŝŶĐŽŶǀĞƌƐĂƟŽŶǀŝĞǁ ďƵƩŽŶƐĞǀĞƌĂůƟŵĞƐ
TimeϮϯƐĞĐŽŶĚƐ TimeϰϳƐĞĐŽŶĚƐ
Protoype A Prototype B
Task 2 ůŝĐŬĞĚƌĞƉůLJďƵƩŽŶĂŶĚĂĚĚĞĚĐŽŶƚĂĐƚƐ ĂŶƚĮŶĚZĞƉůLJůůďƵƩŽŶZĂŶĚŽŵůLJĐůŝĐŬĞĚĨŽƌ ŵĂŶƵĂůůLJ ĂĐƟŽŶ
TimeϮϬƐĞĐŽŶĚƐ TimeϯϮƐĞĐŽŶĚƐ
Task 3^ĞĂƌĐŚĞĚ/dϮϬϭ&ŽƵŶĚĮƌƐƚĞŵĂŝů tĞŶƚƚŽ/ŶďŽdžƐĞƌĂĐŚĞĚ/dϮϬϭ &ŽƵŶĚϰĞŵĂŝůƐ KƚŚĞƌƚǁŽŽďƚĂŝŶĞĚďLJŶĂŵĞƐĞĂƌĐŚ ŽƵůĚŶƚĮŶĚƌĞŵĂŝŶŝŶŐĞŵĂŝůƐhƐĞƌĂƐŬƐƚŽƐĞĂƌĐŚ ďLJŐƌŽƵƉŵĂƚĞŝŶƚŚĞ/ŶďŽdž
TimeϱϵƐĞĐŽŶĚƐ TimeϭŵŝŶƵƚĞϯϮƐĞĐŽŶĚƐ
Task 4ůŝĐŬĞĚƚŚĞΔĂƌƌŽǁƟůůŚĞƌĞĂĐŚĞĚƚŚĞƵŶƌĞĂĚ ůŝĐŬĞĚƚŚĞΔĂƌƌŽǁƵŶƟůŚĞƌĞĂĐŚĞĚƚŚĞƵŶƌĞĂĚ ŵĞƐƐĂŐĞ ŵĞƐƐĂŐĞ
TimeϮϭƐĞĐŽŶĚƐ TimeϮϰƐĞĐŽŶĚƐ
Task 5 TimeϭϮƐĞĐŽŶĚƐ TimeϭϯƐĞĐŽŶĚƐ
ƌƌŽƌƐ ϯ ϲ
ůŝĐŬƐ Ϯϰ Ϯϱ
WĂƵƐĞƐ ϵ ϰ
KďƐĞƌǀĂƟŽŶ EŽŵĂũŽƌŝƐƐƵĞƐŝŶŶĂǀŝŐĂƟŽŶ ŽŵƉůĂŝŶĞĚŚĞĐŽƵůĚŶŽƚƵƐĞƚŚĞƐĞĂƌĐŚďĂƌ ĂƐŚĞǁĂŶƚĞĚEŽŵĂũŽƌŝƐƐƵĞƐŝŶŶĂǀŝŐĂƟŽŶ
dŽƚĂůdŝŵĞ ϭŵŝŶƵƚĞϰϱƐĞĐŽŶĚƐ ϯŵŝŶƵƚĞƐϮƐĞĐŽŶĚƐ
0
2
4
6
8
10
User 6User 6User 4User 3 User 2User 1
Total Pauses
Prototype A Prototype B
Results
Quantitative Data
(a). Pauses(b). Total clicks(c). Total errors ;ĚͿdŝŵĞŽĨĐŽŵƉůĞƟŽŶ
0
2
4
6
8
10
12
User 6User 5User 4User 3User 2User 1
Prototype A Prototype B
Total Errors
0
5
10
15
20
25
30
35
User 6User 5User 4User 3User 2User 1
Prototype A Prototype B
Total Clicks
0.0
0.5
1.0
1.5
2.0
2.5
User 6User 5User 4User 3User 2User 1
Prototype A Prototype B
Total Time
0
2
4
6
8
10
User 6User 6User 4User 3 User 2User 1
Total Pauses
Prototype A Prototype B
Results
Quantitative Data
(a). Pauses(b). Total clicks(c). Total errors ;ĚͿdŝŵĞŽĨĐŽŵƉůĞƟŽŶ
0
2
4
6
8
10
12
User 6User 5User 4User 3User 2User 1
Prototype A Prototype B
Total Errors
0
5
10
15
20
25
30
35
User 6User 5User 4User 3User 2User 1
Prototype A Prototype B
Total Clicks
0.0
0.5
1.0
1.5
2.0
2.5
User 6User 5User 4User 3User 2User 1
Prototype A Prototype B
Total Time
Qualitative Data
ŌĞƌĞĂĐŚƵƐĞƌŚĂĚĐŽŵƉůĞƚĞĚƚŚĞƚĂƐŬƐĨŽƌƚŚĞƚǁŽƉƌŽƚŽƚLJƉĞƐƚŚĞLJǁĞƌĞƉƌĞƐĞŶƚĞĚǁŝƚŚĂĞŝŐŚƚƋƵĞƐƟŽŶƐƵƌǀĞLJKƵƌŐŽĂůǁĂƐƚŽĮŐƵƌĞŽƵƚǁŚŝĐŚƉƌŽƚŽƚLJƉĞĚĞůŝǀĞƌĞĚĂŵŽƌĞĨƵŶĐŝƚŽŶĂůůĂLJŽƵƚǁŚĂƚŚĂĚƚŚĞďĞƐƚŽǀĞƌĂůůĚĞƐŝŐŶĂŶĚƵůƟŵĂƚĞůLJǁŚŝĐŚĚĞƐŝŐŶƉƌŽƚŽƚLJƉĞĚŝĚĞĂĐŚƵƐĞƌƉƌĞĨĞƌ ůŽŶŐǁŝƚŚƚŚĞƋƵĂŶƟƚĂƟǀĞĚĂƚĂƚŚĞƐĞƌĞƐƵůƚƐƉƌŽǀŝĚĞĚƵƐǀĂůƵĂďůĞŝŶĨŽƌŵĂƟŽŶǁŚŝĐŚůĞĚƵƐƚŽŵŽǀĞŽŶĨƵƌƚŚĞƌǁŝƚŚŽŶĞŽĨƚŚĞƉƌŽƚŽƚLJƉĞƐ ĞůŽǁŝƐĂŶŽǀĞƌǀŝĞǁŽĨƐŽŵĞĮŶĚŝŶŐƐƚŚĂƚǁĞĨŽƵŶĚǁĞƌĞƌĞůĞǀĂŶƚĂŶĚŝŶƐŝŐŚƞƵů
Prototype A
ͲdŚĞŵĂũŽƌŝƚLJ ĮǀĞŽƵƚŽĨƐŝdžƉĂƌƟĐŝƉĂŶƚƐŐĂǀĞĨĂǀŽƵƌĂďůĞƌĂƟŶŐƐĨŽƌŝĐŽŶĂĞƐƚŚĞƟĐƐǁŝƚŚ ƚŚƌĞĞƐĂLJŝŶŐŝƚŝƐdžĐĞůůĞŶƚ KŶĞƵƐĞƌŐĂǀĞŝƚĂƉŽŽƌƌĂŝƟŶŐŽĨϮ
ͲKǀĞƌĂůůtĞď>ĂLJŽƵƚƌĞĐŝĞǀĞĚƌĂƟŶŐƐŽĨϯŽƌŚŝŐŚĞƌĨƌŽŵĂůůƵƐĞƌĞƐ
ͲEŽŶĞŽĨƚŚĞƵƐĞƌƐĞdžƉƌĞƐƐĞĚƚŚĂƚƚŚĞƚĂƐŬƐǁĞƌĞƚŽŽĚŝĸĐƵůƚůůƵƐĞƌƐƌĂƚĞĚƚŚĞůĞǀĞůŽĨ ĚŝĸĐƵůƚďĞůŽǁƚǁŽǀĞŶƵƐĞƌƐϰΘϱǁŝƚŚƚŚĞůŽŶŐĞƐƚĐŽŵƉůĞƟŽŶƟŵĞŐĂǀĞĂĚŝĸĐƵůƚLJ ƌĂƚĞŽĨϮ
Prototype B
ͲϭϬϬйŽĨƵƐĞƌĞƐƉƌŽǀŝĚĞĚĨĂǀŽƵƌĂďůĞƌĂƟŶŐƐϯŽƌŚŝŐŚĞƌǁĞƌĞĂƩƌŝďƵƚĞĚƚŽŝĐŽŶǀŝƐŝďŝůŝƚLJ ĚĞƐŝŐŶĂŶĚ ǁĞďůĂLJŽƵƚ
ͲƐǁŝƚŚWƌŽƚŽƚLJƉĞĂůůƵƐĞƌƐƌĂƚĞĚƚŚĞůĞǀĞůŽĨĚŝīƵĐůƚLJŽĨϮŽƌďĞůŽǁ
Comparative Data
Ͳ/ŶĐŽŵƉĂƌŝƐŽŶƚŽWƌŽƚŽLJƉĞƐƵƌƉƌŝƐŝŶŐůLJ WƌŽƚŽƚLJƉĞƵŶĂŶŝŵŽƵƐůLJŽƵƚƐĐŽƌĞƐWƌŽƚŽƚLJƉĞŝŶ ĞǀĞƌLJĐĂƚĞŐŽƌLJ&ŝǀĞŽƵƚŽĨƐŝdžĐŚŽƐĞWƌŽƚŽƚLJƉĞĂƐƚŚĞďĞƐƚŽǀĞƌĂůůŝŶƚĞƌĨĂĐĞ^ŝdžŽƵƚŽĨ^ŝdžĐŚŽƐĞ WƌŽƚŽƚLJƉĞĂƐƚŚĞŵŽƐƚǀŝƐƵĂůůLJĂƉƉĞĂůŝŶŐ ͲhƐĞƌƐĚĞƐĐƌŝďĞĚƚŚĂƚWƌŽƚŽLJƉĞǁĂƐhŶŝƋƵĞŝŶĐŽŵƉĂƌŝƐŽŶƚŽWƌŽƚŽƚLJƉĞĂŶĚŽƚŚĞƌĞŵĂŝůƐ ƉƌŽŐƌĂŵƐ
ͲKŶůLJŽŶĞƵƐĞƌƉƌĞīĞƌĞĚWƌŽƚŽƚLJƉĞĂƐƚŚĞďĞƐƚŽǀĞƌĂůů,ŝƐĞdžƉůĂŶĂƟŽŶǁĂƐƚŚĂƚŝŶĐŽŵƉůĞƚĞŝŶŐƚŚĞ ƚĂƐŬƐĨŽƌWƌŽƚŽƚLJƉĞŝƚǁĂƐƐŝŵŝůĂƌƚŽƚŚĂƚŽĨ'ŵĂŝůĂŶĚŝƚǁĂƐĞĂƐŝĞƌƚŽŶĂǀŝŐĂƚĞďĞĐĂƵƐĞŽĨƚŚŝƐ
Discussion & Conclusion - Implications for Future Interation Design
Results
ŽŵƉĂƌŝŶŐƚŚĞĚĂƚĂŽĨƚŚĞĞǀĂůƵĂƟŽŶƐƚƵĚLJ ŝƚǁĂƐƋƵŝƚĞĂƉƉĂƌĞŶƚƋƵĂŶƟƟǀĞůLJĂŶĚƋƵĂůŝƚĂƟǀĞůLJ ƚŚĂƚWƌŽƚŽƚLJƉĞǁĂƐǁŚĂƚƵƐĞƌƐŚĂĚƐĞĞŶĂƐƚŚĞďĞƐƚŽǀĞƌĂůůĚĞƐŝŐŶ
dŚĞĚĂƚĂƌĞǀĞĂůƐƚŚĂƚƚŚĞŵĂũŽƌŝƚLJŽĨƵƐĞƌƐĚŝĚĐŽŵƉůĞƚĞƚŚĞƚĂƐŬƐŝŶWƌŽƚŽƚLJƉĞĨĂƐƚĞƌƚŚĂŶŝŶdŚŝƐƌĞƐƵůƚǁĂƐĂďŝƚŽĨĂƐƵƌƉƌŝƐĞĐŽŶƐŝĚĞƌŝŶŐƚŚĞƵŶŝƋƵĞůĂLJŽƵƚĚĞƐŝŐŶŽĨWƌŽƚŽLJƉĞĂŶĚĚŽĞƐĐŽŶƚƌĂĚŝĐƚƐŽŶĞĚĞƐŝŐŶŚLJƉŽƚŚĞƐŝƐĨŽƌWƌŽƚŽƚLJƉĞdŚĞƐƚĂŶĚĂƌĚĨĂŵŝůŝĂƌůĂLJŽƵƚŽĨĚĞƐŝŐŶƉƌŽǀŝĚĞƐĂŵŽƌĞŶĂǀŝŐĂďůĞŝŶƚĞƌĨĂĐĞƚŚĂŶĚĞƐŝŐŶ KǀĞƌĂůůƟŵĞŽĨĐŽŵƉůĞƟŽŶĨŽƌWƌŽƚŽƚLJƉĞǁĂƐŶŽƚůŽŶŐŝŶĚƵƌĂƟŽŶƵƐĞƌƐũƵƐƚƉĞƌĨŽƌŵĞĚƚŚĞŐŝǀĞŶƚĂƐŬĨĂƐƚĞƌƵƐŝŶŐWƌŽƚŽƚLJƉĞ
dŚŝƐŵĂLJďĞĂƩƌŝďƵƚĞĚƚŽƐĞǀĞƌĂůĨĂĐƚŽƌƐKŶĞǁŚĞŶƐĞĂƌĐŚŝŶŐĨŽƌĂƐƉĞĐŝĮĐĞŵĂŝůƚŚĞĐŽŶǀĞƌƐĂƟŽŶďƵďďůĞǀŝĞǁƉƌŽǀŝĚĞƐĂĨƌĂŵĞƚŚĂƚƵƐĞƌƐƵƐĞƚŽĐůĞĂƌůLJĚŝƐŶƟŶŐƵŝƐŚĞŵĂŝůƐďLJĚĂƚĞĐĂƚĞŐŽƌLJĂŶĚŶĂŵĞŽĨƐĞŶĚĞƌ ^ĞĐŽŶĚůLJŐŝǀĞŶϭϰŽĨǁŝŶĚŽǁƐƉĂĐĞƚŚĞůĂƌŐĞŝĐŽŶƐŝŶƚŚĞůĞŌĐŽůƵŵŶĂƌĞŵŽƌĞǀŝƐƵĂůůLJŽƌŐĂŶŝnjĞĚƚŚĂŶĂůŝƐƚŽĨŝĐŽŶƐ&ŽƌĞdžĂŵƉůĞǁŚĞŶŵŽǀŝŶŐƚŚĞĞŵĂŝůƐƚŽƚŚĞ,ŽŵĞǁŽƌŬĨŽůĚĞƌŝŶWƌŽƚŽƚLJƉĞƚŚĞĨŽůĚĞƌŝƐŵƵĐŚŵŽƌĞǀŝƐŝďůĞƚŽƚĂƌŐĞƚĂƐŝŶWƌŽƚŽƚLJƉĞ
EŽƚŽŶůLJĚŝĚƵƐĞƌƐƉĞƌĨŽƌŵĨĂƐƚĞƌƵƐŝŶŐWƌŽƚŽƚLJƉĞĂůůďƵƚŽŶĞƵƐĞƌĐŚŽƐĞWƌŽƚŽLJƉĞĂƐƚŚĞďĞƐƚŽǀĞƌĂůůĂŶĚƐŝdžŽƵƚŽƵƚƐŝdžĐŚŽƐĞWƌŽƚŽƚLJƉĞĂƐƚŚĞŵŽƐƚǀŝƐƵĂůůLJĂƉƉĞĂůŝŶŐdŚĞƐĞƌĞƐƵůƚƐǁĞƌĞŶŽƚĂƐƵƌƉƌŝƐĞƚŽŽƵƌƚĞĂŵtĞĞdžƉĞĐƚĞĚƵƐĞƌƐƚŽƌĞƐƉŽŶĚĨĂǀŽƵƌĂďůLJďĞĐĂƵƐĞŝƚƉƌĞƐĞŶƚĞĚĂĚŝīĞƌĞŶƚĂƉƉƌŽĂĐŚƚŽĞŵĂŝůƐŝŶĐŽŶƚƌĂƐƚƚŽĂƐƚĂŶĚĂƌĚŝŶƚĞƌĨĂĐĞŝŵƉůĞŵĞŶƚĞĚďLJƚŚĞŵĂũŽƌŝƚLJŽĨĞŵĂŝůƉƌŽŐƌĂŵƐ
tĞĚŽƚĂŬĞŝŶƚŽĐŽŶƐŝĚĞƌĂƟŽŶƚŚĞĞŶǀŝƌŽŶŵĞŶƚŝŶǁŚŝĐŚƚŚĞƵƐĞƌƐƚƵĚLJǁĂƐĐŽŵƉůĞƚĞĚdŚĞĚŝƐĐƌĞƉĂŶĐLJŝŶƚŚĞĞŶǀŝƌŽŶŵĞŶƚƚŚĞƵƐĞƌĞƐŚĂĚĐŽŵƉůĞƚĞĚƚŚĞƐƚƵĚLJŵĂLJŚĂǀĞĂīĞĐƚĞĚƚŚĞƌĞƐƵůƚƐhƐĞƌƐǁŽƵůĚŶŽƌŵĂůůLJŶŽƚďĞƵƐŝŶŐĞŵĂŝůǁŝƚŚƐĞǀĞƌĂůŽƚŚĞƌƐƐƚĂŶĚŝŶŐĂƌŽƵŶĚŝŶŽďƐĞƌǀĂƟŽŶ/ĚĞĂůůLJ ĂůĂƌŐĞƌƐĂŵƉůĞƐŝnjĞǁŝůůƌĞŇĞĐƚĂŵŽƌĞĂĐĐƵƌĂƚĞĚĞƐĐƌŝƉƟŽŶŽĨŽƵƌĚĞƐŝŐŶƐ/ŶĨƵƌƚŚĞƌƐƚƵĚŝĞƐƚŚŝƐǁŝůůďĞĂƉƌŝŽƌŝƚLJŝŶŽƌĚĞƌƚŽƌĞƚƌŝĞǀĞƚŚĞŵŽƐƚĂĐĐƵƌĂƚĞƌĞƐƵůƚƐƉŽƐƐŝďůĞ
dŽĐŽŶĐůƵĚĞƚŚĞƌĞƐƵůƚƐŽĨƚŚĞĞǀĂůƵĂƟŽŶƐƚƵĚLJĞŵƉŚĂƐŝnjĞWƌŽƚŽƚLJƉĞĂƐƚŚĞďĞƐƚŽǀĞƌĂůůĚĞƐŝŐŶŝŶƚĞƌŵƐŽĨĚĞƐŝŐŶůĂLJŽƵƚĂŶĚĨƵŶĐƟŽŶĂůŝƚLJEŽƚŽŶůLJŝƐƚŚĞĚĞƐŝŐŶƵŶŝƋƵĞƉƌĞƐĞŶƚĞĚĂŵŽƌĞĞŶŐĂŐŝŶŐŝŶƚĞƌĨĂĐĞŝƚŽƵƚƉĞƌĨŽƌŵĞĚƚŚĞĨƵŶĐƟŽŶĂůŝƚLJŽĨWƌŽƚŽƚLJƉĞdŚƵƐŝƚŝƐŽƵƌĚĞƐŝĐŝŽŶƚŽĐŽŶƟŶƵĞĨƵƚƵƌĞŝƚĞƌĂƟŽŶƐŽŶWƌŽƚŽƚLJƉĞĂŶĚĮŶĚĂƌĞĂƐŝŶǁŚŝĐŚŽƵƌƚĞĂŵĐĂŶŝŵƉƌŽǀĞ