Intro to User Research

Friday, October 21, 2011

MATT TONAKCOMMUNITY MANAGER

THE NERDERY

WE HELP OUR PARTNERS GET BIG IDEAS OUT OF THEIR HEADS AND ONTO THEIR CLIENTS’ WEBSITES

HTTP://WWW.NERDERY.COMTWITTER: @THE_NERDERY

821,217 4334HOURS WORKED SINCE 2003 PROJECTS DOGS IN OUR OFFICE BIKE COMMUTERS

HOURS WORKED, LAST 12 MONTHS

PEOPLE WHO WORK AT THE NERDERY

AVERAGE JANUARY TEMPERATURE

TWO HUNDRED SIXTY-ONE

EIGHT 6

FOURº

HOW TO PARTICIPATE

Using the questions panels in the GoToMeeting app

On Twitter @The_Nerdery

Send us an email at primers@nerdery.com

INTRO TO

USER RESEARCHI N T E R A C T I V E P R I M E R S E R I E S

ZACKUSER EXPERIENCE DESIGNER

MIKEDIRECTOR OF USER EXPERIENCE

WHAT IS UX?

User Goals

Business Goals

Application

WHAT IS UX?

User Goals Business Goals Application

Aligning user behavior and motivations with business objectives

through interaction design

WHAT IS UX?

UX is not part of the process...

WHAT IS UX?

UX is not part of the process...

...it is the process.

A WORD ABOUT PROCESS

^Friday, October 21, 2011

(OR SEVERAL)

^Friday, October 21, 2011

DESIGN PHILOSOPHIES

There is no “one-size-fits-all”

DESIGN PHILOSOPHIES

Self Design

DESIGN PHILOSOPHIES

Self Design

Genius Design

DESIGN PHILOSOPHIES

Self Design

Genius Design

User-Centered Design

DESIGN SOLVES PROBLEMS

DESIGN SOLVES PROBLEMS...now let’s cook some dinner

SELF DESIGNSOLVING YOUR OWN PROBLEM

I know what I want for dinner.

Self Design is cooking for yourself.

I know what I want for dinner.

Self Design is cooking for yourself.

Pretty simple.Friday, October 21, 2011

GENIUS DESIGNSOLVING A PROBLEM YOU’VE SOLVED BEFORE

If I’ve made dinner for Mike (or people like him) many times before, I rely on my

domain specific experience to cook dinner for Mike.

If I’ve made dinner for Mike (or people like him) many times before, I rely on my

domain specific experience to cook dinner for Mike.

I don’t actually cook for Mike. #justsayin’

GENIUS DESIGNTHERE’S A CATCH

Genius Design presupposes that you originally did your research to

define the problem.

USER-CENTERED DESIGNAKA: UX DESIGN

A UX PROCESS STARTS WITH

UNDERSTANDING THE PROBLEM

USER-CENTERED DESIGN

FOCUSES ON BEHAVIOR, USE & CONTEXT.

BUILDING EMPATHY.

HOW DO WE DO THAT?

USER RESEARCH

IS NOT

MARKETING RESEARCH

USER RESEARCH

IS NOT

MARKETING RESEARCH

...but there is some overlap

USER RESEARCH

IS NOT

MARKETING RESEARCH

USER RESEARCH

IS NOT

MARKETING RESEARCH

We do this

USER RESEARCH

IS NOT

MARKETING RESEARCH

We do this

USER RESEARCH

IS NOT

MARKETING RESEARCH

We do this

We DON’T do this

MARKETING RESEARCHUSER RESEARCH

MARKETING RESEARCH

Preferences

Opinions

Desires

USER RESEARCH

MARKETING RESEARCH

Preferences

Opinions

Desires

USER RESEARCH

Behavior

Mental & Physical Context

RESEARCH SPECTRUM

http://www.flickr.com/photos/rosenfeldmedia/2159500714/in/set-72157603511616271/ Indi Young - Mental Models: Rosenfeld Media

RESEARCH SPECTRUM

overlap

WHY DO USER RESEARCH?

Remember when we said that design solves problems?

Remember when we said that a UX process starts with defining the problem?

Research tells us what the problem is.

Research tells us why it’s a problem.

Research shows us how to fix it.

Research tells us why it’s a problem.

BENEFITS OF USER RESEARCH

Throughly defines the problem.

Informs design decisions.

Provides direction & priority.

SHOWS US THE “WHAT”

TEACHES US THE “WHY”

GUIDES US TO THE “HOW”

EXAMPLE PROJECT NEEDS

“WHAT”

“WHY”

“HOW”

Stated: What Research Tells Us:

“WHAT”

“WHY”

“HOW”

“We need a website redesign”

“WHAT”

“WHY”

“HOW”

“We need a website redesign” The website doesn’t meet users’ expectations

“WHAT”

“WHY”

“HOW”

“The current site isn’t working for us”

The website doesn’t meet users’ expectations

“WHAT”

“WHY”

“HOW”

There are usability flaws in the design

“WHAT”

“WHY”

“HOW”

“We should update the look & feel”

“WHAT”

“WHY”

“HOW”

We need to design clearercall to action buttons.

“WHAT”

“WHY”

“HOW”

“WHAT”

“WHY”

“HOW”

“WHAT”

“WHY”

“HOW”

Vague & Undefined

“WHAT”

“WHY”

“HOW”

Vague & Undefined

“WHAT”

“WHY”

“HOW”

Vague & UndefinedClear & Actionable

vs. QUANTITATIVEQUALITATIVE

BEWARE OF THE DATA TYPE

vs. X QUANTITATIVEQUALITATIVE

Just remember

X QUANTITATIVEQUALITATIVE

Just remember

We need both!

X QUANTITATIVEQUALITATIVE

vs. X QUALITATIVEQUANTITATIVESubjective

“Non-measurable”NOT Numerical

Concepts

Objective“Measurable”

Numerical DataStatistics

QUALITATIVEQUANTITATIVE

QUALITATIVE

QUANTITATIVE

BEWARE OF THE DATA TYPEQUALITATIVEQUANTITATIVE

Page Views

Bounce Rate

Time On Site

Yes/No

True/False

Page Views

Bounce Rate

Time On Site

Yes/No

True/False

Expectations

Reactions

Confusion

Comprehension

Behavior

BEWARE OF THE DATA TYPEQUANTITATIVE QUALITATIVE

QUANTITATIVE

QUALITATIVE

QUANTITATIVE QUALITATIVE

informs QUANTITATIVE QUALITATIVE

informs

“WHAT”

informs

“WHAT”

informs

“WHAT” “WHY”

informs “WHAT” “WHY”

informs i.e. Sign-up page bounce rate it high.

informs i.e. Sign-up page bounce rate it high. i.e. Call to action text is confusing.

WHEN SHOULD YOU DO USER RESEARCH?

Timeframe Beginning of the project During Design Production Project Completion

- inform direction & scope- throughly defines the problem- provides insights for next steps

- re-enforce direction- validate design decisions- acquire design feedback at significantly lower cost

- gauge progress/success- guides product direction- discover areas for improvement

- Contextual Inquiry- Field Study/Ethnography- User Interviews- Surveys

- Usability Testing- Card Sorting- Personas- Mental Models

- Usability Testing- Site Search Analytics- Web Analytics- A/B Testing/Multivariate Testing

Benefit

Example Method/Use

BONUS ROUND

ONGOING RESEARCH

BONUS ROUND

ONGOING RESEARCH

BONUS ROUND

ONGOING RESEARCH

How: - Create a solid and sustainable research plan for a continuous feedback loop from your customers/users

BONUS ROUND

ONGOING RESEARCH

BONUS ROUND

ONGOING RESEARCH

Why: - Your audience changes and evolves over time

BONUS ROUND

ONGOING RESEARCH

- Your product/service/website will attract new audience segments

BONUS ROUND

ONGOING RESEARCH

- Your product/service/website will attract new audience segments

-Other products/services/websites introduce new expectations for interacting with your information

Benefit

Example Method/Use

Benefit

Example Method/Use

Benefit

Example Method/Use

Let’s talk about a few in more detail

CONTEXTUAL INQUIRY

WHAT IS CONTEXTUAL INQUIRY?

Fancy Definition:

a field data-gathering technique that studies a few carefully selected individuals in depth to arrive at a fuller understanding of the work practice across all customers.

Fancy Definition:

- Hugh Beyer and Karen Holtzblatt - Contextual Design: Defining Customer-Centered Systems

Fancy Definition:

Non-Nerd Version:

Fancy Definition:

go watch people work in their own context.Non-Nerd Version:

Fancy Definition:

go watch people work in their own context.Non-Nerd Version:

THE “HOW-TO” OF CONTEXTUAL INQUIRY

4. Analyze

5. Report

1. Recruiting

3. Observe

2. Research Plan

Review what you learned. What patterns emerged?

Create appropriate documentation to communicate what you found to the team.

Contact & schedule the people you will observe. THIS IS THE MOST IMPORTANT STEP.

Watch users completing relevant goals & tasks in their own context.

Establish a clear focus for what you’re seeking to understand & what you hope to learn.

WHAT’S THE BENEFIT OF CONTEXTUAL INQUIRY?

Environment

Applications

Issues

What is their physical location like? How does it impact the design or how they use it?

What other hardware or software are they using to do their work? Can (or should) they be integrated? Can the new design eliminate the need of these factors?

Are there current frustrations or problems with the existing design? What about with their physical environment or other systems and processes? Can the new design support those?

What are the steps people are taking to accomplish those goals?

What are the high level priorities of the people using the current design? What are they trying to accomplish?

WHAT’S THE BENEFIT OF CONTEXTUAL INQUIRY?

Who does the person work with to accomplish a goal or task?

Do people have “cheat-sheets” or other materials to help them accomplish goals and tasks?

Are people creating ways to work around a poor design now?

Are there several ways in which people are accomplishing the same goal or task? Should the design support one? Both?

What causes someone to begin down a path of completing a goal?

Work-Arounds

Triggers

Variation(s)

Partners

“Crutches”

RECOMMENDATIONS FOR CONTEXTUAL INQUIRY

Recruiting

Timeline

Be sure to observe an appropriate, representative sample of your target audience.Aim for 3-5 participants separately.

Allow 1-2 weeks for recruiting effort. (Varies depending on the project & participant availability)Allow 1-2 weeks for conducting the research. (Assuming 5 participants)Allow AT LEAST 1 week for analysisAllow 1 week to create a report.

Approximately 4-8 weeks total

USABILITY TESTING

WHAT IS USABILITY TESTING?

Definition:

WHAT IS USABILITY TESTING?

a form of gathering feedback from actual users of a design by having them attempt to complete intended goals and tasks with said design.

Definition:

THE “HOW-TO” OFUSABILITY TESTING

4. Analyze

5. Report

1. Recruiting

3. Conduct Tests

2. Research Plan

Discuss test results with any participating team members & review recordings if available.

Create appropriate documentation that conveys the findings from the research.

Determine who you will conduct usability testing with, write a screener to ensure you recruit your target audience from the responses & schedule the participants. Again, a CRITICAL step.

Conduct the test (ideally with an experience moderator) & observe, while taking notes.

Where will the tests take place? What will the research cover? As before, Establish a clear focus for what you hope to learn.

WHAT’S THE BENEFIT OF USABILITY TESTING?

Path Taken

Impression

Expectations

Level of difficulty

Task Completion

What were the steps involved in completing a given task?

Did the user(s) understand the overall message and intent that the design meant to convey?

Is the solution designed meeting expectations of those intended to use it?

If so, how difficult was it for them to complete the task(s)? Why?

Can the users complete the available tasks of the design?

VARIATIONS OFUSABILITY TESTING

Guerilla

In-Person, Moderated

Remote, Un-moderated

Remote, Moderated

Usability testing done with minimal recruiting effort and logistical planning. Common locations are coffee shops, bars, offices, etc.

Sessions are conducted at a physical location with a live, in-person moderator leading the session(s) with participants.

Sessions are conducted using an online service that allows users to participate at their convenience, without a moderator.

Research is conducted via “live recruiting” from an existing website. Participants are immediately connected with a moderator from a remote location.

Guerilla

Remote, Moderated

Guerilla

Remote, Moderated

Better

Guerilla

Remote, Moderated

RECOMMENDATIONS FORUSABILITY TESTING

Recruiting

Timeline

Do your own recruiting if possible. If this is not possible, work closely with a recruiting agency to ensure the participants being recruited match your target audience.(especially for the particular research you’re doing)

Aim for 5-10 participants. (dependent on the study)

Allow 1-2 weeks for recruiting effort. (Varies depending on the recruiting method)Allow 1 week for conducting the tests. (Assuming 5 participants)Allow 3 days to 1 week for analysis.Allow 3 days to 1 week to create a report.

Approximately 3-6 weeks total

PUTTING IT ALL TOGETHER

FICTIONAL PROJECT: WEB APP REDESIGN

“We need to redesign our web application to increase customer engagement”

Let’s get started:

THE “WHAT”

Targeted SurveysTHE “WHAT”

Targeted Surveys Web AnalyticsTHE “WHAT”

THE “WHY”

User InterviewsTHE “WHY”

User Interviews Contextual InquiryTHE “WHY”

THE “HOW”

Usability TestingTHE “HOW”

Usability Testing

“HOW”

Project Overview:

Targeted Surveys

Web Analytics

User Interviews

Contextual Inquiry

Prototype[design & development}

“WHY”“WHAT”

iteration(s)

WHAT ELSE?

NERDERY RESEARCH METHODS

Usability Testing

Surveys

Card Sorting

Stakeholder Interviews

User Interviews

Contextual Inquiry

Personas

Field Study/Ethnography

Site Search Analytics

Web Analytics

A/B Testing : Multivariate Testing

Mental Models

Usability Testing

Surveys

Card Sorting

User Interviews

Contextual Inquiry

Personas

Web Analytics

Mental Models

“WHAT”

Usability Testing

Surveys

Card Sorting

User Interviews

Contextual Inquiry

Personas

Web Analytics

Mental Models

“WHY”

Usability Testing

Surveys

Card Sorting

User Interviews

Contextual Inquiry

Personas

Web Analytics

Mental Models

“HOW”

QUESTIONS?Using the questions panels in the GoToMeeting app

On Twitter @The_Nerdery

Send us an email at primers@nerdery.com

More answers online at http://nerdery.com

Intro to User Research

Design

Transcript of Intro to User Research

Research Intro

Action Research Intro

Agile Requirements with User Storiesxunitpatterns.com/~gerard/agile2005-intro-to-user...3 Intro to User Stories July 24 . 2004 2005 Gerard Meszaros IUS-5 Sample User Stories A user

0 Serato DJ Intro User Guide

Intro Qualitative Research

Business Research Intro

CiviCRM User Group-Intro to CiviCRM

Theme Intro User Research

Intro to research

Intro Research

Argumentative Research Intro

Intro to user experience UX

Intro IPO - End User

User Interaction: Intro to Mobile Development Landscapedjp3/classes/2012_09_INF... · Intro to Mobile Development Source: Gartner Research Android iOs 0 14.00 28.00 42.00 56.00 70.00

Intro to User eXperience

Self intro research

Nursing Research Intro

Mobile user experience intro

User experience design (intro)

Intro to user centered design