Blind Dates - Or the right choice of Test U sers

44
Reto Lämmler • UXCamp Hamburg 2015 @rlaemmler @testingtime Blind Dates – Or the right choice of test users

Transcript of Blind Dates - Or the right choice of Test U sers

Page 1: Blind Dates - Or the right choice of Test U sers

Reto Lämmler • UXCamp Hamburg 2015@rlaemmler @testingtime

Blind Dates – Or the right choice of test users

Page 2: Blind Dates - Or the right choice of Test U sers

Why do I want to talk about this?

Page 3: Blind Dates - Or the right choice of Test U sers

The UX industry still designs too much based on

assumptions.

Page 4: Blind Dates - Or the right choice of Test U sers

Talking to a user is worth more than a thousand

assumptions.

Page 5: Blind Dates - Or the right choice of Test U sers

• From Zurich, Switzerland• Co-Founder & CEO of www.testingtime.com• MAS Human Computer Interaction Design• VP Product Management at Doodle.com• BS Computer Science

About meTest early, test often.

Page 6: Blind Dates - Or the right choice of Test U sers

Why user testing?

Page 7: Blind Dates - Or the right choice of Test U sers

Designer UI UserMental Model

Page 8: Blind Dates - Or the right choice of Test U sers

Blind Date

Page 9: Blind Dates - Or the right choice of Test U sers
Page 10: Blind Dates - Or the right choice of Test U sers

Test SubjectCollaboration platform for architects, naval engineers etc.

Page 11: Blind Dates - Or the right choice of Test U sers
Page 12: Blind Dates - Or the right choice of Test U sers

“There are some times when it’s important to test your product with your exact market, and other times when users from any demographic can give you the feedback you need.”

Source: www.usertesting.com/blog/2015/02/09/demographics

Testing with Exact DemographicsWhen to Use Them and When to Lose Them

Page 13: Blind Dates - Or the right choice of Test U sers

User Testing

Page 14: Blind Dates - Or the right choice of Test U sers

Hallway Testing

Page 15: Blind Dates - Or the right choice of Test U sers

Extreme User InterviewsIDEO Method Cards

Page 16: Blind Dates - Or the right choice of Test U sers

What does Jacob think?

Page 17: Blind Dates - Or the right choice of Test U sers

Jacob Nielsen About simplified User Testing

The three main rules:1. Get representative users2. Ask them to perform representative tasks with the

design 3. Shut up and let the users do the talking.

Page 18: Blind Dates - Or the right choice of Test U sers

The last thing you want to hear during a usability study session is a participant saying, “I don’t use this kind of [system],” or “I never do that [task] for my job.” That person cannot help you discover the problems with that system or how well the system supports users’ tasks.

Jacob Nielsen About representative Users

Page 19: Blind Dates - Or the right choice of Test U sers
Page 20: Blind Dates - Or the right choice of Test U sers

The right choice of test users

Page 21: Blind Dates - Or the right choice of Test U sers

Recruit Test Users by

Category

Page 22: Blind Dates - Or the right choice of Test U sers

Test Users by CategoryConsumers vs Experts

Consumers• Shopping• News• Travel• Social• Entertainment• …

Experts• Medical• Engineering• Architecture• Finance• Legal• …

Page 23: Blind Dates - Or the right choice of Test U sers

Experts are also ConsumersBut Consumers are not always Experts.

Expert

Consumer

Everyone can be potentially recruited to test a consumer application.

E.g. A neuro scientist uses www.travel.ch

Only Experts from the field can be recruited to test an Expert application.

E.g. A neuro scientist uses NemoDevices.

Page 24: Blind Dates - Or the right choice of Test U sers
Page 25: Blind Dates - Or the right choice of Test U sers
Page 26: Blind Dates - Or the right choice of Test U sers
Page 27: Blind Dates - Or the right choice of Test U sers

Recruit Test Users byPersonas & Scenarios

Page 28: Blind Dates - Or the right choice of Test U sers

Test Users by PersonasPrimary vs. Secondary vs. Other Personas

PrimarySecondar

y or Supportiv

eNon-

Personas

Page 29: Blind Dates - Or the right choice of Test U sers
Page 30: Blind Dates - Or the right choice of Test U sers

Primary and Secodary PersonasWith some example scenarios in mind

Primary Personas• Experienced Kiter who wants to purchase a new

Kite• Newbie Kiter who wants to find a beginners course• …

Secondary Personas• A worried parent who wants to learn about the

sport• Godfather who wants to find a gift for a godchild• …

Page 31: Blind Dates - Or the right choice of Test U sers

Supportive and Non-PersonasWith some example scenarios in mind

Supportive• Site Manager who maintains the inventory• Human Resources maintaining job listings• …

Non-Personas• …?

Page 32: Blind Dates - Or the right choice of Test U sers

Recruit Test Users by Test Object

Page 33: Blind Dates - Or the right choice of Test U sers

Website, App, DocumentationTest objects

Website / App

Navigation

Content

Accessibility

Task Completion

Page 34: Blind Dates - Or the right choice of Test U sers
Page 35: Blind Dates - Or the right choice of Test U sers

Devices

Packaging, Food, DevicesTest objects

Food…

Packaging…

Page 36: Blind Dates - Or the right choice of Test U sers

Recruiting service for UX people

Page 37: Blind Dates - Or the right choice of Test U sers
Page 38: Blind Dates - Or the right choice of Test U sers
Page 39: Blind Dates - Or the right choice of Test U sers
Page 40: Blind Dates - Or the right choice of Test U sers

DACH Panel20‘000+

Page 41: Blind Dates - Or the right choice of Test U sers

When do you blind date and when do you choose

carefully?

Page 42: Blind Dates - Or the right choice of Test U sers

My LearningsAnd recommendations

• It’s still better to test with anyone, than no testing at all

There is always something you can learn.

• Choose smaller tests over extensive studiesBut iterate as often as necessary

• UX is not a project, it’s an ongoing processSo don’t excuse it with «I’m not ready yet.»

Page 43: Blind Dates - Or the right choice of Test U sers
Page 44: Blind Dates - Or the right choice of Test U sers

Test early.Test often.

[email protected]@rlaemmler @testingtime