Users Play Cards, We Keep Score, Magic Results!

Post on 05-Dec-2014

3.056 views 1 download

description

These are the slides from our STC2011 presentation on using Microsoft's product reaction cards in our usability testing sessions. We are making a shorter version of this talk at UPA in June.

Transcript of Users Play Cards, We Keep Score, Magic Results!

Users play cards We keep score Magic results!

Carol Barnum and Laura Palmer 

The Usability Center @ Southern Polytechnic

www.usability.spsu.edu

• Microsoft introduces the cards in 2002– varies their use in 2004

• A few others report in

• We get on board in 2006

• We've been crazy about them ever since

• We share what we have learned

• We give you the tools to do it yourself

Microsoft plays their hand

2usability.spsu.edu                                     STC Summit 2011

Your presenters

Carol Barnum Laura Palmer

3usability.spsu.edu                                     STC Summit 2011

ISO defines the key elements in usability

U testing gives great results for 2 out of 3

We’re here to talk about desirability

4usability.spsu.edu                                     STC Summit 2011

Can’t get no…

But, we’ve tried….and we’ve tried…. 

SATISFACTION

5usability.spsu.edu                                     STC Summit 2011

Microsoft tackles the problem

1. Faces Questionnaire

2. Product Reaction Cards

118 Cards

6 Faces

6usability.spsu.edu                                     STC Summit 2011

After Microsoft?

A small oasis of reports shows variations on the theme

7usability.spsu.edu                                     STC Summit 2011

We decided to give the cards a try

8usability.spsu.edu                                     STC Summit 2011

How we deal

Slide 9usability.spsu.edu                                     STC Summit 2011

Putting the “meta” in analysis

2006…..ongoing

Studies from a variety of industries and interfaces

10usability.spsu.edu                                     STC Summit 2011

Teaching the teachers

18 cards…..17 positive, 1 negative

11usability.spsu.edu                                     STC Summit 2011

Got reservations?

PRC = 93% positive + 7% negativeSUS = 82

Themes: ease‐of‐use, comprehensibility, familiarity, speed

12usability.spsu.edu                                     STC Summit 2011

Calling the cable company

January41% +21% 38%‐

Neutral’s good in our industry!

Negative Neutral PositiveAnnoyingBoringDifficultDistractingFrustratingImpersonalInconsistentNot valuablePoor QualityToo technicalUncontrollable

ExpectedFamiliarSterile

AccessibleBusiness‐likeComprehensiveConvenientDesirableEasy‐to‐useHelpfulStraight‐forward

Repeated PositivesPredictable = 3Friendly = 2Usable = 2

13usability.spsu.edu                                     STC Summit 2011

IVR

Six weeks later: the cable company

85% +11%4% ‐

IVR  APOSITIVE                   NEUTRAL                    NEGATIVE

48% +12%40% ‐

14usability.spsu.edu                                     STC Summit 2011

IVR  BPOSITIVE                    NEUTRAL                      NEGATIVE

Changing planes

IVR

SUS = 8779%+ PRC

15usability.spsu.edu                                     STC Summit 2011

Clear for takeoff

21% - PRC

16usability.spsu.edu                                     STC Summit 2011

It’s not easy being green

International “green” initiative

March 2010 = SUS = 5242% PRC positive

October 2010 = ☺SUS = 7382% PRC positive

17usability.spsu.edu                                     STC Summit 2011

March 2011 = ☺☺SUS = 96100% PRC positive

Movin’ on up

Positives: 24 50 43

18usability.spsu.edu                                     STC Summit 2011

1.0 2.0 2.1

Negative choices decline to zero

Negatives: 33 11 0

19usability.spsu.edu                                     STC Summit 2011

2.0 2.1 01.0

Weather or not

3 TV weather sites

0

10

20

30

40

Positive Negative PositiveNegative

PositiveNegativeStation A

Station BStation C

26/13 39/5 24/17

20usability.spsu.edu                                     STC Summit 2011

“B”cause we like you

Repeats within and between

Blanks are just as telling as choices

21usability.spsu.edu                                     STC Summit 2011

“C” you later

What Station B isn’t!

22usability.spsu.edu                                     STC Summit 2011

C’mon…give it a try

Slide 23usability.spsu.edu                                     STC Summit 2011

Our concluding thoughts

24usability.spsu.edu                                     STC Summit 2011

Compare, Contrast and Combine

Slide 25usability.spsu.edu                                     STC Summit 2011

Questions? Now or later?

Carol Barnum Laura Palmer

26usability.spsu.edu                                     STC Summit 2011

cbarnum@spsu.edu lpalmer2@spsu.edu