Usability Testing To Prioritize Your Designs

47
Usability Testing to Prioritize Your Designs Elizabeth Snowdon Solutions Architect, ImageX

Transcript of Usability Testing To Prioritize Your Designs

Usability Testing to Prioritize Your Designs Elizabeth Snowdon Solutions Architect, ImageX

About  me  

•  User  Experience  Analyst  /  Designer  •  Usability  tes8ng  for  over  10  years  •  Facilitated  hundreds  of  user  tests    

Agenda  

Why  test   When  to  test   What  to  test  

How   Case  study   Resources  /  Tools  

Edsel  Car  

User-­‐Centred  Design  

UCD  is  an  approach  to  design  that  grounds  the  process  in  informa8on  about  the  people  who  will  use  the  product.  UCD  processes  focus  on  users  throughout  the  development  cycle.  

Guerilla  Tes8ng  

Focus  groups  vs.  Usability  tes8ng  

WHY  TEST  

Why  test?  

•  Focus  design  efforts  •  Reduce  arguments  •  Reach  consensus  •  Validate  design  ideas  

COMMON  EXCUSES  TO  NOT  TEST  

It  will  slow  us  down  

•  Usability  tes8ng  is  an  investment.  •  ROI  –  get  back  a  product  that  sells  beOer  and  costs  less  to  support  

We  already  have  feedback  

Stakeholder  Interviews  

TesEng   AnalyEcs  What  What  

Project  Goals  

•  Qualita8ve  usability  tes8ng  is  s8ll  gold:    – "I  would  rather  sit  with  one  user  than  see  data  from  1000"  

                   Steve  Krug  

Our  product  is  already  perfect  

•  You  do  not  know  which  parts  of  your  design  your  target  users  will  struggle  with.  

•  You  also  don’t  know  that  you  don’t  know.  – This  behaviour  is  oWen  referred  to  as  “drinking  your  own  Koolaid“.  

Our  website  is  not  ready  to  test  

•  Your  ideas  will  never  be  stable  and  complete  un1l  you’ve  had  the  input  from  users.    

WHEN  TO  TEST  

When  to  test?  

•  Early  and  oLen  – During  discovery  – User  research    – Prior  to  launch  – Post  launch  

WHAT  TO  TEST?  

Current  design  

Before  star8ng  the  new  design,  test  the  old  design  to  iden8fy  the  good  parts  that  you  should  keep  or  emphasize,  and  the  bad  parts  that  give  users  trouble.  

Compe8tors’  designs  

Test  your  compeEtors'  designs  to  get  cheap  data  on  a  range  of  alterna8ve  interfaces  that  have  similar  features  to  your  own.  

Tes8ng  prototypes  

Make  paper  or  interacEve  prototypes  of  one  or  more  new  design  ideas  and  test  them..  

HOW  TO  TEST?  

How  many  users  to  test?  

How  many  users  to  test?  

•  Quan8ta8ve  studies  (aiming  at  sta8s8cs,  not  insights):  Test  at  least  20  users  to  get  sta8s8cally  significant  numbers;  8ght  confidence  intervals  require  even  more  users.  

•  Card  sor8ng:  Test  at  least  15  users.  •  Eyetracking:  Test  39  users  if  you  want  stable  heatmaps.  

 

Find  users  

•  Get  hold  of  some  representa8ve  users,  such  as  customers  for  an  e-­‐commerce  site    

Recruitment  Agency  

Social  Media  

Customer  Lists  

Task  scenarios  

•  Ask  the  users  to  perform  representa8ve  tasks  with  the  design  – Write  non-­‐leading  tasks    

Observe  

•  Observe  what  the  users  do,  where  they  succeed,  and  where  they  have  difficul8es  with  the  user  interface.    

•  Shut  up  and  let  the  users  do  the  talking.  •  Don’t  lead  the  users  or  provide  hints  

WHERE  

In  person  

•  In  person  tes8ng  can  be  done  at  a  usability  lab,  conference  room  or  hotel.  

•  Pros:  won’t  miss  subtle8es  of  body  language  and  facial  expression  

Coffee  shop  

•  Users  can  be  found  in  coffee  shops,  libraries,  community  centres,  etc.  

Remote  

•  Using  web  conferencing  tools  such  as  WebEx  

•  Great  for  recrui8ng  users  that  are  located  in  different  geographic  areas  or  hard  to  find  audiences  

 

Remote  unmoderated  

•  Without  test  facilitator  present  

•  Done  by  par8cipant  on  their  own  computer  or  device  

•  e.g.  usertes8ng.com    

CASE  STUDY  –  DESTINATION  BC  

Des8na8on  BC  

The  “Ask”  

•  Tourism  Bri8sh  Columbia  •  Phased  site  refresh  •  Focus  on  the  user  experience  and  commit  to  user  saEsfacEon  for  visitors  by  –  improving  the  visual  presentaEon  – design  and  navigaEon  

Deliverables:  Recommenda8ons  for  first  phase  launch  

The  Approach  

•  Compara8ve  /  Compe88ve  Analyses    •  Usability  tes8ng  •  Revised  Informa8on  Architecture  and  Content  Organiza8on  

•  Wireframe  Produc8on    

How  tes8ng  was  conducted  

•  usertes8ng.com  was  used  •  4  users  

– Four  middle-­‐income  earning  individuals  based  out  of  the  United  States  par8cipated    

•  35-­‐65  and  older,    •  Canada,  United  States,    •  $40,000  to  $150,000  and    •  above,  Average  Web  User  

•  6  tasks  

Task  scenarios  tested  

Usability  Issues  iden8fied  

Issue  

Revised  sitemap  

Wireframes  to  address  issues  

Resources  

www.nngroup.com  

www.userfocus.co.uk  www.uie.com  

Resources  

silverbackapp.com  

Screen  recording  for  Mac  

Contact  me  

[email protected]  @elizSnowdon  imagexmedia.com