Post on 01-Nov-2014
description
2013
Five Arguments Against Focus Groups — And How to Overcome ThemBob ThomasManager of User Experience, Liberty Mutual
robertl.thomas@libertymutual.com@bobthomas
2013
Five Arguments Against Focus Groups
1. You spend your time listening to users instead of observing their behavior
2. Focus groups are ruined by dominant participants and group think
3. Focus groups rely on users’ abilities to predict their future behavior
2013
Five Arguments Against Focus Groups
4. It’s wrong to allow users to design products in focus groups
5. Focus groups are selected as a methodology, because everyone understands them
2013
Two Camps in User Experience
2013
2013
Argument 1: You spend your time listening to users instead of observing their behavior
๏ Change a flaw to a strength: Make focus group participants do things
2013
๏ Then build a discussion around activities your participants just completed
2013
Argument 2: Focus groups are ruined by dominant participants and group think
๏ Control the room: set the ground rules early
2013
๏ Skilled moderating requires inclusiveness and facilitation
2013
๏ Summarize what ALL participants say. This ensures everyone’s words count.
2013
๏ Prepare effectively - Write a moderator’s guide or test
plan - Do practice runs
2013
Argument 3: Focus groups rely on users’ abilities to predict their future behavior
๏ Change a flaw to a strength: Recruit participants based on past experience
๏ Build discussions around task-based scenarios
Primary Recruit: Have filed an auto insurance claim within the last 12 months
2013
๏ Ultimately you want to base your strategic direction on what users say they will do, based on that past experience
2013
Argument 4: It’s wrong to allow users in focus groups to design products
๏ Change the focus: Show them designs and get their reactions
54% negative words, including “busy” and “overwhelming”
2013
๏ Focus groups let you showcase ideas that you can then usability test
Session 1
Claim via phone call
Claim via mobile app
Claim via tablet app
Claim via computer
Research claims online
Claim via live chat
Someone Injured 6 1 0 0 0 0Car Towed 7 0 0 0 0 0Car Drivable 6 0 0 0 1 0First Accident 6 0 0 0 1 0Second Accident 5 0 0 1 1 0Totals 30 1 0 1 3 0
2013
๏ Focus groups don’t help you make design decisions. They help you make strategic ones.
2013
Argument 5: They only become the methodology of choice because everyone understands them
๏ Make them work for you: OK, so management understands focus groups. Why not use them to sell UX?
2013
๏ Management loves focus groups. It’s a mental model that makes sense to them.
Source: www.CartoonStock.com
2013
๏ Focus groups can end the opinion wars
Source: Photo courtesy of Schlesinger Associates’ New Jersey facility
2013
Conclusion
1.You spend your time listening to users instead of observing their behavior
2.Focus groups are ruined by dominant participants and group think
3.Focus groups rely on users’ abilities to predict their future behavior
4. It’s wrong to allow users to design products in focus groups
5.Focus groups only become the methodology of choice because everyone understands them
1. Make users do things
2. Prepare. Set ground rules. Facilitate.
3. Recruit based on past experience and then create scenarios
4. Use them to confirm and deny ideas
5. Rely on them to end the opinion wars
5 Arguments Against Focus Groups 5 Ways to Overcome Them
2013
Let’s keep focus groups in the UX toolkit. Thank you!
2013Bob ThomasManager of User ExperienceLiberty Mutual
E-mail:robertl.thomas@libertymutual.com
Twitter:@bobthomas
Source: Original photo courtesy of the Abraham Lincoln Art Gallery