Running User Tests for VR Games

Steve Bromley@steve_bromley

My background I’ve been at PlayStation for 5 years, working on their hardware, software and system UI.

For VR, I have: - Run research for ergonomics and comfort - Run research in participants homes - Run quantitative tests - Run many, many qualitative tests on the headset and the launch games

Onto the good stuff…

Room SetupRunning User Tests for VR Games

1:1 Games Testing

Getting the room right is very important for VR games

Watch out for the one way mirror

Beware moving chairs

Room scale VR

Room Setup Make sure that the room setup is not going to cause technical or

usability issues during the session.

Keep the user safe!

MethodologyRunning User Tests for VR Games

Qualitative Research

They cant see or hear you

Multi-Seat Tests

Methodology

Remember to adjust your study design to take into account that players can’t hear you.

ParticipantsRunning User Tests for VR Games

No-one has used VR before

Remove comfort issues

ParticipantsHelp people with the set-up

Recruit resilient people!

OpinionsRunning User Tests for VR Games

For usability, 5-8 users per audience will give a good balance between comprehensiveness and practicality.

5-8 users is not good enough for reliable opinion data.

REPRESENTATIVE

It’s often tempting to ask ‘overall’ opinion questions anyway- Development teams want you too.- You want to be nice to your dev teams.

This is (usually) a waste of time for VR Games

Can I do anything to get better opinion data from qualitative sessions?

Palate Cleanser Getting experienced users

Opinions Ultimately, you probably shouldn’t bother with overall scores or generic likes/dislikes.

Run a proper quantitative test if that's what you're after, and ask more nuanced questions

Summary Set the room up right.

Think about the methodology, it’s not the same as other games.

Don’t expect to talk to players.

Help users with the system, they’ll be new to it!

Don’t expect useful opinion data.

Thanks!

Any Questions?