(Almost) Free Usability Testing
-
Upload
pedro-custodio -
Category
Business
-
view
6.836 -
download
0
description
Transcript of (Almost) Free Usability Testing
![Page 1: (Almost) Free Usability Testing](https://reader033.fdocuments.in/reader033/viewer/2022051609/547b553c5906b57c798b45fd/html5/thumbnails/1.jpg)
(almost) FREE USABILITY TESTING
http://flickr.com/photos/74676300@N00/509491063/
![Page 2: (Almost) Free Usability Testing](https://reader033.fdocuments.in/reader033/viewer/2022051609/547b553c5906b57c798b45fd/html5/thumbnails/2.jpg)
http://flickr.com/photos/dulciedulcie/2413926822/
NOTES / DISCLAIMERS
![Page 3: (Almost) Free Usability Testing](https://reader033.fdocuments.in/reader033/viewer/2022051609/547b553c5906b57c798b45fd/html5/thumbnails/3.jpg)
Why Make Usability Tests?
![Page 4: (Almost) Free Usability Testing](https://reader033.fdocuments.in/reader033/viewer/2022051609/547b553c5906b57c798b45fd/html5/thumbnails/4.jpg)
BETTER EXPERIENCE
SATISFACTION LOYALTY NUMBERS ...
![Page 5: (Almost) Free Usability Testing](https://reader033.fdocuments.in/reader033/viewer/2022051609/547b553c5906b57c798b45fd/html5/thumbnails/5.jpg)
Business Reasons
REDUCE COSTS: Development Support Maintenance
![Page 6: (Almost) Free Usability Testing](https://reader033.fdocuments.in/reader033/viewer/2022051609/547b553c5906b57c798b45fd/html5/thumbnails/6.jpg)
‘software engineering, a practitioners approach’ McGraw-Hill
COST OF CHANGES
1x During Design
6x DuringDevelopment
100x Afterdeployed
![Page 7: (Almost) Free Usability Testing](https://reader033.fdocuments.in/reader033/viewer/2022051609/547b553c5906b57c798b45fd/html5/thumbnails/7.jpg)
Users are all those persons thatis affected by our products/ services
![Page 8: (Almost) Free Usability Testing](https://reader033.fdocuments.in/reader033/viewer/2022051609/547b553c5906b57c798b45fd/html5/thumbnails/8.jpg)
Have you ever done a usability test, lost hours writing the usability report
and in the end didn’t seen any results applied?
![Page 9: (Almost) Free Usability Testing](https://reader033.fdocuments.in/reader033/viewer/2022051609/547b553c5906b57c798b45fd/html5/thumbnails/9.jpg)
How many times have you read someone else usability report?
Lost time?
![Page 10: (Almost) Free Usability Testing](https://reader033.fdocuments.in/reader033/viewer/2022051609/547b553c5906b57c798b45fd/html5/thumbnails/10.jpg)
Usability Reportsnormally don’t get to those
who need them most!
And few are willing to read them!
![Page 11: (Almost) Free Usability Testing](https://reader033.fdocuments.in/reader033/viewer/2022051609/547b553c5906b57c798b45fd/html5/thumbnails/11.jpg)
Traditional Tests
Number of Users
Recruiting Effort
Where to make them
Who makes them
Planning
Preparation
What? And When to test?
Costs
next?
10/12+
Selected according to the audience
Usability Lab
Usability Professional
Weeks planning
Write and Discuss a test protocol
Normally everything and close to the end of the project
€5000 - €15000+
A ‘n’ page report a week later / Development meeting
![Page 12: (Almost) Free Usability Testing](https://reader033.fdocuments.in/reader033/viewer/2022051609/547b553c5906b57c798b45fd/html5/thumbnails/12.jpg)
Traditional Tests
Number of Users
Recruiting Effort
Where to make them
Who makes them
Planning
Preparation
What? And When to test?
Costs
next?
10/12+
Selected according to the audience
Usability Lab
Usability Professional
Weeks planning
Write and Discuss a test protocol
Normally everything and close to the end of the project
€5000 - €15000+
A ‘n’ page report a week later / Development meeting
![Page 13: (Almost) Free Usability Testing](https://reader033.fdocuments.in/reader033/viewer/2022051609/547b553c5906b57c798b45fd/html5/thumbnails/13.jpg)
DIFFICULTIES
Test as often as we need
Recruit Testers
Recording and analyzing all the information
Processing all the recorded materials that came out of the tests
Gather and process all observer’s notes
Evaluate the overall satisfaction for each service/site
Discuss observations
Implementing conclusions
![Page 14: (Almost) Free Usability Testing](https://reader033.fdocuments.in/reader033/viewer/2022051609/547b553c5906b57c798b45fd/html5/thumbnails/14.jpg)
Traditional Tests Fast Usability Tests
Number of Users
Recruiting Effort
Where to make them
Who makes them
Planning
Preparation
What? And When to test?
Costs
next?
8+ 3/4
Selected according to the audience
Any person with web experience
Usability Lab Any Room
Usability Professional Someone with patience
Weeks planning Anytime
Write and Discuss a test protocol
Select the features we want to test
Normally everything and close to the end of the project
Small tests at any time of the development process
€5000 - €15000+ 0 - €300 (€0 - €100 per user)
A ‘n’ page report a week later / Development meeting
Meeting Immediately after the tests
AGILE TESTING
![Page 15: (Almost) Free Usability Testing](https://reader033.fdocuments.in/reader033/viewer/2022051609/547b553c5906b57c798b45fd/html5/thumbnails/15.jpg)
RECORD INFORMATION
![Page 16: (Almost) Free Usability Testing](https://reader033.fdocuments.in/reader033/viewer/2022051609/547b553c5906b57c798b45fd/html5/thumbnails/16.jpg)
Usage stats
Customer support reports
Eye tracking studies
Usage Heat-Maps
...
RECORD INFORMATION
![Page 17: (Almost) Free Usability Testing](https://reader033.fdocuments.in/reader033/viewer/2022051609/547b553c5906b57c798b45fd/html5/thumbnails/17.jpg)
Possible Setup
VNC
Sala de Testes
Observadores
RECORD INFORMATION
![Page 18: (Almost) Free Usability Testing](https://reader033.fdocuments.in/reader033/viewer/2022051609/547b553c5906b57c798b45fd/html5/thumbnails/18.jpg)
Morae
http://www.techsmith.com/morae.asp
ScreenFlow + VNC
https://www.varasoftware.com/products/screenflow/
SilverBack (soon!)
http://www.silverbackapp.com/
RECORD INFORMATION
![Page 19: (Almost) Free Usability Testing](https://reader033.fdocuments.in/reader033/viewer/2022051609/547b553c5906b57c798b45fd/html5/thumbnails/19.jpg)
GATHER AND PROCESS
![Page 20: (Almost) Free Usability Testing](https://reader033.fdocuments.in/reader033/viewer/2022051609/547b553c5906b57c798b45fd/html5/thumbnails/20.jpg)
Assemble a standard observation report form for all observers, to use during the tests
Terminou com Facilidade Terminou com Dificuldade Não conseguiu terminar
(...)2
Terminou com Facilidade Terminou com Dificuldade Não conseguiu terminar
TAREFA 11
Terminou com Facilidade Terminou com Dificuldade Não conseguiu terminar
(...)3
Terminou com Facilidade Terminou com Dificuldade Não conseguiu terminar
(...)4
Terminou com Facilidade Terminou com Dificuldade Não conseguiu terminar
(...)5
Terminou com Facilidade Terminou com Dificuldade Não conseguiu terminar
(...)6
Terminou com Facilidade Terminou com Dificuldade Não conseguiu terminar
(...)7
Terminou com Facilidade Terminou com Dificuldade Não conseguiu terminar
TAREFA 88
Estudo:
Utilizador:
Avaliador:
Data:
Observações:
GATHER AND PROCESS
![Page 21: (Almost) Free Usability Testing](https://reader033.fdocuments.in/reader033/viewer/2022051609/547b553c5906b57c798b45fd/html5/thumbnails/21.jpg)
0
4
Task 1 Task 2 Task 3 Task 4 Task 5 Task 6 Task 7 Task 8
Finished without problems Finished with problems Didn’t finish
GATHER AND PROCESS
![Page 22: (Almost) Free Usability Testing](https://reader033.fdocuments.in/reader033/viewer/2022051609/547b553c5906b57c798b45fd/html5/thumbnails/22.jpg)
EVALUATE SATISFACTION
![Page 23: (Almost) Free Usability Testing](https://reader033.fdocuments.in/reader033/viewer/2022051609/547b553c5906b57c798b45fd/html5/thumbnails/23.jpg)
Escala de Usabilidade de Serviços Discordo Muito
Concordo Muito
1. Gostaria de usar este serviço frequentemente
2. Achei que o serviço era desnecessariamente complexo
3. Achei o serviço simples de usar
4. Penso que iria precisar de apoio técnico para usar o serviço
5. Achei as várias funcionalidades do serviço bem integradas
6. Penso que havia demasiadas inconsistências no serviço
7. Imagino que a maioria das pessoas aprenda rapidamente a usar o serviço
8. Achei que o serviço não era trivial de usar
9. Senti-me muito confiante a usar o serviço
10. Preciso de aprender muito antes de poder usar este serviço
1 2 3 4 5
1 2 3 4 5
1 2 3 4 5
1 2 3 4 5
1 2 3 4 5
1 2 3 4 5
1 2 3 4 5
1 2 3 4 5
1 2 3 4 5
1 2 3 4 5
‘SUS - A quick and dirty usability scale’ - John Brooke
EVALUATE SATISFACTION
![Page 24: (Almost) Free Usability Testing](https://reader033.fdocuments.in/reader033/viewer/2022051609/547b553c5906b57c798b45fd/html5/thumbnails/24.jpg)
Gostaria de usar este serviço frequentemente
Achei que o serviço era desnecessariamente complexo
Achei o serviço simples de usar
Penso que iria precisar de apoio técnico para usar o serviço
Achei as várias funcionalidades do serviço bem integradas
Penso que havia demasiadas inconsistências no serviço
Imagino que a maioria das pessoas aprenda rapidamente a usar o serviço
Achei que o serviço não era trivial de usar
Senti-me muito confiante a usar o serviço
Preciso de aprender muito antes de poder usar este serviço
0 4
Discordo Muito Concordo Muito
EVALUATE SATISFACTION
![Page 25: (Almost) Free Usability Testing](https://reader033.fdocuments.in/reader033/viewer/2022051609/547b553c5906b57c798b45fd/html5/thumbnails/25.jpg)
DISCUSS AND IMPLEMENT
![Page 26: (Almost) Free Usability Testing](https://reader033.fdocuments.in/reader033/viewer/2022051609/547b553c5906b57c798b45fd/html5/thumbnails/26.jpg)
NO FORMAL REPORTS!!!
DISCUSS AND IMPLEMENT
![Page 27: (Almost) Free Usability Testing](https://reader033.fdocuments.in/reader033/viewer/2022051609/547b553c5906b57c798b45fd/html5/thumbnails/27.jpg)
User Test 1
User Test 2
User Test 3
User Test 4
Debriefing Session
DISCUSS AND IMPLEMENT
![Page 28: (Almost) Free Usability Testing](https://reader033.fdocuments.in/reader033/viewer/2022051609/547b553c5906b57c798b45fd/html5/thumbnails/28.jpg)
CONCLUSIONShttp://flickr.com/photos/rayvensmoon/1837103777/
![Page 29: (Almost) Free Usability Testing](https://reader033.fdocuments.in/reader033/viewer/2022051609/547b553c5906b57c798b45fd/html5/thumbnails/29.jpg)
LISTEN USERSRECRUIT WISELYAGILE APPROACH
TEAM WORKDESIGN FOR INTERACTION
CONCLUSIONS
![Page 30: (Almost) Free Usability Testing](https://reader033.fdocuments.in/reader033/viewer/2022051609/547b553c5906b57c798b45fd/html5/thumbnails/30.jpg)
Thoughts
http://flickr.com/photos/jazz_dalek/1845705965/
![Page 31: (Almost) Free Usability Testing](https://reader033.fdocuments.in/reader033/viewer/2022051609/547b553c5906b57c798b45fd/html5/thumbnails/31.jpg)
Thank you!
http://flickr.com/photos/42304632@N00/232004616/
![Page 32: (Almost) Free Usability Testing](https://reader033.fdocuments.in/reader033/viewer/2022051609/547b553c5906b57c798b45fd/html5/thumbnails/32.jpg)
Pedro Custódio
http://blog.centopeia.com