Effect of Instruction Types and Task Assignments af Anders Bruun, AAU
13
Effect of instruction types and task assignments
-
Upload
infinit-innovationsnetvaerket-for-it -
Category
Technology
-
view
134 -
download
0
description
Oplægget blev holdt ved InfinIT-arrangementet "Temadag om Remote Usability Testing" afholdt den 17. januar 2012. Læs mere på http://www.infinit.dk/dk/hvad_kan_vi_goere_for_dig/viden/reportager/mere_tid_prioritering_og_penge_til_brugbarhedstests.htm
Transcript of Effect of Instruction Types and Task Assignments af Anders Bruun, AAU
Effect of instruction types and task assignments
Overview
Synchronous
2
Autologging User Reporting
Asynchronous
Loca
lR
em
ote
Instructions
Three types of instruction:DefinitionExamplesDefinition + Examples
Definition:Usability problems are present when the system is:
• Unuseful: You cannot find the documents or functions you need to solve your tasks. • Difficult to learn: It takes a long time to learn how to use the system.• Difficult to remember: It takes a long time to find elements in the system, which you
have used previously.• Ineffective to use: It takes a long time to solve certain tasks with the system.• Unsatisfying to use: The system does not feel comfortable to use, it is not joyful to work
with it.
3
Instructions
Three types of instruction:DefinitionExamplesDefinition + Examples
Example of a usability problem:I wanted to insert a footnote in my document. I expected to find this function under the menu called 'Insert', but I could not find it. I also tried to look in the menus 'Page layout' and 'View', but without any luck. It was somewhat irritating. I tried to solve the problem by using the help function and found that I must select the 'Reference' menu, which provided me with the correct functionality. It was not intuitive that something I want to insert is located within the 'Reference' menu and not within the 'Insert' menu.
4
Task types
Predefined tasksExample: Imagine that you failed an exam for the third time. Find out what you must do to get a fourth try.
No tasksUsers were asked to solve tasks relevant for their daily work.
5
Experimental Setup
53 ICT students (Computer Science, Informatics, Software Engineering etc.)Evaluation of a website for students (sict.aau.dk)
6
Tasks No tasks
Definition 8 8
Examples 7 6
Definition + Examples
8 6
Conventional Lab
10
Remote asynchronous
Experimental Setup
7
Effect of instruction types
No. of problems found
Subjective ratings (1 = lowest satisfaction, 5 = highest satisfaction)
8
Critical Serious Cosmetic Total
Definition + Examples 10 9 6 25 (59)
Definition 9 8 0 17 (40)
Examples 13 10 6 29 (69)
LAB 12 13 11 36 (86)
Definition Examples Definition + Examples
4 5 4
Effect of task types
No. of tasks solved
No tasks = 1.5 (average)
Tasks = 3.7 (average)
9
No. of problems found
No tasks = 2.16 (average)
Tasks = 6.67 (average)
Effect of task types
Total number of problems found
Problem Agreement
10
Critical Serious Cosmetic Total
No Tasks 4 6 3 13 (31)
Tasks 13 10 6 29 (69)
LAB 12 13 11 36 (86)
Total 15 15 12 42 (100)
Def.
Tasks
Def.
No Tasks
Ex.
Tasks
Ex.
No Tasks
Def.+Ex.
Tasks
Def.+Ex.
No Tasks
LAB
0.24 0.06 0.33 0.02 0.27 0.05 0.54
Konklusion
Users receiving examples:Identified more problemsGave higher satisfaction ratings
Users receiving predefined tasks:Solves more tasksIdentify more problemsHave a higher problem agreement
Users that don’t receive predefined tasks identify a more varied set of problems
11
Fremtidig forskning: Remote evaluering i praksis
Andre brugertyperAnvendelse i virksomhedDirekte integration i software
12
Efter pausen
Individuelle spørgeskema udfyldt
13
