MEASURING LEARNING Leah J Rowe Air Force Research Laboratory 711 Human Performance Wing.
Measuring Human Performance
13
Task Analysis: Addressing complex sociotechnical systems Erin Morrissey 2/8/2016
description
Measuring Human Performance. Muckler (1992) Kantowitz (1992) Hennessy(1990). Muckler (1992). Selecting Performance Measures: “Objective” versus “Subjective” Measurement. The Human Observer. “Alas, no fundamental step in science or technology is independent of the human” ( Muckler 1992) - PowerPoint PPT Presentation
Transcript of Measuring Human Performance
Task Analysis: Addressing complex sociotechnical
systems
Erin Morrissey2/8/2016
Vicente (1999)
• What types of task analysis are suitable for complex sociotechnical systems?
• Role of unpredictability.• Contributions to modern task analysis.• How can we minimize design artifacts?
Task Analysis
• Normative – What the worker should do• Descriptive – What the worker actually does• Formative – The requirements that need to
be met
Normative Approach
• What the worker should do.• Inputs -> outputs• Sequential Flow• Timeline
• How do you determine the fuel efficiency of your car?
• Does not account for the unpredictable.
Normative MethodsInstruction
• What to do
• Less worker discretion
• Less susceptible to human error?
• Device dependent
• Closed systems
Constraint• What not to do
• More worker discretion
• Fosters learning
• More susceptible to human error?
• Device independent
• Open systems
Control Theory
Work Domain Analyses
Directions MapsMental Economy efficient effortfulAbility to adapt to unforeseen contingencies
brittle flexible
Scope of applicability narrow broadAbility to recover from errors limited great
Table 3.3 Relative Advantages and Disadvantages of Directions and Maps
Descriptive Approach
• What the worker actually does• Francophone ergonomics• Task vs. Activity
Contributions
• Hutchins (1995)• Ship Navigation• Physical symbol system hypothesis• (Lacked ecological validity)
• Distributed Cognition
• Klein (1989)• Fire commanders• Classic Decision Theory (sequential)• Recognition-Primed Decision Making
Contributions
• Suchman (1987)• Interaction b/w office workers and help system• Conversation analyses• Situated Action
• Bødker (1991)• Text and image processing• Anglo-American approach to HCI• (focus on artifacts, not context)
• Activity Theory
Task-Artifact Cycle
“[B]y basing new designs on work analysis of current practice, designers will always be one step behind their interventions.”
Iterations!
Rapid prototyping
User Testing Rapid prototyping
User Testing Rapid prototyping
User Testing
In summary
• Use the formative approach to task analysis• This will address the unique needs of a
complex sociotechnical system
• Utilize models to assuage limitation of iterations and scenario based design
• Work domain analysis• Let the activity guide the design
