Brandy A. Brown Dissertation Defense: Teams & Stress

39
Teams & Stress: A Meta-Analysis & Process Analysis Dissertation Defense Brandy A. Brown April 21 st , 2011 @ 2pm in Brackett 419

description

This is my dissertation defense slides, with an awesome stock photo theme of goldfish to represent the team ideas I was investigating in my dissertation research. (One font messed up and a couple of the photos, but I think the message is still clear!) Abstract: Past teamwork stress literature has experienced contradictory findings. As more reliable models of teamwork emerge there is still a noticeable lack of information regarding how stress affects teamwork processes. This paper first reviews the current state of the team stress literature, where two types of stress for teams are explored: qualitative and quantitative stress. A meta-analysis examined the current literature on quantitative stress and the impact on team performance and effectiveness. Results from nine independent samples (N = 1,794) indicated that quantitative stress has a negative effect on team outcomes, ρ = -.41. Second, a lab study sought to discover if team processes predict performance under stress. Teams of two (N = 26) completed a process control simulation where workload was manipulated to create stress conditions. A multiple regression was conducted to explore if stress would moderate team processes, explaining the negative performance effects. The regression results showed that stress accounted for all the variance in performance, R2 = .83, p < .001. Exploratory analyses were conducted to support potential theoretical bases for these findings. The results provide strong support for a categorization of stress in teams (e.g. quantitative and qualitative stress) as well as provide evidence that cognitive load may disrupt team members' ability to self report their teamwork processes.

Transcript of Brandy A. Brown Dissertation Defense: Teams & Stress

Page 1: Brandy A. Brown Dissertation Defense: Teams & Stress

Teams & Stress: A Meta-Analysis & Process

Analysis

Dissertation DefenseBrandy A. Brown

April 21st, 2011 @ 2pm in Brackett 419

Page 2: Brandy A. Brown Dissertation Defense: Teams & Stress

Overview: Team Stress & Performance

Literature Review

Meta-Analysis: Methods & Results

Team Process Analysis: Methods & Results

Discussion

Page 3: Brandy A. Brown Dissertation Defense: Teams & Stress

Teams must be

to produce superior results in the workplace

effective

Boone, Van Olffen, Witteloostuijn, & De Brabander, 2004; Moon et al., 2004; Denison, Hart, & Kahn, 2006

Organizations are using teams to cope with stress, but:

Page 4: Brandy A. Brown Dissertation Defense: Teams & Stress

Theoretical Basis: Team Stress

Lepine, Podsakoff, & Lepine, 2005; Lazarus, 1993; Jex & Behr, 1991; Cohen & Bailey, 1997; Edmondson, 2002; Kerr & Tindale, 2004; West, 2002

Stimuli place demands on individuals &

the team

Adaptive Response Needed

(Appraisals of stress)

Team members

share stress and respond similarly to it

within a team

Input Process Output

Page 5: Brandy A. Brown Dissertation Defense: Teams & Stress

Current Literature: Team Stress

Hobfoll, 2001; Gump & Kulik, 1997; Drach-Zahavy & Fruend, 2007

Team is Stressed

Teamwork

Process Effects

Enhances OR

Limits Teams??

?

Input Process Output

Page 6: Brandy A. Brown Dissertation Defense: Teams & Stress

Past Literature: Individual Stress

Early INDIVIDUAL stress studies & models distinguished between two types of stress (qualitative & quantitative) but found no meaningful differences

Categorization of stressors may be the missing piece in teams research

Matteson & Ivancevich, 1990; Siegrist, 1996; Glazer & Behr, 2005; Glazer & Beehr, 2004; Jamal, 1984; Jordan, 1990

Team is

Stressed

Input

HOW?

Page 7: Brandy A. Brown Dissertation Defense: Teams & Stress

Definition: Qualitative Stress

Conditions that consist of highly complex tasks, non-routine jobs, or performance standards which are too high

Role Episode Model: Role Ambiguity

Pooled resources allow the team to meet these demands

Caplan et al., 1975; Siegrist, 1996; Newton & Keenan, 1996; Kahn, Wolf, Quinn, Snock, & Rosenthal, 1964; Drach-Zahavy et al., 2004; Boone et al., 2004

Team is

Stressed

Input

HOW?

Page 8: Brandy A. Brown Dissertation Defense: Teams & Stress

Definition: Quantitative Stress

Conditions that consist of accumulating demands, time pressures, and overload

Role Episode Model: Role Overload

Attentional Focus Model: Stressed teams restrict attention

Caplan et al., 1975; Siegrist, 1996; Newton & Keenan, 1996; Kahn, Wolf, Quinn, Snock, & Rosenthal, 1964; Karau & Kelly, 1992; Karau & Kelly, 1992; Kelly, Jackson, & Hutson-

Comeaux, 1997; Kelly & Karau, 1999; Parks & Cowlin, 1995

Team is

Stressed

Input

HOW?

Page 9: Brandy A. Brown Dissertation Defense: Teams & Stress

Team Stress Type Effects?

Intentionally: Drach-Zahavy & Fruend, 2007

Quantitative Stress

Teamwork

Process Effects

Limits Teams?

Qualitative Stress

Teamwork

Process Effects

Enhances Teams?

Page 10: Brandy A. Brown Dissertation Defense: Teams & Stress

Quantitative Stress

Teamwork Process Effects

Limits Teams

Is there really a quantitative stress effect on team performance?

Which team processes are disrupted by quantitative stress?(leading to lower performance)

Study Overview

Meta-Analysis

Process Analysis

Page 11: Brandy A. Brown Dissertation Defense: Teams & Stress

Study 1: Meta-Analysis

Team Effectiveness & Quantitative Stress

Page 12: Brandy A. Brown Dissertation Defense: Teams & Stress

Method: Independent Variable Measures Extensive search process has identified that most

studies on teams and stress used quantitative stress

Acute stressLow and high stress environments

WorkloadTime PressureThreatBattle Stress

Strain (Acute Cognitive, Emotional, & Physical)

Perceived Stress & Stress Appraisals

Page 13: Brandy A. Brown Dissertation Defense: Teams & Stress

Team Performance or Effectiveness

Performance = results of the Input-Process-Output model

Effectiveness adds situational components into I-P-O

Guzzo & Dickson (1996) –review of team literature use the term ‘performance effectiveness’ due to definitional issues

Method: Dependent Variable

Page 14: Brandy A. Brown Dissertation Defense: Teams & Stress

Random effects model assumes possibility of moderators

Hunter & Schmidt v.1.1 (Schmidt & Le, 2005)

Corrections:Sampling error Insufficient information available for study-level corrections

Some reliability information available

Method: Meta-Analysis Procedures

Page 15: Brandy A. Brown Dissertation Defense: Teams & Stress

N 1914

k 10

robs -.366

SDobs .136

-.438

SDρ .076

80% credibility interval

-.547 to -.329

Question 1: True effect size?

mean robs = -.366

= -.438

Results: Quantitative Stress & Performance

Page 16: Brandy A. Brown Dissertation Defense: Teams & Stress

Question 2: Any moderators?

Results: Quantitative Stress & Performance

N 1794

k 9

robs -.343

SDobs .096

-.410

SDρ .000

80% credibility interval

-.410 to -.410

% of observed variance due to artifacts

with Minionis (1995) = 47%w/o Minionis (1995) =

100%

Page 17: Brandy A. Brown Dissertation Defense: Teams & Stress

Study 2: Process Analysis

Stressed Teams: Processes & Performance

Page 18: Brandy A. Brown Dissertation Defense: Teams & Stress

Effective Team

Processes

HighPerformance

Figure 1: Theoretical framework of teamwork processes that lead to effective performance. Visual adapted from Salas, Sims, & Burke, 2005.

Page 19: Brandy A. Brown Dissertation Defense: Teams & Stress

Method: Participants26 Undergraduate TeamsN = 52Teams of 2English-speaking

Based on Power Analysis (22 team min.)

Page 20: Brandy A. Brown Dissertation Defense: Teams & Stress

Method: DesignTeamwork Process Variables: (Questionnaire)

Team OrientationTeam LeadershipBackup Behaviors (Mutual Performance Monitoring Mutual Trust)

Shared Mental ModelsClosed-Loop Communication

Process Control SimulatorStress Manipulation (High vs. Low)

Check: NASA TL-X QuestionnairePerformance (Error)

Page 21: Brandy A. Brown Dissertation Defense: Teams & Stress

Method: ProcedureTeam arrives, fills out informed consentTeam Orientation measure (<5 min)Brief orientation (1 min), tutorial (5 min), and practice session (5 min)

Team undergoes one trial: low or high stress (10 min)

NASA-TLX and MTFQ (<15 min)Debrief

Page 22: Brandy A. Brown Dissertation Defense: Teams & Stress

Error scores from simulation z-scores Performance CompositesTeam Performance: All z-scores of Operator A, B, & Center averaged

Regression Preparation: Normality, Linearity, Homoscedasticity, & MulticollinearityMet assumptions without transformation

Data Preparation

Page 23: Brandy A. Brown Dissertation Defense: Teams & Stress

Team

Orie

ntat

ion

Team

Lea

ders

hip

Back

up B

ehav

iors

Shar

ed M

enta

l Mod

els

Close

d Lo

op C

omm

unicat

ion

5.605.806.006.206.406.606.807.007.207.40

7.13

6.38

6.83

6.41

7.08

6.95

6.22

6.63

6.46

7.08

Low StressHigh Stress

Initial Analyses: Means

Page 24: Brandy A. Brown Dissertation Defense: Teams & Stress

Initial Analyses: Means

Low Stress High Stress

-4

-3

-2

-1

0

1

2

3

4

-3.62

2.95

Team Performance (Error)

High Error = Low Performance

Page 25: Brandy A. Brown Dissertation Defense: Teams & Stress

Initial Analyses: Regression (w/o stress)

Variable β

Team Orientation -.11

Team Leadership -.18

Backup Behaviors .05

Shared Mental Model .17

Closed Loop Communication -.31

R2 = .09

Page 26: Brandy A. Brown Dissertation Defense: Teams & Stress

Initial Analyses: Regression (w/ stress)

Variable β

Stress Condition .839

Team Orientation -.03

Team Leadership -.06

Backup Behaviors .20

Shared Mental Model -.04

Closed Loop Communication -.25

R2 = .75

Page 27: Brandy A. Brown Dissertation Defense: Teams & Stress

Meta-Analysis: Quantitative Stress negatively affects team performance

Lab Study: No specific evidence of disruptions to the team processes we measured

Study Results: Summary

before we focus on that,let’s explore the data

Page 28: Brandy A. Brown Dissertation Defense: Teams & Stress

  Shared Mental Models Mutual Trust

Condition M SD t df Sig. M SD t df Sig.

Prior Relationship(N = 17)

6.96 .84-

2.2524

.032

8.81 1.07-

2.7124

.012

Just Met(N = 9)

6.16 1.30-

2.3416.1

67.59 1.12

-2.74

16.16

Exploratory Analysis: Team Composition

Consistent with Team Process Model (Salas, Sims, & Burke, 2005)

Did not have performance effects, t(24) = .119, p = .399

Page 29: Brandy A. Brown Dissertation Defense: Teams & Stress

Exploratory Analyses: Team Processes, Performance and Coordination.

Team Orientation r = .59

Observed Team

Coordination

Closed Loop Communicatio

nr =.59 Center Panel

Error

Mutual Trust r =-.56 Team Performance

Low Stress

Page 30: Brandy A. Brown Dissertation Defense: Teams & Stress

Exploratory Analyses: Individual Perceptions of Performance & Contributions.

Observed Team Coordination

r = -.80 B: Other

Responsible

Team Performance r = -.59

A: Other Responsible

Observed Team Coordination

r = -.61

B: Other Responsible

Low

Str

ess

Hig

h

Str

ess

Page 31: Brandy A. Brown Dissertation Defense: Teams & Stress

Meta-Analysis: Quantitative Stress negatively affects team performance

Lab Study: No specific evidence of disruptions to the team processes we measured, but more support for negative quantitative stress effectsTask required teamwork and stress was manipulated

Operator A more aware of team processes Operator B more aware of team performance

In high stress – responsibility became a factor

Full Results: Summary

Let’s discuss…

Page 32: Brandy A. Brown Dissertation Defense: Teams & Stress

Meta-Analysis: When categorized, quantitative stress has consistent effects

Process Analysis: Supports Meta-AnalysisWhen teams are quantitatively stressed, self-report measures do not capture team processes

Team members are aware of their workload but unaware of the effects on their teamwork

Discussion

Page 33: Brandy A. Brown Dissertation Defense: Teams & Stress

Team stress acts through team cognition so when teams experience quantitative stress…

Less Interpersonal Communication & Less Team Coordination

Team focus shifts to individual focus

Discussion: Attentional Focus Model

(Cogen & Bailey, 1997; E.G. Kelly & Mcgrath, 1985; Moon, Hollenbeck, Humphrey, Ilgen, West, Ellis, Et Al., 2004; Driskell, Salas, & Johnston, 1999)

Page 34: Brandy A. Brown Dissertation Defense: Teams & Stress

Team stress acts through team cognition so when teams experience quantitative stress…

Study 2: Team members may be so unaware of this shift they cannot report on their teamwork processes accurately

Discussion: Attentional Focus Model

(Cogen & Bailey, 1997; E.G. Kelly & Mcgrath, 1985; Moon, Hollenbeck, Humphrey, Ilgen, West, Ellis, Et Al., 2004; Driskell, Salas, & Johnston, 1999)

Page 35: Brandy A. Brown Dissertation Defense: Teams & Stress

Discussion: Limitations

Study 1: Limited Meta-Analysis

Study 2:Lab StudyReal-time TaskDyadsHomogenous SampleSelf-report Team Processes

Page 36: Brandy A. Brown Dissertation Defense: Teams & Stress

Categorization of team stress needs to be standardRequalification of past team stress work would allow further meta-analysis

Discussion: Future Research

Qualitative Quantitative

Page 37: Brandy A. Brown Dissertation Defense: Teams & Stress

Team process measurement should move past self-report

Discussion: Future Research

Especially where cognitive load is a potential factor

E.g. physiological measures, communication count or coding, etc.

Page 38: Brandy A. Brown Dissertation Defense: Teams & Stress

Questions?

Comments?

Feedback?

Page 39: Brandy A. Brown Dissertation Defense: Teams & Stress

Discussion: Job Demands-Resources Model