CognitiveTask_032513comp Methods to Improve Patient-Centered Medical Home Models by Understanding...
-
Upload
james-lindon -
Category
Documents
-
view
217 -
download
0
Transcript of CognitiveTask_032513comp Methods to Improve Patient-Centered Medical Home Models by Understanding...
-
7/30/2019 CognitiveTask_032513comp Methods to Improve Patient-Centered Medical Home Models by Understanding and Le
1/14
cAgency for Healthcare Research and Quality
Advancing Excellence in Health Care www.ahrq.gov
Prevention & Chronic Care ProgramI M P R O V I N G P R I M A R Y C A R E
Cognitive TaskAnalysis:
Methods to Improve Patient-CenteredMedical Home Models by
Understanding and Leveraging its
Knowledge Work
PCMH Research Methods Series
-
7/30/2019 CognitiveTask_032513comp Methods to Improve Patient-Centered Medical Home Models by Understanding and Le
2/14
-
7/30/2019 CognitiveTask_032513comp Methods to Improve Patient-Centered Medical Home Models by Understanding and Le
3/14
1
Cognitive Task Analysis: Methods to Improve Patient-CenteredMedical Home Models by Understanding and Leveraging itsKnowledge Work
Tis brie ocuses on using cognitive task analysis (CA) to evaluate patient-centered medical home
(PCMH) models. It is part o a series commissioned by the Agency or Healthcare Research and
Quality (AHRQ) and developed by Mathematica Policy Research under contract, with input rom
other nationally recognized thought leaders in research methods and PCMH models. Te series is
designed to expand the toolbox o methods used to evaluate and rene PCMH models. Te PCMH
is a primary care approach that aims to improve quality, cost, and patient and provider experience.
PCMH models emphasize patient-centered, comprehensive, coordinated, accessible care, and a
systematic ocus on quality and saety.
I. Cognitive Task AnalysisCognitive task analysis is a amily o methods designed to reveal the thinking involved in perorming
tasks in real-world contexts and is especially well suited to understanding and helping improve several
aspects o PCMH models. CA methods can be used to uncover and describe the key patterns,
variations, opportunities or improvement, and leverage points in the knowledge worknot just the
physical worko primary care sta and clinicians. Its results can then be used to help individuals and
teams maximize the eectiveness o their implementation process by showing them where and how to
ocus their eorts. Moreover, many CA methods were designed to understand how high perormers
(that is, experts) unction, and thus identiy contextually grounded best practices. Tese best practices
can be used to inorm and improve the training o individuals and teams in new roles such as care
management, new clinical routines, and the meaningul use o technology.
CA methods help us understand and improve peoples perormance on both clinical and
organizational tasks because they identiy the critical cognitive aspects o those tasks that would
otherwise remain hidden. Identiying these cognitive aspects allows or more comprehensive, accurate,
and eective ormative evaluations, implementation planning and troubleshooting, and knowledge
transer (such as training and scaling up best practices). Te cognitive aspects o tasks that are oten
not directly observable are the macrocognitive processes o clinical or organizational tasks that
occur where individual knowledge and cognition interacts with group knowledge and cognition
(Crandall, Klein, and Homan, 2006; Homan and Woods, 2000). Macrocognition is the collection
o cognitive processes that characterize how people think in natural settings (Crandall, Klein, and
Homan, 2006). Tese macrocognitive processes include how individuals, teams, and organizationsmake decisions, make sense o events and experiences (called sensemaking), use and share knowledge,
plan and replan, coordinate, learn, monitor their work, detect problems, manage the unknown, and
adapt to changing conditions. Although these processes are conceptually distinct rom one another,
they interact in all clinical routines and organizational change eorts that require thinking. CA is
useul in studying PCMH models because macrocognitive processes are central to the way the sta in a
PCMH organizes the practice to deliver patient care.
-
7/30/2019 CognitiveTask_032513comp Methods to Improve Patient-Centered Medical Home Models by Understanding and Le
4/14
2
Although CA is an applied method designed to study macrocognition (that is, cognition in real-
world contexts), it is inormed by laboratory-based research on cognition. It is designed primarily
to study thinking processes and structures, not to evaluate outcomes. Tat said, CA can easily be
combined with outcome-ocused quantitative techniques using mixed methods. CA methods have
been used successully or several decades in a wide range o settings requiring high reliability, suchas military and civil aviation, air trac control, naval ship command, nuclear power plant operation,
and reghting, but have only recently been used in health care (Crandall and Calderwood, 1989;
Dominguez, Hutton, Flach, et al., 1995; Crandall and Grome, 2010). CA comprises a wide
range o qualitative techniques rom disparate disciplines that have been adapted to the study o
macrocognition. In act, many researchers and practitioners do orms o CA without calling it that.
Te advantage o drawing on CA explicitly, however, is that the literature on what has been done in
the past can help researchers more systematically and eectively choose and adapt methods to address
their own research questions.
Regardless o the technique used, CA consists o three main steps: (1) knowledge elicitation, (2)
data analysis, and (3) knowledge representation (Crandall, Klein, and Homan, 2006). Te choice owhich method(s) to use to elicit the knowledge, conduct the analysis, and represent results depends
upon the questions being asked, the context in which they are being asked, and the objectives o the
project. Broadly speaking, CA can be used to better understand the macrocognition in any clinical
or organizational task, how and when it occurs, where it occurs, who is involved, and how technology
and artiacts such as orms, emails, logs, and patient charts are (or can be) involved. Although we will
ocus on describing CA methods that are suited to understanding and improving the typical types
o organizational and clinical routines in a PCMH, additional CA methods do exist should the
reader wish to investigate the macrocognition o uncommon, critical events related to PCMH models
(Crandall, Klein, and Homan, 2006).
II. Uses of Cognitive Task Analysis
In this section, we describe three commonly used CA techniques, give examples, and discuss how
they might benet implementation studies o PCMH transormation projects and dissemination o
successul approaches. All three techniques can be used when conducting on-site research.
Task Diagram
Te goal o constructing a ask Diagram is to capture one or more aspects o macrocognition involved
in a routine task. Building a ask Diagram involves getting a rich, multi-perspective description o
the task by interviewing the range o people involved in it. In the rst pass, the interviewer asks theinterviewee (such as a physician, patient, or other practice sta) to break the task into our to seven
large steps. In subsequent passes, the interviewer uses predened (but open-ended) probes, guided by
psychological and organizational theory, to elicit the macrocognitive processes within and between
those steps. For example, CA analysts might try to uncover: (1) the step(s) in which the most
challenging decisions were made, (2) what made those decisions dicult, (3) what inormation was
needed to make the critical decisions, (4) who needed the inormation, (5) how that inormation was
-
7/30/2019 CognitiveTask_032513comp Methods to Improve Patient-Centered Medical Home Models by Understanding and Le
5/14
3
obtained and transmitted, (6) what went wrong or ell through the cracks and why, and (7) how the
team detected ailures and problems in the task.
An important eature o these interviews is that respondents are asked to rst identiy a single, recent
instance o the task in which they were involved (such as a specic patients visit this week). Tey are
then asked to keep that instance in mind when answering questions. Once that instance is described,
the interviewer shits the ocus and tries to identiy naturally occurring variations in the task. o do
so, the interviewer asks respondents to identiy other specic cases in which the task deviated rom the
norm, and tries to probe with plausible, hypothetical what i scenarios to reveal how the interviewees
think they would perorm their part o the task and why. Great care is taken to guide the interviewees
away rom general or decontextualized task descriptions. As the interviewer collects dierent
interviewee perspectives on the task, the interviewer begins to develop a more complete and richer
sense o the task and the characteristics o its macrocognitive dynamics. In the end, the ask Diagram
method produces a depiction o the physical work fow with some o its critical macrocognitive
processes uncovered and described. Te result can be shown to members o the organization, who
are oten surprised at how accurate and inormative it is. It can also be used as the basis or processredesign, or to identiy areas warranting deeper investigation using other CA methods.
Examples
Christensen, Fetters, and Green (2005) conducted ask Diagram interviews with experienced
amily physicians to understand the range o ways in which they structured visits, ocusing on when
computerized reminders or preventive and chronic disease management services could be inserted
into the work fow. Te purpose was to understand the cognitivenot physicaldimension o
their work fow well enough that they could introduce computerized reminders while minimizing
the risk o negative consequences, such as distracting rom patients primary concerns or increasing
provider burden and stress. Tey discovered clear patterns in how physicians structured patient visits,
which helped pinpoint stages at which reminders would be helpul, rather than disruptive. Te
ndings allowed the team to design and implement an eective clinical reminder system that avoided
producing reminder atigue (Green, Nease, and Klinkman, 2009), the commonly observed decrease
o response rates to reminders over time as a result o excessive reminders.
As another example, Shachak, Hadas-Dayagi, Ziv, et al. (2009) used ask Diagram interviews and
observations to understand the cognitive aspects o physician electronic medical record (EMR) use.
Tey ocused on the benets, errors, and patient communication problems associated with EMR
use, and the role o physician EMR expertise in overcoming those communication problems. On the
one hand, they ound that physicians elt the EMR helped their decisionmaking, and thus improved
patient care and saety, by making patient inormation more comprehensive, organized, and readable,
and including decision aids and warnings o adverse drug interactions. On the other hand, they
discovered that physicians were susceptible to EMR-specic errors, including making typos, choosing
an option next to the correct one on pull-down menus, and entering data on the wrong patients
chart. Tey also ound that physicians were aware that these errors were occurring, and, in some cases,
routines had been put in place to better catch them (known as problem detection). Finally, they
ound that certain computer skills and spatial organization o oces helped physicians overcome some
EMR-related patient communication barriers.
-
7/30/2019 CognitiveTask_032513comp Methods to Improve Patient-Centered Medical Home Models by Understanding and Le
6/14
4
PCMH Application
Implementing PCMH unctions in a practice requires improving clinical and organizational routines,
and key aspects o those routines are macrocognitive in nature. Te ask Diagram method ocuses
on revealing the macrocognitive aspects o practices routine work fows, to oer important new
insights into clinical and organizational process redesign. For example, it can be used or the ormative
evaluation o practices change routines. We are currently conducting a study using ask Diagrams
supplemented by eam Knowledge Audits (see below) or, among other things, studying and oering
consultation on improving practices change routines so that the practices can more eectively
implement a health inormation technology (I) system. We ound great variation in how practices
were approaching change implementation, but none had any change or implementation routines
per se. Tey varied widely in their ability to engage in sensemaking, planning, communication,
problem detection, and replanning. Identiying how practices address these macrocognitive unctions
during implementation gave us a more detailed understanding o their change capacity. Tis, in
turn, allowed us to make evidence-based and contextually tailored predictions about the uture
implementation diculties they were likely to ace, and make targeted recommendations, customizedor each practice.
Concept Mapping
Te objective o Concept Mapping is to understand and graphically depict how ideas (that is,
concepts) on a given topic are related. In CA, these ideas reer primarily to belies and values, which
are connected in a network or mental model. Te belies and values in ones mental model o a
topic and the connections between them dene ones understanding o that topic. In CA, Concept
Mapping has traditionally been used to map the mental models o experts on critical tasks. Experts
mental models shape what they are aware o, what they pay attention to, what options and possibilities
they consider, how they make sense o events and experiences, solve problems, make judgments, andultimately make decisions and act. aken together, these account or how well and consistently they
perorm both routine and exceptionally challenging tasks.
Concept Mapping a mental model involves choosing a topic, eliciting an individuals belies and values
about that topic, identiying how those belies and values are related, and then graphically depicting
the parts o the model and their relationships. For practical purposes, topics typically address: (1)
how some category o things is organized, (2) how a system works, or (3) how to perorm some task
properly. Te rst type o mental model tends to be typological, whereas the latter two tend to have
sequential and causal links. Models can vary in a number o ways, including their completeness, their
internal consistency, their sophistication, and their ability to account or phenomena. For example,
consider how dierently the mechanisms o diabetes are understood by a molecular biologist, a amilyphysician, a diabetic educator, and a patient.
Concept Mapping has evolved over time so that, in addition to being used to capture experts mental
models, it is now used to measure group consensus (rochim and Kane, 2005), team mental models
(Burtscher and Manser, 2012; Mohammed, Ferzandi, and Hamilton, 2010), and cultural mental
models (Sieck, 2010).
-
7/30/2019 CognitiveTask_032513comp Methods to Improve Patient-Centered Medical Home Models by Understanding and Le
7/14
5
Example
An example o one o the newest orms o Concept Mapping is Rasmussen, Sieck, and Smarts (2009)
cultural network analysis (CNA), which they used to reveal and explain key cultural dierences
between American and British military conceptions o eective planning. In mapping out the network
o ocers concepts, values, and causal belies about eective planning, they discovered that, in British
military culture, eective planning consists o communicating the plans intent so that it can be
fexibly implemented in the eld as circumstances change. In contrast, eective planning in American
military culture aims to reduce the need to make decisions in the eld by working through various
contingencies ahead o time. Tese ndings were used to improve joint British-American military
planning operations.
PCMH Application
One o the cornerstones o a PCMH is to improve patient care by developing more eective
coordination among providers, sta, and organizations involved in a given patients care. Providers and
sta inevitably identiy with dierent personal, proessional, and organizational cultures. Tis meansthat, or a PCMH model to succeed, it is important to identiy and address important tacit dierences
in their mental models o such organizational and clinical unctions as planning, coordination,
cooperation, remuneration, disease management, sel-management, and even what it means to be
a PCMH (see Ho, 2010). As demonstrated in the example o military planning, (cultural) mental
models need not be identical or coordination to succeed. However, understanding dierences in
mental models, as well as the eect o these dierences on social interactions, helps one calibrate and
reorganize complex interactions so that they are more eective.
Team Knowledge Audit
Te eam Knowledge Audit (KA) is derived rom the well-studied Knowledge Audit (KA) CAtool (Klein and Militello, 2005; Militello and Hutton, 1998). Te KA was developed using insights
rom the literature on expert-novice dierences in decisionmaking (Ericsson and Smith, 1991), and
is designed to probe or macrocognition unctions in routine knowledge work. Te KA is the KA
extended to ocus on macrocognitive unctions between, as well as within, individuals on a team
(Klein, Pliske, and Tordsen, 1999; Militello, Kyne, Klein, et al., 1999). Much o a teams expertise is
contained in tacit understandings o how it perorms macrocognitive unctions, and key knowledge
may be distributed (held across team members) or dispersed (portions held by dierent members)
(Becker, 2004). Like the highly automatized knowledge o individual experts, the teams expertise is
oten employed with little conscious awareness.
Te KA ocuses on identiying the specics o how members o a team carry out macrocognitiveunctions, rather than on how they understand them (that is, team mental models), as would
be revealed by the Concept Mapping method. KA uses mainly semi-structured interviews, but
commonly includes observations o team interactions and analyses o orms, logs, patient charts, and
other artiacts. Each interview begins with a set o probe questions that are structured to elicit the
tacit knowledge o the team. Multiple team members are interviewed independently to elicit both
-
7/30/2019 CognitiveTask_032513comp Methods to Improve Patient-Centered Medical Home Models by Understanding and Le
8/14
6
distributed and dispersed knowledge and distinguish the two. Te probes ocus on how the team
executes macrocognitive unctions related to the task and context. Similarly, observations and artiact
analyses ocus on uncovering macrocognitive unctions.
Te KA typically builds on a ask Diagram, and develops additional detail about the execution o
each step and the coordination between steps. Not all categories o macrocognition are necessarily
inormative or any given task, so the interviewers will oten increase or decrease their use o various
planned probes as the interviews progress. As in the ask Diagram method, interviewees are guided
to relate how tasks are carried out with specic examples in mind, and are careully dissuaded rom
answering in the abstract. Finally, the KA usually ocuses on how teams currently carry out their
tasks, though it can be used or studying past routine tasks.
Examples
Te KA has been applied successully to develop a training program or surgical teams to make
optimal use o newly introduced, very complex patient status and management plan displays in
cardiothoracic surgery suites (Crandall and Grome, 2010). Detailed mapping o the teams planning,problem detection, coordination, and replanning revealed patterns that resulted in marked changes
rom the initial design o the displays themselves and the training program or introducing them. As
a result o this process, improvements were introduced beore the training began, avoiding potentially
costly and disruptive revision.
In another project, we are combining a ask Diagram and KA to understand how practices
implement care management or chronic diseases, and relating the ndings to quantitative changes
in quality indicators. In yet another, we are using the KA to examine macrocognition process
dierences in whether and how primary care practices accomplish the changes necessary to implement
a PCMH unctionality o their choosing (such as, test tracking and ollowup, patient registries, or care
management) in a setting where they have nancial and organizational incentives to do so.
PCMH Application
Te KA has been used extensively in other elds or knowledge transer, that is, to understand what
high-perorming teams are doing accurately enough to instruct new or lower-perorming teams and
improve their perormance (see, or example, Klein and Militello, 2005). In a PCMH context, the
KA oers a structured, rigorous approach to yield more comprehensive and contextually detailed
best practices. Tese best practices can distill the skills developed and used by practices doing well
with PCMH activities to help those doing less well. KAs also can be conducted within organizations
with teams within practices that dier in levels o success, enabling them to share knowledge to
increase overall eectiveness. Finally, KAs and other CA techniques can also be used to understand
and improve the ways best practices are disseminated.
III. Advantages
Macrocognition is rarely studied in health services research or addressed in practical primary care
applications, and yet is at the heart o complex, interdependent knowledge work such as the team-
-
7/30/2019 CognitiveTask_032513comp Methods to Improve Patient-Centered Medical Home Models by Understanding and Le
9/14
7
based care that PCMH models require. Below we list three advantages o using CA to understand
and improve PCMH implementation.
Helps uncover the thinking and decisionmaking involved in PCMH models. A key advantage o
CA is that its structured approach to elicitation and its ocus on macrocognition reveal important
phenomena that are oten missed by traditional methodologies (Ryder and Redding, 1993;
Schneider, 1985). CA arose in part because attempts to implement ndings rom behavioral task
analysis resulted in errors and poor perormance (Schraagen, Chipman, and Shute, 2000), leading
to a realization that observation and more traditional interview approaches produced incomplete
inormation. Macrocognitive processes oten are not observable, and introspection in un- or semi-
structured interviewing does not oten bring them out spontaneously. Skilled teams usually carry out
macrocognitive unctions and processes so automatically that the methods and reasons behind them go
unnoticed or are misperceived unless specically and skillully elicited. CAs specic ocus on eliciting
macrocognitive unctions and processes helps ensure that they will not be overlooked.
Provides results that can be used to improve training and transition processes. Te power and
fexibility o CA methods to help understand a variety o relevant eatures in a given cognitive
landscape has yielded benets in individual and team training, quality improvement and saety, and
change eorts more generally. Each o these, in turn, serves to decrease the risk o being blindsided
by unanticipated consequences when implementing a PCMH, which keeps costs down, and quality,
productivity, and collective sel-ecacy high.
Supports eforts to obtain organizational buy-in. Te existence o a large, practical, applied body
o CA literature and respected consultants with portolios o successul work or prominent clients
provides reassurance and credibility to teams anxious about change and looking or guidance.
IV. LimitationsRequires a airly high level o skill to execute properly. Investigators who possess a clear
understanding o how the dierent macrocognitive and organizational theories bear on their objective
(in this case, PCMH models) yield better results. Both interviewers and analysts (i they are not the
same) benet greatly rom understanding how the techniques are grounded in the cognitive sciences,
as this aords the necessary fexibility to adapt and blend CA methods to ones purposes, including
on the fy during interviews. For this reason, CA is not amenable to scripted interviews conducted
by student research assistants.
Involves time-consuming processes. Tough it need not be excessively so, using CA methods
can be time-consuming. With training, practice, and a suciently ocused objective, a CA can be
designed, conducted, and analyzed in a weeks time. An example o a smaller CA project might be
mapping an exceptionally good care managers mental model o eective communication with and
engagement o providers.
Better suited to process than outcomes studies. Like other qualitative methods, CA is not
especially good at testing hypotheses (although, Crandall, Klein, and Homan [2006] do describe how
-
7/30/2019 CognitiveTask_032513comp Methods to Improve Patient-Centered Medical Home Models by Understanding and Le
10/14
8
to use CA in an experimental design). Ultimately, CA is best suited or uncovering, describing, and
explaining how thinking happens in a specic and complex context.
V. Conclusion
CAs benets are showcased by its decades-long track record o success in delivering tangible benets
where stakes are high and ailure is very visible, including or high-prole organizations such as the
U.S. Armed Forces, the national air trac control system, nuclear power plants, and intensive care
unit and operating room teams in major health care systems (Crandall and Grome, 2010; Crandall,
Klein, and Homan, 2006). CA is a powerul addition to methods or studying the implementation
o PCMH models and identiying and disseminating contextually grounded best practices. It is used
to understand how cognitive tasks are carried outhow the knowledge work o a PCMH is doneby
primary care clinicians and sta. Ultimately, this richer understanding acilitates the transer o what is
essential in best practice skills to other sta and organizations implementing PCMH models.
VI. References
Becker MC. Organizational routines: a review o the literature. Industrial and Corporate Change
2004;13:64377.
Burtscher MJ, Manser . eam mental models and their potential to improve teamwork and saety: a
review and implications or uture research in healthcare. Sa Sci 2012;50:134454.
Christensen RE, Fetters MD, Green LA. Opening the black box: cognitive strategies in amily
practice. Ann Fam Med 2005; 3:144150.
Crandall B, Calderwood R. Clinical Assessment Skills o Experienced Neonatal Intensive Care Nurses.(Prepared or the National Center or Nursing, NIH, under Contract No. 1 R43 NR0191101.)
Fairborn, OH: Klein Associates Inc., 1989.
Crandall B, Grome A. CA workshop. Presented at the University o Michigan; 2010 Jan.
Crandall B, Klein GA, Homan RR. Working Minds: A Practitioners Guide o Cognitive ask
Analysis. Cambridge, MA: MI Press; 2006. http://www.books24x7.com/marc.asp?bookid=12926.
Dominguez C, Hutton R, Flach J, et al. Perception-action coupling in endoscopic surgery: a cognitive
task analysis approach. In: Barry B, Boutsma RJ, and Guiard Y, eds. Studies In Perception And Action
III. Mahwah, NJ: Lawrence Erlbaum Associates; 1995.
Ericsson KA, Smith J. oward A General Teory O Expertise: Prospects And Limits. Cambridge, UK:Cambridge University Press; 1991.
Green LA, Nease DE, Klinkman MS. Clinical reminders designed and implemented using cognitive
and organizational science principles do not produce reminder atigue. Presented at the 31st Annual
Meeting o the Society or Medical Decision Making; 2009 Oct; Hollywood, CA.Ho . Te patient-
centered medical home: what we need to know more about. Med Care Res Rev 2010;67(4):38392.
Homan R, Woods DD. Studying cognitive systems in context. Hum Factors 2000;42(1):17.
-
7/30/2019 CognitiveTask_032513comp Methods to Improve Patient-Centered Medical Home Models by Understanding and Le
11/14
9
Klein GA, Militello L. Te Knowledge Audit as a method or cognitive task analysis. In Lipshitz R
and Brehmer B, eds. How Proessionals Make Decisions. Mahwah, NJ: Lawrence Erlbaum Associates;
2005.
Klein GA, Pliske R, Tordsen M, et al. A Model O Distributed eam Perormance. Fairborn, OH:
Klein Associates; 1999.
Militello LG, Hutton RJ. Applied cognitive task analysis (ACA): a practitioners toolkit or
understanding cognitive task demands. Ergonomics 1998 Nov;41(11):161841.
Militello LG, Kyne M, Klein GA, et al. A synthesized model o team perormance. Int J Cogn Ergon
1999;3(2):13158.
Mohammed S, Ferzandi L, Hamilton K. Metaphor no more: a 15-year review o the team mental
model construct. J Manage 2010 Jul;36:876910.
Rasmussen LJ, Sieck WR, Smart, P. What is a good plan? Cultural variations in expert planners
concepts o plan quality. Journal o Cognitive Engineering & Decision Making 2009;3, 22849.
Ryder JM, Redding RE. Integrating cognitive task analysis into instructional systems development.
Educ echnol Res Dev 1993;41:7596.
Schneider W. raining high-perormance skills: allacies and guidelines. Hum Factors 1985; 27:285
300.
Schraagen JM, Chipman SF, Shute VJ. State-o-the-art review o cognitive task analysis techniques.
In Schraagen JM, Chipman SF, and Shute VJ, eds. Cognitive ask Analysis. Mahwah, NJ: Lawrence
Erlbaum Associates; 2000. p. 46787.
Shachak A, Hadas-Dayagi M, Ziv A, et al. Primary care physicians use o an electronic medical record
system: a cognitive task analysis. J Gen Intern Med. 2009;24(3):3418.Sieck,WR. Cultural network analysis: method and application. In Schmorrow D and Nicholson D,
eds. Advances In Cross-Cultural Decision Making. Boca Raton: CRC Press/aylor & Francis, Ltd;
2010. p. 2609.
rochim W, Kane M. Concept mapping: an introduction to structured conceptualization in health
care. International Journal o Quality Health Care 2005 Jun;17(3):18791.
VII. Resources
Guides to Conducting CTABuchanan, D. A., & Bryman, A. (Eds.). Te Sage Handbook o Organizational Research Methods.
Tousand Oaks, CA: Sage; 2009.
Crandall B, Klein G, Homan RR. Working Minds: A Practitioners Guide o Cognitive ask
Analysis. Cambridge, MA: MI Press; 2006.
-
7/30/2019 CognitiveTask_032513comp Methods to Improve Patient-Centered Medical Home Models by Understanding and Le
12/14
10
Klein GA, Militello L. Te Knowledge Audit as a method or cognitive task analysis. In Lipshitz R
and Brehmer B, eds. How Proessionals Make Decisions. Mahwah, NJ: Lawrence Erlbaum Associates;
2005.
MacroCognition. Web site. http://www.macrocognition.com.
Militello LG, Hutton RJ. Applied cognitive task analysis (ACA): a practitioners toolkit or
understanding cognitive task demands. Ergonomics 1998 Nov;41(11):161841.
Sieck WR. Cultural network analysis: method and application. In Schmorrow D and Nicholson D,
eds. Advances In Cross-Cultural Decision Making. Boca Raton: CRC Press/aylor & Francis, Ltd;
2010. p. 2609.
Applications of CTA
Burtscher MJ, Manser . eam mental models and their potential to improve teamwork and saety: a
review and implications or uture research in healthcare. Sa Sci 2012;50:134454.
Christensen RE, Fetters MD, Green LA. Opening the black box: cognitive strategies in amily
practice. Ann Fam Med 2005; 3:14450.
Crandall B, Calderwood R. Clinical Assessment Skills o Experienced Neonatal Intensive Care Nurses.
(Prepared or the National Center or Nursing, NIH, under Contract 1 R43 NR0191101.) Fairborn,
OH: Klein Associates Inc., 1989.
Dominguez C, Hutton R, Flach J, et al. Perception-action coupling in endoscopic surgery: a cognitive
task analysis approach. In: Barry B, Boutsma RJ, and Guiard Y, eds. Studies In Perception And Action
III. Mahwah, NJ: Lawrence Erlbaum Associates; 1995.
Green LA, Nease DE, Klinkman MS. Clinical reminders designed and implemented using cognitive
and organizational science principles do not produce reminder atigue. Presented at the 31st Annual
Meeting o the Society or Medical Decision Making; 2009 Oct; Hollywood, CA.
Minkman A, Fabbricotti N, Huijsman. A quality management model or integrated care: results o a
Delphi and Concept Mapping study. Int J Qual Health Care 2009;21(1):6675.
Rasmussen LJ, Sieck WR, Smart P. What is a good plan? Cultural variations in expert planners
concepts o plan quality. Journal o Cognitive Engineering & Decision Making 2009;3:22849.
Ryder JM, Redding RE. Integrating cognitive task analysis into instructional systems development.
Educ echnol Res Dev 1993;41:7596.
Schraagen JM, Chipman SF, Shute VJ. State-o-the-art review o cognitive task analysis techniques.
In Schraagen JM, Chipman SF and Shute VJ, eds. Cognitive ask Analysis. Mahwah, NJ: Lawrence
Erlbaum Associates; 2000. p. 46787.
Shachak A, Hadas-Dayagi M, Ziv A, et al. Primary care physicians use o an electronic medical record
system: a cognitive task analysis. J Gen Intern Med 2009;24(3):3418.
-
7/30/2019 CognitiveTask_032513comp Methods to Improve Patient-Centered Medical Home Models by Understanding and Le
13/14
11
Weir CR, Nebeker JJ, Hicken BL, et al. A cognitive task analysis o inormation management strategies
in a computerized provider order entry environment. J Am Med Inorm Assoc 2007;14:6575.
Tis brie was prepared by Georges Potworowski, Ph.D. ([email protected], University at Albany,
State University o New York) and Lee A. Green, M.D., M.P.H. (University o Alberta).
Suggested Citation: Potworowski G. and Green L. A. Cognitive ask Analysis: Methods to Improve
Patient-Centered Medical Home Models by Understanding and Leveraging its Knowledge Work.
Rockville, MD: Agency or Healthcare Research and Quality. February 2013. AHRQ Publication No.
13-0023-EF.
Tis brie and companion bries in this series are available or download rom pcmh.ahrq.gov.
-
7/30/2019 CognitiveTask_032513comp Methods to Improve Patient-Centered Medical Home Models by Understanding and Le
14/14
bAHRQ Publication No. 13-0023-EF
March 2013