Evidence-Based Mental Health Treatments and …...Evidence-Based Mental Health Treatments and...
Transcript of Evidence-Based Mental Health Treatments and …...Evidence-Based Mental Health Treatments and...
Evidence-Based Mental Health Treatments and Services: Examples to Inform Public Policy
Milbank Memorial Fund
by Anthony F. Lehman, Howard H. Goldman, Lisa B. Dixon, and Rachel Churchill
0404_472_TXTr2 6/24/04 6:26 PM Page i
©2004 Milbank Memorial Fund
Milbank Memorial Fund
645 Madison Avenue
New York, NY 10022
All rights reserved. No part of this
publication may be reproduced, stored in
any retrieval system, or transmitted in any
form or by any means, electronic, mechanical,
photocopying, recording, or otherwise without
prior permission.
The Milbank Memorial Fund is an endowed
operating foundation that engages in
nonpartisan analysis, study, research, and
communication on significant issues in health
policy. In the Fund’s own publications, in
reports or books it publishes with other
organizations, and in articles it commissions
for publication by other organizations, the
Fund endeavors to maintain the highest
standards for accuracy and fairness.
Statements by individual authors, however, do
not necessarily reflect opinions or factual
determinations of the Fund.
Printed in the United States of America.
ISBN 1-887748-57-1
0404_472_TXTr2 6/24/04 6:26 PM Page ii
List of Figures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . iv
Foreword . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . v
Acknowledgments . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . vi
Executive Summary . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1
Glossary of Terms . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2
Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4
Methods of Evidence-Based Practices . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6
Effective Treatments and Services . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8
Further Issues, Services, and Policy Implications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18
Notes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20
References . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22
The Authors . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 27
T A B L E O F C O N T E N T S
0404_472_TXTr2 6/24/04 6:26 PM Page iii
ivMilbank Memorial Fund ivMilbank Memorial Fund
L I S T O F F I G U R E S
Figure 1 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9
Efficacy and Effectiveness of Antipsychotic Medications:
Annual Relapse Rates
Figure 2 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10
Combining Medication and Family Education in Schizophrenia:
Annual Relapse Rates
Figure 3 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11
Cognitive Behavioral Therapy (CBT) for Residual Symptoms in
Schizophrenia Patients in Community
Figure 4 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12
Benefits of Assertive Community Treatment (ACT)
Figure 5 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13
Supported Employment Studies
Figure 6 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14
Effectiveness of Antidepressant Medications
Figure 7 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15
Reduction in Depression: Collaborative Care v. Usual Primary Care
Figure 8 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16
Outcomes of the Multimodal Treatment for Children with ADHD Study
Figure 9 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17
Implementation of Intensive Psychiatric Community Care (IPCC)
with High and Low Fidelity
0404_472_TXTr2 6/24/04 6:26 PM Page iv
Milbank Memorial Fundv
The purpose of this report is to inform policymakers about the significance of recent advances in
evaluating evidence for allocating resources to and within public mental health programs. These
advances are of particular importance because the public sector is the largest payer for services to
persons with chronic mental illness.
The authors’ central point is that the best evidence yields both good and bad news. The good news is
that “many potentially available treatments and services” have been shown to produce “improved
symptoms and functioning” in patients with severe, persistent mental illness. The bad is that “there are
substantial gaps between what science tells us to do and what we do in actual practice, despite the
significant investment of public resources.”
The research about which the authors report is increasingly useful to policymakers and clinicians.
Many scientists are working collaboratively, often across national boundaries, to collect, analyze, and
synthesize evidence about interventions to prevent and treat illness. A recent Milbank Report describes
this international scientific advance (Ray Moynihan, Evaluating Health Services: A Reporter Covers the
Science of Research Synthesis).
This report on the significance for policy of evidence about mental health services began as a
request from policymakers. Leaders in the legislative and executive branches of government in
Maryland asked the Milbank Memorial Fund to collaborate in organizing a meeting to discuss the
strengths and weaknesses of that state’s public mental health programs. The Fund asked Anthony
Lehman, Chair of the Department of Psychiatry at the University of Maryland School of Medicine, to
prepare a background paper on evidence-based mental health treatments and services for this meeting.
Lehman, a national leader in urging that the best available evidence should guide mental health
services, invited his departmental colleagues Howard Goldman and Lisa Dixon to be coauthors. Because
of the international reach of the science that underlies evidence-based practice, Lehman also invited
Rachel Churchill, the London-based Coordinating Editor of the Cochrane Collaboration’s Depression,
Anxiety and Neurosis Review Group, to be a coauthor. The Cochrane Collaboration is the leading
international organization in reviewing systematically evidence about health services.
The Fund invited policymakers, researchers, and clinicians to review this report in draft; they are
listed in the Acknowledgments. As a result of both the authors’ and reviewers’ expertise, this report is a
useful guide for understanding how science can inform policy for mental health services.
Daniel M. Fox
President
Samuel L. Milbank
Chairman
F O R E W O R D
0404_472_TXTr2 6/24/04 6:26 PM Page v
viMilbank Memorial Fund
The following persons reviewed this report in draft. They are listed in the positions they held at the time
of their participation.
Bernard S. Arons, Senior Science Advisor to the Director, National Institute of Mental Health, Bethesda,
Md.; Steve Baron, President, Baltimore Mental Health Systems; Tom Barrett, Director, Colorado
Department of Human Services, and President, National Association of State Mental Health Program
Directors; Yvonne Block, Acting Director, Mental Health, Manitoba Health, Canada; Sharon E.
Carpinello, Executive Deputy Commissioner, New York State Office of Mental Health; Patricia Carter,
Clinical Director, Children, Youth and Families, Missouri Department of Mental Health; Kevin
Concannon, Director, Iowa Department of Human Services; John Conway, Member, Saskatchewan
Health Quality Council, and Professor of Psychology Emeritus, University of Saskatchewan, Canada;
Gene Davis, Member, Executive Appropriations Committee, Utah Senate; Adelaide C. Eckardt, Member,
Joint Health Care Delivery and Financing Committee, Maryland House of Delegates; Susan Essock,
Director, Division of Health Services Research, Mount Sinai School of Medicine, New York; Wayne
Fenton, Deputy Director for Clinical Affairs, Division of Mental Disorders, National Institute of Mental
Health, Bethesda, Md.; Junius Gonzales, Chief, Services Research and Clinical Epidemiology Branch,
National Institute of Mental Health, Bethesda, Md.; Gail Gray, Director, Montana Department of Public
Health and Human Services; Jessie C. Gruman, Executive Director, Center for the Advancement of
Health, Washington, D.C.; William Hargreaves, Department of Psychiatry, University of California, San
Francisco; Toni Nathaniel Harp, Chair, Appropriations Committee, Connecticut Senate, and Chair,
Health Committee, National Conference of State Legislatures; Margaret Henbest, Minority Caucus
Chair, Idaho House of Representatives; Brian Hepburn, Acting Executive Director, Mental Hygiene
Administration, Maryland Department of Health and Mental Hygiene; Paula C. Hollinger, Chair,
Education, Health and Environmental Affairs Committee, Maryland Senate; Pamela S. Hyde, Secretary,
New Mexico Department of Human Services; Billy E. Jones, B. Jones Consulting Services, New York;
Jeffrey C. Lerner, President and Chief Executive Officer, ECRI, Plymouth Meeting, Pa.; Joyce
McRoberts, Deputy Director, Idaho Department of Health and Welfare; David Mechanic, Professor of
Behavioral Science, Institute for Health, Health Care Policy and Aging Research, Rutgers University,
New Brunswick, N.J.; Kenneth C. Montague, Jr., Secretary, Maryland Department of Juvenile Justice;
Oscar Morgan, Senior Consultant, Healthcare Policy, National Mental Health Association, Alexandria,
Va.; Karen Oliver, National Institute of Mental Health, Bethesda, Md.; Margaret Pennington,
Commissioner, Kentucky Department for Mental Health and Mental Retardation, and Vice President,
National Association of State Mental Health Program Directors; Sheila Peterson, Director, Fiscal
Management Division, North Dakota Office of Management and Budget; Daryl C. Plevy, Acting Chief,
Montgomery County Adult Mental Health and Substance Abuse Services, Rockville, Md.; Simon G.
Powell, Principal Analyst, Office of Policy Analysis, Maryland Department of Legislative Services;
Linda Raines, Executive Director, Mental Health Association of Maryland; Peggy Reeves, Member,
Joint Budget and Appropriations Committee, Colorado Senate; Robert Rosenheck, Professor of
A C K N O W L E D G M E N T S
0404_472_TXTr2 6/24/04 6:26 PM Page vi
Milbank Memorial Fundvii
Psychiatry, VA Administration, West Haven, Conn.; Steven S. Sharfstein, President and Chief Executive
Officer, Sheppard and Enoch Pratt Hospital, Baltimore, Md.; Greg Simon, Investigator, Center for
Health Studies, Group Health Cooperative, Seattle, Wash.; Richard Surles, Senior Vice President,
Medical Information Technologies, Comprehensive NeuroScience, Inc., Pennington, N.J.; Leticia Van
de Putte, Member, Education Committee, Texas Senate.
0404_472_TXTr2 6/24/04 6:26 PM Page vii
0404_472_TXTr2 6/24/04 6:26 PM Page viii
Milbank Memorial Fund1
States continue to bear the major responsibility for mental health care for persons with serious and
disabling mental illnesses, both through direct provision of services and through funding of private-
sector care. Central to this mission is how best to allocate limited resources so as to gain maximum value
for patients, families, and society. This briefing makes the following essential points, illustrated with
examples of evidence-based practices:
• A substantial body of outcomes research supports the efficacy of a wide range of mental
health treatments.
• Mental health services can be expected to provide evidence-based practices in order to yield
good outcomes.
• Mental health service authorities and providers should be held accountable for providing services
consistent with evidence-based practices.
• Measures of “program fidelity” have been developed that permit monitoring and accountability.
• Outcomes should be monitored regularly by clinicians as a part of good practice.
• The wide array of effective treatments should be available within a community, because even
when treatments are equally effective on average, many of them are not equally effective for
significant subgroups.
• Treatment choice and wide selection are essential in order to maximize treatment response and
adherence to treatment.
• Access to evidence-based practices is necessary but not sufficient to ensure a quality mental
health service system.
E X E C U T I V E S U M M A R Y
0404_472_TXTr2 6/24/04 6:26 PM Page 1
2Milbank Memorial Fund
Blinding: A research technique often used in clinical trials, such that the patient does not know,
and often the researchers do not know, to what treatment condition the patient has been
assigned. This reduces the risk of bias occasioned by patients’ or researchers’ knowledge about
what treatment is actually being received, influencing response to treatments or interpretation
of results. Once the study is completed, the “blind” is broken so that the results can be analyzed
and interpreted.
Collaborative Care: In the context of this paper, refers to approaches to treating patients with mental
illness in primary care settings through the collaboration of primary care personnel (doctors, nurses,
etc.) and mental health specialists.
Data Extraction Form: A form used to summarize information from research studies in a standardized
manner in order to compare results across studies.
Efficacy v. Effectiveness: “Efficacy” refers to how well a treatment works under carefully controlled
research conditions. “Effectiveness” refers to how well the treatment works when applied in more
typical clinical circumstances.
Home Rule: The principle or practice of self-government in the internal affairs of a dependent political
unit. In the context of this paper, “home rule” refers to the increased importance of local (mental health)
authorities in policy and decision making devolved from state government.
Meta-Analysis: A set of statistical techniques used to combine the results of multiple research studies in
order to answer certain questions.
Negative Symptoms: Symptoms that occur in some persons with schizophrenia, including loss of
emotional expression (flattened affect), poverty of speech, and loss of drive. They are referred to as
“negative” because they are defined by loss of functions.
New Federalism: Refers to the recent national trend according to which certain governmental
responsibilities and authority are being decentralized from the federal government to state
governments. This is one aspect of a broader national tendency to devolve authority and responsibility to
more decentralized levels of government.
Patient Attrition: This occurs when patients in a research study drop out of the study, for any reason,
before the study is completed.
Positive Symptoms: Symptoms that occur in some persons with schizophrenia, including hallucinations,
G L O S S A R Y O F T E R M S
0404_472_TXTr2 6/24/04 6:26 PM Page 2
Milbank Memorial Fund3
delusions, and disordered thinking. They are referred to as “positive” because they are experiences
beyond the normal range of functioning.
Program Fidelity: The degree to which a treatment or program as it is delivered in usual practice remains
true to the treatment as originally developed and evaluated in a research study.
Randomized Clinical Trial: A standard design for research studies evaluating alternative treatment
strategies, in which subjects are assigned by chance (for example, by flip of a coin) to alternative
treatments. Randomization is used to reduce the risk that results are inadvertently biased in favor of one
treatment over another—so-called treatment allocation bias (see below).
Treatment Allocation Bias: Refers to the undesirable situation in a clinical trial in which research
subjects with different characteristics are assigned to different treatments, thus biasing the results
toward a particular treatment. Randomization seeks to eliminate this bias.
Usual Community Care: In treatment studies that compare alternative treatment approaches, refers to
the treatment usually provided in the absence of the research study. Typically, it is the comparison or
“control” condition with which experimental treatments are compared.
0404_472_TXTr2 6/24/04 6:26 PM Page 3
4Milbank Memorial Fund
The states have historically assumed substantial responsibility for the care of persons with severe and
disabling mental illnesses across the life span. This responsibility manifests itself in the form of
treatment programs directly operated by or contracted for by the states, as well as in the form of state
Medicaid programs that support private-sector services. Many persons with severe mental illnesses rely
upon these programs as a result of their disability, and the consequent poverty and unemployment to
which they are vulnerable. Hence, the treatment of persons with severe mental illnesses represents a
major investment of resources for states, as well as for other local government entities. It is essential that
these resources be invested wisely so as to maximize value to patients, families, and society.
A significant approach to increasing the value gained from the expenditure of health care dollars is
adoption of evidence-based practices: that is, the purchase of treatments and services that have been
scientifically confirmed to improve outcomes. With respect to treatment for persons with severe mental
illnesses, the news is both good and bad. The good news is that solid scientific evidence suggests that
many potentially available treatments and services are efficacious; substantial gains in the form of
improved symptoms and functioning are possible with the right treatment. The bad news is that there
are substantial gaps between what science tells us to do and what we do in actual practice, despite the
significant investment of public resources. These gaps exist for several reasons:
• The knowledge and skills of practitioners, as well as of state mental health authorities, lag
substantially behind the evidence. Hence, practitioners and service systems often continue
to provide some interventions that either are unsupported by evidence or have been shown
to be ineffective.
• Policies related to the expenditure of public mental health dollars often do not hold practitioners or
public mental health authorities accountable to provide evidence-based practices and to eliminate
practices that do not help people. Monitoring program fidelity and outcomes is essential for
ensuring this accountability.
• Public funding for mental health services in various instances is often inadequate, or is constrained
in such ways as to make support for certain evidence-based practices difficult (for example, the
awkward and multiple funding streams needed to support certain employment rehabilitation
services), or is poorly invested for other reasons.
This report illustrates the substantial scientific basis for treatments and services for adults, children,
and adolescents with severe mental disorders, with the aim of providing a foundation for policy
discussions at various levels of government, especially states, geared to planning their investment of
mental health care dollars to enhance the value of the services they fund or provide. The report is not
intended to provide a comprehensive summary of evidence-based practices in mental health, but rather
to provide instructive examples of such practices. Readers interested in a comprehensive summary of
evidence-based practices are referred to Mental Health: A Report of the Surgeon General, the National
Guideline Clearinghouse of the Agency for Healthcare Research and Quality (AHRQ) recommendations,
and professional associations’ clinical practice guidelines. In England the National Institute for Clinical
I N T R O D U C T I O N
0404_472_TXTr2 6/24/04 6:26 PM Page 4
Milbank Memorial Fund5
Excellence (NICE) and in Scotland the Scottish Intercollegiate Guidelines Network (SIGN) produce
clinical guidelines using evidence-based reviews. State-of-the-art evidence reviews are available in the
Cochrane Library and in reviews commissioned by AHRQ from the Evidence-Based Practice Centers.
The policy challenge is not only how to ensure that there are adequate resources to enable the
provision of evidence-based practices, but how to hold practitioners and state mental health authorities
accountable to ensure that these practices are delivered in an effective manner and that resources are
not wasted on ineffective treatments and services. We begin with a brief overview of the methods for
evaluating evidence-based practices; proceed with summaries of evidence-based practices for adults,
children, and adolescents; and conclude with policy implications. Two general themes emerge:
• The most effective services combine optimal medication management with psychosocial
interventions that provide the patient and the family with information about the illness, ongoing
supports, and rehabilitation services.
• These evidence-based treatments provide a tangible and measurable road map for improving
outcomes and accountability.
0404_472_TXTr2 6/24/04 6:26 PM Page 5
6Milbank Memorial Fund
Conclusions regarding evidence-based practices have been reached through the systematic review of
thousands of studies combining new statistical techniques and the judgment of expert reviewers.
Groups such as the Agency for Healthcare Research and Quality in the United States and the
Cochrane Collaboration have established principles for determining the effectiveness of treatments.
These include:
• Randomized clinical trials improve the validity of causal conclusions.
• Replication of results in multiple settings improves the validity of results for actual practice.
• Consistency of findings builds confidence.
• Evidence can be ranked in terms of validity, clinical confidence, and expert judgments.
Examples of evidence-based mental health practices are available in the Cochrane Library, in
reviews commissioned by AHRQ from the Evidence-Based Practice Centers, and in professional
associations’ clinical practice guidelines. One of the most recent reference documents is Mental
Health: A Report of the Surgeon General.
The process for conducting systematic, evidence-based reviews includes:
• Statement of objectives and eligibility criteria
• Identification of (all) potentially eligible studies
• Application of eligibility criteria
• Use of unbiased procedures for extracting data
• Critical appraisal
• Assembly of the most complete data set feasible
• Analysis of the data set, using statistical syntheses and sensitivity analyses only if appropriate
and possible
• Preparation of a structured report
A statistical set of methods used in the process of systematic review, called meta-analysis, has
itself become a science in the last decade. New statistical techniques allow for combining data in
ways that allow assessment of effect sizes and of the level of confidence in the replicability of the
conclusions. In its most structured form, researchers conducting these systematic reviews rely
upon the following:
• Design and pilot testing of data extraction forms so as to ensure the standardization of the data
extracted from each study
• Selection of studies for review based upon explicit eligibility criteria and agreed upon by more
than one reviewer
• Assessment of inter-rater reliability in extracting the data from studies
• When possible, blinding of observers to authors, institutions, and journals
• Data extraction and quality assessment by more than one observer
M E T H O D S O F E V I D E N C E - B A S E D P R A C T I C E S
0404_472_TXTr2 6/24/04 6:26 PM Page 6
Milbank Memorial Fund7
• Careful assessment of biases in studies, including treatment allocation biases, blinding, and
handling of patient attrition
• Listing excluded studies, along with reasons for the exclusions
This methodology, as in other scientific endeavors, is designed to allow readers to evaluate the
methods, and to allow others to try to replicate the findings, of the review.
P O P U L A T I O N S
There are two groups of mental health patients of particular concern as regards public-sector policy in
the United States:
• Adults with severe and persistent mental disorders, including disorders of late life (e.g.,
schizophrenia, bipolar disorder, dementia)
• Children and adolescents with severe emotional disturbances (e.g., schizophrenia and other
pervasive developmental disorders in addition to conduct disorder)
G O V E R N A N C E
Patterns of governance, responsibility, accountability, and financing for mental health services have
been changing:
• The public mental health system and public mental health authorities now serve most
population groups.
• No one agency is accountable for all services and resources.
• The service system is fragmented, making it difficult to meet the multiple needs of
each individual.
• Financing streams, especially federal funding sources, have changed significantly in the past
decade with contraction and reduction of social service funding sources and expansion of
Medicaid as a source of ever-widening treatment and support.
• Considerable devolution of responsibility has taken place at all levels of government, in
accordance with the so-called new federalism and the trend toward increasing home rule.
0404_472_TXTr2 6/24/04 6:26 PM Page 7
8Milbank Memorial Fund
O V E R V I E W
A range of effective treatments exists from which to choose in order to suit patient preferences and
provider skills. The following discussion is intended to be illustrative, not exhaustive, of all evidence-based
mental health treatments. In general, the following patterns emerge across various mental illnesses:
• Medications are effective for most of the illnesses discussed here, and although they often have side
effects, they are superior to psychosocial treatments alone in severe cases of many conditions.
• Combined treatments (medication plus psychosocial interventions) often produce the best results.
• Some psychotherapies are empirically supported, particularly cognitive-behavioral and
interpersonal psychotherapies, and have equal efficacy vis-à-vis medication in mild-to-moderate
cases of many conditions.
• Other psychosocial treatments (e.g., family education) and services (e.g., assertive community
treatment and supported employment for adults; multisystemic treatment for children with conduct
disorder) provide advantages for some conditions—particularly to promote rehabilitation and
recovery in the most impaired individuals.
The following examples illustrate these general principles.
F O R A D U L T S W I T H S C H I Z O P H R E N I A
At least five categories of treatments and services for adults with schizophrenia have substantial
evidence bases:
• Antipsychotic medications
• Family education and support
• Illness-specific counseling
• Assertive Community Treatment
• Supported employment
Clearly, medications are the most extensively evaluated treatments for reducing hallucinations,
delusions, and thought disorganization. The evidence for the efficacy of antipsychotic agents in
reducing symptoms and symptom relapse is impressive. Figure 1 aggregates the results of randomized,
placebo-controlled clinical trials to assess the impact of medication on annual relapse rates. Patients
on placebo had an aggregated relapse rate of 70 percent, compared with only 23 percent for those on
antipsychotic medication. The figure also shows that the projected annual relapse rates with these
medications in usual practice are in the range of 40 to 50 percent. The reasons for lower effectiveness
(i.e., in actual practice) as compared with efficacy (i.e., in research trials) are complex. Research
studies often exclude patients who present with complicating problems, such as medical illnesses or
noncompliance, and hence these studies may overestimate the effectiveness that can be achieved in
routine practice where complicating problems are common. However, there are other practice factors
E F F E C T I V E T R E A T M E N T S A N D S E R V I C E S
0404_472_TXTr2 6/24/04 6:26 PM Page 8
Milbank Memorial Fund9
that may influence effectiveness and that can be addressed to improve care, in particular, the use of
unproven dosages in practice and the failure to attend to side effects that may lead to patient
noncompliance and relapse. Similarly, more careful attention and intervention with respect to
common comorbid conditions that affect outcomes, such as comorbid substance abuse, can enhance
overall outcomes.
A number of psychosocial treatments, in combination with appropriate pharmacotherapy, have
been found to provide benefits in the form of reducing symptoms and relapse. Schizophrenia is a
chronic illness that challenges the coping skills of patients and their families; psychosocial treatments
provide guidance and support to enhance coping.
Interventions to help families cope more effectively have been shown to improve outcomes.
Interventions that educate families about schizophrenia, provide support, and offer training in effective
problem solving and communication have been subjected to numerous randomized clinical trials. The
data strongly and consistently support the value of such interventions in reducing symptom relapse, and
there is some evidence that they contribute to improved patient functioning and family well-being. The
randomized clinical trials have reported one-year relapse rates for patients receiving these family
“psychoeducation” programs in combination with medication that are more than 50 percent lower than
for patients receiving medication alone (see Figure 2). This relative reduction in relapse rates has
persisted for at least two years in the one clinical trial that followed patients for that long. Furthermore, a
recent study found psychoeducational programs using multiple family groups to be more effective and
less expensive than individual family psychoeducational interventions for Caucasians, though not for
F I G U R E 1 . E F F I C A C Y A N D E F F E C T I V E N E S S O F A N T I P S Y C H O T I C M E D I C A T I O N S :
A N N U A L R E L A P S E R A T E S
Placebo Medication Efficacy Medication Effectiveness
Source: Dixon, Lehman, and Levine 1995.
Per
cen
tage
of
Pat
ien
ts
100
90
80
70
60
50
40
30
20
10
0
23
45
70
0404_472_TXTr2 6/24/04 6:26 PM Page 9
10Milbank Memorial Fund
African Americans. Other beneficial outcomes of family interventions that have been reported include
reduced rates of hospital admission, reduced family burden, and improved patient-family relationships.
Based upon the evidence, persons with schizophrenia and their families who have ongoing contact with
each other should be offered a family intervention, the key elements of which are a duration of at least
nine months, illness education, crisis intervention, emotional support, and training in how to cope with
illness symptoms and related problems.
Similarly, there is evidence that illness-specific forms of psychotherapy for persons with schizophrenia
improve outcomes. Controlled studies of cognitive behavioral psychotherapy (CBT) have reported benefits
in reducing symptom severity among patients who do not respond fully to antipsychotic medications. CBT
focuses on changing maladaptive behaviors, including certain patterns of thinking, by attempting to alter
underlying cognitive distortions. For example, persons with paranoid delusions may habitually resort to
distorted interpretations about their environment that in turn reinforce a sense of persecution; CBT is
designed to help the person recognize such maladaptive thought habits and change them. Most studies of
cognitive behavioral psychotherapy have been performed with individual CBT of at least several months’
duration; in some studies, group CBT and/or therapy of a shorter duration have been used. In all of the
studies, clinicians who provided CBT received specialized training in the approach.
Persons with schizophrenia who have residual psychotic symptoms despite receiving adequate
pharmacotherapy may benefit, therefore, from cognitive behaviorally oriented psychotherapy. The key
elements of this intervention include a shared understanding of the illness between the patient and
therapist, identification of target symptoms, and the development of specific cognitive and behavioral
F I G U R E 2 . C O M B I N I N G M E D I C A T I O N A N D F A M I L Y E D U C A T I O N I N
S C H I Z O P H R E N I A : A N N U A L R E L A P S E R A T E S
Placebo Medication Medication and Family Psychoeducation
Sources: Dixon, Adams, and Lucksted 2000; Dixon and Lehman 1995.
Per
cen
tage
of
Pat
ien
ts
100
90
80
70
60
50
40
30
20
10
0
45
20
70
0404_472_TXTr2 6/24/04 6:26 PM Page 10
Milbank Memorial Fund11
strategies to cope with these symptoms. Figure 3 summarizes the results from recent studies comparing
CBT with some control interventions in the case of schizophrenia patients with residual symptoms on
medications who are living in the community.
The program of Assertive Community Treatment (ACT) is a specific model of community-based
care. Its origin is an experiment in Madison, Wisconsin, in the late 1970s in which the multidisciplinary
inpatient team of the state hospital was moved into the community. The experiment arose from the
observation that as inpatient programs became more successful at discharging patients, a new problem
of the “revolving door” arose owing to the inadequacy of community services. The researchers in essence
“deinstitutionalized” the inpatient treatment team to create ACT. The team took with it all of the
functions of an inpatient team: interdisciplinary teamwork, 24-hour/7-days-per-week coverage,
comprehensive treatment planning, ongoing responsibility, staff continuity, and small caseloads. ACT is
designed to treat patients who are at high risk for hospital readmission and who cannot be maintained by
more usual community-based treatment.
Randomized trials comparing ACT to other community-based care programs have consistently
shown that ACT substantially reduces inpatient utilization and promotes continuity of outpatient care.
Patient satisfaction with this model is generally high, and family advocacy groups, such as the National
Alliance for the Mentally Ill in the United States, strongly support its use and dissemination. Results are
less consistent regarding the impacts of ACT on other outcomes, although at least some studies have
shown enhancement of clinical status, functioning, and quality of life. Figure 4 summarizes the
impressive results of ACT from over two dozen controlled trials.
F I G U R E 3 . C O G N I T I V E B E H AV I O R A L T H E R A P Y ( C B T ) F O R R E S I D U A L
S Y M P T O M S I N S C H I Z O P H R E N I A P A T I E N T S I N C O M M U N I T Y
Positive Symptoms Negative Symptoms Depression Total Symptoms
Source: Dickerson 2000.
Nu
mbe
r of
Stu
dies
7
6
5
4
3
2
1
0
CBT NoDifference
Patients Improved
0404_472_TXTr2 6/24/04 6:26 PM Page 11
12Milbank Memorial Fund
Supported employment is an approach to improving vocational functioning among persons with
various types of disabilities, including schizophrenia. “Supported employment” refers to an approach
to vocational rehabilitation that emphasizes rapid placement of the patient into a competitive, not
necessarily full-time, job based upon the patient’s preferences and skills, and provision of ongoing
supports and training to help the patient maintain employment. For this reason it is also referred to as
a “place and train” model of vocational rehabilitation, in contrast to the “train and place” approach
that is much more widely used by rehabilitation services and that has not been found to consistently
help patients achieve competitive employment. The evidence-based supported employment programs
that have been found effective incorporate the key elements of individualized job development, rapid
placement emphasizing competitive employment, ongoing job supports, and integration of vocational
and mental health services.
Randomized trials have consistently demonstrated the effectiveness of supported employment in
helping persons with schizophrenia to achieve competitive employment (see Figure 5). Employment
outcomes related to the duration of employment and the amount of earnings also favor supported
employment over traditional vocational services, and there is no evidence that engagement in
supported employment leads to stress, increased symptoms, or other negative outcomes. Evidence is
inconsistent about the relationship between clinical and demographic variables and successful
vocational performance. It is recommended, therefore, that any person with schizophrenia who
expresses an interest in work should be offered supported employment.
F I G U R E 4 . B E N E F I T S O F A S S E R T I V E C O M M U N I T Y T R E A T M E N T ( A C T )
Time inHospital
HousingStability
Quality of Life
ClientSatisfaction
Symptoms SocialFunctioning
Vocational Jail/Arrests
Source: Mueser et al. 1998.
Nu
mbe
r of
Stu
dies
18
16
14
12
10
8
6
4
2
0
Based on 25 Studies
ACT Betterthan Standard
ACT Not Better than Standard
17
6
8
3
5
3
1
3
7 7 7
910
5
2
7
0404_472_TXTr2 6/24/04 6:26 PM Page 12
Milbank Memorial Fund13
F O R A D U L T S W I T H M I L D T O M O D E R A T E D E P R E S S I O N
Depression is the most common mental illness, and it is among the leading causes of disability in
established market economies. Cognitive behavioral and interpersonal psychotherapies have been
found effective in reducing or eliminating the symptoms and sequelae of depression, as have a range
of antidepressant medications. Figure 6 provides a composite view of the advantages of antidepressant
medications over placebo for major depression and for dysthymia, a less acutely disabling but more
chronic form of depression. As shown, patients are significantly more likely to improve with
medication as compared with placebo.
Because many patients with depression are treated in primary care settings, development of
effective strategies in these settings is essential. Current research is examining a range of innovative
strategies for collaborative care using mental health specialists in primary care–based disease-
management strategies. These strategies involve two basic approaches. First is the approach that adds
routine, systematic screening to identify primary care patients who are depressed, followed by a
collaborative care approach that enhances the usual primary care treatment for depression. Often
such patients otherwise go undiagnosed and untreated. Instead, a mental health specialist works
collaboratively with the primary care team to provide evidence-based depression treatment.
A second approach adds collaborative, evidence-based mental health care to the primary care
setting for patients already diagnosed with depression. Some of these approaches make efficient use of
regular telephone consultations with patients to help guide treatment decisions. Such programs vary
F I G U R E 5 . S U P P O R T E D E M P L O Y M E N T S T U D I E S
0 10 20 30 40 50 60 70 80 90 100
Source: Bond et al. 1999.Percentage Working at Least Part-time
Supported Employment Comparison
Mueser et al. 2004
Lehman et al. 2002
McFarlane et al. 2000
Drake et al. 1999
Chandler et al. 1997
Drake et al. 1996
Bond et al. 1995
Gervey and Bedell 1994
0404_472_TXTr2 6/24/04 6:26 PM Page 13
14Milbank Memorial Fund
in their effectiveness in producing depression-free days and in the costs required to achieve these
outcomes, but in general the innovative programs demonstrate gains vis-à-vis primary care services
provided without these collaborative approaches. For example, the evaluation of one model of
collaborative care using nonphysician mental health specialists shows that patients with depression
treated with the collaborative care model in primary care settings experienced a significantly greater
reduction in symptoms over a one-year period than did patients treated with usual primary care
(see Figure 7).
F O R C H I L D R E N W I T H C O N D U C T D I S O R D E R S
Multisystemic treatment (MST) is a community-based, intensive, short-term (three to four months)
home- and family-focused treatment approach for youths with severe emotional disorders. MST seeks
to promote more socialized behavior and better long-term outcomes by intervening in multiple
contexts—with family, peer groups, school, and neighborhood—to enhance the capacity of parents and
community organizations to support troubled youths. To date, eight randomized trials of MST with
various youth subgroups have been published: Three studies focused on violent and chronic juvenile
offenders, and one study each focused on substance-abusing juvenile offenders, youths presenting
with psychiatric emergencies, youths with maltreating families, inner-city delinquents, and juvenile
sex offenders. Studies consistently indicate that MST reduces long-term rates of rearrest by 25 to 70
percent and long-term rates of days in out-of-home placements by 47 to 64 percent; reduces
F I G U R E 6 . E F F E C T I V E N E S S O F A N T I D E P R E S S A N T M E D I C A T I O N S
Major Depression Dysthymia
Source: U.S. Department of Health and Human Services 1999.
Per
cen
tage
of
Pat
ien
ts I
mpr
oved
70
60
50
40
30
20
10
0
Placebo
Antidepressant
Medication
0404_472_TXTr2 6/24/04 6:26 PM Page 14
Milbank Memorial Fund15
psychiatric symptoms and substance abuse; and improves mainstream school attendance, family
relations, and consumer satisfaction.
F O R C H I L D R E N W I T H A T T E N T I O N D E F I C I T H Y P E R A C T I V I T Y D I S O R D E R
As is the case for most conditions, accurate diagnosis is the key first step in appropriate treatment of
attention deficit hyperactivity disorder (ADHD). Unfortunately, misdiagnosis, in the form of both
underdiagnosis (particularly in poorer families) and overdiagnosis, is common. Stimulants and other
newer medications are effective in controlling behaviors that cause children with this condition to
otherwise have poor outcomes in school and in later life. Experience with these medications suggests
that close monitoring and close contact with families are essential to good practice. Behavioral
treatments are also effective with children, particularly those who prefer not to take medications or
who do not respond to medications. In the landmark Multimodal Treatment for Children with
Attention Deficit Hyperactivity Disorder (MTA) Study, children with ADHD were randomly assigned
to four treatment protocols: medication management, behavioral treatment, combined medication
and behavioral treatment, or usual community care (CC). As Figure 8 shows, medication management
and combined medication and behavioral treatment were superior to usual community care or
behavioral treatment alone in reducing hyperactive-impulsive symptoms. For some other outcomes,
behavioral treatment was superior to usual community care.
F I G U R E 7 . R E D U C T I O N I N D E P R E S S I O N : C O L L A B O R A T I V E C A R E V.
U S U A L P R I M A R Y C A R E
Baseline 3 6 12
Follow-up (months)Source: Unutzer et al. 2002.
Dep
ress
ion
Sco
re
2.0
1 .8
1 .6
1 .4
1 .2
1 .0
0.8
0.6
0.4
0.2
0.0
p = .553
p < .0001
p < .0001p < .0001
CollaborativeCare
Usual Primary Care
0404_472_TXTr2 6/24/04 6:26 PM Page 15
16Milbank Memorial Fund
F O R O T H E R M E N T A L I L L N E S S E S
The effectiveness of various other treatments for a range of other mental disorders has also been
demonstrated for such conditions as severe mood disorders, bipolar disorders, anxiety disorders (such as
panic disorder and obsessive-compulsive disorder), posttraumatic stress disorder, and borderline
personality disorder.
P R O G R A M F I D E L I T Y
There are various dimensions to the gap between the development of scientifically validated treatments
and actual practice. The one on which we have focused thus far is failure to adopt a given “practice.” But
it is also true that there are different levels of implementation, and too often interventions are not
properly implemented in practice based upon how they were administered in the original scientific
studies. A readily apparent example is the prescription of the appropriate medication, based upon
scientific evidence of efficacy but using a dose not evaluated in the original clinical trials. The challenges
are even greater when it comes to implementation of evidence-based psychosocial interventions that
require significant changes in practitioner and service system behavior and structure.
Program fidelity measures have been developed that permit monitoring and accountability for
several evidence-based psychosocial interventions, including assertive community treatment, supported
F I G U R E 8 . O U T C O M E S O F T H E M U L T I M O D A L T R E A T M E N T F O R C H I L D R E N
W I T H A D H D S T U D Y
Assessment Point (months)
• Medication > Behavioral
• Combined > Behavioral
• Combined = Medication
• Combined > CC
• Medication > CC
• Behavioral = CC
Ave
rage
Sco
re
2.5
2.0
1 .5
1 .0
0.5
0
Hyperactive-Impulsive Symptoms
Effectiveness in Symptom Reduction
Medication
Behavioral
Combined
CommunityCare (CC)
.
!
j
B
B
B
j
!
!
!
.
..
!j
jj
B B.
Source: Unutzer et al. 2002.
0404_472_TXTr2 6/24/04 6:26 PM Page 16
Milbank Memorial Fund17
employment, and treatment for patients dually diagnosed with both mental illness and substance abuse.
Fidelity in implementing programs is key to both effectiveness and costs, as illustrated in Figure 9. As
shown in this large study by the Department of Veterans Affairs of the implementation of an assertive
community treatment program called Intensive Psychiatric Community Care (IPCC), the sites in which
IPCC was implemented with good fidelity to the assertive community treatment model realized cost
reductions and better outcomes. In contrast, at sites where program fidelity was not good, costs actually
increased and outcomes were poorer. The lesson from a policy perspective is that the commitment of
resources to implement evidence-based treatments must be accompanied by regular monitoring of
program fidelity and associated outcomes.
F I G U R E 9 . I M P L E M E N T A T I O N O F I N T E N S I V E P S Y C H I A T R I C C O M M U N I T Y C A R E
( I P C C ) W I T H H I G H A N D L O W F I D E L I T Y
Source: Rosenheck et al. 1995.
$20,000
$15,000
$10,000
$5,000
0
- $5,000
- $10,000
- $15,000
- $20,000
40
20
0
-20
-40
-60
-80
-100
IPCC v. Control
Changes in Costs (2-year mean) Changes in Inpatient Days (2-year mean)
IPCC v. Control
High Fidelity
Low Fidelity
High Fidelity
Low Fidelity
0404_472_TXTr2 6/24/04 6:26 PM Page 17
18Milbank Memorial Fund
W O R K F O R C E I S S U E S
The success of all human services depends heavily upon the adequate supply of a quality workforce. It
should be clear from the information provided here that effective mental health systems that provide
quality, evidence-based treatment must rely upon a well-trained and available workforce. Producing
such a workforce is a daunting task. For the most part, mental health practitioners, in the appropriate
circumstances and given the appropriate training and incentives, will be willing to adopt practices that
improve outcomes. Too often, however, practitioners are overworked and underpaid, lack training in
many of the evidence-based practices presented here, and lack incentives to change. Simply
mandating changes in practice, then, is likely to fail. Practitioners need opportunities and incentives
to learn new, evidence-based approaches, combined with the expectation that they will avail
themselves of such opportunities and put into practice what they learn. It must be noted, too, that
whereas substantial efforts are needed to address the performance of the existing workforce,
comparable efforts are also necessary within the institutions of higher learning that are training the
future workforce. As important as it is that these institutions emphasize competence in evidence-based
practices, it is even more critical that they instill openness to adopting new evidence-based practices as
knowledge evolves over practitioners’ careers.
W H A T A B O U T S E R V I C E S L A C K I N G A N E V I D E N C E B A S E ?
Although evidence-based practices are necessary for a quality mental health system, they are not
sufficient. This is a critical point. A distinction must be made between treatments and services
that have been shown to be ineffective (or substantially less effective than other evidence-based
alternatives) and those about which there is little or no systematic evidence either way. Clearly,
the former are to be discouraged in favor of proven evidence-based alternatives. For many
services, however, there is often little systematic outcome evidence upon which to base informed
decisions. Practitioners and policymakers are left to evaluate the merit of these services
based upon prevailing professional standards of practice, community needs, and other
pragmatic factors.
Whereas services that are consuming substantial resources should be subjected to evaluations
that can guide decisions about their value, a categorical approach to not funding services unless
they have a systematic evidence base can do considerable harm, eliminating some essential
services. Some services are of self-evident value, and investment in their systematic evaluation
may provide little new information; it seems obvious, for example, that provision of shelter and
food to homeless persons with severe mental illness has value. Other services may warrant
continued support but with the expectation that some evaluation occur to ensure that resources
are well spent.
F U R T H E R I S S U E S , S E R V I C E S , A N D P O L I C Y I M P L I C A T I O N S
0404_472_TXTr2 6/24/04 6:26 PM Page 18
Milbank Memorial Fund19
I M P L I C A T I O N S F O R P O L I C Y M A K E R S
There are a number of key points for policymakers from this body of scientific evidence:
• A substantial body of outcomes research supports the efficacy of a wide range of evidence-based
mental health treatments.
• Mental health services should be expected to provide evidence-based practices in order to yield
good outcomes.
• Existing service providers should be held accountable for providing services consistent with
evidence-based practices.
• Funding and policy entities should be held accountable for creating an environment that enables
service providers to deliver evidence-based practices.
• Measures of “program fidelity” have been developed that permit monitoring and accountability.
• Outcomes should be monitored regularly by clinicians as a part of good practice.
• Programs that achieve and maintain fidelity to evidence-based practices should be expected to
achieve those expected outcomes.
• The wide array of effective treatments should be available within a community, because even
when treatments are equally effective in general for the entire population, many of them are not
equally effective for significant subgroups.
• Treatment choice and wide selection are essential in order to maximize treatment response and
adherence to treatment.
• Federal sources of system support should incorporate and require evidence-based practices in
considering approval of state and county Medicaid plans.
These recommendations, if implemented, could help balance the costs of care and treatment with
the advantages to patients and the benefits to society. Most of the treatments and services described in
this report are considered to be cost-effective—and they have been implemented in settings in which
care has been managed with reasonable cost.
0404_472_TXTr2 6/24/04 6:26 PM Page 19
20Milbank Memorial Fund
I N T R O D U C T I O N
4 A significant approach to increasing the value gained: Institute of Medicine 2001; Lehman,
Steinwachs, and the Survey Co-Investigators of the PORT Project 1998.
4 Readers interested in a comprehensive summary of evidence-based practices are referred to Mental
Health: A Report of the Surgeon General: U.S. Department of Health and Human Services 1999.
4 the National Guideline Clearinghouse: http://www.guideline.gov/ (accessed March 15, 2004).
4 professional associations’ clinical practice guidelines: American Psychiatric Association
1993, 1997.
4-5 In England the National Institute for Clinical Excellence (NICE): http://www.nice.org.uk (accessed
March 15, 2004).
5 in Scotland the Scottish Intercollegiate Guidelines Network (SIGN): http://www.sign.ac.uk (accessed
March 15, 2004).
5 State-of-the-art evidence reviews are available in the Cochrane Library: http://www.cochrane.org
(accessed March 15, 2004).
5 and in reviews commissioned by AHRQ from the Evidence-Based Practice Centers:
http://www.ahcpr.gov/clinic/epcix.htm (accessed March 15, 2004).
M E T H O D S O F E V I D E N C E - B A S E D P R A C T I C E S
6 Examples of evidence-based mental health practices are available in the Cochrane Library:
http://www.cochrane.org (accessed March 15, 2004).
6 in reviews commissioned by AHRQ from the Evidence-Based Practice Centers:
http://www.ahcpr.gov/clinic/epcix.htm (accessed March 15, 2004).
6 professional associations’ clinical practice guidelines: American Psychiatric Association 1993, 1997.
6 One of the most recent reference documents is: U.S. Department of Health and Human Services 1999.
E F F E C T I V E T R E A T M E N T S A N D S E R V I C E S
8 The evidence for the efficacy of antipsychotic agents in reducing symptoms and symptom relapse is:
Dixon, Lehman, and Levine 1995.
9 Interventions that educate families about schizophrenia, provide support, and offer training: Dixon,
Adams, and Lucksted 2000; Dixon and Lehman 1995.
9 This relative reduction in relapse rates has persisted: Hogarty et al. 1991.
9 Furthermore, a recent study found psychoeducational programs using: McFarlane et al. 1995.
10 Controlled studies of cognitive behavioral psychotherapy (CBT) have reported: Dickerson 2000.
11 Its origin is an experiment in Madison, Wisconsin: Stein and Test 1980.
N O T E S
p.
0404_472_TXTr2 6/24/04 6:26 PM Page 20
Milbank Memorial Fund21
11 Randomized trials comparing ACT to other community-based care programs have: Mueser et al. 1998;
Scott and Dixon 1995.
12 Supported employment is an approach to improving vocational functioning: Bond et al. 1999.
12 Randomized trials have consistently demonstrated: Bond et al. 1997.
12 Employment outcomes related to the duration of employment: Lehman 1995.
13 Depression is the most common mental illness: Murray and Lopez 1997.
13 Cognitive behavioral and interpersonal psychotherapies have been found: Beck, Rush, and Shaw
1979; Frank et al. 1990; Frank et al. 1991.
13 As shown, patients are significantly more likely to improve: U.S. Department of Health and
Human Services 1999.
13 First is the approach that adds routine: Lave and Schulberg 1999; Mynors-Wallis et al. 1995;
Peveler et al. 1999.
13 A second approach adds collaborative, evidence-based mental health care: Hunkeler et al. 2000;
Katon et al. 1995; Katon et al. 1996; Katon et al. 1999; Simon et al. 2000; Von Korff et al. 1998.
14 For example, the evaluation of one model of collaborative care: Unutzer et al. 2002.
14 Multisystemic treatment (MST) is a community-based: Halliday-Boykins and Henggeler 2001.
14 Studies consistently indicate that MST reduces long-term rates of rearrest: Halliday-Boykins and
Henggeler 2001; Henggeler et al. 1998; Henggeler et al. 2002; Hoagwood et al. 1996; Schoenwald
et al. 2003; U.S. Department of Health and Human Services 1999.
15 In the landmark Multimodal Treatment for Children with Attention Deficit Hyperactivity Disorder:
The MTA Cooperative Group Moderators and Mediators of Treatment Response for Children with
Attention-Deficit/Hyperactivity Disorder 1999.
16 The effectiveness of various other treatments: U.S. Department of Health and Human Services 1999.
16 Program fidelity measures have been developed: McGrew et al. 1994.
17 In contrast, at sites where program fidelity was not good: Rosenheck et al. 1995.
0404_472_TXTr2 6/24/04 6:26 PM Page 21
22Milbank Memorial Fund
American Psychiatric Association. 1993. Practice Guideline for Major Depressive Disorder in Adults.
American Journal of Psychiatry 150 (suppl. 4): 1–26.
American Psychiatric Association. 1997. Practice Guideline for the Treatment of Patients with
Schizophrenia. Washington, D.C.: American Psychiatric Association Press.
Beck, A.T., A.J. Rush, and B.F. Shaw. 1979. Cognitive Therapy of Depression. New York: Guilford Press.
Bond, G.R., L.L. Dietzen, J.H. McGrew, and L.D. Miller. 1995. Accelerating Entry into Supported
Employment for Persons with Severe Psychiatric Disabilities. Rehabilitation Psychology 40:91–111.
Bond, G., R.E. Drake, D. Becker, and K. Mueser. 1999. Effectiveness of Psychiatric Rehabilitation
Approaches for Employment of People with Severe Mental Illness. Journal of Disability Policy Studies
10:18–52.
Bond, G., R. Drake, K.T. Mueser, and D. Becker. 1997. An Update on Supported Employment for
People with Severe Mental Illness. Psychiatric Services 48:335–46.
Chandler, D., J. Meisel, T. Hu, M. McGowen, and K. Madison. 1997. A Capitated Model for a Cross-
Section of Severely Mentally Ill Clients: Employment Outcomes. Community Mental Health Journal
33:501–16.
Dickerson, F.B. 2000. Cognitive Behavioral Psychotherapy for Schizophrenia: A Review of Recent
Empirical Studies. Schizophrenia Research 43:71–90.
Dixon, L., C. Adams, and A. Lucksted. 2000. Update on Family Psychoeducation for Schizophrenia.
Schizophrenia Bulletin 26:5–20.
Dixon, L., and A. Lehman. 1995. Family Interventions for Schizophrenia. Schizophrenia Bulletin 21:631–43.
Dixon, L., A. Lehman, and J. Levine. 1995. Conventional Antipsychotic Medications for
Schizophrenia. Schizophrenia Bulletin 21:567–78.
Drake, R.E., G.J. McHugo, R.R. Bebout, D.R. Becker, M. Harris, G.R. Bond, and E. Quimby. 1999. A
Randomized Clinical Trial of Supported Employment for Inner-City Patients with Severe Mental
Disorders. Archives of General Psychiatry 56:627–33.
R E F E R E N C E S
0404_472_TXTr2 6/24/04 6:26 PM Page 22
Milbank Memorial Fund23
Drake, R.E., G.J. McHugo, D.R. Becker, W.A. Anthony, and R.E. Clark. 1996. The New Hampshire
Study of Supported Employment for People with Severe Mental Illness: Vocational Outcomes. Journal
of Consulting and Clinical Psychology 64:391–9.
Frank, E., D.J. Kupfer, J.M. Perel, C. Cornes, D.B. Jarrett, A.G. Mallinger, M.E. Thase, A.B.
McEachran, and V.J. Grochoconski. 1990. Three-Year Outcomes for Maintenance Therapies in
Recurrent Depression. Archives of General Psychiatry 47:1093–9.
Frank, E., D.J. Kupfer, E.F. Wagner, A.B. McEachran, and C. Cornes. 1991. Efficacy of Interpersonal
Psychotherapy as a Maintenance Treatment for Recurrent Depression. Archives of General Psychiatry
48:1053–9.
Gervey, R., and J.R. Bedell. 1994. Supported Employment Invocation Rehabilitation. In Psychological
Assessment and Treatment of Persons with Severe Mental Disorders, edited by J.R. Bedell, 139–63.
Washington, D.C.: Taylor and Francis.
Halliday-Boykins, C.A., and S.W. Henggeler. 2001. Multisystemic Therapy: Theory, Research and
Practice. In Balancing Family-Centered Services and Child Well-Being, edited by E. Walton, P.A.
Sandau-Beckler, and M. Mannes, 320–35. New York: Columbia University Press.
Henggeler, S.W., S.K. Schoenwald, C.M. Borduin, M.D. Rowland, and P.B. Cunningham. 1998.
Multisystemic Treatment of Antisocial Behavior in Children and Adolescents. New York: Guilford Press.
Henggeler, S.W., S.K. Schoenwald, J.G. Liao, E.J. Letourneau, and D.L. Edwards. 2002. Transporting
Efficacious Treatments to Field Settings: The Link between Supervisory Practices and Therapist
Fidelity in MST Programs. Journal of Clinical Child Psychology 31(2):155–67.
Hoagwood, K., P.S. Jensen, T. Petti, and B.J. Burns. 1996. Outcomes of Mental Health Care for
Children and Adolescents, I. A Comprehensive Conceptual Model. Journal of the American Academy of
Child and Adolescent Psychiatry 35:1055–63.
Hogarty, G.E., C.M. Anderson, D.J. Reiss, S.J. Kornblith, D.P. Greenwald, R.F. Ulrich, and M. Carter.
1991. Family Psychoeducation, Social Skills Training, and Maintenance Chemotherapy in the
Aftercare Treatment of Schizophrenia: Two-Year Effects of a Controlled Study on Relapse and
Adjustment. Archives of General Psychiatry 48:340–7.
0404_472_TXTr2 6/24/04 6:26 PM Page 23
24Milbank Memorial Fund
Hunkeler, E.M., J.F. Meresman, W.A. Hargreaves, B. Fireman, W.H. Berman, A.J. Kirsch, J. Groebe,
S.W. Hurt, P. Braden, M. Getzell, P.A. Feigenbaum, T. Peng, and M. Salzer. 2000. Efficacy of Nurse
Telehealth Care and Peer Support in Augmenting Treatment of Depression in Primary Care. Archives
of Family Medicine 9:700–8.
Institute of Medicine. 2001. Crossing the Quality Chasm: A New Health System for the 21st Century.
Washington, D.C.: National Academy Press.
Katon, W.J., P. Robinson, M. Von Korff, E.H.B. Lin, T. Bush, E.J. Ludman, G. Simon, and E. Walker.
1996. A Multifaceted Intervention to Improve Treatment of Depression in Primary Care. Archives of
General Psychiatry 53:924–32.
Katon, W., M. Von Korff, E. Lin, G.E. Simon, E. Walker, J. Unutzer, G. Simon, J. Russo, and E.
Ludman. 1999. Stepped Collaborative Care for Primary Care Patients with Persistent Symptoms of
Depression: A Randomized Trial. Archives of General Psychiatry 56:1109–15.
Katon, W.J., M. Von Korff, E.H.B. Lin, E.A. Walker, G.E.M. Simon, T. Bush, P. Robinson, and J.
Russo. 1995. Collaborative Management to Achieve Treatment Guidelines: Impact on Depression in
Primary Care. Journal of the American Medical Association 273:1026–31.
Lave, J.R., and H.C. Schulberg. 1999. Integrating Cost-Effectiveness Analyses within Clinical Trials of
Treatment for Major Depression in Primary Care Practice. In Cost-Effectiveness of Psychotherapy: A
Guide for Practitioners, Researchers, and Policy-Makers, edited by N.E. Miller and K.M. Magruder,
75–84. New York: Oxford University Press.
Lehman, A.F. 1995. Vocational Rehabilitation in Schizophrenia. Schizophrenia Bulletin 21:645–56.
Lehman, A.F., R. Goldberg, L.B. Dixon, S. McNary, L. Postrado, A. Hackman, and K. McDonnell.
2002. Improving Employment Outcomes for Persons with Severe Mental Illness. Archives of General
Psychiatry 59:165–72.
Lehman, A.F., D.S. Steinwachs, and the Survey Co-Investigators of the PORT Project. 1998. Patterns
of Usual Care for Schizophrenia: Initial Results from the Schizophrenia Patient Outcomes Research
Team (PORT) Client Survey. Schizophrenia Bulletin 24:11–20.
McFarlane, W.R., R.A. Dushay, S.M. Deakins, P. Stastny, E.P. Lukens, J. Toran, and B. Link. 2000.
Employment Outcomes in Family-Aided Assertive Community Treatment. American Journal of
Orthopsychiatry 70:203–14.
0404_472_TXTr2 6/24/04 6:26 PM Page 24
Milbank Memorial Fund25
McFarlane, W.R., E. Lukens, B. Link, R. Dushay, S.A. Deakins, M. Newmark, E.J. Dunne, B. Horen,
and J. Toran. 1995. Multiple Family Group and Psychoeducation in the Treatment of Schizophrenia.
Archives of General Psychiatry 52:679–87.
McGrew, J.H., G.R. Bond, L. Dietzen, and M. Saylers. 1994. Measuring the Fidelity of Implementation
of a Mental Health Program Model. Journal of Consulting and Clinical Psychology 62:670–8.
The MTA Cooperative Group Moderators and Mediators of Treatment Response for Children with
Attention-Deficit/Hyperactivity Disorder. 1999. Archives of General Psychiatry 56:1088–96.
Mueser, K.T., G.R. Bond, R.E. Drake, and S.G. Resnick. 1998. Models of Community Care for Severe
Mental Illness: A Review of Research on Case Management. Schizophrenia Bulletin 42:37–74.
Mueser, K.T., R.E. Clark, M. Haines, R.E. Drake, G.J. McHugo, G.R. Bond, S.M. Essock, D.R. Becker,
R. Wolfe, and K. Swain. Forthcoming, 2004. The Hartford Study of Supported Employment for
Persons with Severe Mental Illnesses. Journal of Consulting and Clinical Psychology.
Murray, C.J.L., and A.D. Lopez. 1997. Alternative Projections of Mortality and Disability by Cause,
1990–2020; Global Burden of Disease Study. Lancet 349:1498–1504.
Mynors-Wallis, L.M., D.H. Gath, A.R. Lloyd-Thomas, and D. Tomlinson. 1995. Randomized Controlled
Trial Comparing Problem Solving Treatment with Amitriptyline and Placebo for Major Depression in
Primary Care. BMJ 310:441–5.
Peveler, R., C. George, A.L. Kinmonth, M. Campbell, and C. Thompson. 1999. Effect of
Antidepressant Drug Counseling and Information Leaflets on Adherence to Drug Treatment in
Primary Care: Randomized Controlled Trial. BMJ 319:612–5.
Rosenheck, R.A., M. Neale, P. Leaf, R. Milstein, and L. Frisman. 1995. Multisite Experimental Cost
Study of Intensive Psychiatric Community Care. Schizophrenia Bulletin 21:129–40.
Schoenwald, S.K., A.J. Sheidow, E.J. Letourneau, and J.G. Liao. 2003. Transportability of Multisystemic
Therapy: Evidence for Multi-Level Influences. Mental Health Services Research 5(4):223–39.
Scott, J., and L. Dixon. 1995. Assertive Community Treatment and Case Management. Schizophrenia
Bulletin 21:657–68.
0404_472_TXTr2 6/24/04 6:26 PM Page 25
26Milbank Memorial Fund
Simon, G.E., M. Von Korff, C. Rutter, and E.H. Wagner. 2000. Randomized Trial of Monitoring,
Feedback, and Management of Care by Telephone to Improve Treatment of Depression in Primary
Care. BMJ 320:550–4.
Stein, L.I., and M.A. Test. 1980. Alternative to Mental Hospital Treatment, I. Conceptual Model,
Treatment Program, and Clinical Evaluation. Archives of General Psychiatry 37:392–7.
Unutzer, J., W. Katon, C. Callahan, J.W. Williams, Jr., E. Hunkeler, L. Harpole, M. Hoffing, R.D. Della
Penna, P.H. Noel, E.H. Lin, P.A. Arean, M.T. Hegel, L. Tang, T.R. Belin, S. Oishi, C. Langston, for the
IMPACT Investigators. 2002. Collaborative Care Management of Late-Life Depression in the Primary
Care Setting: A Randomized Controlled Trial. Journal of the American Medical Association
288:2836–45.
U.S. Department of Health and Human Services. 1999. Mental Health: A Report of the Surgeon
General. Rockville, Md.: U.S. Department of Health and Human Services, Substance Abuse and
Mental Health Services Administration, Center for Mental Health Services, National Institutes of
Health, National Institute of Mental Health.
Von Korff, M., W. Katon, T. Bush, E.H. Lin, G.E. Simon, K. Saunders, E. Ludman, E. Walker, J.
Unutzer. 1998. Treatment Costs, Cost Offset, and Cost-Effectiveness of Collaborative Management of
Depression. Psychosomatic Medicine 60:143–9.
W E B S I T E S
http://www.ahcpr.gov/clinic/epcix.htm (accessed March 15, 2004).
http://www.cochrane.org (accessed March 15, 2004).
http://www.guideline.gov/ (accessed March 15, 2004).
http://www.nice.org.uk (accessed March 15, 2004).
http://www.sign.ac.uk (accessed March 15, 2004).
0404_472_TXTr2 6/24/04 6:26 PM Page 26
Milbank Memorial Fund27
A N T H O N Y F . L E H M A N
Anthony F. Lehman, M.D., M.S.P.H., is Professor and Chair of the Department of Psychiatry at the
University of Maryland School of Medicine. His clinical, teaching, and research activities have focused
on serving persons with severe and persistent mental illnesses and examining outcomes, the impacts
of substance use disorders, the effectiveness of Assertive Community Treatment programs, supported
employment, and interventions for families. In 1998 the National Alliance for the Mentally Ill
presented Lehman with its Distinguished Service Award. He recently chaired the Work Group
updating the American Psychiatric Association’s Practice Guideline for the Treatment of Patients
with Schizophrenia.
H O W A R D H . G O L D M A N
Howard H. Goldman, M.D., Ph.D., is Professor of Psychiatry at the University of Maryland School of
Medicine. Goldman served as the Senior Scientific Editor of the Surgeon General’s Report on Mental
Health from 1997 to 1999, for which he was awarded the Surgeon General’s Medallion. During 2002
and 2003 he was a consultant on evidence-based practices for the President’s New Freedom
Commission on Mental Health. He and Robert Drake edited Evidence-Based Practices in Mental Health
for the American Psychiatric Association in 2003. In 2002 Goldman was elected to the Institute of
Medicine of the National Academy of Sciences.
L I S A B . D I X O N
Lisa B. Dixon, M.D., is a Professor of Psychiatry at the University of Maryland School of Medicine.
She serves as Director of the Division of Services Research in the School’s Department of Psychiatry.
Dixon is also the Associate Director for Research of the Veterans Administration Mental Illness
Research, Education and Clinical Center (MIRECC) in VISN 5, the Capitol Health Care Network.
Dixon is an active researcher with grants from the National Institute of Mental Health, National
Institute for Drug Abuse, the Veterans Administration, and numerous foundations. Her research
activities have focused on improving the health outcomes of persons with severe mental illnesses and
their families.
R A C H E L C H U R C H I L L
Rachel Churchill, Ph.D., M.Sc., is a Lecturer in Psychiatric Epidemiology in the Health Services
Research Department at the Institute of Psychiatry in London. Churchill is active in both teaching
and research, and her interests include evaluating interventions for a range of mental health
problems, policy research and mental health legislation, and evidence-based psychiatry. She was
T H E A U T H O R S
0404_472_TXTr2 6/24/04 6:26 PM Page 27
28Milbank Memorial Fund
instrumental in both setting up the Cochrane Depression, Anxiety and Neurosis Collaborative Review
Group (CCDAN) and in establishing a specialist trials register in the field. She is now Coordinating
Editor of CCDAN.
0404_472_TXTr2 6/24/04 6:26 PM Page 28
Milbank Memorial Fund29
A complete list of the Fund’s reports may be viewed online at www.milbank.org. Reports published
since 1993 are available electronically. Single or multiple copies of reports that have print editions are
available without charge while supplies last.
Emergency Preparedness, Bioterrorism, and the States: The First Two Years after September 11
by Gerald Markowitz and David Rosner
2004 92 pages
Addressing the HIV/AIDS Pandemic: A U.S. Global AIDS Strategy for the Long Term
co-published with the Council on Foreign Relations
2004 44 pages
Evaluating Health Services: A Reporter Covers the Science of Research Synthesis
by Ray Moynihan
2004 68 pages
Making Sense of the System: How States Can Use Health Workforce Policies to Increase Access and
Improve Quality of Care
by Edward Salsberg
co-published with the Reforming States Group
2003
Available electronically only at
http://www.milbank.org/reports/2003salsberg/2003salsberg.html
Food Safety Updated: Developing Tools for a More Science- and Risk-Based Approach
by Michael R. Taylor, Margaret O’K. Glavin, J. Glenn Morris, Jr., and Catherine E. Woteki
co-published with Resources for the Future
2003 56 pages
Implementing the Resident Assessment Instrument: Case Studies of Policymaking for Long-Term Care
in Eight Countries
2003
Available electronically only at
http://www.milbank.org/reports/interRAI/030222interRAI.html
September 11 and the Shifting Priorities of Public and Population Health in New York
by David Rosner and Gerald Markowitz
2003 68 pages
S E L E C T E D P U B L I C A T I O N S O F T H E
M I L B A N K M E M O R I A L F U N D
0404_472_TXTr2 6/24/04 6:26 PM Page 29
30Milbank Memorial Fund
Rebalancing Long-Term Care in New Jersey: From Institutional toward Home and Community Care
by Susan C. Reinhard and Charles J. Fahey
2003
Available electronically only at
http://www.milbank.org/reports/030314newjersey/030314newjersey.html
2000-2001 State Health Care Expenditure Report
co-published with the National Association of State Budget Officers and the Reforming States Group
2003 92 pages
Proactive Hazard Analysis and Health Care Policy
by John E. McDonough
co-published with ECRI
2002 36 pages
Achieving Better Health Outcomes: The Oregon Benchmark Experience
by Howard M. Leichter and Jeffrey Tryens
2002 60 pages
2001 Robert H. Ebert Memorial Lecture: Health Care Quality and How to Achieve It
by Kenneth I. Shine
2002 24 pages
Informing Judgment: Case Studies of Health Policy and Research in Six Countries
co-published with the Cochrane Collaboration
2001 212 pages
1998-1999 State Health Care Expenditure Report
co-published with the National Association of State Budget Officers and the Reforming States Group
2001 204 pages
When Care Becomes a Burden: Diminishing Access to Adequate Nursing
by Claire M. Fagin
2001 48 pages
Why Health Is Important to U.S. Foreign Policy
by Jordan S. Kassalow
co-published with the Council on Foreign Relations
2001 32 pages
0404_472_TXTr2 6/24/04 6:26 PM Page 30
Milbank Memorial Fund31
C A L I F O R N I A / M I L B A N K B O O K S O N H E A L T H A N D T H E P U B L I C
The following books are co-published with and distributed by the University of California Press.
For information or to order, call 1-800-822-6657 or visit http://www.ucpress.edu.
What Price Better Health? Hazards of the Research Imperative
by Daniel Callahan
2003 341 pages
$29.95 cloth
When Walking Fails: Mobility Problems of Adults with Chronic Conditions
by Lisa I. Iezzoni
2003 380 pages
$60.00 cloth; $19.95 paper
Death Is That Man Taking Names: Intersections of American Medicine, Law, and Culture
by Robert A. Burt
2002 256 pages
$29.95 cloth
Big Doctoring in America: Profiles in Primary Care
by Fitzhugh Mullan
2002 302 pages
$29.95 cloth
Deceit and Denial: The Deadly Politics of Industrial Pollution
by Gerald Markowitz and David Rosner
2002 464 pages
$45.00 cloth; $19.95 paper
Public Health Law and Ethics: A Reader
edited by Lawrence O. Gostin
2002 536 pages
$60.00 cloth; $35.00 paper
0404_472_TXTr2 6/24/04 6:26 PM Page 31
32Milbank Memorial Fund
Public Health Law: Power, Duty, Restraint
by Lawrence O. Gostin
2000 518 pages
$29.95 paper
Experiencing Politics: A Legislator’s Stories of Government and Health Care
by John E. McDonough
2000 336 pages
$21.95 paper
The Fund also publishes the Milbank Quarterly, a multidisciplinary journal of population health and
health policy. Information about subscribing to the Quarterly is available by calling toll-free
1-800-835-6770, or at www.milbank.org/quarterly/.
Information about other work of the Fund is available from the Fund at
645 Madison Ave., 15th Floor, New York, NY 10022, (212) 355-8400. Fax: (212) 355-8599.
E-mail: [email protected]. On the Web: www.milbank.org.
0404_472_TXTr2 6/24/04 6:26 PM Page 32
0404_472_TXTr2 6/24/04 6:26 PM Page 33
0404_472_TXTr2 6/24/04 6:26 PM Page 34
0404_472_TXTr2 6/24/04 6:26 PM Page 35
Design and Typography:
The Boland Design Company
Printing:
Prestone Printing Company, Inc.
0404_472_TXTr2 6/24/04 6:26 PM Page 36