CDC’s Interactive Evidence-Based Decision Making Tool€¦ · CDC’s Interactive Evidence-Based...
Transcript of CDC’s Interactive Evidence-Based Decision Making Tool€¦ · CDC’s Interactive Evidence-Based...
![Page 1: CDC’s Interactive Evidence-Based Decision Making Tool€¦ · CDC’s Interactive Evidence-Based Decision Making Tool A Resource to Strengthen Evaluation Practice and Capacity Natalie](https://reader035.fdocuments.in/reader035/viewer/2022063017/5fd7f0ef5eae931f7b42ec4a/html5/thumbnails/1.jpg)
CDC’s Interactive Evidence-Based
Decision Making Tool A Resource to Strengthen Evaluation
Practice and Capacity
Natalie Wilkins, PhD
Sally Thigpen, MPA
Helen Singer, MPH
Richard Puddy, PhD MPH
Division of Violence Prevention
National Center for Injury Prevention and Control
Centers for Disease Control and Prevention
![Page 2: CDC’s Interactive Evidence-Based Decision Making Tool€¦ · CDC’s Interactive Evidence-Based Decision Making Tool A Resource to Strengthen Evaluation Practice and Capacity Natalie](https://reader035.fdocuments.in/reader035/viewer/2022063017/5fd7f0ef5eae931f7b42ec4a/html5/thumbnails/2.jpg)
What is ‘Evidence?’
“The available body of facts or
information indicating whether a belief or
proposition is true” (New Oxford American Dictionary,2001)
“Evidence concerns facts (actual or
asserted) intended for use in support of a
conclusion.” (Canadian Health Services Research Foundation, 2004)
“Evidence comprises the interpretation of empirical
data derived from formal research or systematic
investigations using science or social science
methods.” (Rychetnik et al, 2002)
“Evidence can be defined as information or
facts that are systematically obtained, i.e.
obtained in a manner that is replicable,
observable, credible, verifiable, or basically
supportable.” (Rycroft-Malone & Stetler, 2004)
“For public health professional evidence is
some form of data - including epidemiologic
(quantitative) data, results of program or
policy evaluations, and qualitative data - for
use in making judgments or decisions,”
(Brownson, Fielding, and Maylahn, 2009)
![Page 3: CDC’s Interactive Evidence-Based Decision Making Tool€¦ · CDC’s Interactive Evidence-Based Decision Making Tool A Resource to Strengthen Evaluation Practice and Capacity Natalie](https://reader035.fdocuments.in/reader035/viewer/2022063017/5fd7f0ef5eae931f7b42ec4a/html5/thumbnails/3.jpg)
Framework for Thinking About
Evidence
Contextual
Evidence Experiential
Evidence
Evidence Based Decision Making
Best Available Research Evidence
![Page 4: CDC’s Interactive Evidence-Based Decision Making Tool€¦ · CDC’s Interactive Evidence-Based Decision Making Tool A Resource to Strengthen Evaluation Practice and Capacity Natalie](https://reader035.fdocuments.in/reader035/viewer/2022063017/5fd7f0ef5eae931f7b42ec4a/html5/thumbnails/4.jpg)
Framework for Thinking About
Evidence
Contextual
Evidence Experiential
Evidence
Evidence Based
Decision Making
Best Available
Research Evidence
![Page 5: CDC’s Interactive Evidence-Based Decision Making Tool€¦ · CDC’s Interactive Evidence-Based Decision Making Tool A Resource to Strengthen Evaluation Practice and Capacity Natalie](https://reader035.fdocuments.in/reader035/viewer/2022063017/5fd7f0ef5eae931f7b42ec4a/html5/thumbnails/5.jpg)
• How much scientific research has been
done on the program/strategy?
• What effects has the program had on your
desired outcomes?
• How rigorously has the program been
studied? How much confidence can we have
in the validity of study findings?
• What implementation guidance is available,
and what does that guidance tell us about
capacity needed to successfully implement
the program?
Questions BARE Can Help Answer
![Page 6: CDC’s Interactive Evidence-Based Decision Making Tool€¦ · CDC’s Interactive Evidence-Based Decision Making Tool A Resource to Strengthen Evaluation Practice and Capacity Natalie](https://reader035.fdocuments.in/reader035/viewer/2022063017/5fd7f0ef5eae931f7b42ec4a/html5/thumbnails/6.jpg)
![Page 7: CDC’s Interactive Evidence-Based Decision Making Tool€¦ · CDC’s Interactive Evidence-Based Decision Making Tool A Resource to Strengthen Evaluation Practice and Capacity Natalie](https://reader035.fdocuments.in/reader035/viewer/2022063017/5fd7f0ef5eae931f7b42ec4a/html5/thumbnails/7.jpg)
Experiential Evidence
Evidence Based
Decision Making
Best Available Research Evidence
Framework for Thinking About
Evidence
Contextual
Evidence
![Page 8: CDC’s Interactive Evidence-Based Decision Making Tool€¦ · CDC’s Interactive Evidence-Based Decision Making Tool A Resource to Strengthen Evaluation Practice and Capacity Natalie](https://reader035.fdocuments.in/reader035/viewer/2022063017/5fd7f0ef5eae931f7b42ec4a/html5/thumbnails/8.jpg)
What is Contextual Evidence?
• Measurable factors in the community that are
likely to influence the implementation of a
strategy.
• Provides information on whether a strategy is
likely to be:
– Feasible to implement
– Useful
– Acceptable to the local community
![Page 9: CDC’s Interactive Evidence-Based Decision Making Tool€¦ · CDC’s Interactive Evidence-Based Decision Making Tool A Resource to Strengthen Evaluation Practice and Capacity Natalie](https://reader035.fdocuments.in/reader035/viewer/2022063017/5fd7f0ef5eae931f7b42ec4a/html5/thumbnails/9.jpg)
• Does the community have the resources and/or
capacity to implement the prevention strategy
effectively? Who will implement the strategy?
• What are the characteristics of the
setting/population to be served by the
prevention strategy?
• Who will be implementing the strategy?
• How might setting/population characteristics
affect implementation of the prevention
strategy?
Questions Contextual Evidence
Can Help Answer
![Page 10: CDC’s Interactive Evidence-Based Decision Making Tool€¦ · CDC’s Interactive Evidence-Based Decision Making Tool A Resource to Strengthen Evaluation Practice and Capacity Natalie](https://reader035.fdocuments.in/reader035/viewer/2022063017/5fd7f0ef5eae931f7b42ec4a/html5/thumbnails/10.jpg)
Laws and Policies
Social Norms and
Values
Community
Values
Employment
Opportunities
Community
History
Physical
Infrastructure
Family Health
History
Social Capital
Peer Support
Family Values
Income
Age, Gender, Cultural Identity
Individual Values
Individual Relationship Community Societal
Media
Measurable Contextual Variables
Across the Social Ecology
![Page 11: CDC’s Interactive Evidence-Based Decision Making Tool€¦ · CDC’s Interactive Evidence-Based Decision Making Tool A Resource to Strengthen Evaluation Practice and Capacity Natalie](https://reader035.fdocuments.in/reader035/viewer/2022063017/5fd7f0ef5eae931f7b42ec4a/html5/thumbnails/11.jpg)
How do you Measure Contextual
Evidence?
• Existing Sources of data
– Census data
– Local administrative data (hospital, school, law
enforcement)
• Gathering new data
– Community Assessments
– Surveys
– Focus Groups/Interviews
![Page 12: CDC’s Interactive Evidence-Based Decision Making Tool€¦ · CDC’s Interactive Evidence-Based Decision Making Tool A Resource to Strengthen Evaluation Practice and Capacity Natalie](https://reader035.fdocuments.in/reader035/viewer/2022063017/5fd7f0ef5eae931f7b42ec4a/html5/thumbnails/12.jpg)
Framework for Thinking About
Evidence
Contextual
Evidence
Evidence Based
Decision Making
Best Available Research Evidence
Experiential Evidence
![Page 13: CDC’s Interactive Evidence-Based Decision Making Tool€¦ · CDC’s Interactive Evidence-Based Decision Making Tool A Resource to Strengthen Evaluation Practice and Capacity Natalie](https://reader035.fdocuments.in/reader035/viewer/2022063017/5fd7f0ef5eae931f7b42ec4a/html5/thumbnails/13.jpg)
What is Experiential
Evidence?
• The collective experience and expertise
of those who have practiced or lived in a
particular setting.
• The knowledge and expertise of subject
matter experts.
![Page 14: CDC’s Interactive Evidence-Based Decision Making Tool€¦ · CDC’s Interactive Evidence-Based Decision Making Tool A Resource to Strengthen Evaluation Practice and Capacity Natalie](https://reader035.fdocuments.in/reader035/viewer/2022063017/5fd7f0ef5eae931f7b42ec4a/html5/thumbnails/14.jpg)
• What has previously worked/not worked in the
community?
• Would this program appeal to stakeholders
and participants?
• What are common goals among stakeholders
related to this issue?
• How well matched are these goals to the
programs based on the best available research
evidence that are being considered?
Questions Experiential Evidence
Can Help Answer
![Page 15: CDC’s Interactive Evidence-Based Decision Making Tool€¦ · CDC’s Interactive Evidence-Based Decision Making Tool A Resource to Strengthen Evaluation Practice and Capacity Natalie](https://reader035.fdocuments.in/reader035/viewer/2022063017/5fd7f0ef5eae931f7b42ec4a/html5/thumbnails/15.jpg)
How do you Measure
Experiential Evidence?
Methods
• Reflective questions
• Communities of practice
• Expert panels
• Team decision making
• Other consensus processes
![Page 16: CDC’s Interactive Evidence-Based Decision Making Tool€¦ · CDC’s Interactive Evidence-Based Decision Making Tool A Resource to Strengthen Evaluation Practice and Capacity Natalie](https://reader035.fdocuments.in/reader035/viewer/2022063017/5fd7f0ef5eae931f7b42ec4a/html5/thumbnails/16.jpg)
Putting it all Together: Evidence-Based Decision Making
Key Characteristics
• Transparency
• Inclusiveness/Participation
• Openness/Explicitness
• Skilled Leadership
• Defined Process
![Page 17: CDC’s Interactive Evidence-Based Decision Making Tool€¦ · CDC’s Interactive Evidence-Based Decision Making Tool A Resource to Strengthen Evaluation Practice and Capacity Natalie](https://reader035.fdocuments.in/reader035/viewer/2022063017/5fd7f0ef5eae931f7b42ec4a/html5/thumbnails/17.jpg)
CDC’s Framework for Program
Evaluation
![Page 18: CDC’s Interactive Evidence-Based Decision Making Tool€¦ · CDC’s Interactive Evidence-Based Decision Making Tool A Resource to Strengthen Evaluation Practice and Capacity Natalie](https://reader035.fdocuments.in/reader035/viewer/2022063017/5fd7f0ef5eae931f7b42ec4a/html5/thumbnails/18.jpg)
Understanding Evidence
http://vetoviolence.cdc.gov/evidence
![Page 19: CDC’s Interactive Evidence-Based Decision Making Tool€¦ · CDC’s Interactive Evidence-Based Decision Making Tool A Resource to Strengthen Evaluation Practice and Capacity Natalie](https://reader035.fdocuments.in/reader035/viewer/2022063017/5fd7f0ef5eae931f7b42ec4a/html5/thumbnails/19.jpg)
![Page 20: CDC’s Interactive Evidence-Based Decision Making Tool€¦ · CDC’s Interactive Evidence-Based Decision Making Tool A Resource to Strengthen Evaluation Practice and Capacity Natalie](https://reader035.fdocuments.in/reader035/viewer/2022063017/5fd7f0ef5eae931f7b42ec4a/html5/thumbnails/20.jpg)
![Page 21: CDC’s Interactive Evidence-Based Decision Making Tool€¦ · CDC’s Interactive Evidence-Based Decision Making Tool A Resource to Strengthen Evaluation Practice and Capacity Natalie](https://reader035.fdocuments.in/reader035/viewer/2022063017/5fd7f0ef5eae931f7b42ec4a/html5/thumbnails/21.jpg)
![Page 22: CDC’s Interactive Evidence-Based Decision Making Tool€¦ · CDC’s Interactive Evidence-Based Decision Making Tool A Resource to Strengthen Evaluation Practice and Capacity Natalie](https://reader035.fdocuments.in/reader035/viewer/2022063017/5fd7f0ef5eae931f7b42ec4a/html5/thumbnails/22.jpg)
![Page 23: CDC’s Interactive Evidence-Based Decision Making Tool€¦ · CDC’s Interactive Evidence-Based Decision Making Tool A Resource to Strengthen Evaluation Practice and Capacity Natalie](https://reader035.fdocuments.in/reader035/viewer/2022063017/5fd7f0ef5eae931f7b42ec4a/html5/thumbnails/23.jpg)
![Page 24: CDC’s Interactive Evidence-Based Decision Making Tool€¦ · CDC’s Interactive Evidence-Based Decision Making Tool A Resource to Strengthen Evaluation Practice and Capacity Natalie](https://reader035.fdocuments.in/reader035/viewer/2022063017/5fd7f0ef5eae931f7b42ec4a/html5/thumbnails/24.jpg)
![Page 25: CDC’s Interactive Evidence-Based Decision Making Tool€¦ · CDC’s Interactive Evidence-Based Decision Making Tool A Resource to Strengthen Evaluation Practice and Capacity Natalie](https://reader035.fdocuments.in/reader035/viewer/2022063017/5fd7f0ef5eae931f7b42ec4a/html5/thumbnails/25.jpg)
![Page 26: CDC’s Interactive Evidence-Based Decision Making Tool€¦ · CDC’s Interactive Evidence-Based Decision Making Tool A Resource to Strengthen Evaluation Practice and Capacity Natalie](https://reader035.fdocuments.in/reader035/viewer/2022063017/5fd7f0ef5eae931f7b42ec4a/html5/thumbnails/26.jpg)
![Page 27: CDC’s Interactive Evidence-Based Decision Making Tool€¦ · CDC’s Interactive Evidence-Based Decision Making Tool A Resource to Strengthen Evaluation Practice and Capacity Natalie](https://reader035.fdocuments.in/reader035/viewer/2022063017/5fd7f0ef5eae931f7b42ec4a/html5/thumbnails/27.jpg)
![Page 28: CDC’s Interactive Evidence-Based Decision Making Tool€¦ · CDC’s Interactive Evidence-Based Decision Making Tool A Resource to Strengthen Evaluation Practice and Capacity Natalie](https://reader035.fdocuments.in/reader035/viewer/2022063017/5fd7f0ef5eae931f7b42ec4a/html5/thumbnails/28.jpg)
![Page 29: CDC’s Interactive Evidence-Based Decision Making Tool€¦ · CDC’s Interactive Evidence-Based Decision Making Tool A Resource to Strengthen Evaluation Practice and Capacity Natalie](https://reader035.fdocuments.in/reader035/viewer/2022063017/5fd7f0ef5eae931f7b42ec4a/html5/thumbnails/29.jpg)
![Page 30: CDC’s Interactive Evidence-Based Decision Making Tool€¦ · CDC’s Interactive Evidence-Based Decision Making Tool A Resource to Strengthen Evaluation Practice and Capacity Natalie](https://reader035.fdocuments.in/reader035/viewer/2022063017/5fd7f0ef5eae931f7b42ec4a/html5/thumbnails/30.jpg)
![Page 31: CDC’s Interactive Evidence-Based Decision Making Tool€¦ · CDC’s Interactive Evidence-Based Decision Making Tool A Resource to Strengthen Evaluation Practice and Capacity Natalie](https://reader035.fdocuments.in/reader035/viewer/2022063017/5fd7f0ef5eae931f7b42ec4a/html5/thumbnails/31.jpg)
![Page 32: CDC’s Interactive Evidence-Based Decision Making Tool€¦ · CDC’s Interactive Evidence-Based Decision Making Tool A Resource to Strengthen Evaluation Practice and Capacity Natalie](https://reader035.fdocuments.in/reader035/viewer/2022063017/5fd7f0ef5eae931f7b42ec4a/html5/thumbnails/32.jpg)
![Page 33: CDC’s Interactive Evidence-Based Decision Making Tool€¦ · CDC’s Interactive Evidence-Based Decision Making Tool A Resource to Strengthen Evaluation Practice and Capacity Natalie](https://reader035.fdocuments.in/reader035/viewer/2022063017/5fd7f0ef5eae931f7b42ec4a/html5/thumbnails/33.jpg)
![Page 34: CDC’s Interactive Evidence-Based Decision Making Tool€¦ · CDC’s Interactive Evidence-Based Decision Making Tool A Resource to Strengthen Evaluation Practice and Capacity Natalie](https://reader035.fdocuments.in/reader035/viewer/2022063017/5fd7f0ef5eae931f7b42ec4a/html5/thumbnails/34.jpg)
Thank you!
Natalie Wilkins
Sally Thigpen
Helen Singer
Rich Puddy