The Major Steps of a Public Health Evaluation

1. Engage Stakeholders

2. Describe the program

3. Focus on the evaluation design

4. Gather credible evidence

5. Justify Conclusions

6. Ensure use of findings

and share lessons

learned

STANDARDSUtility

FeasibilityProprietyAccuracy

Adapted from the Centers for Disease Control and Prevention (CDC) Program Evaluation Framework

Step 1. Engage StakeholdersStep 1. Engage Stakeholders Who are they?Who are they?

Those involved in program operations, those affected by the program operations, and primary users of evaluation results

Step 2. Describe the ProgramStep 2. Describe the Program

Program’s goal and purpose Problem or need that is to be addressed Expected effects, how success is defined Activities, what the program does to effect

change Resources: time, talent, technology, money and

any other available assets Stage of development, how long in operation Contextual aspects; history, socioeconomic

factors Logic model; sequence of events to effect change

Logic Model ExampleLogic Model Example

Resources(Inputs)

Activities(Outputs)

Impact(Outcomes)

Instructors Classes & Short-term

Workshops Knowledge

Money Skills

Training in Intermediate

Computers, Relationship Practices

Equipment Skills Behaviors

Long-term

Curriculum Pre / Post Tests Responsible Parenting

Basic Model for a Paternity Education Program

Step 3. Focus the EvaluationStep 3. Focus the Evaluation

Specify what you want to know (key questions)

Decide who will be involved in or affected by the evaluation, or use the findings

To focus an evaluation, consider its purpose, methods, roles, budget, deliverables, etc.

PurposesPurposes

Gain insight: Assess needs, identify barriers, describe program

Change practice: Refine plans, make mid-course adjustments/enhancements

Assess effects: Assess success, skills development by program participants

Affect participants: Raise awareness, support organizational development

Step 4. Gather Credible Evidence Step 4. Gather Credible Evidence

Select methodological approach, sources of evidence, and data collection instruments

Determine who is to be studied and when

Evidence must be Evidence must be believable, trustworthy, and relevantbelievable, trustworthy, and relevant

Methodology and SampleMethodology and Sample

Quantitative, including the use of linked data files Qualitative Mixed Method

Things to Consider… Sample selection Use of comparison groups Timing and frequency of data collection

Step 5. Justify ConclusionsStep 5. Justify Conclusions

Analyze data to determine findingsInterpret: What do the findings mean?Judgments: What is the value of findings

based on accepted standardsRecommendations: What claims can be

made based on the evidence and the programmatic context, i.e. environmental and social influences

Step 6. Ensure Use & Step 6. Ensure Use & Share Lessons LearnedShare Lessons Learned

Ensuring that stakeholders are aware of the evaluation procedures and findings

That findings are considered in decisions or actions that affect the program

Those who participated in the evaluation have had a beneficial experience

Lessons learned are disseminated in a timely, unbiased, and consistent manner