Seeking Inspiration? Evaluate! Amy Teddy Injury Prevention Program Manager.
-
Upload
byron-johns -
Category
Documents
-
view
215 -
download
0
Transcript of Seeking Inspiration? Evaluate! Amy Teddy Injury Prevention Program Manager.
![Page 1: Seeking Inspiration? Evaluate! Amy Teddy Injury Prevention Program Manager.](https://reader035.fdocuments.in/reader035/viewer/2022070400/56649f115503460f94c247c7/html5/thumbnails/1.jpg)
Seeking Inspiration?Evaluate!
Amy TeddyInjury Prevention Program Manager
![Page 2: Seeking Inspiration? Evaluate! Amy Teddy Injury Prevention Program Manager.](https://reader035.fdocuments.in/reader035/viewer/2022070400/56649f115503460f94c247c7/html5/thumbnails/2.jpg)
Objectives
1. List & define 2 ways to evaluate IP programs
2. Explain how to tabulate & report results
3. Identify 1 way to incorporate evaluation into your IP program
![Page 3: Seeking Inspiration? Evaluate! Amy Teddy Injury Prevention Program Manager.](https://reader035.fdocuments.in/reader035/viewer/2022070400/56649f115503460f94c247c7/html5/thumbnails/3.jpg)
Considerations
• NOT to prove or disprove…….Improve = inspire• “Nature of prevention…”• “Is the juice worth the squeeze?”• Does not have to be scientific• Sampling is appropriate• Anecdotal feedback• Do not be a burden
![Page 4: Seeking Inspiration? Evaluate! Amy Teddy Injury Prevention Program Manager.](https://reader035.fdocuments.in/reader035/viewer/2022070400/56649f115503460f94c247c7/html5/thumbnails/4.jpg)
1) CPS MONTH END REPORT
![Page 5: Seeking Inspiration? Evaluate! Amy Teddy Injury Prevention Program Manager.](https://reader035.fdocuments.in/reader035/viewer/2022070400/56649f115503460f94c247c7/html5/thumbnails/5.jpg)
Month End Report
1393 (in 2010) – 907 (in 2007) = 486 486 ÷ 907 = 54% increase
How do I calculate increase? How do I determine percent?
![Page 6: Seeking Inspiration? Evaluate! Amy Teddy Injury Prevention Program Manager.](https://reader035.fdocuments.in/reader035/viewer/2022070400/56649f115503460f94c247c7/html5/thumbnails/6.jpg)
Visual Aide
54% increase
Same numbers = different presentation
![Page 7: Seeking Inspiration? Evaluate! Amy Teddy Injury Prevention Program Manager.](https://reader035.fdocuments.in/reader035/viewer/2022070400/56649f115503460f94c247c7/html5/thumbnails/7.jpg)
Numbers Matter• Cost-outcome analysis - calculation of the
economic benefits and costs associated with an intervention so that the intervention can be compared to other interventions.
• $52 child safety seat = $2,200 benefit to society– Ex: 100 car seats distributed x $2200 = $220,000
economic benefit
• $35 booster seat = $2,500 benefit to society
• Car Seat Checked = $7 benefit to society
Children’s Safety Network, Injury Prevention: What Works?, 2010 update
![Page 8: Seeking Inspiration? Evaluate! Amy Teddy Injury Prevention Program Manager.](https://reader035.fdocuments.in/reader035/viewer/2022070400/56649f115503460f94c247c7/html5/thumbnails/8.jpg)
Advice
• Numbers are MOST important – grants/donations– justify program staffing and resources
• “Rather be looking at it than looking for it!”
• Presenting data? - consider audience
• Share this information…when appropriate
• Always look for new ways to engage and evaluate!
![Page 9: Seeking Inspiration? Evaluate! Amy Teddy Injury Prevention Program Manager.](https://reader035.fdocuments.in/reader035/viewer/2022070400/56649f115503460f94c247c7/html5/thumbnails/9.jpg)
2) SEAT CHECK SURVEY
![Page 10: Seeking Inspiration? Evaluate! Amy Teddy Injury Prevention Program Manager.](https://reader035.fdocuments.in/reader035/viewer/2022070400/56649f115503460f94c247c7/html5/thumbnails/10.jpg)
Ask Yourself
1. What do you need to know?– Did they learn anything?– Would they recommend to friend/family?– How did they find out about service?– Suggestions for improvement?
2. What do you want to know?– Staff capacity?– Forward thinking
![Page 11: Seeking Inspiration? Evaluate! Amy Teddy Injury Prevention Program Manager.](https://reader035.fdocuments.in/reader035/viewer/2022070400/56649f115503460f94c247c7/html5/thumbnails/11.jpg)
Knowledge - Questions
Each indicator = value
1 2 3 4 5
![Page 12: Seeking Inspiration? Evaluate! Amy Teddy Injury Prevention Program Manager.](https://reader035.fdocuments.in/reader035/viewer/2022070400/56649f115503460f94c247c7/html5/thumbnails/12.jpg)
Knowledge - Report
How do you calculate?• You are finding the “average” or “mean” of the scores• 5 = best
# of people that responded this value
![Page 13: Seeking Inspiration? Evaluate! Amy Teddy Injury Prevention Program Manager.](https://reader035.fdocuments.in/reader035/viewer/2022070400/56649f115503460f94c247c7/html5/thumbnails/13.jpg)
1 2 3 4 5VALUES
![Page 14: Seeking Inspiration? Evaluate! Amy Teddy Injury Prevention Program Manager.](https://reader035.fdocuments.in/reader035/viewer/2022070400/56649f115503460f94c247c7/html5/thumbnails/14.jpg)
Knowledge – Report
Question: BEFORE AFTER Change
Rate your knowledge about safely installing your car seat: 2.64 4.52 +1.88
![Page 15: Seeking Inspiration? Evaluate! Amy Teddy Injury Prevention Program Manager.](https://reader035.fdocuments.in/reader035/viewer/2022070400/56649f115503460f94c247c7/html5/thumbnails/15.jpg)
Knowledge - Question
![Page 16: Seeking Inspiration? Evaluate! Amy Teddy Injury Prevention Program Manager.](https://reader035.fdocuments.in/reader035/viewer/2022070400/56649f115503460f94c247c7/html5/thumbnails/16.jpg)
Attitude - Questions
![Page 17: Seeking Inspiration? Evaluate! Amy Teddy Injury Prevention Program Manager.](https://reader035.fdocuments.in/reader035/viewer/2022070400/56649f115503460f94c247c7/html5/thumbnails/17.jpg)
Open-ended
The staff are wonderful - I greatly appreciate their time and willingness to assist and educate…
THANK YOU for providing such an outstanding service to the Ann Arbor community…
This is a wonderful service. I was so impressed with the instructors and I felt so much more comfortable after attending the installation lesson…
I think it's a wonderful service. I have already told at least 4 people about it and I only had it the day before yesterday!
The helpers are phenomenal as well as patient! Thank you for everything!!!
![Page 18: Seeking Inspiration? Evaluate! Amy Teddy Injury Prevention Program Manager.](https://reader035.fdocuments.in/reader035/viewer/2022070400/56649f115503460f94c247c7/html5/thumbnails/18.jpg)
3) EDUCATION SURVEY
![Page 19: Seeking Inspiration? Evaluate! Amy Teddy Injury Prevention Program Manager.](https://reader035.fdocuments.in/reader035/viewer/2022070400/56649f115503460f94c247c7/html5/thumbnails/19.jpg)
Ask Yourself
1. What do you need to know?– What did they learn?– What will they do differently as a result?– Rate instructor? Materials? Classroom?
2. What do you want to know?– Staff capacity?– Forward thinking
![Page 20: Seeking Inspiration? Evaluate! Amy Teddy Injury Prevention Program Manager.](https://reader035.fdocuments.in/reader035/viewer/2022070400/56649f115503460f94c247c7/html5/thumbnails/20.jpg)
Behavior - Question
![Page 21: Seeking Inspiration? Evaluate! Amy Teddy Injury Prevention Program Manager.](https://reader035.fdocuments.in/reader035/viewer/2022070400/56649f115503460f94c247c7/html5/thumbnails/21.jpg)
Behavior - report
• Example:– “82% of participants indicated that they were likely-
very likely to discuss car seats with parents as a result of the workshop”
![Page 22: Seeking Inspiration? Evaluate! Amy Teddy Injury Prevention Program Manager.](https://reader035.fdocuments.in/reader035/viewer/2022070400/56649f115503460f94c247c7/html5/thumbnails/22.jpg)
4) EDUCATION PRE-POST
![Page 23: Seeking Inspiration? Evaluate! Amy Teddy Injury Prevention Program Manager.](https://reader035.fdocuments.in/reader035/viewer/2022070400/56649f115503460f94c247c7/html5/thumbnails/23.jpg)
Ask Yourself
1. What do you need to know?– What did they know before session?– Which objectives were most important?
2. What do you want to know?– Staff capacity?– Time?– Forward thinking
![Page 24: Seeking Inspiration? Evaluate! Amy Teddy Injury Prevention Program Manager.](https://reader035.fdocuments.in/reader035/viewer/2022070400/56649f115503460f94c247c7/html5/thumbnails/24.jpg)
Knowledge - Question
• Which type of car seat provides optimal protection for infants?
![Page 25: Seeking Inspiration? Evaluate! Amy Teddy Injury Prevention Program Manager.](https://reader035.fdocuments.in/reader035/viewer/2022070400/56649f115503460f94c247c7/html5/thumbnails/25.jpg)
Tabulate Results
• 100 students answered this question**
• 75 of those students answered WRONG
FORMULA:
# of tests - # wrong = n
n ÷ # of tests = % ________________________________________
Ex. #1 – Pre-test
100 - 75 = 25
25 ÷ 100 = .25 = 25%
![Page 26: Seeking Inspiration? Evaluate! Amy Teddy Injury Prevention Program Manager.](https://reader035.fdocuments.in/reader035/viewer/2022070400/56649f115503460f94c247c7/html5/thumbnails/26.jpg)
Knowledge - Report
• Repeat test post-education
• Compare pre and post results:– Pre: 25%– Post: 80%– CHANGE: 55% knowledge gain
![Page 27: Seeking Inspiration? Evaluate! Amy Teddy Injury Prevention Program Manager.](https://reader035.fdocuments.in/reader035/viewer/2022070400/56649f115503460f94c247c7/html5/thumbnails/27.jpg)
5) PROGRAM IMPACT
![Page 28: Seeking Inspiration? Evaluate! Amy Teddy Injury Prevention Program Manager.](https://reader035.fdocuments.in/reader035/viewer/2022070400/56649f115503460f94c247c7/html5/thumbnails/28.jpg)
![Page 29: Seeking Inspiration? Evaluate! Amy Teddy Injury Prevention Program Manager.](https://reader035.fdocuments.in/reader035/viewer/2022070400/56649f115503460f94c247c7/html5/thumbnails/29.jpg)
Protect UR Brain – Wear a Helmet
• Goal: increase helmet usage on the slopes
• Partner with slopes across MI to negotiate policy change:– Caberfae (Cadillac)– Boyne Mountain (Boyne Falls)– Boyne Highlands (Harbor Springs)– Mt. Brighton
![Page 30: Seeking Inspiration? Evaluate! Amy Teddy Injury Prevention Program Manager.](https://reader035.fdocuments.in/reader035/viewer/2022070400/56649f115503460f94c247c7/html5/thumbnails/30.jpg)
The Results
Intervention
1303 helmets 15,000 ski/board
8%
3425 helmets 20,000 ski/board
17%
5387 helmets 18,000 ski/board
30%
![Page 31: Seeking Inspiration? Evaluate! Amy Teddy Injury Prevention Program Manager.](https://reader035.fdocuments.in/reader035/viewer/2022070400/56649f115503460f94c247c7/html5/thumbnails/31.jpg)
NEW(ER) CONCEPT
![Page 32: Seeking Inspiration? Evaluate! Amy Teddy Injury Prevention Program Manager.](https://reader035.fdocuments.in/reader035/viewer/2022070400/56649f115503460f94c247c7/html5/thumbnails/32.jpg)
Net Promoter Score
• The ultimate question…
• “How likely are you to recommend us to a friend or colleague?”
![Page 33: Seeking Inspiration? Evaluate! Amy Teddy Injury Prevention Program Manager.](https://reader035.fdocuments.in/reader035/viewer/2022070400/56649f115503460f94c247c7/html5/thumbnails/33.jpg)
Net Promoter
• Can this apply to CPS programs?
![Page 34: Seeking Inspiration? Evaluate! Amy Teddy Injury Prevention Program Manager.](https://reader035.fdocuments.in/reader035/viewer/2022070400/56649f115503460f94c247c7/html5/thumbnails/34.jpg)
NEW(ER) TECHNOLOGY
![Page 35: Seeking Inspiration? Evaluate! Amy Teddy Injury Prevention Program Manager.](https://reader035.fdocuments.in/reader035/viewer/2022070400/56649f115503460f94c247c7/html5/thumbnails/35.jpg)
Poll Everywhere
• “The fastest way to create stylish real-time experiences using mobile devices”
• Replaces remotes
• Free: audiences of 40 or less
• Embedded in presentation
• Options:
![Page 36: Seeking Inspiration? Evaluate! Amy Teddy Injury Prevention Program Manager.](https://reader035.fdocuments.in/reader035/viewer/2022070400/56649f115503460f94c247c7/html5/thumbnails/36.jpg)
How does it work?
![Page 37: Seeking Inspiration? Evaluate! Amy Teddy Injury Prevention Program Manager.](https://reader035.fdocuments.in/reader035/viewer/2022070400/56649f115503460f94c247c7/html5/thumbnails/37.jpg)
Others
• iPad friendly–Survey Monkey–Qualtrics
• GetWell Network
![Page 38: Seeking Inspiration? Evaluate! Amy Teddy Injury Prevention Program Manager.](https://reader035.fdocuments.in/reader035/viewer/2022070400/56649f115503460f94c247c7/html5/thumbnails/38.jpg)
Questions?