What Works, Wisconsin: From good intentions to effective interventions for delinquency prevention
description
Transcript of What Works, Wisconsin: From good intentions to effective interventions for delinquency prevention
![Page 1: What Works, Wisconsin: From good intentions to effective interventions for delinquency prevention](https://reader035.fdocuments.in/reader035/viewer/2022062723/56813cce550346895da6752a/html5/thumbnails/1.jpg)
What Works, Wisconsin: From good intentions to effective
interventions for delinquency prevention
Wisconsin State Prevention Conference
July 19, 2006
Cailin O’Connor, Steve Small & Mary HuserUniversity of Wisconsin-Extension and
University of Wisconsin-Madison
![Page 2: What Works, Wisconsin: From good intentions to effective interventions for delinquency prevention](https://reader035.fdocuments.in/reader035/viewer/2022062723/56813cce550346895da6752a/html5/thumbnails/2.jpg)
What Works, Wisconsin
Full report and additional information available at:
www.oja.state.wi.us/jj
![Page 3: What Works, Wisconsin: From good intentions to effective interventions for delinquency prevention](https://reader035.fdocuments.in/reader035/viewer/2022062723/56813cce550346895da6752a/html5/thumbnails/3.jpg)
Overview of today’s presentation
What are evidence-based programs? What does it mean for a program to be
“cost-effective”? What are some principles of effective
programs? How can we use this knowledge to improve
existing programs?
![Page 4: What Works, Wisconsin: From good intentions to effective interventions for delinquency prevention](https://reader035.fdocuments.in/reader035/viewer/2022062723/56813cce550346895da6752a/html5/thumbnails/4.jpg)
What are evidence-based programs?
A new class of programs that: Are based on a solid scientific and theoretical
foundation Have been carefully implemented and evaluated using
rigorous scientific methods Have been replicated and evaluated in a variety of
settings with a range of audiences Have evaluation findings that have been subjected to
critical review and published in respected scientific journals
Have been “certified” as evidence-based by a federal agency or respected research organization
![Page 5: What Works, Wisconsin: From good intentions to effective interventions for delinquency prevention](https://reader035.fdocuments.in/reader035/viewer/2022062723/56813cce550346895da6752a/html5/thumbnails/5.jpg)
History of evidence-based programs
Medical practice and health care Public health Social work Clinical and school psychology Prevention science
Other fields
![Page 6: What Works, Wisconsin: From good intentions to effective interventions for delinquency prevention](https://reader035.fdocuments.in/reader035/viewer/2022062723/56813cce550346895da6752a/html5/thumbnails/6.jpg)
Number of evidence-based programs
5
10
15
20
25
30
35
40
45
1950s 1960s 1970s 1980s 1990s
![Page 7: What Works, Wisconsin: From good intentions to effective interventions for delinquency prevention](https://reader035.fdocuments.in/reader035/viewer/2022062723/56813cce550346895da6752a/html5/thumbnails/7.jpg)
Evidence-based program registries
Number of registries is growing Most focus on a particular area of interest There is a great deal of overlap between
evidence-based registries
![Page 8: What Works, Wisconsin: From good intentions to effective interventions for delinquency prevention](https://reader035.fdocuments.in/reader035/viewer/2022062723/56813cce550346895da6752a/html5/thumbnails/8.jpg)
![Page 9: What Works, Wisconsin: From good intentions to effective interventions for delinquency prevention](https://reader035.fdocuments.in/reader035/viewer/2022062723/56813cce550346895da6752a/html5/thumbnails/9.jpg)
![Page 10: What Works, Wisconsin: From good intentions to effective interventions for delinquency prevention](https://reader035.fdocuments.in/reader035/viewer/2022062723/56813cce550346895da6752a/html5/thumbnails/10.jpg)
![Page 11: What Works, Wisconsin: From good intentions to effective interventions for delinquency prevention](https://reader035.fdocuments.in/reader035/viewer/2022062723/56813cce550346895da6752a/html5/thumbnails/11.jpg)
![Page 12: What Works, Wisconsin: From good intentions to effective interventions for delinquency prevention](https://reader035.fdocuments.in/reader035/viewer/2022062723/56813cce550346895da6752a/html5/thumbnails/12.jpg)
![Page 13: What Works, Wisconsin: From good intentions to effective interventions for delinquency prevention](https://reader035.fdocuments.in/reader035/viewer/2022062723/56813cce550346895da6752a/html5/thumbnails/13.jpg)
![Page 14: What Works, Wisconsin: From good intentions to effective interventions for delinquency prevention](https://reader035.fdocuments.in/reader035/viewer/2022062723/56813cce550346895da6752a/html5/thumbnails/14.jpg)
![Page 15: What Works, Wisconsin: From good intentions to effective interventions for delinquency prevention](https://reader035.fdocuments.in/reader035/viewer/2022062723/56813cce550346895da6752a/html5/thumbnails/15.jpg)
![Page 16: What Works, Wisconsin: From good intentions to effective interventions for delinquency prevention](https://reader035.fdocuments.in/reader035/viewer/2022062723/56813cce550346895da6752a/html5/thumbnails/16.jpg)
![Page 17: What Works, Wisconsin: From good intentions to effective interventions for delinquency prevention](https://reader035.fdocuments.in/reader035/viewer/2022062723/56813cce550346895da6752a/html5/thumbnails/17.jpg)
![Page 18: What Works, Wisconsin: From good intentions to effective interventions for delinquency prevention](https://reader035.fdocuments.in/reader035/viewer/2022062723/56813cce550346895da6752a/html5/thumbnails/18.jpg)
Common program labels
Exemplary Programs (Department of Education)
Effective Programs (CDC, NIDA, DHHS) Model Programs (SAMHSA, OJJDP
Blueprints, Surgeon General) Proven Programs (Promising Practices
Network) What Works (Child Trends)
![Page 19: What Works, Wisconsin: From good intentions to effective interventions for delinquency prevention](https://reader035.fdocuments.in/reader035/viewer/2022062723/56813cce550346895da6752a/html5/thumbnails/19.jpg)
Why the interest in evidence-based programs?
Body of scientific evidence has reached a critical mass Public accountability Efficiency (don’t need to reinvent the wheel) Increases the likelihood that programs will have the
impact that they were designed to produce Evidence helps sell the program to funders,
stakeholders and potential audiences Data may be available to estimate cost effectiveness
![Page 20: What Works, Wisconsin: From good intentions to effective interventions for delinquency prevention](https://reader035.fdocuments.in/reader035/viewer/2022062723/56813cce550346895da6752a/html5/thumbnails/20.jpg)
Sample evidence from an evidence-based program
0
0.2
0.4
0.6
0.8
1
1.2
1.4
6thgradepretest
6thgrade
posttest
7thgrade
8thgrade
10thgrade
Control group
SFP 10-14Program
Ag
gre
ssio
n a
nd
Ho
stil
ity
Ind
ex
SOURCE: Spoth, R., Redmond, C., & Shin, C. (2000) Reducing adolescents' aggressive and hostile behaviors: Randomized trial effects of a brief family intervention four years past baseline. Archives of Pediatrics and Adolescent Medicine 154, 1248-1257
Aggressive and hostile behaviors
![Page 21: What Works, Wisconsin: From good intentions to effective interventions for delinquency prevention](https://reader035.fdocuments.in/reader035/viewer/2022062723/56813cce550346895da6752a/html5/thumbnails/21.jpg)
![Page 22: What Works, Wisconsin: From good intentions to effective interventions for delinquency prevention](https://reader035.fdocuments.in/reader035/viewer/2022062723/56813cce550346895da6752a/html5/thumbnails/22.jpg)
Barriers to effective prevention policy
Short-sighted policy making Concerns with the here and
now outweigh future issues Inequitable funding
![Page 23: What Works, Wisconsin: From good intentions to effective interventions for delinquency prevention](https://reader035.fdocuments.in/reader035/viewer/2022062723/56813cce550346895da6752a/html5/thumbnails/23.jpg)
![Page 24: What Works, Wisconsin: From good intentions to effective interventions for delinquency prevention](https://reader035.fdocuments.in/reader035/viewer/2022062723/56813cce550346895da6752a/html5/thumbnails/24.jpg)
Cost-benefit analysis
Assessment of program impact taking costs into account
“Evaluation of alternatives according to their costs and benefits when each is measured in monetary terms.” Levin & McEwan (2002)
Program economic-benefit indicators: 1. Net economic return is Benefits – Costs 2. Benefit-cost ratio is Benefits / Costs
![Page 25: What Works, Wisconsin: From good intentions to effective interventions for delinquency prevention](https://reader035.fdocuments.in/reader035/viewer/2022062723/56813cce550346895da6752a/html5/thumbnails/25.jpg)
An illustration of cost-benefit analysis:
Johnny Ricky
Two children born in similar circumstances
![Page 26: What Works, Wisconsin: From good intentions to effective interventions for delinquency prevention](https://reader035.fdocuments.in/reader035/viewer/2022062723/56813cce550346895da6752a/html5/thumbnails/26.jpg)
Both live in similar environments characterized by risk factors
such as:
Poverty Family history of criminal behavior Family history of maltreatment or neglect Single parent household Low parental education
![Page 27: What Works, Wisconsin: From good intentions to effective interventions for delinquency prevention](https://reader035.fdocuments.in/reader035/viewer/2022062723/56813cce550346895da6752a/html5/thumbnails/27.jpg)
At age 3
Johnny Ricky
Johnny is cared for at home by his older sibling and aunt
Ricky is enrolled in the Chicago Child-
Parent Center
![Page 28: What Works, Wisconsin: From good intentions to effective interventions for delinquency prevention](https://reader035.fdocuments.in/reader035/viewer/2022062723/56813cce550346895da6752a/html5/thumbnails/28.jpg)
The program provides educational enrichment for Ricky
![Page 29: What Works, Wisconsin: From good intentions to effective interventions for delinquency prevention](https://reader035.fdocuments.in/reader035/viewer/2022062723/56813cce550346895da6752a/html5/thumbnails/29.jpg)
Parent education for Ricky’s mother
![Page 30: What Works, Wisconsin: From good intentions to effective interventions for delinquency prevention](https://reader035.fdocuments.in/reader035/viewer/2022062723/56813cce550346895da6752a/html5/thumbnails/30.jpg)
Home visits, health screening, and other services
![Page 31: What Works, Wisconsin: From good intentions to effective interventions for delinquency prevention](https://reader035.fdocuments.in/reader035/viewer/2022062723/56813cce550346895da6752a/html5/thumbnails/31.jpg)
The Chicago Longitudinal Study Study follows a cohort of students who were 3 or 4
years old in Chicago in 1985 Study looks at various combinations of preschool
participation (1 year or 2 years), school-age program participation, or no program participation
Wide range of outcomes measured: educational success/attainment, criminality, childbearing, etc.
Age-21 follow-up interviews: 989 young adults who attended a Child-Parent Center preschool and 550 who did not
Overall, the preschool program was found to have benefits of $10.15 for every dollar spent
![Page 32: What Works, Wisconsin: From good intentions to effective interventions for delinquency prevention](https://reader035.fdocuments.in/reader035/viewer/2022062723/56813cce550346895da6752a/html5/thumbnails/32.jpg)
Learning from Johnny and Ricky
“Johnny” and “Ricky” are examples of the best- and worst-case outcomes for youth from the study sample for CPC preschool or no CPC preschool
We will look at Johnny’s and Ricky’s outcomes at critical points in their development, and the public costs and benefits associated with those outcomes
We will also see what percentage of the preschool group and what percentage of the comparison group experienced each outcome, positive or negative
Most participants in the study probably experienced a mix of negative and positive outcomes
![Page 33: What Works, Wisconsin: From good intentions to effective interventions for delinquency prevention](https://reader035.fdocuments.in/reader035/viewer/2022062723/56813cce550346895da6752a/html5/thumbnails/33.jpg)
Public costs for Johnny & Ricky in the preschool years
$0 - $5,364 per year for 2 years
Johnny RickyNOTE: All dollar amounts are converted to 2006 dollars, based on present-value calculations in 1998 dollars published in Reynolds, Temple, Robertson, & Mann (2002). Age 21 Cost-Benefit Analysis of the Title I Chicago Child-Parent Centers. Educational Evaluation and Policy Analysis. 24(4), 267-303.
![Page 34: What Works, Wisconsin: From good intentions to effective interventions for delinquency prevention](https://reader035.fdocuments.in/reader035/viewer/2022062723/56813cce550346895da6752a/html5/thumbnails/34.jpg)
At age 9Johnny is enrolled in special
education classesRicky succeeds
at school
RickyJohnny
- $9,497 per yearfor 4 years
(Above and beyond normal instruction costs)
$0
(Only normal instruction costs)
![Page 35: What Works, Wisconsin: From good intentions to effective interventions for delinquency prevention](https://reader035.fdocuments.in/reader035/viewer/2022062723/56813cce550346895da6752a/html5/thumbnails/35.jpg)
At age 9Johnny is enrolled in special
education classesRicky succeeds
at school
RickyJohnny
24.6% of comparison children were enrolled in special education for at least one year, compared to
only 14.4% of the preschool participants.
![Page 36: What Works, Wisconsin: From good intentions to effective interventions for delinquency prevention](https://reader035.fdocuments.in/reader035/viewer/2022062723/56813cce550346895da6752a/html5/thumbnails/36.jpg)
At age 10Johnny is found to be the
victim of child abuseRicky’s family has no contact with the child
welfare system
RickyJohnny
- $10,861(Average cost for
child welfare services with a substantiated report)
$0
![Page 37: What Works, Wisconsin: From good intentions to effective interventions for delinquency prevention](https://reader035.fdocuments.in/reader035/viewer/2022062723/56813cce550346895da6752a/html5/thumbnails/37.jpg)
At age 10Johnny is found to be the
victim of child abuseRicky’s family has no contact with the child
welfare system
RickyJohnny
10.3% of comparison children were found to be victims of maltreatment between the ages of 4 and 17, compared to only 5% of
the preschool participants.
![Page 38: What Works, Wisconsin: From good intentions to effective interventions for delinquency prevention](https://reader035.fdocuments.in/reader035/viewer/2022062723/56813cce550346895da6752a/html5/thumbnails/38.jpg)
At age 14
Johnny Ricky
Ricky stays out of trouble
Johnny is arrested
- $16,690(Average juvenile justice system expenditure for a court petition)
$0
![Page 39: What Works, Wisconsin: From good intentions to effective interventions for delinquency prevention](https://reader035.fdocuments.in/reader035/viewer/2022062723/56813cce550346895da6752a/html5/thumbnails/39.jpg)
At age 14
Johnny Ricky
Ricky stays out of trouble
Johnny is arrested
25.1% of comparison children had at least one petition to juvenile court by age 18, compared to only 16.9% of the preschool
participants.
For violent arrests in particular, the numbers were 15.3% for the comparison group and 9%
for the preschool group.
![Page 40: What Works, Wisconsin: From good intentions to effective interventions for delinquency prevention](https://reader035.fdocuments.in/reader035/viewer/2022062723/56813cce550346895da6752a/html5/thumbnails/40.jpg)
At age 14
Johnny Ricky
Ricky stays out of trouble
Johnny is arrested
• For every 100 children served by the program, 17 eventually came into contact with the juvenile justice system.
• For every 100 children not served by the program, 25 had at least one petition in juvenile court.
• That means eight fewer juvenile offenders - and $133,520 saved in the juvenile justice system alone – for every 100 children served.
• This translates to juvenile justice savings of $1,335 for each child served by the preschool program.
![Page 41: What Works, Wisconsin: From good intentions to effective interventions for delinquency prevention](https://reader035.fdocuments.in/reader035/viewer/2022062723/56813cce550346895da6752a/html5/thumbnails/41.jpg)
At age 18
Johnny Ricky
Ricky graduates from high school and
enrolls in college
Johnny doesn’t graduate from high school and is often
unemployed - $4,039 per yearfor 4 years(Average taxpayer share of cost for tuition at a Chicago university)
$0
![Page 42: What Works, Wisconsin: From good intentions to effective interventions for delinquency prevention](https://reader035.fdocuments.in/reader035/viewer/2022062723/56813cce550346895da6752a/html5/thumbnails/42.jpg)
At age 18
Johnny Ricky
Ricky graduates from high school and
enrolls in college
Johnny doesn’t graduate from high school and is often
unemployed61.9% of preschool participants had graduated from high school by age 21,
compared to only 51.4% of the comparison group.
At age 21, 47% of preschool participants were attending college.
![Page 43: What Works, Wisconsin: From good intentions to effective interventions for delinquency prevention](https://reader035.fdocuments.in/reader035/viewer/2022062723/56813cce550346895da6752a/html5/thumbnails/43.jpg)
Entering adulthood
Johnny Ricky
Ricky graduates college and gets a good job
Johnny is in and out of jail for petty crimes
- $40,195(Average criminal justice
system expenditure over an adult criminal career)
+ $78,838(Increased tax revenue based on lifetime earnings of $223,303 greater than a non-graduate)
![Page 44: What Works, Wisconsin: From good intentions to effective interventions for delinquency prevention](https://reader035.fdocuments.in/reader035/viewer/2022062723/56813cce550346895da6752a/html5/thumbnails/44.jpg)
Entering adulthood
Johnny Ricky
Ricky graduates college and gets a good job
Johnny is in and out of jail for petty crimes
These projections for adult outcomes were based on the age-21 follow-up and national
statistics.
Researchers continue to track the preschool participants and comparison group and will refine these estimates based on reports of
actual outcomes throughout their adult years.
![Page 45: What Works, Wisconsin: From good intentions to effective interventions for delinquency prevention](https://reader035.fdocuments.in/reader035/viewer/2022062723/56813cce550346895da6752a/html5/thumbnails/45.jpg)
Other differences in Johnny and Ricky’s adult lives
Ricky is more likely to be involved in raising his
own children
Ricky is more likely to be healthy
Johnny has poor health
Ricky supports himself and his family, pays
taxes, and stays out of trouble
Johnny relies on public systems for
living expenses and health care
Based on findings from the Perry Preschool Age 40 follow-up and projections from the Chicago Child-Parent Study at Age 21
![Page 46: What Works, Wisconsin: From good intentions to effective interventions for delinquency prevention](https://reader035.fdocuments.in/reader035/viewer/2022062723/56813cce550346895da6752a/html5/thumbnails/46.jpg)
Overall costs and benefits to society
Johnny Ricky
Special education
College tuition
Adult crime
Juvenile delinquency
Child welfare system
Chicago Child-Parent Center- $37,988
- $10,861
- $16,690
- $40,195
- $10,728
- $16,156
TOTAL: - $105,734 TOTAL: + $51,954
Increased tax revenue
+ $78,838
![Page 47: What Works, Wisconsin: From good intentions to effective interventions for delinquency prevention](https://reader035.fdocuments.in/reader035/viewer/2022062723/56813cce550346895da6752a/html5/thumbnails/47.jpg)
Cost-benefit analysis summary
Cost-benefit analysis builds on a rigorous evaluation of program impacts over time
The analysis takes into account: Costs of program participation Costs and monetary benefits – for individuals and
for society – of various outcomes Percentage of individuals in each group who
experience those outcomes Result: Average impact of the program across
individuals
![Page 48: What Works, Wisconsin: From good intentions to effective interventions for delinquency prevention](https://reader035.fdocuments.in/reader035/viewer/2022062723/56813cce550346895da6752a/html5/thumbnails/48.jpg)
![Page 49: What Works, Wisconsin: From good intentions to effective interventions for delinquency prevention](https://reader035.fdocuments.in/reader035/viewer/2022062723/56813cce550346895da6752a/html5/thumbnails/49.jpg)
Some limits of evidence-based programs
May not address targeted issues (most are prevention oriented)
Often problem-focused May deter grassroots program development Can be costly to implement May not be practically feasible at site May not be well matched to local context Tells you what works but not why May ignore local knowledge, experience &
expertise
![Page 50: What Works, Wisconsin: From good intentions to effective interventions for delinquency prevention](https://reader035.fdocuments.in/reader035/viewer/2022062723/56813cce550346895da6752a/html5/thumbnails/50.jpg)
A less orthodox view of evidence-based programs
Only scientifically proven interventions
Interventions based on good intentions or recent fads
FINDING A BALANCE BETWEEN:
vs.
vs. Centrally designed
and certified interventions
Interventions reinvented in every new setting
![Page 51: What Works, Wisconsin: From good intentions to effective interventions for delinquency prevention](https://reader035.fdocuments.in/reader035/viewer/2022062723/56813cce550346895da6752a/html5/thumbnails/51.jpg)
Finding the balance: Evidence-based practices & principles
Implementing evidence-based programs is not always possible or desirable
Community ownership of programs and local, practitioner knowledge of “what works” are also valuable
The accumulating evidence from evidence-based programs can be used to improve current practice even when it is not possible to implement a “gold standard” program
![Page 52: What Works, Wisconsin: From good intentions to effective interventions for delinquency prevention](https://reader035.fdocuments.in/reader035/viewer/2022062723/56813cce550346895da6752a/html5/thumbnails/52.jpg)
Principles of effective interventions
Program characteristics that are consistent across effective programs
Derived from evaluations of evidence-based programs
Only rarely studied independently Useful for
Improving existing programs Selecting programs Evaluability assessment Funding decisions
![Page 53: What Works, Wisconsin: From good intentions to effective interventions for delinquency prevention](https://reader035.fdocuments.in/reader035/viewer/2022062723/56813cce550346895da6752a/html5/thumbnails/53.jpg)
Principles of effective prevention programs
Delivered at a high dosage and intensity Comprehensive Appropriately timed Developmentally appropriate Socio-culturally relevant Implemented by well-trained, effective staff Implemented using varied, active methods Based on strong scientific theory Evaluated regularly
![Page 54: What Works, Wisconsin: From good intentions to effective interventions for delinquency prevention](https://reader035.fdocuments.in/reader035/viewer/2022062723/56813cce550346895da6752a/html5/thumbnails/54.jpg)
Principles of effective juvenile offender programs
Provide human services, not just punishment Assign offenders to programs based on risk
of recidivism Address criminogenic needs of offenders Be responsive to offenders’ learning styles
and readiness to change Implement programs with fidelity to their
original design
![Page 55: What Works, Wisconsin: From good intentions to effective interventions for delinquency prevention](https://reader035.fdocuments.in/reader035/viewer/2022062723/56813cce550346895da6752a/html5/thumbnails/55.jpg)
Moving toward evidence-based practices
Assess your own program practice against the principles of effective programs General principles for prevention programs or
juvenile offender programs More specific principles for your type of program
Engage staff and other stakeholders in making improvements based on those principles
Seek assistance from evaluation specialists (University, Extension, others) to support continuous program improvement
![Page 56: What Works, Wisconsin: From good intentions to effective interventions for delinquency prevention](https://reader035.fdocuments.in/reader035/viewer/2022062723/56813cce550346895da6752a/html5/thumbnails/56.jpg)
Moving toward evidence-based practice: Discussion
How do you see yourself moving toward evidence-based programs or practices in your work?
What are the barriers? What kind of support do you need?