Adrienne Fischer, Tom Keily and Matt Weyer · It does this by building upon, “Untangling the...

8
POLICY BRIEF POLICY BRIEF Exploring New Research on Pre-K Outcomes Adrienne Fischer, Tom Keily and Matt Weyer MAY 2020 ecs.org | @EdCommission As pre-K programming increasingly garners more political attention and funding in the states, policymakers are seeking the most up-to-date and rigorous research to support decision-making and creation or expansion of these programs. High-quality pre-K has bipartisan support in part because of the vast amount of existing research detailing positive benefits — notably that it is of great benefit to students from low- income families and those who are dual-language learners. However, some research also demonstrates that positive growth among pre-K students isn’t consistently sustained over time. This idea is known as “convergence” or “fadeout,” because the short-term gains of pre-K attendees may diminish in early elementary school. The reasons for these mixed findings vary. Some researchers have pointed out that large-scale, public pre-K often varies in quality from program to program, making comparisons difficult. Others have suggested that the convergence effect may be a function of the instruction provided in kindergarten and early elementary grades, which often focuses heavily on improving the skills of struggling students who may lack access to pre-K rather than building on the skills of pre-K attendees. This Policy Brief aims to capture and make sense of the most recent research studies on pre-K programs and outcomes. It does this by building upon, “Untangling the Evidence on Preschool Effectiveness: Insights for Policymakers,” a pioneering study by the Learning Policy Institute, to analyze a set of research studies conducted between January 2018 and March 2020. To better understand the research findings, reference the glossary of key terms. 44 states plus D.C. offer state-funded pre-K programs, which are often seen as an important investment in early childhood development. Research on the effectiveness of pre-K programs is generally positive, with some findings of converging effects, in part because there are a lot of variables that are hard to control for. This new analysis of 15 research studies finds significantly more long- term positive outcomes — extending beyond kindergarten — than converging effects.

Transcript of Adrienne Fischer, Tom Keily and Matt Weyer · It does this by building upon, “Untangling the...

Page 1: Adrienne Fischer, Tom Keily and Matt Weyer · It does this by building upon, “Untangling the Evidence on Preschool Effectiveness: Insights for Policymakers,” a pioneering study

ecs.org | @EdCommission ecs.org | @EdCommission

1

POLICY BRIEFPOLICY BRIEF

Exploring New Research on Pre-K Outcomes

Adrienne Fischer, Tom Keily and Matt Weyer

MAY 2020

ecs.org | @EdCommission

As pre-K programming increasingly garners more political

attention and funding in the states, policymakers are seeking

the most up-to-date and rigorous research to support

decision-making and creation or expansion of these programs.

High-quality pre-K has bipartisan support in part because of

the vast amount of existing research detailing positive benefits

— notably that it is of great benefit to students from low-

income families and those who are dual-language learners.

However, some research also demonstrates that positive

growth among pre-K students isn’t consistently sustained

over time. This idea is known as “convergence” or “fadeout,”

because the short-term gains of pre-K attendees may diminish

in early elementary school.

The reasons for these mixed findings vary. Some researchers

have pointed out that large-scale, public pre-K often varies in

quality from program to program, making comparisons difficult.

Others have suggested that the convergence effect may be a

function of the instruction provided in kindergarten and early

elementary grades, which often focuses heavily on improving

the skills of struggling students who may lack access to pre-K

rather than building on the skills of pre-K attendees.

This Policy Brief aims to capture and make sense of the most

recent research studies on pre-K programs and outcomes.

It does this by building upon, “Untangling the Evidence

on Preschool Effectiveness: Insights for Policymakers,” a

pioneering study by the Learning Policy Institute, to analyze

a set of research studies conducted between January 2018

and March 2020. To better understand the research findings,

reference the glossary of key terms.

44 states plus D.C. offer

state-funded pre-K

programs, which are often

seen as an important

investment in early

childhood development.

Research on the effectiveness

of pre-K programs is

generally positive, with

some findings of converging

effects, in part because there

are a lot of variables that are

hard to control for.

This new analysis of 15

research studies finds

significantly more long-

term positive outcomes

— extending beyond

kindergarten — than

converging effects.

Page 2: Adrienne Fischer, Tom Keily and Matt Weyer · It does this by building upon, “Untangling the Evidence on Preschool Effectiveness: Insights for Policymakers,” a pioneering study

ecs.org | @EdCommission

22

GLOSSARY OF KEY TERMSDUAL-LANGUAGE LEARNERS: These are children up to age 8 who are in the process of learning

English while still learning their home language.

EXECUTIVE FUNCTION: This group of skills helps an individual focus on multiple streams of

information at the same time and revise plans as necessary.

PRE-K: This includes part- and full-day educational programming for students ages 3 to 5.

PROGRAM EFFECTIVENESS (SHORT-TERM AND LONG-TERM): Short-term effectiveness is

generally defined as improvements in academic (generally literacy and math skills) and non-

academic outcomes (e.g., social and emotional skills, self-regulation) when compared with a

control group at kindergarten entry. Long-term effectiveness mirrors short-term effectiveness, but

with a focus on outcomes at the end of kindergarten and beyond.

QUALITY: There are two main indicators of quality in pre-K settings: process and structural.

Process quality refers to the “child’s day-to-day experiences in pre-K settings and includes the

social, emotional, physical and instructional aspects of children’s activities and interactions with

teachers, peers and materials that are the proximal determinants of child development.” Structural quality includes class-size maximums, child-to-teacher ratios and teacher qualifications, among

other characteristics.

RETENTION: Grade-level retention is often a metric used in pre-K effectiveness studies as a proxy

for academic and/or social and emotional readiness and/or achievement.

SPECIAL EDUCATION PLACEMENT: This is another proxy used in research studies, primarily

related to placement based on behavioral and/or developmental challenges.

What the Research SaysIn addition to the evidence of pre-K’s positive impacts on student achievement, pre-K enrollment

has also been demonstrated to provide positive generational gains, modest-to-strong returns on

investment, enhanced social and emotional learning skills, and spillover effects to students who did

not participate.

For example, in a study demonstrating generational effects, children of program participants were

found to be more likely to:

• Never be suspended from school, addicted or arrested.

• Have at least a high school diploma or some college experience.

• Be employed full-time or be self-employed.

Page 3: Adrienne Fischer, Tom Keily and Matt Weyer · It does this by building upon, “Untangling the Evidence on Preschool Effectiveness: Insights for Policymakers,” a pioneering study

ecs.org | @EdCommission ecs.org | @EdCommission

3

POLICY BRIEF

Estimates of the return on investment in pre-K range from $2 to $13

per dollar spent and strongly depend on the level of quality.

Additionally, a recent review of 33 research articles found small-to-medium effects for

development of social and emotional skills and reduction in problem behaviors. Studies have also

demonstrated spillover effects, where students ineligible to attend pre-K demonstrated benefits

from being enrolled in elementary classrooms with their pre-K attending peers.

The Education Commission of the States analysis considered a subset of 15 research studies,

published between January 2018 and March 2020, demonstrating 37 outcome effects. Each study

demonstrated at least one positive effect, and some studies also demonstrated converging effects.

This chart provides a breakdown of the outcome effects in both the short and long term. Short-

term effectiveness is generally defined as improvements in academic and non-academic outcomes

at kindergarten entry. Long-term effectiveness focuses on outcomes at the end of kindergarten

and beyond.

In the analysis, the majority of research demonstrates positive effects for those who participated in

pre-K: 70% demonstrated positive effects in the short term and long term, while 30% demonstrated

converging effects.

72% 68%

COMPARING SHORT-TERM AND LONG-TERM FINDINGS

= POSITIVE EFFECTS   = CONVERGING EFFECTS

Page 4: Adrienne Fischer, Tom Keily and Matt Weyer · It does this by building upon, “Untangling the Evidence on Preschool Effectiveness: Insights for Policymakers,” a pioneering study

ecs.org | @EdCommission

44

The analysis also looked at the number of positive and converging effects for specific content areas:

OUTCOME MEASURE EFFECTS

LITERACY

MATH

SPECIAL-EDUCATION PLACEMENT REDUCTION

RETENTION REDUCTION

ON-TIME HIGH SCHOOL GRADUATION

EXECUTIVE FUNCTION

LANGUAGE DEVELOPMENT (FOR DUAL-LANGUAGE LEARNERS)

SCIENCE

SOCIAL STUDIES

GPA

TOTAL NUMBER OF EFFECTS

= POSITIVE EFFECT  = CONVERGING EFFECT*

*INCLUDES NULL FINDINGS AND NEGATIVE EFFECTS.

The research shows positive short- and long-term effects across academic skills in reading

and math for all students and language development, specifically for dual-language learners.

Additionally, research found that pre-K contributed to reductions in grade-level retention, as well as

increases in on-time high school graduation and executive function. Also of note are several studies

that found larger short- and long-term positive effects of pre-K for low-income children and dual-

language learners.

To separate positive effects from converging effects, it is important to consider questions of

whether, how and for whom a pre-K program is effective. Because these are complex questions to

Page 5: Adrienne Fischer, Tom Keily and Matt Weyer · It does this by building upon, “Untangling the Evidence on Preschool Effectiveness: Insights for Policymakers,” a pioneering study

ecs.org | @EdCommission ecs.org | @EdCommission

5

POLICY BRIEF

investigate, researchers are looking at a variety of new methods to discover what works best and

in which environments. The following list highlights some critical areas of current consideration for

developing pre-K systems at scale.

QUALITY OF EARLY ELEMENTARY LEARNING ENVIRONMENTS. Recent research in Tennessee

showed that while pre-K students did not perform better overall than a control group in third

grade, students who attended high-quality elementary schools and were taught by highly

effective teachers in the years after pre-K performed significantly better than a control group

without pre-K.

STRATEGIC ALIGNMENT BETWEEN PRE-K AND EARLY ELEMENTARY. Studies have shown

that aligning curricula to build on the content covered in pre-K has a significant positive

effect on achievement in kindergarten, whereas pre-K without the enhanced curricula showed

convergence.

UNDERSTANDING THE ROLE OF PRE-K QUALITY. While elements of process quality — such

as teacher-child interactions and curriculum materials — are thought to have a greater effect on

student outcomes, structural quality components may also have an influence.

QUANTIFYING STUDENT OUTCOMES. While social and emotional learning and behavioral

development are harder to measure than academic skills, these soft skills are frequently linked

to later academic and career success. Studies of curricula focused on social and emotional

learning have shown promising results among low-income children, but incorporating these

skills uniformly on a large scale still presents a challenge.

Final ThoughtsState policymakers continue to prioritize pre-K programming. In the 2018-19 school year, they

invested more than $8.75 billion in state pre-K programs — a $301 million increase from the

previous year (up 3.6%). And in 2020, at least 19 governors touted early learning in their State of

the State address.

This new analysis shows positive effects for pre-K programs across all studies, with some instances

of convergence with peers in comparison groups. Emerging research suggests that sustaining

the positive effects gained by students during pre-K may be partly a function of the learning

environments that follow in the early elementary grades. In order to create learning environments

that sustain pre-K effects, policymakers can consider factors such as school and teacher quality,

exposure to challenging content, engaging home experiences and parental involvement.

Policymakers can also enable long-term, consistent, aligned and disaggregated data collection to

allow state education agencies and researchers to evaluate pre-K effects that inform future policy

decisions. As of 2018, 22 states link data across all early care and education programs (e.g., child

care and pre-K programs).

Page 6: Adrienne Fischer, Tom Keily and Matt Weyer · It does this by building upon, “Untangling the Evidence on Preschool Effectiveness: Insights for Policymakers,” a pioneering study

ecs.org | @EdCommission

66

Importantly, pre-K should not be expected to inoculate children for the rest of their educational

careers. What follows the pre-K years is also critical in providing high-quality environments that

sustain positive gains, especially in the K-3 grades.

Finally, while scaling high-quality pre-K environments will be a continual challenge, above all, safe

environments, positive classroom climates, and consistent, caring and responsive educators are

paramount to ensuring that positive effects from pre-K are developed. More comprehensive and

longitudinal data collection and evaluation can go a long way in improving states’ pre-K systems.

INTERESTED IN LEARNING MORE? To explore more state policy trends and other important context for

statewide pre-K programs, refer to Education Commission of the States’

Key Issue Page on Early Childhood Education.

Page 7: Adrienne Fischer, Tom Keily and Matt Weyer · It does this by building upon, “Untangling the Evidence on Preschool Effectiveness: Insights for Policymakers,” a pioneering study

ecs.org | @EdCommission ecs.org | @EdCommission

7

POLICY BRIEF

Research Articles Included in this Analysis (Listed by State and/or Locality)ALABAMA: “Achievement Gap Closure and Gains Associated with Alabama First Class Pre-K,”

Alabama Department of Early Childhood Education.

CHICAGO: “The Chicago School Readiness Project: Examining the Long-Term Impacts of an Early

Childhood Intervention,” PoLS One.

COLORADO: “Colorado Preschool Program Legislative Report 2020,” Colorado Department

of Education.

DENVER: “The Effects of Full-Day Pre-Kindergarten: Experimental Evidence of Impacts on

Children’s School Readiness,” Education Evaluation and Policy Analysis.

GEORGIA: “Children’s Outcomes through Second-Grade Findings from Year 4 of Georgia’s

Pre-K Longitudinal Study,” University of North Carolina at Chapel Hill, Frank Porter Graham Child

Development Institute.

GEORGIA: “Participation in Georgia’s Pre-K as a Predictor of Third-Grade Standardized Test

Scores,” Child Trends and Bright from the Start, Georgia Department of Early Care and Learning.

MIAMI: “New Benefits of Public School Pre-Kindergarten Programs: Early School Stability, Grade

Promotion and Exit from ELL Service,” Early Childhood Research Quarterly.

NATIONAL: “Estimating the Relationship Between Preschool Attendance and Kindergarten Science

Achievement: Implications for Early Science Achievement Gaps,” Education Finance and Policy.

NEW YORK CITY: “Strengthening Children’s Math Skills with Enhanced Instruction: The Impacts

of Making Pre-K Count and High 5s on Kindergarten Outcomes,” MDRC.

NORTH CAROLINA: “Effects of the North Carolina Pre-Kindergarten Program Findings Through

Pre-K of a Small-Scale RCT Study, 2017-2018 Statewide Evaluation,” University of North Carolina

at Chapel Hill, Frank Porter Graham Child Development Institute.

NORTH CAROLINA: “Long-Term Effects of Early Childhood Programs Through Eighth Grade: Do

the Effects Fade Out or Grow?,” Children and Youth Service Review.

TENNESSEE: “Effects of the Tennessee Pre-Kindergarten Program on Children’s Achievement

and Behavior Through Third Grade,” Vanderbilt University.

TULSA: “Tulsa Pre-K Alumni Are More Likely to Complete Algebra I Early,” Georgetown

University, Center for Research on Children in the United States.

UNSPECIFIED LOCATION: “Starting Early: The Benefits of Attending Early Childhood Education

Programs at Age 3,” American Educational Research Journal.

VIRGINIA: “The Effects of Public Pre-Kindergarten Attendance on First-Grade Literacy

Achievement: A District Study,” International Journal of Child Care and Educational Policy.

Page 8: Adrienne Fischer, Tom Keily and Matt Weyer · It does this by building upon, “Untangling the Evidence on Preschool Effectiveness: Insights for Policymakers,” a pioneering study

© 2020 by Education Commission of the States. All rights reserved. Education Commission of the States encourages its readers to share our information with others.

Education Commission of the States | 700 Broadway Suite 810 Denver, CO 80203

About the Authors

Adrienne Fischer

As a policy analyst, Adrienne focuses on issues related to early learning. Prior to

joining Education Commission of the States, Adrienne covered education policy

issues with the National Conference of State Legislatures and earned a master’s

degree in public administration. When Adrienne is not hard at work, she can be

found enjoying the outdoors or immersed in a good book. Contact Adrienne at

[email protected] or 303.299.3600.

Tom Keily

As a policy analyst, Tom contributes to the work of the policy team on issues across

the education spectrum. Prior to joining Education Commission of the States, Tom

taught middle school in Milwaukee, Wisconsin. Tom is dedicated to providing state

policymakers with quality research that supports them in making a positive impact

on students’ lives. Contact Tom at [email protected] or 303.299.3694.

Matt Weyer

As a senior policy analyst, Matt focuses on early learning issues. Prior to joining the

Education Commission of the States, Matt worked for over four years covering early

learning issues for the National Conference of State Legislatures, earned his

doctorate in educational leadership and policy studies from the University of

Denver and was a kindergarten teacher in a bilingual classroom for Denver Public

Schools. When Matt is not working, he can be found snowboarding or trail running in beautiful

Colorado. Contact Matt at [email protected] or 303.299.3626.

AcknowledgmentEducation Commission of the States gives special thanks to Hanna Melnick, Abby Schachner and

Cathy Yun at the Learning Policy Institute for their support in developing this Policy Brief.