Ohio’s New Accountability System

Ohio’s Response to No Child Left Behind (NCLB)

a.k.a. Elementary & Secondary Education Act

a.k.a. ESEA

January 8, 2002

2

Challenges• Tougher system• New ground-rules

– All students accounted for– Group, as well as aggregate,

performance counts

• Creates new starting point for judging future performance– 2002-03 results are not directly

comparable to past years

3

Opportunities• Multiple ways to tell the achievement

story• Highlights the achievement of all

students• Ohio’s educators have been

improving achievement for almost a decade -- we believe that 2003-04 and beyond will result in continuing improvement

4

Key Features

• Grades 3-8 reading & math tests

• Multiple measures

• School building designations

• Group accountability

• Recognition & consequences

• More timely results

5

Tests Administered

Previously• Grades 4, 6, 9• 5 subjects

ReadingMathematicsWritingScienceCitizenship

Now• Grades 3-8, 10• 5 subjects

ReadingMathematicsWritingScienceSocial studies

Ohio Test Schedule2003-04 2004-05 2005-06 2006-07 2007-08

GradesK-2

DiagnosticsR, W, M

DiagnosticsR, W, M

DiagnosticsR, W, M

DiagnosticsR, W, M

DiagnosticsR, W, M

Grade 3Achievement

R

DiagnosticsW

AchievementR, M

DiagnosticsW

AchievementR, M

DiagnosticsW

AchievementR, M

DiagnosticsW

AchievementR, M

DiagnosticsW, S, SS

Grade 4ProficiencyR, W, M, S, C

AchievementR, W

ProficiencyM, S, C

AchievementR, M, W

AchievementR, M, W

AchievementR, M, W

DiagnosticsS, SS

Grade 5Achievement

RAchievement

R, MAchievement

R, M, S, SSAchievement

R, M, S, SS

DiagnosticsW

Grade 6 ProficiencyR, W, M, S, C

ProficiencyR, W, M, S, C

AchievementR, M

AchievementR, M

AchievementR, M

DiagnosticsW, S, SS

Grade 7Achievement

MAchievement

R, MAchievement

R, M, WAchievement

R, M, W

DiagnosticsS, SS

Grade 8

AchievementR, M

AchievementR, M

AchievementR, M, S

AchievementR, M, S, SS

DiagnosticsW

Grade 10ProficiencyR, W, M, S, C

OGTR, M

OGTR, M, W, S , SS

OGTR, M, W, S , SS

OGTR, M, W, S , SS

OGTR, M, W, S , SS

7

Test Performance Levels

Proficiency Tests• Advanced• Proficient• Basic• Below Basic

Achievement Tests• Advanced• Accelerated• Proficient• Basic• Limited

8

Diagnostics• ODE-developed diagnostics required for:

– Students in buildings missing AYP for 2 years or more

– Transfer students– All Kindergarten students within first 6 weeks

• If school met AYP or missed for one year, district may select diagnostic

• 9th graders in AE & AW districts (10th grade practice test)

9

Student Intervention• Required for:

– 3rd graders reading below “proficient” -- intense remediation

– Students scoring below “proficient” on achievement tests

– Students failing to make satisfactory progress toward attaining grade level academic standards on diagnostic tests

– 9th graders scoring below “proficient” on the 10th grade practice test

10

Designations Applied

Previously• Districts only

Now• Districts• School buildings• Community

schools

11

Same Five Designations for Ohio

• Excellent

• Effective

• Continuous Improvement

• Academic Watch

• Academic Emergency

12

Designations Determined

Previously• Percent of

performance (local report card) indicators met

Now• Percent of

performance indicators

• Performance index score

• Improvement• AYP

13

Multiple Measures to Determine Designations

• Current Ohio Indicators (existing)

• Performance Index (new)

• Growth Calculation (new)

• Adequate Yearly Progress (federal requirement)

14

Multiple Measures:Current Ohio Indicators

• 22 total– 20 test scores

• 5 subjects• 4 grades (4th, 6th, 9th, 10th)

– graduation rate– attendance rate

• High standard -- 75% plus

15

Multiple Measures to Determine Designations

• Current Ohio Indicators (existing)

• Performance Index (new)

• Growth Calculation (new)

• Adequate Yearly Progress (federal requirement)

16

Multiple Measures: Ohio Performance Index

• More sensitive to gradations of achievement than indicators

• Credits achievement at all performance levels

• Weights higher performance more than lower performance

• Rewards “advanced” performance

17

Multiple Measures: Ohio Performance Index

Advanced 1.2Proficient 1.0Basic 0.6Below Basic 0.3Untested 0.0

18

Multiple Measures: Ohio Performance IndexPerf. Level % Weight ScoreAdvanced 2.0 1.2 2.4Proficient 21.6 1.0 21.6Basic 33.3 0.6 20.0Below Basic 39.2 0.3 11.8Untested 3.9 0.0 0

Total 100 55.8

19

Multiple Measures: Performance Index

N % weight score N % weight score N % weight scoreadvanced 2 2.0% 1.2 2.4 3 2.9% 1.2 3.5 5 4.9% 1.2 5.8proficient 22 21.6% 1.0 21.6 25 24.0% 1.0 24.0 28 27.2% 1.0 27.2basic 34 33.3% 0.6 20.0 41 39.4% 0.6 23.7 40 38.8% 0.6 23.3below basic 40 39.2% 0.3 11.8 32 30.8% 0.3 9.2 26 25.2% 0.3 7.6untested 4 3.9% 0.0 0.0 3 2.9% 0.0 0.0 4 3.9% 0.0 0.0total 102 55.8 104 60.4 103 63.9

2001-02 2002-03 2003-04

20

Multiple Measures: Ohio Performance Index

60.4

55.8

63.9

0

20

40

60

80

100

120

2001-02 2002-03 2003-04

21

Multiple Measures to Determine Designations

• Current Ohio Indicators (existing)

• Performance Index (new)

• Growth Calculation (new)

• Adequate Yearly Progress (federal requirement)

22

Multiple Measures:Growth Calculation --Value Added

• Based on individual student gain– once grades 3-8 tests in place– multiple years of data

23

Multiple Measures:Growth Calculation --Temporary Measure

• Based on improvement in performance index score– two years of improvement– at least 10 total points– at least 3 points in most recent

year

24

Multiple Measures:Growth Calculation --Temporary Measure

• District or school can move from:– Academic Emergency to Academic

Watch– Academic Watch to Continuous

Improvement

25

Multiple Measures to Determine Designations

• Current Ohio Indicators (existing)

• Performance Index (new)

• Growth Calculation (new)

• Adequate Yearly Progress (federal requirement)

26

AYP Applies to:

Previously• Title I funded

schools & districts only

Now• All public

schools & districts, including community schools

• Regardless of Title I funding

27

Group Accountability

Previously• Reported only

Now• Reported• Basis of federal

Adequate Yearly Progress calculation

28

Multiple Measures: NCLB Adequate Yearly Progress

• Whole school (all students)• Groups

– Race/ethnicity– Students with disabilities– Limited English proficient– Economically disadvantaged

29

Multiple Measures: Adequate Yearly Progress

• Same targets for each district, building, group, & statewide– Separate targets for % proficient:

• reading• mathematics

– 95% participation requirement

• High school graduation rate• K-8 attendance rate

30

Multiple Measures: Adequate Yearly Progress (2002-03 targets) Reading Math

Grade 4 40.5% 35.9%

Grade 6 36.0% 36.8%

Grade 9 78.0% 53.1%

31

Multiple Measures: Adequate Yearly Progress (trajectory based on 40% starting point)

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Series1 40% 40% 50% 50% 50% 60% 60% 60% 70% 80% 90% 100%

2002-03 2003-04 2004-05 2005-06 2006-07 2007-08 2008-09 2009-10 2010-11 2011-12 2012-13 2013-14

32

Who Counts

Previously• Districts could

exclude:Students with

disabilitiesLimited English

proficient

Now• All students• No exclusions• Full academic

year• New rules for

where students count

33

New Report Card Criteria:Multiple Ways of Earning Designations

94% to 100%(21 or 22 for districts)

94% to 100%(21 or 22 for districts)

75% to 93%(17 to 20 for districts)

75% to 100%(17 to 22 for districts)

0% to 74%(0 to 16 for districts)

50% to 74%(11 to 16 for districts)

31% to 49%(7 to 10 for districts)

0% to 31%(0 to 6 for districts)

Temporary Growth Calculation ** --

Districts and schools will move from Emergency to Watch or from Watch to

Improvement if: (a) improved performance index score each of past two years, (b) total two-year gain of at least 10 points, and (c) most recent year's gain of at least

3 points.

and

Academic Watch

Academic Emergency and

Effective

or

or

or

or

or

or

Federal AYP Requirements

Value Added -- Once grades 3 to 8 reading and

math assessments are implemented and multiple

years of data available, Ohio will incorporate a measure of individual student grade-to-grade achievement gains

to help determine school building and district

designations.

Performance Index Score Growth Calculation

100 to 120

0 to 69

100 to 120

90 to 99

90 to 120

and

and

and

and

Missed AYP*

Met AYP

Missed AYP*

Met AYP

80 to 89

70 to 79

0 to 89Continuous

Improvement

or

Missed AYP

Missed AYP

Missed AYP

and

and

and

Met AYPandor

Excellent

Existing Ohio Report Card

Indicators

34

2002-03 Report Card Content

Previously• Percent of

performance (local report card) indicators met

• Designation

Now• Percent of

performance indicators

• Performance index score

• Improvement• AYP• Designation

35

Timeline for Report Card Release

Previously• February of next

school year

Now• Before start of

next school year

36

Recognition & Consequences

Recognition• Excellent• Effective

Consequences• Continuous

Improvement• Academic

Watch• Academic

Emergency

37

Consequences

School Buildings• School district

has primary responsibility for support, intervention, & consequences

Districts• State has

primary

responsibility for support, intervention, & consequences

38

Consequences

1 Year 2 Years 3 Years 4 Years 5 YearsEffectiveContinuous ImprovementAcademic WatchAcademic Emergency

Failing to Meet AYP

More Intrusiv

e

39

Consequences:Title I Funded Schools Only

• Choice (after missing AYP for two years)

• Supplemental services (after missing AYP for three years)

40

Consequences: All Schools

Less Intrusive• New curriculum• Decrease

management authority

• Appoint outside expert

• Extend day or year

More Intrusive• Replace key staff• Reorganize

administrative structure

after 4 years missing AYP

41

Consequences: All Schoolsafter 6 years missing AYP

• Reopen as community school• Replace personnel• Contract w/ nonprofit or for-profit entity to

operate school• Turn operation of building over to ODE• Other significant restructuring of

building’s governance

42

Consequences: All Districts

Less Intrusive• Withhold Title I

funds• New curriculum• Alternate

governance for particular schools

More Intrusive• Replace key staff• Appoint trustee in

place of superintendent & school board

after 4 years missing AYP

43

Challenges• Tougher system• New ground-rules

– All students accounted for– Group, as well as aggregate,

performance counts

• Creates new starting point for judging future performance– 2002-03 results are not directly

comparable to past years

44

Opportunities• Multiple ways to tell the achievement

story• Highlights the achievement of all

students• Ohio’s educators have been

improving achievement for almost a decade -- we believe that 2003-04 and beyond will result in continuing improvement

Accountability Website

www.ode.state.oh.us/Accountability/default.asp