Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan...

115
Data Analysis State Accountability

Transcript of Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan...

Page 1: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

Data Analysis State

Accountability

Page 2: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.
Page 3: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

Data Analysis(What)

Needs Assessment

(Why)

Improvement Plan

(How)

Implement and Monitor

Page 4: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

Details

Page 5: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

Index Framework Statutory Goal

Improving Student achievement at all levels in the core subjects of the state curriculum

1

Page 6: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

Index Framework Statutory Goal

Ensuring the progress of all students toward achieving Advanced Academic Performance

2

Page 7: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

Index Framework Statutory Goal

Closing Advanced Academic Performance level gaps among groups

3

Page 8: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

Index Framework Statutory Goals

Closing gaps among groups in percentage of students graduating under the recommended high school program and advanced high school program

4

Page 9: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

Index 1: Student Achievement

Page 10: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

Index 2: Student Progress

Page 11: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

Index 3: Closing Performance Gaps

Page 12: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

Index 4: Postsecondary Readiness

Page 13: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

System Safeguards

Page 14: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

Why a Performance Index ?

Page 15: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

With a performance Index, the resulting rating reflects overall performance for the campus or district rather than the weakest performance of one student group/subject area.

Page 16: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

Multiple indexes can be used in the framework to ensure accountability for every student.

Page 17: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

Any number of indicators and student groups can be added to the system without creating additional targets for campuses and districts to meet.

Page 18: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.
Page 19: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

2013

Page 20: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

Met Standard

Met Alternative StandardImprovement Required

Page 21: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

Index Standards

Index Score

50

AEA-25

5th Percentile

Index Score

55

AEA-30

Index Score

75

AEA-45

Page 22: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

Differences

Page 23: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

English Language Learners

Student Groups…Economically Disadvantaged

African AmericanAmerican IndianAsianHispanicPacific IslanderWhiteTwo or more races

Special Education

Page 24: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

Minimum Group Size

25

Page 25: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

Common

Elements

Page 26: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.
Page 27: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.
Page 28: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

If student was enrolled on the campus/district on this date:

Then these results are included in the campus/district accountability subset

Fall 2011 enrollment snapshot

EOC summer 2012

Fall 2012 enrollment snapshot

EOC Fall 2012

EOC Spring 2013

Grade 3-8 Spring 2013

Page 29: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.
Page 30: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.
Page 31: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

Different

“Let Go”Keep

Page 32: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

Different

“Let Go”Keep

Minimum Group Size 25 30/10/50 or

50/10/200

Page 33: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

What does this report tell you about a

campus?

Page 34: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

New Reports• Calculation Report-Tables used to

aggregate scores to determine Index Points

• Data Table- Table of disaggregated data used for the Calculation Report. The highlighted cells indicate data used in calculations.

Page 35: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

Index 1: Student

Achievement

Page 36: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.
Page 37: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

No Minimum Size3 year average if less than

10 students

Which student groups are calculated in Index 1?

Page 38: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

Index 1 :Student Achievement

Subjects: Combined over Reading, Mathematics, Writing, Science, and Social Studies.

Tests: STAAR English, STAAR Spanish, EOC, STAAR and EOC Modified and Alternate, TAKS Grade 11

Performance Standards: Phase-in 1 Level II

(2013)

MSR: None

Page 39: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

# Met Phase in Level II for Reading

# Met Phase in Level II for Writing

# Met Phase in Level II for Math

# Met Phase in Level II for Science# Met Phase in Level II for Social Studies

# Tested Reading

# Tested Writing

# Tested Math

# Tested Science

# Tested Social Studies

Page 40: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

What does the calculation report indicate about a

campus?What would an Index score

of 45 indicate about the campus?

Page 41: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

What are the strengths and weaknesses of the campus based on the calculation report?

What reflective questions would you ask the campus about this data?

What are your unanswered questions about this campus based on the calculation report?

Page 42: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.
Page 43: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

Index 2: Student Progress

Page 44: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.
Page 45: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

We do not know? Scores for :Did not Meet Expectations Met ExpectationsExceeded Expectations

The Index scores that identifies the lowest 5%

Page 46: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

What we do know?

Page 47: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

Subjects Reading

Math

Writing

Applies to available grades

Page 48: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

Student Groups

Two or More Races

Pacific IslanderHispanic

Asian

American Indian

African American

Special Education

ELL

White

All Students

Page 49: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

Minimum Size CriteriaAll Students = 10 testsRace/ Ethnicity groups = 25

Page 50: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

Methodology

Met- one point for each percent of students at the Met growth expectation levelExceeded- two points for each percent of students at the Exceeded growth expectations level

Page 51: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

Set a side for a minute

Page 52: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

Methodology

Met- one point for each percent of student at the Met growth expectation levelExceeded- two points for each percent of students at the Exceeded growth expectations level

Page 53: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.
Page 54: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.
Page 55: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.
Page 56: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.
Page 57: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

How is the data in Index 2 different from Index 1?

How does improved performance on Index 2 impact the other

Indexes?

What advice would you give this campus to impact Index 2? (using

the sample reports)

Page 58: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

Index 3: Closing

Performance Gaps

Page 59: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.
Page 60: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

What you need to know to calculate Index 3?

Page 61: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

Subjects…

Page 62: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

• STAAR English 3-8 and STAAR Spanish 3-5 at phase-in Level II

• EOC at phase-in Level II for spring, and the previous fall and summer

• STAAR 3-8 and EOC Modified and Alternative at Level II

• Retest results 5 and 8 from 1st retest• TAKS Grade 11 in 2013

Results include…

Page 63: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

2 lowest performing race/ethnicity groups from the previous year

Student Groups…Economically Disadvantaged

African AmericanAmerican IndianAsianHispanicPacific IslanderWhiteTwo or more races

Page 64: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

Accountability Subset…

Page 65: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

Minimum Group Size… >=25 for Race/Ethnicity groups

Page 66: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.
Page 67: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

Methodology…

Phase-in Level II- 2013 and beyond- one point for each percent of students at the phase-in Level II performance standard and above

Advanced Level III-2014 and beyond- one additional point for each percent of students at the Level III performance standard

Page 68: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

Calculations

Number of Tests

Number at Phase in Level II

Number of Tests

Number at Level III

2014

Page 69: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

Economically Disadvantaged group always

evaluated

Page 70: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

Set a Side

Page 71: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

Set a Side

Page 72: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.
Page 73: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.
Page 74: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.
Page 75: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.
Page 76: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.
Page 77: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

How will each subject tested affect the

overall Index 3 score?

What recommendations would you make to this campus based

on the sample reports?

Page 78: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.
Page 79: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

Index 4: Postsecondary Readiness

Page 80: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

Indicators

STAAR Percent Met Final Level II on One or More Tests

Grade 9-12 Graduation Rate

Grade 9-12 Annual Dropout Rate

Recommended/ Distinguished Achievement (Advanced) High School Program (RHSP/DAP)

2013-2014

Page 81: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

STAAR Percent Met Final Level II on One or More TestsIncludes Assessment results

for:STAAR English (Grade 3-8 and Spanish (Grade 3-5) at final Level II performance standard for assessments administered in the springEOC at final Level II performance standard for assessments administered in the spring and the previous fall and summerSTAAR Grades 3-8 and EOC Modified and Alternative at final Level II performanceRetest results

2013-2014

Page 82: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

Number of Students Met final II Standard on One or More Tests

Number of Students with One or More Tests

2013-2014

Page 83: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.
Page 84: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

Class of

2011 and beyond Student Groups:

All Students ELL-Identified in Grade 9 Special Education 7 Race/ Ethnicity Groups

25

Graduation Rate

Page 85: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

Graduates

Graduates + continuers +

GED recipients + dropouts

Page 86: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

2013 and beyond

Student Groups: All Students ELL-Identified in during reported year Special Education 7 Race/ Ethnicity Groups

Annual Drop Out Rate

Campuses with Grade 9, 10, 11, & 12

25

Page 87: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

Number of students who dropped out during

year

Number of students enrolled during year

Page 88: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.
Page 89: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

Student Groups: All Students 7 Race/ Ethnicity Groups

Recommended/ Distinguished Achievement High School Program

25

Page 90: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

Number of prior year graduates with graduation

codes for RHSP or DAP

Number of prior year graduates

Page 91: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

Index Standards

Index Score

50

AEA-25

5th Percentile

Index Score

55

AEA-30

Index Score

75

AEA-45

Page 92: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.
Page 93: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.
Page 94: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

Why is some of the data marked out?

Why is only graduation rate and RHSP/DAP

calculated in the sample report for Index 4 points?

Page 95: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.
Page 96: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

System Safeguards

Page 97: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

Purpose• Ensure system disaggregates

performance by student group, performance level, subject area, and grade

• Target for disaggregated results meet and exceed federal requirements– Performance Target– Participation Rate – Graduation rate targets and improvement– Limit on Alternative Assessments

Page 98: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

Impact• Results are reported for any cell that

meets minimum size criteria.• Failure to meet the safeguard target

for any reported cell must be addressed

• Performance on the safeguard indicators are incorporated into the Texas Accountability Intervention System (TAIS)

Page 99: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.
Page 100: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.
Page 101: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.
Page 102: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

How does the system safeguards ensure high

expectations for all students?

Using these sample reports, how would you advise a

campus that met all Index standards but only 85% of the system safeguards?

Page 103: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

Who are our AEA campuses?

Page 104: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

Current 10 eligibility Criteria Primarily Grades 6-12

AEA Eligibility

Page 105: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.
Page 106: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

Residential Facilities

No rating for 2013

Page 107: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

What’s different for AEA?

GED

Page 108: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

What’s different for AEA?

GED 4, 5 and 6 Year Graduation rates

Choose the best

4, 5 and 6 Year Graduation rates

Page 109: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

What’s different for AEA?

Dropout Rate

Less then 20%

Bonus points given for Index 4

Page 110: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

75 %Graduation

and GED Score

What’s different for AEA?

25 %% met Level II

on one or more tests

Page 111: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

Alternate Education Accountability

Index Score

50

AEA-25

5th Percentile

Index Score

55

AEA-30

Index Score

75

AEA-45

Page 112: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

AEA

BON

US

POIN

TSRHSD and DAP Plans

Continuing Student who Graduate in 5th or 6th year

Graduating/GED for “statutorily excluded students”

Page 113: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

What is the 4 year graduation rate?

What happens if you do not meet graduation for a student group?

What effect does drop out rate have

on index score?

Why will elementary and middle schools not be scored on Index 4 this year?

Page 114: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.

What information can the AEA Index Scores and the System

Safeguards data tell you about alternative campuses?

Page 115: Data Analysis State Accountability. Data Analysis (What) Needs Assessment (Why ) Improvement Plan (How) Implement and Monitor.