Understanding Your Top from Your Bottom: A Guide to Michigan’s Accountability System
-
Upload
dexter-garrison -
Category
Documents
-
view
23 -
download
1
description
Transcript of Understanding Your Top from Your Bottom: A Guide to Michigan’s Accountability System
Understanding Your Top from Your Bottom: A Guide to Michigan’s Accountability System
September 2013Mitch Fowler
Agenda
• Scorecard Overview• Scorecard Components• Top to Bottom Overview• Understanding Z-Scores• Z-Score Components
Outcomes
Participants will:• Identify Scorecard Components and Scoring Guidelines• Complete an Audit to Identify Areas of Concern• Understand Top to Bottom Components and Scoring
Guidelines• Complete a Top to Bottom Audit to Identify Areas of Concern• Identify Resources from BAA (TTB Lookup Tool, BTO Look Up
Tool, Focus Achievement Gap Tool)
Accountability Pre Assessment
Two Sides to AccountabilityAYP Scorecard Top to Bottom Ranking
(Priority/Focus/Reward/No Label)
Criterion – Referenced: New Target with New Cut Scores, 85% Proficient by 2022.
Normative – Ranking relative to the state average if at least 30 FAY students.
Annual Measurable Objectives (AMOs) based on linear trajectory from 2011/12
Focuses attention on smaller subset of schools; designates Priority, Focus, & Rewards
Given to all schools; acts as an “early warning” system; looks at subgroups, set targets
The primary mechanism for sanctions and supports for Priority and Focus Schools.
All Schools (Approx. 3,400 buildings)
Fewer Schools (2,866 buildings)
Scorecard Availability
• Available on BAA Secure Site
• Available on MI School Data (Public or Secure)
Scorecard
Scorecard Components
• Proficiency– Based on Annual Measurable Objectives– Must be at 85% Proficient by 2022 in ALL Areas and Subgroups
• Participation– Must Test 95% of Students
• Completion Rate– Graduation / Attendance Rate
• Other Factors– SIP / DIP– Educator Evaluations
Scorecard Components - Proficiency
ANNUAL MEASURABLE OBJECTIVES (AMO)
Activity: Identifying AMOs
Scorecard Components - Proficiency
• AMO ExampleContent
AreaAnnual
Increment2011-12
Base Target2012-13
Target2013-14
TargetMathematics 5.49 30.10 35.59 41.08
Reading 2.35 61.54 63.89 66.23
Science 7.12 13.82 20.94 28.06
Social Studies 5.51 29.87 35.38 40.90
Writing 3.87 46.26 50.13 54.01
Scorecard Components - ProficiencyContent
AreaAnnual
Increment2011-12
Base Target2012-13
Target2013-14
TargetScience 7.12 13.82 20.94 28.06
All Students made the 20.94% proficiency mark… 2 points.
The Bottom 30% of students did not meet the 20.94% proficiency mark… 0 points.
Scorecard Components - Proficiency
This is awesome!
Scorecard Components - Proficiency
1 = Top 30%2 = Middle 40%3 = Bottom 30%
Activity: Who are the Bottom 30%?
Scorecard Components - Proficiency
Of the 33 proficient students, 18 were provisional… they
received a 3.
Activity: Revealing Proficiency
Activity: Proficiency Audit
Scorecard Components - Participation
95% Tested!
Scorecard Components - Participation
Activity: Participation Audit
Scorecard Components – Completion Rate
Completion Rate OR
Attendance Rate
Activity: Completion Rate Audit
Scorecard Components – Other Factors
Activity: Other Factors Audit
Scorecard Decision Tree
http://www.michigan.gov/documents/mde/ScorecardOverallColorDecisionTree_433459_7.pdf
Activity: Overall Color
Top to Bottom Availability
• Available via the BAA Look Up Tool – (On the BAA Website Here)
• Available on MI School Data (Public or Secure)
Top to Bottom Ranking
• Schools are compared to other schools in the state by utilizing z-scores (a statistical measure that describes how far you are from the middle of the pack).
• Z-scores that are positive, show that you are above the 50th percentile when compared to the state. Z-scores that are negative, show that you are below the 50th percentile when compared to the state.
• Z-scores are centered around zero or the “state average”
• Positive is ABOVE the state avg.• Negative is BELOW the state avg.
Z-scores (Standard Deviations)
State AverageZ-score = Zero
-1-2-3 1 2 3
50% 68% 84% 98%
0.5
-0.532%16%2%
PercentileState
Average
Top 1/3 > +0.5Middle 1/3
Between-0.5 & 0.5
Bottom 1/3 < -0.5
Slide courtesy of Doug Greer, Ottawa ISD
Z-Score Structure
Weight
Subject Area Sub Z-Scores
Subject Area
Z- scores
Overall Ranking
33rd
Science
Achievement 50%
Improvement 25%
Achievement Gap 25%Math
Reading
Writing
Social Studies
Graduation
Top to Bottom Report (MI School Data)
Overall Rank
Subject Area Z-Scores
Subject Area Sub Z-Scores
Accountability Labels (Priority, Focus, Reward)Overall Rank (Priority or
Reward) Top or Bottom 5%
Achievement Gap z-score
(Focus)
Activity: Z Score Review
How Close to Focus Are We?
http://www.michigan.gov/documents/mde/2013_Individual_School_Gap_Lookup_Tool_431296_7.xls
Focus Cut Off
School’s Location
Achievement Gap Z-Scores
TTB Resources and Look Up Tools
http://www.michigan.gov/mde/0,4615,7-140-22709_59490---,00.html
Accountability Post Assessment