MEAP / MMEMEAP / MMENew Cut ScoresNew Cut Scores
Gill ElementaryGill Elementary
February 2012February 2012
Meaning of a Cut ScoreMeaning of a Cut Score
A “cut score” is the lowest score a student A “cut score” is the lowest score a student can achieve on a test (or multiple tests) to be can achieve on a test (or multiple tests) to be considered “proficient” or “passing” at their considered “proficient” or “passing” at their respective grade levelrespective grade level
A cut score on a test is the score that A cut score on a test is the score that separates test takers into various categories, separates test takers into various categories, such as advanced proficient, proficient, such as advanced proficient, proficient, partially proficient and not proficientpartially proficient and not proficient
The New MEAP/MME Cut ScoresThe New MEAP/MME Cut Scores
New cut scores approved by State Board New cut scores approved by State Board of Education in Sept. 2011of Education in Sept. 2011
New cut scores in effect for 2011-12 testsNew cut scores in effect for 2011-12 tests What is different?What is different?
1.1. They did not use standard setting panels, They did not use standard setting panels, which is how nearly all other previous cut which is how nearly all other previous cut scores were set.scores were set.
2.2. The new method was purely statistical, The new method was purely statistical, they linked 11they linked 11thth grade MME scores to grade MME scores to college grades and then linked grades 3-9 college grades and then linked grades 3-9 MEAP to those MME scores.MEAP to those MME scores.
Cut Score StudyCut Score Study
MDE conducted a special study using:MDE conducted a special study using:– Michigan students’ 2008-09 MME scores, Michigan students’ 2008-09 MME scores,
and and – First semester freshman grades in Fall First semester freshman grades in Fall
2010 in selected non-remedial courses at 2010 in selected non-remedial courses at Michigan post-secondary public Michigan post-secondary public institutionsinstitutions
Twenty-two 4-year colleges Twenty-two 4-year colleges Fifteen 2-year institutionsFifteen 2-year institutions
– Then the 2008-09 MME scores were linked Then the 2008-09 MME scores were linked to the 2010-11 MME scores.to the 2010-11 MME scores.
5
• The grades being predicted are often being given by graduate teaching assistants whose knowledge about grading may vary.
• The “social science” courses are a variety of the courses.
• There are large differences in the grading practices and student populations among colleges (and community colleges).
• 75% of the variation in college grades cannot be predicted by ACT scores.
Considerations with Prediction Data
““AdvancedAdvanced”” is now defined as having a is now defined as having a 2 in 32 in 3 or or greatergreater chance of earning an A or B in college (or being chance of earning an A or B in college (or being proficient on the next grade level test).proficient on the next grade level test).
““ProficientProficient”” is now defined as having a is now defined as having a 1 in 21 in 2 to 2 in 3 to 2 in 3 chance of earning an A or B in college (or being proficient chance of earning an A or B in college (or being proficient on the next grade level test).on the next grade level test).
““Partially ProficientPartially Proficient”” is now defined as having a is now defined as having a 1 in 31 in 3 to 1 in 2to 1 in 2 chance of earning an A or B in college (or being chance of earning an A or B in college (or being proficient on the next grade level test).proficient on the next grade level test).
““Not ProficientNot Proficient”” is now defined as having is now defined as having less than aless than a 1 in 31 in 3 chance of earning an A or B in college (or being chance of earning an A or B in college (or being proficient on the next grade level test).proficient on the next grade level test).
Cut Score VideoCut Score Video
http://www.mistreamnet.com/vidflv.php?who=resa121611http://www.mistreamnet.com/vidflv.php?who=resa121611
Impact of Cut Score Impact of Cut Score ChangesChanges
In the short term…In the short term… Fewer students will be deemed Fewer students will be deemed
“proficient” on state tests“proficient” on state tests This may result in some criticism of This may result in some criticism of
schools’ past efforts or previous schools’ past efforts or previous standardsstandards
New scores will more closely align New scores will more closely align with our local assessmentswith our local assessments
Impact of Cut Score ChangesImpact of Cut Score Changes
In the long term…In the long term…
Higher standards will likely result in Higher standards will likely result in improved achievement over timeimproved achievement over time
Michigan schools and students will be Michigan schools and students will be better prepared for transition to common better prepared for transition to common state standards and assessments, state standards and assessments, scheduled for implementation in 2014-15scheduled for implementation in 2014-15
Scale Score DistributionScale Score Distribution
Drops in proficiency may be Drops in proficiency may be attributed to how many students fall attributed to how many students fall in the “just made it” category. in the “just made it” category.
Those students who were proficient Those students who were proficient in previous years are now in previous years are now designated partially proficient.designated partially proficient.
State=62
State=36
3rd Grade MEAP 2005-06 - 2011-12 Old & New Cut Scores
95 95 94 94 9490
94 94 95 95 96 97 98 96
78 76 75 75 7771 71
53 5448
5652 53
46
0
10
20
30
40
50
60
70
80
90
100
05-06 06-07 07-08 08-09 09-10 10-11 11-12 05-06 06-07 07-08 08-09 09-10 10-11 11-12
Reading Math
Subject and Year
Per
cen
t P
rofi
cien
t
Farmington 3rd Old Farmington 3rd New
State=68
State=40
State=45
4th Grade MEAP 2005-06 - 2011-12 Old & New Cut Scores
93 93 92 92 89 90 92 91 93 93 93 95 95 94
71
59 59 58
79 77 75 75 76 75 77
5450 50
58 57 58
50
6155
0
10
20
30
40
50
60
70
80
90
100
05-06
06-07
07-08
08-09
09-10
10-11
11-12
05-06
06-07
07-08
08-09
09-10
10-11
11-12
05-06
06-07
07-08
08-09
09-10
10-11
11-12
Reading Math Writing
Subject and Year
Per
cen
t P
rofi
cien
t
Farmington 4th Old Farmington 4th New
The writing test changed, cut scores did not.
33rdrd Grade Math Old to New Cut Grade Math Old to New Cut ScoresScores
44thth Grade Math Old to New Cut Grade Math Old to New Cut ScoresScores
33rdrd Grade Reading Old to New Cut Scores Grade Reading Old to New Cut Scores
44thth Grade Reading Old to New Cut Scores Grade Reading Old to New Cut Scores
44thth Grade Writing – New Test Was Grade Writing – New Test Was Based on New Cut ScoresBased on New Cut Scores
55thth Grade Science Grade Science Old to New Cut Old to New Cut ScoresScores
Michigan AYP Targets for 2011-12 – Michigan AYP Targets for 2011-12 – Percent Proficient (Including Percent Proficient (Including
Subgroups)Subgroups)
GradeGrade ReadingReading MathematicsMathematics
3rd3rd 86%86% 83%83%
4th4th 85%85% 82%82%
5th5th 84%84% 81%81%
6th6th 83%83% 80%80%
7th7th 82%82% 78%78%
8th8th 82%82% 77%77%
11th11th 86%86% 78%78%
Projected Targets for Adequate Projected Targets for Adequate Yearly Progress (AYP)Yearly Progress (AYP)
Are the Annual Measurable Outcomes Are the Annual Measurable Outcomes ambitious ambitious enough?enough?
New cut scores - standard for New cut scores - standard for proficiency is much higher.proficiency is much higher.
Almost no school in Michigan is above Almost no school in Michigan is above 85% on the new cut scores.85% on the new cut scores.
((“Maybe not even one school“Maybe not even one school..” ” )) 85% is an interim goal; 100% is still the 85% is an interim goal; 100% is still the
ultimate goal.ultimate goal.Dr. Venessa Keesler, Office of Psychometrics, Dr. Venessa Keesler, Office of Psychometrics,
Accountability, Research and EvaluationAccountability, Research and Evaluation
What is the Future of Statewide Testing What is the Future of Statewide Testing in Michigan?in Michigan?
Michigan adopted the Common Core State Michigan adopted the Common Core State Standards in June 2010Standards in June 2010
These standards are shared with 43 statesThese standards are shared with 43 states The new end of year assessment will The new end of year assessment will
replace the MEAP/MME in the Spring of replace the MEAP/MME in the Spring of 20152015
There will be more changes both in the There will be more changes both in the administration (on-line) and reporting administration (on-line) and reporting (comparison (comparison acrossacross states) in the future states) in the future
Efforts to Meet New StandardsEfforts to Meet New Standards
Use of National Assessments Use of National Assessments aligned to standards for aligned to standards for monitoring progress and growthmonitoring progress and growth
Use Iowa Assessments along with Use Iowa Assessments along with ACT Explore and Plan as ACT Explore and Plan as predictors for College Readiness predictors for College Readiness to adjust instructionto adjust instruction
Efforts to Meet New Standards Efforts to Meet New Standards (continued)(continued)
Identification of students and Identification of students and areas for needed supportareas for needed support
Use of interventions for identified Use of interventions for identified studentsstudents
Professional development for staff Professional development for staff focusing on strategies identified in focusing on strategies identified in the school improvement processthe school improvement process
School Goals Summary on the Wiki School Goals Summary on the Wiki https://gillschool.wiki.farmington.k12.mi.us/https://gillschool.wiki.farmington.k12.mi.us/
Top Related