Post on 28-Dec-2015
Statewide Assessment Transition Update
Vince Dean, Ph.D.Director, Office of Standards & Assessment
DAS Advisory Committee 11-7-13
1
Career and College Ready
2
Career- and College-Ready (CCR) means that a high school graduate has the core foundational knowledge and skills necessary to succeed in workforce training, certification programs, and entry-level, credit-bearing academic college courses that provide preparation for careers leading to a self-sustaining wage, pathways to advancement, and competitiveness in the global economy
3
• Use technology and tools strategically in learning and communicating
• Use argument and reasoning to do research, construct arguments, and critique the reasoning of others
• Communicate and collaborate effectively with a variety of audiences
• Solve problems, construct explanations and design solutions
Career and College Ready
4
What the Suite of Summative and Interim Assessments will Look Like
Subject
Grade
K 1 2 3 4 5 6 7 8 9 10 11 12
Mathematics i i i s s s s s s S S S c
Reading i i i s s s s s s S S S c
Writing i i i s s s s s s S S S c
Science * * * i mi i i mi c c c Mc c
Social Studies * * * i i mi i i mi c c Mc c
Other (e.g., Art, Music, P.E.) * * * * * * * * * * * * *i Interim assessments
c Interim course content assessments based on Michigan Merit Curriculum
m MEAP end of year assessment
M MME end of year assessment
s Smarter Balanced (based on grade level common core). Includes interim grade level, and summative assessments.
S Smarter Balanced (based on high school common core). Includes interim course content, and summative assessments.
* Model interim/course content assessments
Legislative Action on Common Core & Smarter Balanced Suspension
• October 1 MDE budget prohibition against any implementation of Common Core or Smarter Balanced
• ‘Affirmative Action’ – Defined by Michigan House of Representatives as a
resolution– Voted on 9/26/13; 85-21 in support of CCSS and Smarter
Balanced through HCR 11 if certain conditions met• Guarantee local control; data security; report on
assessment options
5
Legislative Action on Common Core & Smarter Balanced Suspension
• Senate took action on October 24th – Held hearing with limited testimony and public
comment on October 2nd –May develop a new resolution, modify the House
resolution, or resolve through a revision to the MDE budget
–Modified House resolution• Preference for CAT• Administered twice per year• Real-time results
6
Legislative Action on Common Core & Smarter Balanced Suspension
• Example Repercussions– Implementation purgatory; CCSS were still our state standards– Michigan in violation of our NCLB flexibility waiver– Approximately 97% of schools and districts fail AYP– Revert to original method of calculating Bottom 5 percent, causing
turmoil with schools coming on and going off the list – Participation in Smarter Balanced and DLM field testing during this
school year– K-2 Pilot Test
7
Assessment Transition Planning
• Leaving Consortia • Collective state capacity• Item types• Scoring and reporting• Computer Adaptive Testing• Individual student growth data • PD materials• Fall 14/Moving to spring
8
Assessment Transition PlanningSummative and Interim
Different purposes Multiple measures to support reform efforts
and accountabilityFall to Spring
All summative will eventually be spring Thinking about a year’s growth
Spring 2015: Goal for as many operational components as possible
9
Assessment Transition Planning Pilot/Field testing opportunities are the key in every
scenario Every fall and spring there will be opportunities for
schools to participate in an online pilot or field test event
Enough students must participate in order to: Calibrate items Compare mode effects Test systems Support the move to spring Field viable assessments if no consortia opportunities
10
Interim Assessment Pilot Testing
Smarter Balanced Field Testing• Currently at approximately 92% of what we need in terms of
Michigan students participating to provide a demographically representative sample
• Voluntary sign-up through November 8th
• Low numbers for grades 8 and 11; everything else looking very good
• Targeted recruitment coming next• First 2/3 of window; fixed-form to calibrate items• Last 1/3 of window; shakedown cruise of CAT algorithm and
scoring solutions– Same approximate test length, item type and DOK distribution
12
Interim Assessment PilotingWhere are we now:•Currently pilot testing Science & Social Studies around the state. Window opened 10/28 will close Dec 6; piloting 2,800 items•Beginning recruitment for Spring Pilot of K2, due to legislative delay
– While the delay hurts our overall timeline by half a year, it may help with participation as schools will not be competing with MEAP
– Approximately 500 TE items– K: 135 schools, 17k students– 1: 153 schools, 19k students– 2: 172 schools, 21k students
•Begin item writing and development of approximately 850-1,000 high school mathematics items. •Mathematics design challenge
13
Interim Assessment PilotingWhat’s next:•Spring 2014 K2 Pilot: Looking at a 6-week window– Suggestions for best window between February and May?
•Schedule work sessions to think about high school ELA interim content and design– Suggestions for a 12th grade ELA interim assessment?
•Fall 14 large-scale field-test of Science and Social Studies interim system– This will model the operational test design as closely as possible. The goal
would be to move to an operational status for Spring 15– Waiver status issue
14
MI-Access FI Social Studies• New EGLCEs and EHSCEs posted to MI-Access webpage• Assessment will consist of two kinds of items:
– stand-alone and passage-based;• Currently recruiting for a spring (April/May) pilot test for
students in grades 5, 8, and 11• Pilot will include chance for teachers and students to provide
feedback on the online assessment experience and assessment features (such as different types of audio presentations)
• Operational in Spring 2015• Interested in pilot? email John Jaquith at
JaquithJ@michigan.gov
15
Dynamic Learning Maps• One ISD center based program participating in the fall Pilot• Michigan districts have been encouraged to participate in three
different field test opportunities in the winter and spring (Deadline for districts to sign up is 11/18: go to https://kansasedu.qualtrics.com/SE/?SID=SV_1BVeB6p9r9zXYYR)– make sure Michigan students and teachers are well represented;– students/teachers will become more familiar with DLM and
computer-based testing;– opportunity to give feedback after each field test;– allows DLM’s system to be improve movement through learning
map (which set of items/testlets to administer to student);
16
WIDA Assessments• 3 available assessments:
– W-APT: replaces ELPA Initial Screening– ACCESS for ELLs: replaces Spring ELPA (test window Feb. 10 – Mar. 28)– Alternate ACCESS for ELLs: for ELs who are also SWDs (test window Feb. 10 – Mar. 28)
• PD for the ACCESS starting in December• 3 districts field testing online Reading items in spring• Biggest transition challenges:
– Communication with districts who don’t have ISD/RESA support or large EL populations– Greater amount of time to screen students than with ELPA– Difficulty in achieving inter-rater reliability on scoring W-APT Speaking and Writing items
• QuestionsHow can we better assist schools with low to medium sized populations in this
transition year? How can we, on a large-scale, better prepare test administrators to score Speaking
and Writing items using the WIDA rubrics?
17
Kindergarten Entry Assessment The KEA pilot began September 3, 2013 ended on November 1,
2013. Jeff Beal - currently assisting teachers in making sure that they
finalize all of their checkpoints and entered information for every student.
Administrators and teachers are now able to create reports through TS GOLD.
TS GOLD is sending a survey to all participants this week. 76 districts throughout Michigan 88 schools 173 teachers 4107 students
18
Contact Information Smarter Balanced – Vince Dean; deanv@michigan.gov DLM & MI-Access Social Studies– Linda Howley;
howleyl@michigan.gov & John Jaquith; jaquithj@michigan.gov
Interim Assessments – Andy Middlestead; middlesteada@michigan.gov
WIDA – Jen Paul; paulj@michigan.gov KEA – Jeff Beal; bealj1@michigan.gov Online Assessment Readiness – Matt Ayotte;
ayottem@michigan.gov
19