Science MCA-III Updates
21
Science MCA-III Updates Minnesota Department of Education Science Assessment Specialist Jim Wood Dawn Cameron [email protected] [email protected] 651.582.8541 651.582.8551
description
Science MCA-III Updates. Minnesota Department of Education Science Assessment Specialist Jim WoodDawn Cameron [email protected] [email protected] 651.582.8541651.582.8551. MCA Update. Scorable Item Samplers in 2012-13 Test D esign and Simulations Text to Speech - PowerPoint PPT Presentation
Transcript of Science MCA-III Updates
Science MCA-IIIUpdates
Minnesota Department of EducationScience Assessment Specialist
Jim Wood Dawn [email protected] [email protected] 651.582.8551
education.state.mn.us 2
MCA Update• Scorable Item Samplers in 2012-13• Test Design and Simulations• Text to Speech• Reporting: Data and Resources
education.state.mn.us 3
Item Samplers – Teacher Guides
education.state.mn.us 4
Item Samplers – Score reportshttp://www.mnstateassessments.org/itemsamplers.html
Score Report Teacher Guide
education.state.mn.us 5
Test Design and Navigation
education.state.mn.us 6
Science • Grades 5, 8 and high school MCA-III Statewide
scores went up from 2012 • Increase in performance was realized as
standards were more consistently implemented across the state.
2013 MCA Assessment Results Summary
education.state.mn.us 7
2013 State Proficiency Level
education.state.mn.us 8
education.state.mn.us 9
education.state.mn.us 10
education.state.mn.us 11
Comparison of 2012 and 2013St. Paul
Grade 5 Grade 5 State Grade 8 Grade 8 State High School HS State0
10
20
30
40
50
60
2012Series22013
education.state.mn.us 12
Information found in MDE Data Center
education.state.mn.us 13
• Interpreting Science MCA-III Test Scores– Overall scale scores (G01-99)– Scale scores match with the ALD’s
• Strand, Sub-Strand levels– Reported using a different scale score system (1-9)– Standard Deviation– Standard Error of the Mean= SD/√n
Putting it all together
education.state.mn.us 14
Benchmark Analysis
6.1.3.1.1
education.state.mn.us 15
• All data is relative to the state data
• Watch the dotted lines – different colors may overlap in their standard deviation
• Keep an eye on the CLES metric when comparing schools
CAUTION!!!P-values and standard deviation
Food for Thought
• Save time for evaluation of data, individually and as a team
• What inferences can and cannot be made from results?
• Formative vs. Summative strengths– What are you going to do with this data
education.state.mn.us 17
Test Development Process Test
SpecsStoryboard Writing
Item Revie
w
Field Test
Items
Data Revie
w
Operational Item
Pool
Operational Test
Bias Revie
w
Achievement Levels
Storyboard Review
Bias Revie
w
Item Writin
g
education.state.mn.us 18
Get involved!Assessment Advisory Panels—ongoing
Register to be invited to panels at http://education.state.mn.us
Educator ExcellenceTesting Resources
Register for Advisory panels
education.state.mn.us 19
education.state.mn.us 20
• Broken down bySub-strand
HS Benchmark Graphs 2013
education.state.mn.us 21
Grade 5 Grade 80.45 – 16% 0.45 – 14%0.50 – 50% 0.50 – 50%0.55 – 90% 0.55 – 91%
High School0.45 – 15%0.50 – 50%0.55 – 95%
Interpretation of CLES
