Utah Science Standard Setting
Transcript of Utah Science Standard Setting
Utah Science Standard Setting
RISE
GRADES
4 AND 5
UTAH ASPIRE PLUS GRADES 9
AND 10
VERTICAL ARTICULATION
RISE Standard Setting- July 2021
• Board Rule R277-404 & Code 53E-4-303• Computer Adaptative Assessment• Cluster Based• 6th-8th SEEd Standards Assessed since
Spring 2018• Ordered Scoring Assertion Standard
Setting
RISE Standard Setting- Scale Scores
GradeLevel 2
Approaching Proficient
Level 3Proficient
Level 4Highly Proficient
4 543 553 562
5 543 552 563
RISE Standard Setting- Spring 2021
GradeLevel 1Below
Proficient
Level 2Approaching
Proficient
Level 3Proficient
Level 4Highly
Proficient
4 29% 28% 23% 20%5 29% 26% 27% 18%
RISE Standard Setting- Spring 2021
Level 1 Level 2 Level 3 Level 40%
5%
10%
15%
20%
25%
30%
35%
29%28%
23%
20%
29%
26%27%
18%
Grade 4 Grade 5
Utah Aspire Plus Standard Setting- August 2021
• Board Rule R277-404 & Code 53E-4-304• Fixed Form• Cluster Based• Timed• Predictive ACT Score• Extended Modified (Yes/No) Angoff Standard
Setting
Utah Aspire Plus Standard Setting- Scale Scores
Subject Grade
Proficiency LevelBelow Proficient Approaching
Proficient Proficient Highly Proficient
Science9 100-186 187-210 211-236 237-300
10 100-186 187-209 210-239 240-300
STEM9 100-179 180-208 209-234 235-300
10 100-183 184-209 210-237 238-300
UA+ Standard Setting- Predicted ACT
Grade Proficient Scale Score Cut
Predicted ACT Score Lower Bound
Predicted ACT Score Upper Bound
ACT College and Career Benchmark
9 211 19 23 23
10 210 18 23 23
UA+ Standard Setting- Spring 2021
Subject Grade
Performance Levels
Below Proficient Approaching Proficient Proficient Highly Proficient
Science9 30.7% 33.3% 27.1% 8.9%
10 31.2% 31.7% 30.1% 7.0%
STEM9 25.5% 39.0% 28.4% 7.1%
10 30.4% 36.2% 27.6% 5.9%
UA+ Standard Setting- Spring 2021
Level 1 Level 2 Level 3 Level 40.00%
5.00%
10.00%
15.00%
20.00%
25.00%
30.00%
35.00%
30.70%
33.30%
27.10%
8.90%
31.20% 31.70%30.10%
7.00%
Grade 9 Grade 10
Utah Science Vertical Articulation
• The purpose• Ensure the vertical coherence of performance level
classification across grade spans
• The task• Conduct a holistic review of the cut scores that had been
recommended by standard setting panelists, and make final recommendations to USBE
• Proficiency level cut scores were recommended by panelists in three different standard setting workshops:• August 2021: High School (grades 9-10)• July 2021: Elementary (grades 4-5)• September 2018: Middle school (grades 6-8)
Utah Science Vertical Articulation- Scale Scores
Cut Scores
GradeLevel 2 Level 3 Level 4
Approaching Proficient Proficient Highly Proficient
4 543 553 562
5 543 552 563
6 841 849 862
7 841 851 861
8 842 851 861
9 187 211 237
10 187 210 240
Utah Science Vertical Articulation- Spring 2021
4 5 6 7 8 9 100%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
29% 29% 27% 29% 26%31% 31%
28% 25%20%
27%26%
33% 32%
23% 27%34%
26%29%
27% 30%
20% 18% 18% 18% 20%9% 7%
Utah Science Assessment 2021 by Proficiency Levels
Level 1 Level 2 Level 3 Level 4