Update on the PARCC and Smarter Balanced PARCC and Smarter Balanced

Assessment Consortia

August 16, 2013

RTTT Assessment Program Requirements

Groups of 15 or more states could apply for a grant to develop online next generation assessment systems that:online, next-generation assessment systems that:• Assess shared standards in mathematics and ELA/literacy for

college- and career-readiness

• Measure individual growth as well as proficiency;

• Utilize technology to the maximum extent appropriate; and

• d i f i h i f l f• Provide information that is useful in informing: Teaching, learning, and program improvement;

Determinations of school effectiveness and of principal and teacher p peffectiveness for use in evaluations and support; and

Determinations of individual student college and career readiness, such as determinations made for high school exit decisions, college suc as dete at o s ade o g sc oo e t dec s o s, co egecourse placement to credit-bearing classes, or college entrance.

Operational by 2014 – 2015 school year (US Department of Education, 2010)2

Assessment Consortia MembershipsThe Two State-Led

Comprehensive Assessment ConsortiaMembershipsComprehensive Assessment Consortia

PARCC20 states & DC

Smarter Balanced• 26 states

Both:Pennsylvania20 states & DC 26 states y

Washington, DC

Hawaii

Neither: Alabama, Minnesota, Nebraska, Texas, Utah, Virginia

The Partnership for the pAssessment of Readiness forReadiness for

College and Careers (PARCC)

4

PARCC

Last quarter of school year

English Language Arts/Literacy and Mathematics, Grades 3 – 11

PARTNERSHIP RESOURCE CENTER: Digital library of released items; formative assessments; model content frameworks; instructional and formative tools and resources; student and educator tutorials and practice tests; scoring training modules; professional development materials; and an interactive report generation system

Returns information about

DIAGNOSTIC ASSESSMENT

PERFORMANCE-BASED

END-OF-YEARASSESSMENTMid-Year Performance-

MID-YEARASSESSMENT

scoring training modules; professional development materials; and an interactive report generation system.

Retake OptionFlexible timing

student strengths and weaknesses to inform

instruction, supports, & professional development

BASEDASSESSMENT

• ELA/literacy tasks• Math tasks

ASSESSMENT • ELA/literacy• Math

Flexible timing

Mid-Year Performance-Based Assessment

(Potentially summative)ELA/Literacy• Speaking• Listening

Flexible timingFlexible timing Flexible timing Flexible timing

OptionalAssessmentsto inform

Summative assessment f t bilit

Required but not summative, not used for

Developed by The Center for K–12 Assessment & Performance Management at ETS, version 5, March 22, 2012. For detailed information on PARCC, go to http://PARCConline.org.

* After study, individual states may consider including this as a summative component.

to informinstruction

for accountabilitynot used for accountability

PARCC Summative Assessments: Performance Based AssessmentsPerformance-Based Assessments

• Taken after roughly 75% of instructional year

Final 12 weeks of school year

Taken after roughly 75% of instructional year

• 3 ELA/literacy tasks over 3 sessions• 1 narrative task  PERFORMANCE

BASED

• 1 literary analysis task • 1 research simulation task

M th t k 2 i

BASED ASSESSMENT

• ELA/literacy• Math

• Math tasks over 2 sessions• complex, real‐world application problems• emphasis on mathematical practices and modeling

• Electronic and distributed human scoring

• Results by end of school year 6

PARCC Summative Assessments: End of Year AssessmentEnd-of-Year Assessment

• Taken after roughly 90% of instructional year

• Multiple item types including constructedEND‐OF‐YEARASSESSMENT

p yp gresponse and technology enhanced

• Fixed‐form, with multiple forms per grade level

• Will include items across a range of cognitive demand

• Electronically scored• Electronically scored

7

PARCC:

Summative Components

Last 12 weeks of year

Summative Components

• Timed spread over nine testing sessions

Last 12 weeks of year

Timed, spread over nine testing sessions

• Estimated testing time, ELA + math: 8 hours in grade 39 hours in grades 4 ‐ 59.5 hours in grades 6 – 8 9.5 ‐ 10 hours in high school

PERFORMANCEBased Assessment

• ELA/literacy• Math

END OF YEARASSESSMENT

Re‐take option• PT and EOY scores combined for accountability• 1 Retake in 3 – 8 and up to 3 in HS, as State/locally approved

8

• Paper and pencil version as accommodation and for at least the first year at additional cost

PARCC: Speaking/Listening AssessmentSpeaking/Listening Assessment

ELA/Literacy• Speaking• Listening

• Required in grades 3 ‐ 11, but not used for accountability;

Flexible timing

Required in grades 3  11, but not used for accountability; also available in grades K‐2

• Scored by classroom teacher using standardized rubricScored by classroom teacher using standardized rubric

• Scores may be used within students’ grades 9

PARCC Supports: Interim AssessmentsInterim Assessments

MID‐YEAR ASSESSMENT DIAGNOSTIC ASSESSMENT

Flexible Timing

• Optional Diagnostic Assessment, grades 2 – 8p g , g• Two‐stage adaptive assessment designed to inform instruction 

• Optional Mid‐Year Performance Tasks, grades 3 – 11Optional Mid Year Performance Tasks, grades 3  11• Designed to mirror summative Performance Tasks

10

PARCC Supports: The Partnership Resource CenterThe Partnership Resource Center

PARTNERSHIP RESOURCE CENTER: Digital library of released items, formative assessments, model content frameworks instructional and formative tools and resources; student and educator tutorials and practiceframeworks, instructional and formative tools and resources; student and educator tutorials and practice tests, scoring training modules; professional development materials; and an interactive report generation system

• Reporting suite with customizable reports for user groups• Reporting suite with customizable reports for user groups• Online practice tests• Formative assessment items and tasks• Professional development materials – scoring, use of data• Instructional tools and resources developed by Partner statesO i l “ d ” i i ll b dd d f i• Optional “ready‐to‐use,” instructionally embedded formative     tasks  and tools for K‐1

11

PARCC Assessment SystemPARCC Assessment System

Last quarter of school year

English Language Arts/Literacy and Mathematics, Grades 3 – 8 and High School

PARTNERSHIP RESOURCE CENTER: Digital library of released items; formative assessments; model content frameworks; instructional and formative tools and resources; student and educator tutorials and practice tests; scoring training modules; professional development materials; and an interactive report generation system

Returns information about

DIAGNOSTIC ASSESSMENT

PERFORMANCE-BASED

END-OF-YEARASSESSMENTMid-Year Performance-

MID-YEARASSESSMENT

scoring training modules; professional development materials; and an interactive report generation system.

Retake OptionFlexible timing

student strengths and weaknesses to inform

instruction, supports, & professional development

BASEDASSESSMENT

• ELA/literacy tasks• Math tasks

ASSESSMENT • ELA/literacy• Math

Flexible timing

Mid-Year Performance-Based Assessment

(Potentially summative)ELA/Literacy• Speaking• Listening

Flexible timingFlexible timing Flexible timing Flexible timing

Projected cost as of spring 2013: $29.50 per student annually, for both ELA and math summative assessments, 

Developed by The Center for K–12 Assessment & Performance Management at ETS, version 5, March 22, 2012. For detailed information on PARCC, go to http://PARCConline.org.

delivered and scored.

PARCC: Supports and TimelineSupports and TimelinePlans as of spring 2013, subject to change

2012 - 20132012 - 2013• K-16 Educator Leader Cadres launched (24 per state) and

provided on-going training• Prototype items & tasks released (www.parcconline.org)Summer 2013• More prototype items & tasks released• 2 sets of online Professional Learning Modules releasedFall 2013Fall 2013• Assessment PD modules releasedSpring 2014• Practice tests availablePractice tests available• College readiness tools released 2014 – 2015 school year• Mid-Year and Summative assessments ready2015 – 2016 school year• K-1 formative tasks ready• Diagnostic and Speaking/Listening assessments ready 13

Th S t B l d The Smarter Balanced Assessment Consortium

14

Smarter BalancedSmarter Balanced

Last 12 weeks of school year

English Language Arts/Literacy and Mathematics, Grades 3 – 8 and High School*

DIGITAL LIBRARY of formative tools, processes and exemplars; released items and tasks; model curriculum units; educator training; professional development tools and resources; practice tests;

t i i d l d t h ll b ti t l

Computer Adaptive

INTERIM ASSESSMENT

Computer Adaptive

INTERIM ASSESSMENT

scorer training modules; and teacher collaboration tools.

Scope, sequence, number, and timing locally determined

Assessment and Performance Tasks

Assessment and Performance Tasks PERFORMANCE

TASKS• 1 ELA/Literacy

Task• 1 Math Task

COMPUTER ADAPTIVE

ASSESSMENT• ELA/Literacy • Math

Optional Interim assessment Summative assessment

locally determinedRetake Option

* Summative and interim assessments for grades 3 – 8 and 11, with additional supporting assessments for grades 9 and 10.** Time windows may be adjusted based on results from the research agenda and final implementation decisions.

system — no stakes for accountability

15

Smarter Balanced Summative Assessment

Performance TasksPerformance Tasks

Last 12 weeks of year*

• Taken after roughly 75% of instructional year

• One ELA task and 1 math task per year,  p y ,90 – 120 minutes per content area

• Focus on hard‐to‐measure standards

PERFORMANCETASKS

• Reading• Writing• Math

• Combination of machine and teacher/human scoring

R lt b d f h l• Results by end of school year

16

Smarter Balanced Summative AssessmentComputer Adaptive End-of-Year Assessment

Last 12 weeks of year*

Computer Adaptive End-of-Year Assessment

• Taken after roughly 90% of instructional year

• Multiple item types including constructed• Multiple item types including constructedresponse and technology enhanced

• Adaptive delivery can span up to two

COMPUTERADAPTIVE

ASSESSMENT

Adaptive delivery can span up to two grade levels up or down to gain accuracy and clearer profile of strengths and needs

Re‐take option

17

Smarter Balanced

Summative Components

Last 12 weeks of year

Summative Components

• Untimed over multiple testing sessions

Last 12 weeks of year

Untimed, over multiple testing sessions

• Estimated testing time, ELA + math: 7 hours in grades 3 – 5 PERFORMANCE

TASKS• Reading

COMPUTERADAPTIVE

7.5 hours in grades 6 – 8 8.5  hours in grade 11

• Reading• Writing• Math

Re‐take option

ASSESSMENT

• PT and EOY scores combined for accountability

• 1 Retake, if locally approved, for testing irregularities

18

• Paper and pencil version for 3 years; thereafter as   accommodation 

Smarter Balanced Supports: Optional Interim Assessment SystemOptional Interim Assessment System

INTERIM INTERIM INTERIM

• Computer adaptive, multiple item types from EOY summative

• Customizable: number, scope, timing

• Non‐secure and fully accessible ‐‐ teachers can see items and student responses

• Produces links to student resources and PD resources19

Smarter Balanced Supports:

The Digital Clearinghouse

Last 12 weeks of year*

The Digital Clearinghouse

DIGITAL CLEARINGHOUSE of formative tools, processes and exemplars, released items and tasks, modelDIGITAL CLEARINGHOUSE of formative tools, processes and exemplars, released items and tasks, model curriculum units, educator training; professional development tools and resources, interactive reporting system; scoring training modules, and teacher collaboration tools.

• Reporting suite with differentiated tools for usersReporting suite with differentiated tools for users

• Online Practice Test utility

• Assessment literacy modules

• Formative tools, exemplar instructional modules, vetted and rated units

l d f k d b• Released performance tasks and rubrics

• Issue‐focused chat rooms for teachers26

Smarter Balanced Assessment SystemS a te a a ced ssess e t Syste

Last 12 weeks of school year

English Language Arts/Literacy and Mathematics, Grades 3 – 8 and High School*

DIGITAL LIBRARY of formative tools, processes and exemplars; released items and tasks; model curriculum units; educator training; professional development tools and resources; practice tests;

t i i d l d t h ll b ti t l

Computer Adaptive

INTERIM ASSESSMENT

Computer Adaptive

INTERIM ASSESSMENT

scorer training modules; and teacher collaboration tools.

Scope, sequence, number, and timing locally determined

Assessment and Performance Tasks

Assessment and Performance Tasks PERFORMANCE

TASKS• 1 ELA/Literacy

Task• 1 Math Task

COMPUTER ADAPTIVE

ASSESSMENT• ELA/Literacy • Mathlocally determined

Retake Option

Projected cost as of spring 2013: $22 50 d ll f b h ELA d h i

21

$22.50 per student annually, for both ELA and math summative assessments, delivered and scored.  Additional $4.80 per student annually for use of the interim assessment system and optional resources.

The Smarter Balanced Open Source System Architecture

Test AdministrationTest Registration, Test Delivery, Test 

Scoring

Test CreationItem Authoring, Item Banking,  Test 

Creation

Open Source System Architecture

Data Warehouse 

SharedServices

& Reporting

Future Plug‐and‐Play 

Applications

Submit to Library

Review Against Quality Criteria Digital Library

Applications

Publish to Library

Browse/Search

Download / Stream

Apply in Classroom Rate

TRAINED EDUCATORS IN CONSORITUM

STATES

EDUCATORS IN

CONSORTIUM STATES

Commission Content Development to Q li C i i S ifi i

PUBLISHERS

LEADERS FROM

STATES EDUCATORS IN

CONSORTIUM STATES

Quality Criteria Specifications

Smarter Balanced: Supports and TimelinePlans as of spring 2013, subject to change

2012 2013

Supports and Timeline

2012 - 2013• Prototype items & tasks released (www.smarterbalanced.org• Practice Test utility available to teachers, students, publics y , , p

Summer/fall 2013• Teacher cadres (avg. 90 per state) trained in use of formative tools

and PD modules; ready to lead in state trainings (Summer)and PD modules; ready to lead in-state trainings (Summer)

• First set of Exemplary Instructional Modules released (Fall)

Winter 2014Winter 2014• Second set of Exemplary Instructional Modules released

Fall 2014Fall 2014• Comprehensive Electronic Platform, including Digital Library launched• Interim assessments available 23

www k12center org

CONTACT

www.k12center.org

CONTACT

Pascal (Pat) D. Forgione, Jr., Ph.D.Pascal (Pat) D. Forgione, Jr., Ph.D.Distinguished Presidential Scholar and Executive Director

Center for K-12 Assessment & Performance Management at ETS701 Brazos Street, Suite 500

Austin TX 78701Austin, TX 78701E-Mail: pdforgione@k12center.org

Nancy DooreyDirector of ProgramsDirector of Programs

Wilmington, DEE-Mail: ndoorey@k12center.org