Building a Learning Progression Rubric

Denver Public SchoolsAssessment, Research and Evaluation, 2015

Objectives Review the SLO process and timeline for

2014-15 Understand the purpose of the learning

progression rubric in the SLO process Understand the recommended rubric

structure Understand the generic learning

progression frameworks that should be utilized to build/modify an SLO rubric

On

go

ing

Da

ta D

rive

n In

stru

ction

Step 1: Create an Objective Statement

Step 2: Determine Performance Criteria & Rubric

Step 3: Collect Baseline Data & categorize Preparedness Levels

Step 4: Plan and collect Body of Evidence

Step 5: Evaluate and reflect on Student Growth

Review: The SLO Process

SLO Timeline 2014-15

Present SLO

overview to

teachers

Ensure access to

SLO Application

Approve Phase 1

Approve Phase 2

Submit ratings

Ongoing Data Team Guidance and Support

*Gain familiarity with the SLO process

*Create 2 Objective Statements

*Determine Performance Criteria and Rubric*Collect Baseline Data*Submit Phase 1 using SLO application

*Analyze Baseline Dataand categorize students’ Baseline Preparedness Levels

*Plan and Collect Body of Evidence, monitor progress, and adjust instruction accordingly

*Collect Body of Evidence, monitor progress, and adjust instruction accordingly*Submit Phase 2 using SLO application

*Collect Body of Evidence, monitor progress, and adjust instruction accordingly

*Collect Body of Evidence, monitor progress, and adjust instruction accordingly

*Collect Body of Evidence, monitor progress, and adjust instruction accordingly

*Evaluate and reflect on student growth*Submit Phase 3 using SLO Application

Phase 1 Phase 2 Phase 3

Review: the First Steps

1. Select what is most important for students to know by the end of the year. (Objective Statement)

2. Determine what it “looks like” when students reach the Objective. (Performance Criteria)

3. Specify the proficiency levels through which students progress on the path towards mastery of the Objective. (Rubric)

The Learning Progression Rubric “rubric” – same word, different meanings

Rubric as a Scoring and Learning Tool

Rubric as a Learning Progression*

• Specific to the task with which they are used (Brookhart, 2013)

• Contain answers to a problem, explain the reasoning students are supposed to use, or list facts and concepts students are supposed to mention (Brookhart, 2013)

• Describe a student’s level of command or proficiency along the path of developing deeper understanding of the content and the gradual building of fluency in skills and academic language

• Use criteria and descriptions of student performance that generalize across time and can be used with different tasks (Brookhart, 2013)

• Describe successively more sophisticated ways of thinking about an idea (Wilson & Bertenthal, 2005)

*This is the type of rubric used for the DPS SLO process.

Rubric Structure Columns (Proficiency Levels):

Each column identifies milestones students typically reach as they develop mastery of the skills and/or concepts embodied in each Performance Criterion.

The proficiency levels describe the developmental levels through which students progress on the path toward mastery.

The following four proficiency levels should be used: Limited/Partial Command Moderate Command Strong Command

Represents the level of the standards – that is, proficiency in the grade-level standards of the Objective Statement

For SLOs, this column should use the exact wording of the Performance Criteria with each criterion appearing in a single box

Distinguished Command

Rubric Structure, cont. Rows:

The number of rows directly corresponds to the number of Performance Criteria.

Example:Limited/Partial

Command

Moderate Command

Strong Command

Distinguished Command

Performance Criterion 1

Performance Criterion 2

Performance Criterion 3 . . .

Suggested Resources for Rubric Building

Including, but not limited to: Performance Level Descriptors from PARCCStandards-based rubrics WIDA Can Do DescriptorsTS Gold (ECE and Kindergarten)Curricular resourcesStudent work

General Guidelines Phrase descriptors in the positive on the basis of

what students are able to do. Provide qualitative descriptions of what students

at each level are able to do rather than to distinguish proficiency levels on the basis of quantities or percentages.

Avoid vague evaluative terms (e.g., good, fair, poor, etc.) in which there is no consistent understanding of meaning.

Let the “Distinguished Command” column be open for further interpretation as students may surprise us by demonstrating new ways to apply their knowledge.

Guiding Questions What might we typically see from a student as

they first begin to learn the content, skills, and/or academic language in the criterion? What do you teach first? And how?

What milestones do students’ reach on their way towards proficiency and eventually mastery? How do you tailor your instruction during the

course to deepen understanding of the content and the gradual building of fluency in skills and academic language?

Generic Learning Progression Frameworks There are four generic options for delineating a

typical continuum, or learning progression, from Limited/Partial Command to Distinguished Command. options should be combined and modified as needed, and

the descriptors of each command need to be written with subject- and grade-specific language and content

The following frameworks are: Development of conceptual understanding Development of procedural skills Type or amount of support and scaffolding that a student

needs in order to be successful The extent to which the student can monitor his/her own

learning (metacognition)

Framework 1: Conceptual UnderstandingLimited/Partial

Command

Moderate Command

Strong Command

(Performance Criteria)

Distinguished Command

Students demonstrate knowledge of a concept through either recognition or recall.

Students demonstrate knowledge of several related concepts through recognition or recall, yet make limited connections among them.

Students apply knowledge of several related concepts to solve problems; students make strong connections among concepts.

Students apply knowledge to other areas (e.g., to other subjects; in new and unfamiliar contexts). Students demonstrate a nuanced understanding of the concepts (e.g., the limits within which they can be applied to other domains).

Framework 2: Procedural Skill Limited/Partial

Command

Moderate Command

Strong Command

(Performance Criteria)

Distinguished Command

Students use skills following a step-by-step, or effortful process with minimal fluidity. Students demonstrate errors when following the steps and a pattern of errors may be evident.

Students demonstrate fluidity with the skills and apply them to solve problems in familiar contexts.

Students demonstrate fluidity with the skills and apply them to solve problems in new contexts. Students’ fluidity allows them to demonstrate higher-order thinking while using the skills.

Students apply the skills, often in combination with other skills, in novel ways. Students apply the skills to solve new, complex problems.

Framework 3: Support and ScaffoldingLimited/Partial

Command

Moderate Command

Strong Command

(Performance Criteria)

Distinguished Command

Students are dependent upon support from a teacher, coach, or more advanced peer and/or students are dependent upon scaffolded work/assessments* to demonstrate success.

Students intermittently utilize support/coaching and/or scaffolding (less than that for Limited/Partial Command) to demonstrate basic success.

Students demonstrate independence in applying concepts or skills. Support or coaching is utilized for success in solving more complex problems.

Students demonstrate independence and reflectiveness in applying concepts and skills. Coaching is used for extending or achieving greater success, yet the coaching is more collaborative between student and teacher.

*Examples of scaffolds may include, but are not limited to: word banks, cloze type paragraphs, use of additional manipulatives/tools, “chunking” activities/assignments into smaller sections, simplified instructions, etc.

Framework 4: MetacognitionLimited/Partial

Command

Moderate Command

Strong Command

(Performance Criteria)

Distinguished Command

Students rely on external feedback to monitor and regulate their learning.

Students monitor their learning with prompting. Students begin to use explicit learning strategies.

Students monitor their learning with minimal or no prompting. Students use learning strategies efficiently and in appropriate contexts.

Students independently monitor and extend their own learning. Students self-regulate their learning, generating and using learning strategies efficiently and in appropriate contexts.

Limited/Partial Command Moderate Command Strong Command (Performance Criteria)

Distinguished Command

Students rely on the use of concrete objects, models, and drawings  to add and subtract within 100.Students begin to show some evidence of using place value strategies to compute sums and differences within 100.

Students can add tens and ones separately and use counting on strategies to count on by tens and ones, or a mixture of such strategies in which they add instead of counting the tens and ones.Students can consistently and accurately subtract within 100 when regrouping is not involved.

Students independently add and subtract within 100, with fluency and accuracy, using strategies based on place value, properties of operations, and/or the relationship between addition and subtraction.

Students independently add and subtract within 100 with fluency and accuracy using strategies based on place value, properties of operations, and  the relationship between addition and subtraction.

Students rely on support and scaffolding  to write and solve number sentences for one-step word problems that require addition and subtraction within 100.

Students independently, consistently, and accurately write and solve number sentences for one-step word problems that require addition and subtraction within 100.Students independently and with some accuracy, write and solve number sentences for two-step word problems that require addition and subtraction within 100.

Students independently and accurately write and solve number sentences for one- and two-step word problems that require addition and subtraction within 100.

Students independently write and solve word problems when given a number sentence involving addition and subtraction within 100.

Students rely on the use of concrete objects, models, and drawings to add and subtract within 1000.Students begin to show some evidence of using place value strategies to compute sums and differences within 1000.

Students can add hundreds, tens and ones separately and use counting on strategies to count on by hundreds, tens and ones, or a mixture of such strategies in which they add instead of counting the hundreds, tens and ones. Students can consistently and accurately subtract within 1000 when regrouping is not involved.

Students independently and accurately add and subtract within 1000 using concrete models or drawings and strategies based on place value, properties of operations, and/or the relationship between addition and subtraction.

Students independently and accurately add and subtract within 1000 using strategies based on place value, properties of operations, and  the relationship between addition and subtraction.

When given the grade-level academic and content language, students correctly identify the addition and subtraction strategies they used and begin to explain the process they followed with those strategies.Responses may be incomplete or illogical.

Using academic and content language with scaffolds and supports, students correctly identify and justify their selection of addition and subtraction strategies by explaining the process they followed with those strategies.Responses may be incomplete, but include a logical progression.

Students correctly identify and justify their selection of addition and subtraction strategies and solutions by explaining why the strategies work, using place value, properties of operations, and/or the relationship between addition and subtraction.Justifications include correct use of grade-level academic and content language and symbols.Responses show a logical progression.

Students critique different strategies using place value, properties of operations, and/or the relationship between addition and subtraction; and justify the efficiency  of those strategies. Student critiques include correct use of grade-level academic and content language and symbols.

2nd grade math example

2nd grade math example, closer lookLimited Command Moderate Command Strong Command

(Performance Criteria)Distinguished

Command

Students rely on the use of concrete objects, models, and drawings to add and subtract within 1000.Students begin to show some evidence of using place value strategies to compute sums and differences within 1000.

Students can add hundreds, tens and ones separately and use counting on strategies to count on by hundreds, tens and ones, or a mixture of such strategies in which they add instead of counting the hundreds, tens and ones. Students can consistently and accurately subtract within 1000 when regrouping is not involved.

Students independently and accurately add and subtract within 1000 using concrete models or drawings and strategies based on place value, properties of operations, and/or the relationship between addition and subtraction.

Students independently and accurately add and subtract within 1000 using strategies based on place value, properties of operations, and  the relationship between addition and subtraction.

When given the grade-level academic and content language, students correctly identify the addition and subtraction strategies they used and begin to explain the process they followed with those strategies.Responses may be incomplete or illogical.

Using academic and content language with scaffolds and supports, students correctly identify and justify their selection of addition and subtraction strategies by explaining the process they followed with those strategies.Responses may be incomplete, but include a logical progression.

Students correctly identify and justify their selection of addition and subtraction strategies and solutions by explaining why the strategies work, using place value, properties of operations, and/or the relationship between addition and subtraction.Justifications include correct use of grade-level academic and content language and symbols.Responses show a logical progression.

Students critique different strategies using place value, properties of operations, and/or the relationship between addition and subtraction; and justify the efficiency of those strategies. Student critiques include correct use of grade-level academic and content language and symbols.

Using Your Learning Progression Rubric

What does this student work tell you about where your student is on

the learning progression?

After examining student work that aligns with your SLO and will be included in your Body of Evidence:check student performance as demonstrated by the student work against the learning progression rubric;record appropriate data on your SLO data tracker;ensure assessment and appropriate information is recorded in your SLO Planning pages; andrecord agreed upon changes in instruction in your SLO Planning pages.

Available Resources

http://testing.dpsk12.org/resources/SLO.html

For SLO questions or concerns, please email the ARE SLO team at:

slohelp@dpsk12.org