Looking at Student Work “Looking at student work is a way to move out of complacency. Looking at...

Looking at Student Work

“Looking at student work is a way to move out of complacency.

Looking at student work brings you face to face with your values.”

Daniel Baron

Reasons for Looking at Student Work

• Identify strengths and shortcomings of the work.• Diagnose, identify or monitor student needs.• Align curriculum, instruction and assessment with student needs.• Ensure that all students have equal access and opportunity to

succeed.• Guide curriculum development and refinement.• Improve teaching.• Assess the merits of programs.• Assess the extent to which standards are addressed.• Determine how students compare to outside norms.

What are Protocols?

• Clear, agreed-upon guidelines for conversation.• Collaborative in nature.• Focus can be teacher or student work.

The examination of student work can be one of the most powerful ways to improve the quality of teaching.

Learn how to help teachers use student work to inform their practice.

Use your Professional Learning Communities to make it easier for teachers to learn from their students’ work.

Action PlanningQUESTIONS IMPLEMENTATION IDEAS

WHO (Who participates?)

WHAT (What gets done?)

WHEN (When do we meet and for how long?)

WHERE (Where will we meet?)

WHY (What is the purpose of our time together?)

RECORDKEEPING (Should we keep minutes? If yes, then who will keep the notes and what will be recorded?)

TRUST (How do we build a high trust team to do this work?)

Scheduling Time for Looking at Student Work

•1. How are you finding time for PLC/LASW?• Common Planning Time• Faculty Meetings• Study Teams• PD days/time• Other? ____________________________

2. How do you build groups to work as a PLC? • Departments/Grade Level Teams• Mixed Groups• Specialists• Other? ____________________________

Pre-work (Preparing for the Experience)• Determine WHO will participate.• Determine the subject area and the grade level/ department.

(This process can be used with teams at all grade levels for all subjects.)

• Identify the “presenting teacher(s).• Ask him/her/them to bring the student work samples. Bring

the work of 5-8 students. (The amount of data will depend upon the purpose of the session.)

• Bring enough copies of the student work so that each of the participants has a complete packet.

• If there is a rubric that was used to score the work, bring a copy of the rubric for each participant.

• Bring the lesson plan that was used for the lesson if it is available.

Steps in the Process

• Roles are assigned• Questions and discussions• Presenting teacher’s description and

information• Implications for teaching and learning• Reflection on the process

Roles

The facilitator’s role • Keeps the group focused• Knows and follows the process• Asks for clarification and specificity when evaluations are

being made and questions are being raised• Redirects questions during the discussion of implications

to the speaker’s practice

RolesThe participant’s role • Read the work• Recognize and comment

on what the student knows

• Discuss implications for teaching and learning

• Reflect on the conference

The presenting teacher role• Make notes about

questions and comments about the student work

• Listen to the discussion• Make a choice about

responding to questions and comments from participants

Looking Together at Student/Teacher Work

Protocols from the book, Looking Together at Student Work, by Tina Blythe, David Allen and Barbara Schieffelin-Powell

Two Processes for Looking at Student Work Protocols from the book, Looking Together at Student Work, by Tina Blythe, David Allen and Barbara Schieffelin-Powell

Looking Together at Student Work, Tina Blythe, David Allen, Barbara Schiefflin Powell

Purpose Role of Description, Interpretation,

and/or Evaluation

Presentation of the Context for the Student Work

Kinds and Amount of Student Work Typically

Shared

Tuning Protocol

To develop more effective exhibitions, projects and assessment tasks.

To develop common standards for student’s work.

To support teachers’ instructional practice through focusing on student performances.

Primarily evaluation: The process asks participant to provide “warm” and “cool” feedback on the student work samples and exhibition or project designs.

Context presented initially: At the beginning of the session, the presenting teachers typically provide descriptions (including documents) of the assignment, scoring criteria, and reflections from students and others.

Kinds of pieces: Most often used to look at work deriving from an exhibition or long-term project or portfolio. Sample work may include brief video clip of student presentation as well as written and visual samples.

Number of pieces: Typically used with work from several students. May also be used with a single sample.

Collaborative Assessment Conference

To learn more about students’ goals: the problems and issues they choose to focus on in the course of an assignment.

To learn more about the strengths and need of a particular student.

To reflect on and gather ideas for revising classroom practice

Primarily description, with some interpretation: The process asks participants to describe the student work, to ask questions about it, and to speculate about problems or issues in the work that the student was most focused on.

Context withheld until middle of process: The presenting teacher does not describe the context for the work until after participants have looked carefully at it and formulated questions about it.

Kinds of pieces: Most often used to look at student work drawn from student portfolios (e.g., a piece of art work or a sample of daily class work.) Works best with open-ended assignments (as opposed to worksheets.)

Number of pieces: Most often used to look at one or two pieces of work from a single student. May also be used with multiple samples.

11

Modified Tuning Protocol (45 minutes)Date: Time: Location: Participants:

Topic I/D/A Desired OutcomePerson

ResponsibleTime

Welcome IIntroductions. Review protocols. Introduce the Teacher Presenter and the work that will be shared.

Facilitator 6

Teacher Presentation

I

Teacher Presenter describes the context for student work. Review assignment/scoring rubric. Teachers may choose to share the lesson plan that was used. Teacher presenter sets expectations for feedback.

Teacher-Presenter

7

Clarifying Questions

D

Participants ask clarifying questions.

Facilitator might save some questions for the warm/cool feedback (if a question needs more that a brief answer). Presenting Teacher shares planning information or resources used to prepare the lesson/unit.

Team6

Examination of Student Work

SamplesI

Share and review samples of student work. Work might be original or copied pieces of writing or video clips of presentations. Participants reflect on what they would like to contribute to the feedback session. Encourage participants to work quietly during this step.

Team10

Warm and Cool Feedback

DRemind participants of the focusing question(s). Participants share ideas about the student work providing “warm” and “cool” feedback. Facilitator focuses and clarifies.

Facilitator, Team

9

Plan of Action A

Determine action plan for Teacher Presenter. Consider whether the dialogue has implications for the work of others in the group. How will the ideas generated influence the work of the all participating teachers?

Team 5

Debrief

Wrap Up,

Next Steps

DDebrief. Summarize outcomes. Define next steps. Schedule next LASW meeting. Identify next Teacher Presenter.

Next meeting: __________________________

Facilitator 2

TOTAL 4512

Topic

I/D/A

Desired OutcomePerson

ResponsibleTime

Welcome IIntroductions. Review protocols. Introduce the Teacher Presenter and the work that will be shared.

Facilitator 6


I

Teacher Presenter describes the context for student work. Review assignment/scoring rubric. Teachers may choose to share the lesson plan that was used. Teacher presenter sets expectations for feedback.

Teacher-Presenter

7


D

Participants ask clarifying questions.

Facilitator might save some questions for the warm/cool feedback (if a question needs more that a brief answer). Presenting Teacher shares planning information or resources used to prepare the lesson/unit.

Team 6

13

Topic

I/D/A

Desired OutcomePerson Resp.

Time

Examination of Student

Work Samples

I

Share and review samples of student work. Work might be original or copied pieces of writing or video clips of presentations. Participants reflect on what they would like to contribute to the feedback session. Encourage participants to work quietly.

Team 10

Warm and Cool

FeedbackD

Remind participants of the focusing question(s). Participants share ideas about the student work providing “warm” and “cool” feedback. Facilitator focuses and clarifies.

FacilitatorTeam

9

Plan of Action

A

Determine action plan for Teacher Presenter. Consider whether the dialogue has implications for each participant. How will the ideas generated influence the work of the all participating teachers?

Team 5

Debrief

Wrap Up,

Next Steps

D

Debrief. Summarize outcomes. Define next steps. Schedule next LASW meeting. Identify next Teacher Presenter.

Next meeting: _____________________

Facilitator 2

TOTAL 45

14

Tuning Protocol for Peer ReviewTuning Protocol for Peer ReviewTOPICTOPIC DESIRED OUTCOMEDESIRED OUTCOME PERSON PERSON

RESP.RESP.TIMETIME

IntroductionIntroduction II Introductions. Discuss progress. Review protocols.Introductions. Discuss progress. Review protocols. FacilitatorFacilitator 5 5

Teacher Teacher PresentationPresentation

II Teacher presenter describes the context for student work. Review Teacher presenter describes the context for student work. Review assignment/scoring rubric. assignment/scoring rubric.

Teacher-Teacher-presenterpresenter

1515

Clarifying Clarifying QuestionsQuestions

DD Share and review samples of student work--may be original or copied Share and review samples of student work--may be original or copied pieces of writing or video clips of presentations. Facilitator might save pieces of writing or video clips of presentations. Facilitator might save some questions for the warm/cool feedback (if a question needs more some questions for the warm/cool feedback (if a question needs more than a brief answer.) Ask questions about the teacher preparation for the than a brief answer.) Ask questions about the teacher preparation for the lesson that led to this student work.lesson that led to this student work.

TeamTeam 5 5

Examine Student Examine Student Work SamplesWork Samples

DD Participants silently reflect on what they would like to contribute to the Participants silently reflect on what they would like to contribute to the feedback session.feedback session.

TeamTeam 15 15

Reflect on Reflect on FeedbackFeedback

DD Remind participants of the focusing question(s). Participants share Remind participants of the focusing question(s). Participants share feedback while the teacher-presenter is silent.feedback while the teacher-presenter is silent.

TeamTeam 3 3

Warm ad Cool Warm ad Cool FeedbackFeedback

DD Teacher-presenter speaks to those comments/questions he or she chooses Teacher-presenter speaks to those comments/questions he or she chooses to address. Facilitator focuses and clarifies.to address. Facilitator focuses and clarifies.

Facilitator, Facilitator, TeamTeam

15 15

Plan of ActionPlan of Action AA Determine action plan for teacher presenter. Consider whether the Determine action plan for teacher presenter. Consider whether the dialogue has implications for the work of others in the group. How will dialogue has implications for the work of others in the group. How will the ideas generated influence the work of the teacher?the ideas generated influence the work of the teacher?


13 13

DebriefDebrief DD Facilitator leads an open discussion on the tuning experience: What went Facilitator leads an open discussion on the tuning experience: What went well? What questions did the process raise?well? What questions did the process raise?

TeamTeam 10 10

Next Steps/Next Steps/ II Summarize, define next steps. Next meeting:Summarize, define next steps. Next meeting: TeamTeam 7 7

FacilitatorFacilitator 2 2

TOTALTOTAL 90 min.90 min.

Tuning Protocol for Peer Review (Blythe , et. al.)Tuning Protocol for Peer Review (Blythe , et. al.)TOPICTOPIC I/I/

DADADESIRED OUTCOMEDESIRED OUTCOME PERSON PERSON

RESP.RESP.TIMETIME

IntroductionIntroduction II Introductions. Discuss progress. Review Introductions. Discuss progress. Review protocols.protocols.

FacilitatorFacilitator 5 5

Teacher Teacher PresentationPresentation

II Teacher presenter describes the context Teacher presenter describes the context for student work. Review for student work. Review assignment/scoring rubric. assignment/scoring rubric.


1515

Clarifying Clarifying QuestionsQuestions

DD Share and review samples of student Share and review samples of student work--may be original or copied pieces of work--may be original or copied pieces of writing or video clips of presentations. writing or video clips of presentations. Facilitator might save some questions for Facilitator might save some questions for the warm/cool feedback (if a question the warm/cool feedback (if a question needs more than a brief answer.) Ask needs more than a brief answer.) Ask questions about the teacher preparation questions about the teacher preparation for the lesson that led to this student for the lesson that led to this student work.work.

TeamTeam 5 5

Examine Examine Student Work Student Work SamplesSamples

DD Participants silently reflect on what they Participants silently reflect on what they would like to contribute to the feedback would like to contribute to the feedback session.session.

TeamTeam 15 15

TOPICTOPIC I/I/

DADADESIRED OUTCOMEDESIRED OUTCOME PERSON PERSON

RESP.RESP.TIMETIME


DD Remind participants of the focusing question(s). Remind participants of the focusing question(s). Participants share feedback while the teacher- Participants share feedback while the teacher-presenter is silent.presenter is silent.

TeamTeam 3 3

Warm ad Warm ad Cool Cool FeedbackFeedback

DD Teacher-presenter speaks to those Teacher-presenter speaks to those comments/questions he or she chooses to comments/questions he or she chooses to address. Facilitator focuses and clarifies.address. Facilitator focuses and clarifies.


15 15

Plan of Plan of ActionAction

AA Determine action plan for teacher presenter. Determine action plan for teacher presenter. Consider whether the dialogue has implications Consider whether the dialogue has implications for the work of others in the group. How will for the work of others in the group. How will the ideas generated influence the work of the the ideas generated influence the work of the teachers?teachers?


1515

DebriefDebrief DD Facilitator leads an open discussion on the Facilitator leads an open discussion on the tuning experience: What went well? What tuning experience: What went well? What questions did the process raise?questions did the process raise?

TeamTeam 10 10

Next Steps/Next Steps/ II Summarize, define next steps. Summarize, define next steps.

Next meeting: _____________________Next meeting: _____________________

TeamTeam

FacilitatorFacilitator

7 7

TOTALTOTAL 90 min.90 min.17

TOPICTOPIC I/DAI/DA DESIRED OUTCOMEDESIRED OUTCOME PERSON PERSON RESP.RESP.

TIMETIME


DD Remind participants of the focusing Remind participants of the focusing question(s). Participants share feedback question(s). Participants share feedback while the teacher-presenter is silent.while the teacher-presenter is silent.

TeamTeam 3 3

Warm ad Warm ad Cool Cool FeedbackFeedback

DD Teacher-presenter speaks to those Teacher-presenter speaks to those comments/questions he or she chooses to comments/questions he or she chooses to address. Facilitator focuses and clarifies.address. Facilitator focuses and clarifies.


15 15

Plan of Plan of ActionAction

AA Determine action plan for teacher presenter. Determine action plan for teacher presenter. Consider whether the dialogue has Consider whether the dialogue has implications for the work of others in the implications for the work of others in the group. How will the ideas generated group. How will the ideas generated influence the work of the teacher?influence the work of the teacher?


1515

DebriefDebrief DD Facilitator leads an open discussion on the Facilitator leads an open discussion on the tuning experience: What went well? What tuning experience: What went well? What questions did the process raise?questions did the process raise?

TeamTeam 10 10

Next Steps/Next Steps/ II Summarize, define next steps. Summarize, define next steps.

Next meeting: _____________________Next meeting: _____________________

TeamTeam

FacilitatorFacilitator

7 7

TOTALTOTAL 90 min.90 min.18

Norms

• Begin and end on time.• Listen actively.• Maintain positive intentions.• Focus on the presenting teacher and the

desired outcomes.


• Teacher presenter describes the context for student work. The teacher presenter defines the “guiding question,” the desired outcome for the PLC review of student work.

• Present the assignment.

• Present the scoring rubric.


• Participants ask clarifying questions.

If you run out of time for clarifying questions, the facilitator might save some questions for the warm/cool feedback (if a question needs more that a brief answer.)

Examination of Student Work

Share and review samples of student work. (It might be original or copied pieces of work, video clips of presentations, or other work.)

• Participants reflect on what they would like to contribute to the feedback session.

• Use the following guiding questions as you look at the student work.

Kinds of Questions

About the quality of student work Is the work “good enough”? What is “good enough”? In what ways does this work meet or fail to meet a particular set of

standards?

About teaching practice What do the students’ responses indicate about the effectiveness of

the prompt or the assignment? How might the assignments be improved? What kinds of instruction support high quality student performances?

Kinds of Questions

About students’ understanding What does this work tell us about how well the student understands the

topic of the assignment? What initial understandings do we see beginning to emerge in this work?

About students’ growth How does this range of work from a single student demonstrate growth

over time? How can I support student growth more effectively?

About students’ intent On what issues or questions is this student focused? What aspects of the assignment intrigued this student? Into which parts of the assignment did the student put the most effort? To what extent is the student challenging her/himself? In what ways?

Warm and Cool Feedback

•The Peer Review or Tuning Protocol deliberately cultivates and juxtaposes:

– Warm responses that are supportive and empathic, and that emphasize the promise of a learning experience.

– Cool responses that are questioning and comparative, and that emphasize the ways in which the learning experience might be enriched*.

* Joseph P. McDonald, "Three Pictures of an Exhibition: Warm, Cool, and Hard," Phi Delta Kappan, February 1993, pp. 480-485.

Warm and Cool Feedback•The deliberate effort to keep warm and cool feedback separate and in balance can seem needlessly artificial.

•But this is beneficial because it allows us to:– Seek out deeper levels of promise and shortcoming.– Give each kind of response its due.– Examine and discuss the actual work of students and

teachers in a safe environment.

Warm Comments

Warm, positive feedback consists of supportive, encouraging, appreciative questions, statements and comments about the work, ideas, issues presented that begin dialogue.

Warm Comments

– When giving "warm comments" you may want to try to use a two-part format:

1. Some introductory phrase that indicates that this is a “warm” comment.

2. Some reason or explanation about what the commentator valued about the work.

As a facilitator, emphasize the importance of giving reasons.

– Comments like "Hey, nice lab!" or "Great homework assignment!" do not provide enough meaningful feedback for the teacher presenter.

– Be generous. Begin with a positive intention and positive presupposition.

Examples of "Warm Comments"

– The strengths of this work are…

– The activity that triggered this assignment was very well aligned with the ________ standard.

– It was clear that the students understood the rubric that was being used because there was evidence…

– The interdisciplinary approach here is particularly effective. You incorporated… and… and…

– This is an innovation on a classical strategy... I appreciate how you started with… and then shifted to…

– With these clear and simple directions, everyone will be able to do what you have asked.

– This is exciting because it involves examples that are "real world" to kids. When you…it allowed…

– It is obvious that you allowed for higher level thinking when you…

– I was delighted to see the historical reference, because that's one of our standards we focus on the least with kids.

Cool CommentsCool feedback:

– Offers different ways to think about the work or issues presented.– Raises questions. – Challenges and extends the person’s thinking.– Raises concerns.

Cool comments and questions generally follow "warm" feedback. "Cool" comments can run the gamut and may include:

– Pointing out where a rule was not followed (as in writing a multiple choice question based on state standards).

– Begging a philosophical discussion. – Prompting a decision by the group.

Cool Comments

Cool feedback allows a person to constructively question and voice concerns about the work/issue.

When providing cool comments:– Focus on one suggestion at a time. – Be constructive.– Open up "possibilities" and options. – Analyze and make connections. – Avoid implying "You should…” or “You should not…"

Examples of "Cool Comments"•Some examples of introductory phrases for "cool" comments:

– What are you considering with regard to…

– Have you thought about…

– I wonder...

– What if you...

– What connections have you made (to real world, other concepts, other disciplines, etc.)…?

– Here are some strategies that would address …

– What might add clarification to…

– To align more closely with the standards, what if…

– Might students interpret this as...

– What do you think would happen if…?

– Here are three possibilities . . .

TendenciesThere is a tendency on the part of some reviewers to "fix" the problem, or offer

suggestions to fix a problem and sometimes the group offers spontaneous suggestions to the teacher presenter to do this fixing.

It is the intention of the Tuning Protocol for the teacher presenter to be in control of the comments that are made, making the professional judgment to take or reject any or all of the suggestions.

There is also a tendency on the part of the group to enter into more detailed dialogue about the comments, with a give and take occurring between reviewers and teacher presenter. In the formal Peer Review Process when "Warm and Cool" comments are used, there are specific rules about who talks, when, and for how long; this formality keeps the process on task and prevents digressions, pet peeves and soap box oratory by group members.

The facilitator controls how much dialogue is allowed to go on, depending on the group and time constraints. There is a benefit in (and usually group consensus on) limiting discussion for the sake of getting more comments in short period of time.

Both the warm and cool comments can be used to guide the action planning phase of the protocol.

Mike DuPre, University of Rochester

Plan of Action

Determine action plan for teacher presenter. – What will the teacher do, try, change, reinforce, or modify as a

result of the dialogue? – Prepare a list of “things to do.”

Consider whether the dialogue has implications for the work of others in the group. What ideas did the others in the PLC get that might influence their work?

Debrief

• Facilitator leads an open discussion on the tuning Facilitator leads an open discussion on the tuning experience…experience…– What went well? What went well? – What questions did the process raise?What questions did the process raise?– What will we do differently next time?What will we do differently next time?

Wrap-Up, Next Steps

4 Minutes• Summarize. • Define next steps. • Schedule next teacher presenter.• Next meeting: __________________________

Sample Note Taking Form: Dialogue/NotesTeacher: Date: Assignment:

Participating Teachers:

PROBLEM # or KEY

CONCEPTWHAT STUDENTS KNOW

WHAT STUDENTS

DID NOT KNOWIDEAS

Sample Note Taking Form: Warm and Cool Feedback

Warm Cool

Looking At Student WorkMeeting Report

Date ____________________________________ Group members present: We looked at these pieces of work: We used these standards/assessments/rubrics:

What we discovered about the quality of LEARNING and INSTRUCTION:

What we discovered about the our curriculum/resource materials that we used in the lesson/unit:

What we discovered about the assessments that we used in the lesson/unit:

What is our ACTION PLAN to IMPROVE LEARNING?

What help do we need to make changes? How might we use professional development time to address these concerns?

Additional Comments:

Recorded by _______________________________________________________________________

Looking at Student Work “Looking at student work is a way to move out of complacency. Looking at...

Documents

Transcript of Looking at Student Work “Looking at student work is a way to move out of complacency. Looking at...