Formative assessment: questioning and feedback

31
Formative assessment: questioning and feedback Dylan Wiliam www.dylanwiliam.net

description

Formative assessment: questioning and feedback. Dylan Wiliam. www.dylanwiliam.net. Engineering effective discussions, activities, and classroom tasks that elicit evidence of learning. Kinds of questions: Israel. Which fraction is the smallest?. Success rate 88%. - PowerPoint PPT Presentation

Transcript of Formative assessment: questioning and feedback

Page 1: Formative assessment: questioning and feedback

Formative assessment: questioning and feedback

Dylan Wiliam

www.dylanwiliam.net

Page 2: Formative assessment: questioning and feedback

Engineering effective discussions, activities, and classroom tasks that elicit evidence of learning

Page 3: Formative assessment: questioning and feedback

Kinds of questions: Israel

Which fraction is the smallest? a) 16

, b) 23

, c) 13

, d) 12

.

Success rate 88%

Which fraction is the largest?

Success rate 46%; 39% chose (b)

a) 45

, b) 34

, c) 58

, d) 710

.

Vinner (1997)

3

Page 4: Formative assessment: questioning and feedback

Draw an upside-down triangle…4

Page 5: Formative assessment: questioning and feedback

Inverted red triangle…5

Page 6: Formative assessment: questioning and feedback

Misconceptions in math6

3a = 24a + b = 16

Page 7: Formative assessment: questioning and feedback

Misconceptions in science7

Page 8: Formative assessment: questioning and feedback

Eliciting evidence

Key idea: questioning should cause thinking provide data that informs teaching

Improving teacher questioning generating questions with colleagues low-order vs. high-order not closed vs. open appropriate wait-time

Getting away from I-R-E basketball rather than serial table-tennis ‘No hands up’ (except to ask a question) ‘Hot Seat’ questioning

All-student response systems ABCD cards, “show-me” boards, exit passes

8

Page 9: Formative assessment: questioning and feedback

Questioning in math: Discussion

Look at the following sequence:3, 7, 11, 15, 19, ….

Which is the best rule to describe the sequence?A. n + 4B. 3 + nC. 4n - 1D. 4n + 3

9

Page 10: Formative assessment: questioning and feedback

Questioning in math: Diagnosis

In which of these right-angled triangles is a2 + b2 = c2 ?

A a

c

b

C b

c

a

E c

b

a

B a

b

c

D b

a

c

F c

a

b

10

Page 11: Formative assessment: questioning and feedback

Questioning in science: Discussion

Ice-cubes are added to a glass of water. What happens to the level of the water as the ice-cubes melt?

A. The level of the water dropsB. The level of the water stays the sameC. The level of the water increasesD. You need more information to be sure

11

Page 12: Formative assessment: questioning and feedback

12

The ball sitting on the table is not moving. It is not moving because:A. no forces are pushing or pulling on the ball.

B. gravity is pulling down, but the table is in the way.C. the table pushes up with the same force that gravity pulls

downD. gravity is holding it onto the table. E. there is a force inside the ball keeping it from rolling off

the tableWilson and Draney (2004)

Questioning in science: Diagnosis

Page 13: Formative assessment: questioning and feedback

Questioning in English: Discussion

Macbeth: mad or bad?13

Page 14: Formative assessment: questioning and feedback

Questioning in English: Diagnosis

Where is the verb in this sentence?

The dog ran across the road

A B C D

14

Page 15: Formative assessment: questioning and feedback

Questioning in English: Diagnosis (2)

Which of these is correct?

A. Its on its way.B. It’s on its way.C. Its on it’s way.D. It’s on it’s way.

15

Page 16: Formative assessment: questioning and feedback

Questioning in English: Diagnosis (3)

Identify the adverbs in these sentences:

1. The boy ran across the street quickly. (A) (B) (C) (D) (E)

2. Jayne usually crossed the street in a leisurely fashion. (A) (B) (C) (D) (E)

3. Fred ran the race well but unsuccessfully. (A) (B) (C) (D) (E)

16

Page 17: Formative assessment: questioning and feedback

Questioning in English: Diagnosis (4)

Which of these is the best thesis statement?A. The typical TV show has 9 violent incidentsB. The essay I am going to write is about violence on TVC. There is a lot of violence on TVD. The amount of violence on TV should be reducedE. Some programs are more violent than othersF. Violence is included in programs to boost ratingsG. Violence on TV is interestingH. I don’t like the violence on TV

17

Page 18: Formative assessment: questioning and feedback

Questioning in history: Discussion

In which year did World War II begin?A. 1919B. 1938C. 1939D. 1940E. 1941

18

Page 19: Formative assessment: questioning and feedback

Questioning in history: Diagnosis

Why are historians concerned with bias when analyzing sources?A. People can never be trusted to tell the truthB. People deliberately leave out important detailsC. People are only able to provide meaningful information

if they experienced an event firsthandD. People interpret the same event in different ways,

according to their experienceE. People are unaware of the motivations for their actionsF. People get confused about sequences of events

19

Page 20: Formative assessment: questioning and feedback

Questioning in MFL: Discussion

Is the verb “être” regular in French?

20

Page 21: Formative assessment: questioning and feedback

Questioning in MFL: Diagnosis

Which of the following is the correct translation for “I give the book to him”?

A. Yo lo doy el libro.B. Yo doy le el libro.C. Yo le doy el libro.D. Yo doy lo el libro.E. Yo doy el libro le.F. Yo doy el libro lo.

21

Page 22: Formative assessment: questioning and feedback

Hinge questions

A hinge question is based on the important concept in a lesson that is critical for students to understand before you move on in the lesson.

The question should fall about midway during the lesson.

Every student must respond to the question within two minutes.

You must be able to collect and interpret the responses from all students in 30 seconds

22

Page 23: Formative assessment: questioning and feedback

Real-time test: Figurative language

A. AlliterationB. HyperboleC. OnomatopoeiaD. PersonificationE. Simile

1. He was like a bull in a china shop.2. This backpack weighs a ton.3. The sweetly smiling sunshine…4. He honked his horn at the cyclist.5. He was as tall as a house.

23

Page 24: Formative assessment: questioning and feedback

Providing feedback that moves learners forward

Page 25: Formative assessment: questioning and feedback

Kinds of feedback: Israel

264 low and high ability grade 6 students in 12 classes in 4 schools; analysis of 132 students at top and bottom of each class

Same teaching, same aims, same teachers, same classwork Three kinds of feedback: scores, comments, scores+comments

Butler (1988)

Achievement Attitude

Scores no gain High scorers : positiveLow scorers: negative

Comments 30% gain High scorers : positiveLow scorers : positive

25

Page 26: Formative assessment: questioning and feedback

What happened with students given both scores and comments?A. Gain: 30%; Attitude: all positiveB. Gain: 30%; Attitude: high scorers positive, low scorers negativeC. Gain: 0%; Attitude: all positiveD. Gain: 0%; Attitude: high scorers positive, low scorers negativeE. Something else

Responses

Achievement Attitude

Scores no gain High scorers : positiveLow scorers: negative

Comments 30% gain High scorers : positiveLow scorers : positive

2626

Page 27: Formative assessment: questioning and feedback

27

Butler (1987)

Kinds of feedback: Israel (2)

200 grade 5 and 6 Israeli students Divergent thinking tasks 4 matched groups

experimental group 1 (EG1); comments experimental group 2 (EG2); grades experimental group 3 (EG3); praise control group (CG); no feedback

Achievement EG1>(EG2≈EG3≈CG)

Ego-involvement (EG2≈EG3)>(EG1≈CG)

Page 28: Formative assessment: questioning and feedback

28

Effects of feedback

Kluger and DeNisi (1996) review of 3000 research reports Excluding those:

without adequate controls with poor design with fewer than 10 participants where performance was not measured without details of effect sizes

left 131 reports, 607 effect sizes, involving 12652 individuals

On average, feedback increases achievement Effect sizes highly variable 38% (50 out of 131) of effect sizes were negative

Page 29: Formative assessment: questioning and feedback

Getting feedback right is hard

Response type Feedback indicates performance…

exceeds goal falls short of goal

Change behavior Exert less effort Increase effort

Change goal Increase aspiration Reduce aspiration

Abandon goal Decide goal is too easy Decide goal is too hard

Reject feedback Feedback is ignored Feedback is ignored

Page 30: Formative assessment: questioning and feedback

Provide feedback that moves learning on

Key idea: feedback should: Cause thinking Provide guidance on how to improve

Comment-only grading Focused grading Explicit reference to rubrics Suggestions on how to improve:

Not giving complete solutions Re-timing assessment:

E.g., three-fourths-of-the-way-through-a-unit test

30

Page 31: Formative assessment: questioning and feedback

Comments? Questions?

www.dylanwiliam.net