Lead Teacher Workshop 4

Silent ConversationWhat do / don’t you know about the National Standards?

Twice a year in writing

GenderMaori

Pacific island2012 to report on

the 2011 year

FalseEarly L2

FalseAt L3

The purpose of this session is…

Continue a moderation process for making Overall Teacher Judgements.

Keep you updated with the latest maths resources and news

Continue to explore the mathematics behind the National Standards with a focus on Statistics

Continuing the Moderation Process for Making OTJ’s

http://assessment.tki.org.nz/Moderation/Key-considerations

Making and Moderating Overall Teacher Judgements

Using data to inform teaching and learning from http://nzcurriculum.tki.org.nz/Curriculum-stories/School-

stories

Planning Ahead for 2011• What assessment practices will you keep,

modify, stop, start?

• How might your teachers tweak their recording of evidence based assessment?

• What and how will student achievement and progress in relation to the Standards be passed on to the next teacher… next school?

• How will you identify and select targeted children for extra support?

Challenges for schools and teachers to consider when choosing, using and analysing assessment tools.

Case Study from Lead Teacher Cluster by Marie Hirst

34 students from Years 4 to 6AsTTle, IKAN and GloSS

Alignment of Curriculum Level Achieved

Only 14 out of 34 children (41%) were assigned the same curriculum level from both GloSS and AsTTle.

G

Why were 55% (6 out of 11 children) with a low GloSS stage 4-5 (Level 1-2) assessed higher in AsTTle?

The difference in levels was only minor, 1 sub-level higher.

1. Problem solved correctly but low level thinking/strategy used.

AsTTle, unlike GloSS does not take into account how a problem is solved. For example,

Robert went to the shop with $2. He bought an ice-block for 75c.

How much change did he get

2. Lucky guess when ticking a multi-choice box.

There were 4 multi-choice questions at Level 3 or Level 4. All of the 6 children got one or more of these correct. This may have bumped up their score.

Why were 55% (6 out of 11 children) with a low GloSS stage 4-5 (Level 1-2) assessed higher in AsTTle?

Why were 61% (14 out of 23 children) with a high GloSS stage 6-8 (Level 3-5) assessed lower in AsTTle?

For 43% students the difference is minor, only 1 sub level below on AsTTle.

The remaining 57% had a relatively large variance of 2 or more sub-levels below.

1. The GloSS stage was taken from the highest stage achieved across any domain (add/sub, mult/div, proportions) and therefore may not truly reflect the children’s mathematical thinking.

2. Lack of knowledge of other Level 3 and 4 mathematical ideas assessed only in AsTTle (which accounted for 21% of the test, 7 out of 33 questions) e.g. order of operations, < >, powers of numbers

3. Lower literacy levels or lack of inferential thinking.

Why were 61% (14 out of 23 children) with a high GloSS stage 6-8 (Level 3-5) assessed lower in AsTTle?

The data showed no obvious disparity.

Possible Reason 2 Lack of knowledge of other Level 3 and 4 mathematical ideas assessed only

in AsTTle (which accounted for 21% of the test, 7 out of 33 questions)

• Knowledge of order of operations. (4 questions)

• Use of mathematical symbols < > and = (2 questions)

• Explain the meaning and evaluate powers of whole numbers. (1 question)

Only 4 out of the 14 children (29%)

Only 6 out of the 14 children (43%)

Only 9 out of the 14 children (64%)

Possible Reason 3

Low literacy levels and/or lack of inferential thinkingSome AsTTle problems required significant reading skills and comprehension.

AsTTle Question 22Sarah , Jane and Emma were planning for their class party. John, Bob and David had told them that they would each eat four sausage rolls, but Sarah said that some of the girls would probably eat only three. There are 33 students in the class. Sarah estimated that they would need 100 sausage rolls. Emma estimated that they would need 130 sausage rolls. Whose estimate is best and why?

Sarah , Jane and Emma were planning for their class party. John, Bob and David had told them that they would each eat four sausage rolls, but Sarah said that some of the girls would probably eat only three. There are 33 students in the class. Sarah estimated that they would need 100 sausage rolls. Emma estimated that they would need 130 sausage rolls. Whose estimate is best and why?

100 because they don’t want

any left over

100 because they don’t want

any left over

100 because 99 is closest to

100 than 130

100 because 99 is closest to

100 than 130

100 because 130 is heaps100 because 130 is heaps

100 because it is around

110

100 because it is around

110

9 of the 14 students (64%) incorrectly solved this AsTTle question even though the ‘maths’ was right.

Why did this child get the answer wrong?Samantha had two coins worth $1.50 in her purse. She went to the dairy and spent 95c. On the way home she found 20c.

How much money did Samantha have in her purse when she got home? (Answer = 75c)

How much change should Samantha have when she leaves the shop? (Answer = 55c)

Knowledge Domain

FNWS /BNWS

Fractions Place Value

Basic Facts

Stage 6 4 5 6

Overall IKAN Stage type IKAN stage assigned

(A) Achieved Stage Stage 4 (last bank correct)

(B) Highest Stage Stage 6 (highest across any domain)

(C) Instructional Stage Stage 5 (to cater for gaps with fractions)

(D) Average Stage Stage 5.25 (average across all domains)

How does your school assign one overall IKAN stage – if any?

Challenges for teachers to consider

1. Knowing the purpose for the test “If the main aim of assessment should be to

provide information to improve the teaching and learning of mathematics, teachers need to be clear about the learning goals and set assessment tasks that reflect the critical learning objectives”

“Assessment tasks convey to the student what

learning goals are most important”. (tki.org.nz: assessment)

Challenges for teachers to Consider

2. Knowledge of the assessment toolIKAN: Automatic instant recall of number knowledge. GloSS:How children think. Poor understanding of the Number

Framework could result in teachers wrongly recording a student response.

AsTTle: Poorly created tests with too wide range of levels and content

can result in limited accuracy and diagnostic information. E.g. Stage 4 or 5 children may be better to sit an AsTTle test including levels 2 – 3 only so there is less chance of ‘lucky guesses’ altering their achievement.

Challenges for teachers to Consider

3. Administration of the Assessment Tool• Know how to administer it fairly and consistently.• The language and format of the assessment should

also be familiar to the students, i.e.

IKAN: practice looking up to see the questions and then writing the answer in a timed manner.

GloSS: practice explaining strategies on a one-to-one basis. No leading questions given

AsTTle: practice reading the question carefully, answering multi-choice type questions and apply inferential thinking

Challenges for teachers to consider

4. Multiple Sources of EvidenceTo rely heavily on one source of evidence alone can cause misguided judgement.

Quality judgements about student achievement should be made using multiple sources of evidence, including:•formal test outcomes (AsTTle, GloSS and IKAN)•Informal opportunities (bookwork, learning conversations etc.)

Challenges for teachers to consider

5. Formative Vs Summative use of the data

Effective use of data involves analysing, interpreting and responding to the information rather than just summarising it. Consider gaps and next steps rather than just collating curriculum levels.

When using GloSS and IKAN ensure consistency is given to:

• Whether stages assigned are instructional or achieved?

• How one overall IKAN or GloSS stage is assigned (the highest or average stage across any domain?).

Challenges for teachers to consider6. Student InvolvementAssessment practices should benefit the student and they should be supported to understand what is being assessed and why.

“When students are clear about their learning goals and receive specific feedback on their achievement they can monitor their own learning and set goals”.

“Assessments that reflect the important learning goals not only help the teachers develop a responsive teaching programme but can enhance the student’s ability to take responsibility for their learning” (tki.org.nz)

1. Know the purpose for the assessment.

2. Administer fairly and consistently.

3. Have sound knowledge of the assessment tool

4. Formatively vs summative use of data.

5. Use multiple sources of evidence.

6. Involve the student.

Challenges for schools and teachers to consider when selecting assessment tools

What’s New?Keeping you updated

Parent pamphlets

Parent Pamphletshttp://www.minedu.govt.nz/Parents/YourChild/ProgressAndAchievement/

NationalStandards/Introduction/SupportingYourChildsLearning.aspx

TKI – Responses to NS Querieshttp://assessment.tki.org.nz/Overall-teacher-judgment/Responses-

to-National-Standards-queries-from-schools

nzmaths

•Wed 17 Nov: Lead Teacher Workshop

•Wed 1 Dec: 1 Day Survival Effective Numeracy Course for teachers new to numeracy

•2011 PDRegister your interest by 30 October -form

Future workshop dates

Thought for the day

Eleven plus twoWhen you rearrange the letters

becomes………

Twelve plus one

Statistics