Accurate and Meaningful Measures

© Relay Graduate School of Education. All rights reserved. 1

ACCURATE AND MEANINGFUL MEASURES


Is 82% a high score or a low score?


If your students finished the year with an 82%

average,

would you be proud?


Is 82% a high score or a low score?

http://static2.businessinsider.com/image/50256389ecad047d37000004-900-675/mckayla-maroney.jpg


Some of you who teach 1st grade may say…


“No way! 82% is a B minus grade! That’s not good.”


Some of you who teach Advanced Placement US History may say…


“Yes!

82% earns a strong five on the AP test.

It would be awesome if my students could average such a high score!”


Many of you may say…


“It depends.”


Indeed, it does depend.


It depends on…


• how much (breadth) of the material was taught

It depends on…


• how much (breadth) of the material was taught• the extent (depth) to which the material was taught

It depends on…


• how much (breadth) of the material was taught• the extent (depth) to which the material was taught• the quality, rigor, and alignment of the assessments that

were administered

It depends on…



were administered• when and how frequently the content was assessed

It depends on…



were administered• when and how frequently the content was assessed• how the overall “average” was calculated

It depends on…


• how much (breadth) of the material was taught• the extent (depth) to which the material was taught• The quality, rigor, and alignment of the assessments that

were administered• when and how frequently the content was assessed• how the overall “average” was calculated• what counted or didn’t count in the aggregate

computation

It depends on…


• how much (breadth) of the material was taught• the extent (depth) to which the material was taught• The quality, rigor, and alignment of the assessments that

were administered• when and how frequently the content was assessed• how the overall “average” was calculated• what counted or didn’t count in the aggregate

computation • other factors, too

It depends on…


In summary, it depends on how accurately

& meaningfully student achievement was measured.


An Accurate and Meaningful Measure


Everything is Aligned!



• The scope of instructional content is most appropriate for students in this grade and subject




• The assessments of learning are aligned, rigorous, and high-quality, and give students sufficient at-bats to demonstrate their learning





• Average scores are calculated in a thoughtful way that weights content equally






• The data is complete and error-free






• The data is complete and error-free

• And so on and so on


An Inaccurate and Meaningless Measure


Everything is NOT aligned!



• Only a fraction of the full year’s required curriculum was taught




• The assessments didn’t test everything that students were supposed to have learned





• A bunch of data is missing





• A bunch of data is missing• There was no goal to reach, or the

goal was arbitrary






goal was arbitrary• The data wasn’t treated with care






goal was arbitrary• The data wasn’t treated with care• And so on and so on


• Meas·ure: /ˈmeZHər/: An indication of the degree or extent of something

What is a Measure?


• Ac·cu·rate: /ˈakyərət/ (of information, measurements, statistics, etc.) correct in all details

What is Accurate?


• Mean·ing·ful: /ˈmēniNGfəl/ having a serious or important purpose

What is a Meaningful?



An indication of the degree or extent of

something




something

correct in all details




something

correct in all details

having a serious or important purpose


An Inaccurate and Meaningless Measure


How do you ensure that your measure

of student achievement

is accurate and meaningful?


That’s what you are going to learn how to

do in this module.


The Hiring Decisions Have Been Made!

http://upload.wikimedia.org/wikipedia/commons/6/65/Rom%C3%A9o_et_Juliette_(Gounod)_Act2_London_1867_(Patti,_Mario)_NGO4p32.jpg

Click to the next activity to find out what the principal has decided about hiring

Romeo!

Accurate and Meaningful Measures

Education

Transcript of Accurate and Meaningful Measures