Item Analysis on the Validity of English Summative Test for the First Year Students
Item & Distractor Analysis - Steve Ventura · Item & Distractor Analysis A simple process for...
Transcript of Item & Distractor Analysis - Steve Ventura · Item & Distractor Analysis A simple process for...
![Page 1: Item & Distractor Analysis - Steve Ventura · Item & Distractor Analysis A simple process for determining assessment validity Item Analysis Improve Assessment Validity Purpose •eliminates](https://reader035.fdocuments.in/reader035/viewer/2022062506/5f066af47e708231d417e4af/html5/thumbnails/1.jpg)
Item & Distractor Analysis A simple process for determining assessment validity
Item Analysis
ImproveAssessment
Validity
Purpose
• eliminates ambiguous or misleading items in a single test administration
• increases instructors' skills in test construction
• identify specific areas of course content which need greater emphasis or clarity
• the percentage of students who answered a test item correctly
Item Difficulty Index
p-value:helps determine significance of
results
![Page 2: Item & Distractor Analysis - Steve Ventura · Item & Distractor Analysis A simple process for determining assessment validity Item Analysis Improve Assessment Validity Purpose •eliminates](https://reader035.fdocuments.in/reader035/viewer/2022062506/5f066af47e708231d417e4af/html5/thumbnails/2.jpg)
• occasionally, everyone knows the answer
Item Difficulty Index
p-value:helps determine significance of
results
An unusual high level of success may be
due to:
a)previous teacher
b)knowledge from home; child’s background
c)excellent teaching
Item Difficulty Index
Item Difficulty Index
• Low scores mean-
•Motivation level?
• Ability of teacher?
• Construction of the assessment item?
Is it the students fault for “not
trying”?
![Page 3: Item & Distractor Analysis - Steve Ventura · Item & Distractor Analysis A simple process for determining assessment validity Item Analysis Improve Assessment Validity Purpose •eliminates](https://reader035.fdocuments.in/reader035/viewer/2022062506/5f066af47e708231d417e4af/html5/thumbnails/3.jpg)
Item Difficulty Index
p = total who answered correctly total taking the test
*p is the difficulty index
Item Difficulty Index
p = 22 student get correct answer 25 total taking the test
p value = 0.88
Item Difficulty Index
• High Difficulty Level at p > .80
•Were students taught well?
•Was the item too easy?
88% of the students were
correct
![Page 4: Item & Distractor Analysis - Steve Ventura · Item & Distractor Analysis A simple process for determining assessment validity Item Analysis Improve Assessment Validity Purpose •eliminates](https://reader035.fdocuments.in/reader035/viewer/2022062506/5f066af47e708231d417e4af/html5/thumbnails/4.jpg)
Item Difficulty Index
10
Sample Problem:
In a Math test administered by Mr. Reyes, seven students answered word problem #1 correctly. A total of twenty-‐five students took the test.
What is the difficulty index for word problem #1?
p = 0.28
Item Difficulty Index
11
• Low Difficulty level at p<.30
• Students did not understand concept?
• Badly constructed item?
• Poorly taught? 28% of the students were
correct
Item Difficulty Index
12
•When should we use p value?
• Determine significance of an item
• Determine effective teaching
•Make better inferences Questions?