How to Fail a Student Lisa M. Beardsley-Hardy, PhD, MPH, MBA Director of Education General...
-
Upload
frank-gilbert -
Category
Documents
-
view
226 -
download
2
Transcript of How to Fail a Student Lisa M. Beardsley-Hardy, PhD, MPH, MBA Director of Education General...
![Page 1: How to Fail a Student Lisa M. Beardsley-Hardy, PhD, MPH, MBA Director of Education General Conference of Seventh-day Adventists.](https://reader036.fdocuments.in/reader036/viewer/2022062301/56649eb45503460f94bbca91/html5/thumbnails/1.jpg)
How to Fail a StudentHow to Fail a Student
Lisa M. Beardsley-Hardy, PhD, MPH, MBALisa M. Beardsley-Hardy, PhD, MPH, MBADirector of EducationDirector of Education
General Conference of Seventh-day General Conference of Seventh-day AdventistsAdventists
![Page 2: How to Fail a Student Lisa M. Beardsley-Hardy, PhD, MPH, MBA Director of Education General Conference of Seventh-day Adventists.](https://reader036.fdocuments.in/reader036/viewer/2022062301/56649eb45503460f94bbca91/html5/thumbnails/2.jpg)
Mene, Mene, Tekel, ParsinMene, Mene, Tekel, Parsin
MeneMene : God has numbered the days of : God has numbered the days of your reign and brought it to an end. your reign and brought it to an end.
TekelTekel : You have been weighed on the : You have been weighed on the scales and found wanting. scales and found wanting.
PeresPeres : Your kingdom is divided and : Your kingdom is divided and given to the Medes and Persians.given to the Medes and Persians.““
(Dan 5:26-28 NIV)(Dan 5:26-28 NIV)
![Page 3: How to Fail a Student Lisa M. Beardsley-Hardy, PhD, MPH, MBA Director of Education General Conference of Seventh-day Adventists.](https://reader036.fdocuments.in/reader036/viewer/2022062301/56649eb45503460f94bbca91/html5/thumbnails/3.jpg)
How to Fail a StudentHow to Fail a StudentAbsolute cut-off scoresAbsolute cut-off scores
Norm-referenced cut-off score Norm-referenced cut-off score (e.g. 1 SD below mean fails 15% (e.g. 1 SD below mean fails 15% of class independent of of class independent of competency)competency)
Criterion-referencedCriterion-referenced
![Page 4: How to Fail a Student Lisa M. Beardsley-Hardy, PhD, MPH, MBA Director of Education General Conference of Seventh-day Adventists.](https://reader036.fdocuments.in/reader036/viewer/2022062301/56649eb45503460f94bbca91/html5/thumbnails/4.jpg)
How to Fail a StudentHow to Fail a StudentProvide experience with assessment Provide experience with assessment and feedback.and feedback.
Sample multiple times.Sample multiple times.Plan for leniency to be fair to Plan for leniency to be fair to other students (e.g., require final other students (e.g., require final paper in week 13 of semester) to paper in week 13 of semester) to allow grace.allow grace.
Use multiple methods (multi-trait, Use multiple methods (multi-trait, multi-method sampling).multi-method sampling).
Determine and document reliability.Determine and document reliability.
![Page 5: How to Fail a Student Lisa M. Beardsley-Hardy, PhD, MPH, MBA Director of Education General Conference of Seventh-day Adventists.](https://reader036.fdocuments.in/reader036/viewer/2022062301/56649eb45503460f94bbca91/html5/thumbnails/5.jpg)
“Empirical rule” or 68-95-99
![Page 6: How to Fail a Student Lisa M. Beardsley-Hardy, PhD, MPH, MBA Director of Education General Conference of Seventh-day Adventists.](https://reader036.fdocuments.in/reader036/viewer/2022062301/56649eb45503460f94bbca91/html5/thumbnails/6.jpg)
![Page 7: How to Fail a Student Lisa M. Beardsley-Hardy, PhD, MPH, MBA Director of Education General Conference of Seventh-day Adventists.](https://reader036.fdocuments.in/reader036/viewer/2022062301/56649eb45503460f94bbca91/html5/thumbnails/7.jpg)
Nedelsky MethodNedelsky MethodDetermine minimally competent or Determine minimally competent or borderline borderline ““F-DF-D”” student student
Divide 1 by the number of Divide 1 by the number of answers from which the test answers from which the test taker has to guess. taker has to guess.
Sum expected scores and divide Sum expected scores and divide by number of questions on the by number of questions on the exam.exam.
![Page 8: How to Fail a Student Lisa M. Beardsley-Hardy, PhD, MPH, MBA Director of Education General Conference of Seventh-day Adventists.](https://reader036.fdocuments.in/reader036/viewer/2022062301/56649eb45503460f94bbca91/html5/thumbnails/8.jpg)
Nedelsky exampleNedelsky example My music teacher thinks that Marian My music teacher thinks that Marian
Anderson sings ________any other Anderson sings ________any other contralto he has ever heard.contralto he has ever heard.
(A)(A) more well thanmore well than
(B)(B) better thanbetter than
(C)(C) the best ofthe best of
(D)(D) more better overmore better over
Eliminate A & D, guess between B & C = Eliminate A & D, guess between B & C = ½=.50½=.50
![Page 9: How to Fail a Student Lisa M. Beardsley-Hardy, PhD, MPH, MBA Director of Education General Conference of Seventh-day Adventists.](https://reader036.fdocuments.in/reader036/viewer/2022062301/56649eb45503460f94bbca91/html5/thumbnails/9.jpg)
Modified Nedelsky MethodModified Nedelsky MethodDetermine minimally competent or Determine minimally competent or borderline borderline ““F-DF-D”” student student
Divide 2 by (2 + the number of Divide 2 by (2 + the number of answers) from which the test answers) from which the test taker has to guess. taker has to guess.
Sum expected scores and divide Sum expected scores and divide by number of questions on the by number of questions on the exam.exam.
![Page 10: How to Fail a Student Lisa M. Beardsley-Hardy, PhD, MPH, MBA Director of Education General Conference of Seventh-day Adventists.](https://reader036.fdocuments.in/reader036/viewer/2022062301/56649eb45503460f94bbca91/html5/thumbnails/10.jpg)
Modified Angoff MethodModified Angoff MethodRequires a copy of the test or at least a Requires a copy of the test or at least a wide selection of items from the test item wide selection of items from the test item pool.pool.Asks each judge to Asks each judge to ““state the probability state the probability that the that the ‘‘minimally proficient personminimally proficient person ’’ would would answer each item correctlyanswer each item correctly”” or the number of or the number of borderline students out of 100 who would be borderline students out of 100 who would be expected to get the item correct.expected to get the item correct.Multiple rounds of ratings and discussion Multiple rounds of ratings and discussion are conducted.are conducted.Probabilities are then summed and the total Probabilities are then summed and the total sum = cut score.sum = cut score.The ratings and discussion must be conducted The ratings and discussion must be conducted separately for each cut score being separately for each cut score being determined.determined.Used in NAEP, CLEP and many state programs, Used in NAEP, CLEP and many state programs, particularly on tests that are all Multiple particularly on tests that are all Multiple Choice Choice (see www.collegeboard.com)(see www.collegeboard.com)
![Page 11: How to Fail a Student Lisa M. Beardsley-Hardy, PhD, MPH, MBA Director of Education General Conference of Seventh-day Adventists.](https://reader036.fdocuments.in/reader036/viewer/2022062301/56649eb45503460f94bbca91/html5/thumbnails/11.jpg)
Konosuke MatsushitaKonosuke Matsushita
Matsushita Company (ticker MC)Matsushita Company (ticker MC)– PanasonicPanasonic
http://panasonic.net/corporate/http://panasonic.net/corporate/philosophy/code/04.htmlphilosophy/code/04.html
![Page 12: How to Fail a Student Lisa M. Beardsley-Hardy, PhD, MPH, MBA Director of Education General Conference of Seventh-day Adventists.](https://reader036.fdocuments.in/reader036/viewer/2022062301/56649eb45503460f94bbca91/html5/thumbnails/12.jpg)
![Page 13: How to Fail a Student Lisa M. Beardsley-Hardy, PhD, MPH, MBA Director of Education General Conference of Seventh-day Adventists.](https://reader036.fdocuments.in/reader036/viewer/2022062301/56649eb45503460f94bbca91/html5/thumbnails/13.jpg)
Evidence of Closing the LoopEvidence of Closing the LoopBroad discussion of outcomes dataBroad discussion of outcomes data
Discussion of implications of data and Discussion of implications of data and outline institutional learning agendaoutline institutional learning agenda
Document institutional learning in Document institutional learning in committee minutes, annual departmental committee minutes, annual departmental report, and reports to students, BT, report, and reports to students, BT, and accreditation bodiesand accreditation bodies
![Page 14: How to Fail a Student Lisa M. Beardsley-Hardy, PhD, MPH, MBA Director of Education General Conference of Seventh-day Adventists.](https://reader036.fdocuments.in/reader036/viewer/2022062301/56649eb45503460f94bbca91/html5/thumbnails/14.jpg)
DiscussionDiscussionObservationsObservations
QuestionsQuestions
RecommendationsRecommendations
Next stepsNext steps
![Page 15: How to Fail a Student Lisa M. Beardsley-Hardy, PhD, MPH, MBA Director of Education General Conference of Seventh-day Adventists.](https://reader036.fdocuments.in/reader036/viewer/2022062301/56649eb45503460f94bbca91/html5/thumbnails/15.jpg)
Faculty DevelopmentFaculty Development
Purchase or download Purchase or download A Primer A Primer on Setting Cut Scores on Tests on Setting Cut Scores on Tests of Educational Achievementof Educational Achievement from from
http://www.ets.org/Media/http://www.ets.org/Media/Research/pdf/Research/pdf/Cut_Scores_Primer.pdfCut_Scores_Primer.pdf