Curriculum Vitae Neal Martin Kingston · 2016-01-22 · Curriculum Vitae Neal Martin Kingston...
26
Neal Kingston CV 1 Curriculum Vitae Neal Martin Kingston EDUCATION Ph.D. Educational Measurement, Teachers College, Columbia University, New York, NY, 1983 M.Phil. Educational Measurement, Teachers College, Columbia University, New York, NY, 1983 M.Ed. Educational Measurement, Teachers College, Columbia University, New York, NY, 1978 M.A. Psychology in Education, Teachers College, Columbia University, New York, NY, 1977 B.A. Liberal Studies (concentrations in Biology & Education), State University of New York, Stony Brook, NY, 1974 EMPLOYMENT HISTORY 2006 – present University of Kansas, School of Education, Lawrence, Kansas Director, Achievement and Assessment Institute, 2012 – present Professor, Psychology and Research in Education, 2012 – present Program Coordinator, Research, Evaluation, Measurement, and Statistics track 2010 –2011 Director, Center for Educational Testing and Evaluation, 2009 – 2012 Interim Department Chair, Psychology and Research in Education, Fall 2009 Co‐Director, Center for Educational Testing and Evaluation 2008 – 09 Associate Department Chair, Psychology and Research in Education, 2008 – 10 Associate Professor, Psychology and Research in Education, 2006 – 2012 2004 – 2006 CTB McGraw‐Hill, Monterey, CA Vice President ‐ General Manager and Vice President of Research 1996 – 2004 Measured Progress (name changed from Advanced Systems in 1998), Dover, NH Senior Vice‐President 1997‐2004 Vice‐President 1996‐97 1996 Assessment Consultant 1993 1995 Kentucky Department of Education, Frankfort, KY Associate Commissioner, Office of Curriculum, Assessment, and Accountability 1991 1993 Assessment Consultant 1982 1991 Educational Testing Service, Princeton, NJ Executive Director, Workplace Assessment and Training, 199091 Director of Graduate Record Examinations Research and New Testing Initiatives, 198990 Director of Graduate Record Examinations Research and Test Development, 198789 Group Head, School and Higher Education Programs Statistical Analysis, 198387 Senior Measurement Statistician, School and Higher Education Programs Statistical Analysis, 198287 1981 1982 Los Angeles County Department of Personnel 1978 1981 Educational Testing Service, Princeton, NJ Associate Measurement Statistician 1974 1976 Yonkers Board of Education, Yonkers, NY Science Teacher
Transcript of Curriculum Vitae Neal Martin Kingston · 2016-01-22 · Curriculum Vitae Neal Martin Kingston...
Neal Kingston CV 1
CurriculumVitaeNealMartinKingston
EDUCATIONPh.D. EducationalMeasurement,TeachersCollege,ColumbiaUniversity,NewYork,NY,1983M.Phil. EducationalMeasurement,TeachersCollege,ColumbiaUniversity,NewYork,NY,1983M.Ed. EducationalMeasurement,TeachersCollege,ColumbiaUniversity,NewYork,NY,1978M.A. PsychologyinEducation,TeachersCollege,ColumbiaUniversity,NewYork,NY,1977B.A. LiberalStudies(concentrationsinBiology&Education),StateUniversityofNewYork,
StonyBrook,NY,1974EMPLOYMENTHISTORY2006–presentUniversityofKansas,SchoolofEducation,Lawrence,Kansas Director,AchievementandAssessmentInstitute,2012–present Professor,PsychologyandResearchinEducation,2012–present ProgramCoordinator,Research,Evaluation,Measurement,andStatisticstrack
2010–2011 Director,CenterforEducationalTestingandEvaluation,2009–2012 InterimDepartmentChair,PsychologyandResearchinEducation,Fall2009 Co‐Director,CenterforEducationalTestingandEvaluation2008–09 AssociateDepartmentChair,PsychologyandResearchinEducation,2008–10 AssociateProfessor,PsychologyandResearchinEducation,2006–20122004–2006 CTBMcGraw‐Hill,Monterey,CA VicePresident‐GeneralManagerandVicePresidentofResearch1996–2004 MeasuredProgress(namechangedfromAdvancedSystemsin1998),Dover,NH SeniorVice‐President1997‐2004 Vice‐President1996‐971996 AssessmentConsultant19931995 KentuckyDepartmentofEducation,Frankfort,KY AssociateCommissioner,OfficeofCurriculum,Assessment,andAccountability19911993 AssessmentConsultant19821991 EducationalTestingService,Princeton,NJ ExecutiveDirector,WorkplaceAssessmentandTraining,199091 DirectorofGraduateRecordExaminationsResearchandNewTestingInitiatives,
198990 DirectorofGraduateRecordExaminationsResearchandTestDevelopment,
198789 GroupHead,SchoolandHigherEducationProgramsStatisticalAnalysis,198387 SeniorMeasurementStatistician,SchoolandHigherEducationPrograms
StatisticalAnalysis,19828719811982 LosAngelesCountyDepartmentofPersonnel19781981 EducationalTestingService,Princeton,NJ AssociateMeasurementStatistician19741976 YonkersBoardofEducation,Yonkers,NY ScienceTeacher
Neal Kingston CV 2
HONORS2015 NationalAssociationofAssessmentDirectorsAwardforOutstandingContributions
toEducationalAssessmentKUTEACHINGRECORD
A. ListofCoursesTaught(REMS=Research,Evaluation,Measurement,andStatistics)
CourseNumber&Title Sem/Year #Enrolled PRE812,Meta‐analysis Spring2016 15PRE980,AdvancedTopicsinREMS Fall2015 5PRE812,Meta‐analysis Spring2015 27PRE980,AdvancedTopicsinREMS Fall2014 10PRE515,UnderstandingResearch(McNairScholars) Spring2014 19PRE715,EducationalMeasurement Fall2013 28PRE515,UnderstandingResearch(McNairScholars) Spring2013 15PRE715,EducationalMeasurement Fall2012 34PRE812,Meta‐analysis Spring2012 11PRE980,AdvancedTopicsinREMS Spring2012 1PRE725,EducationalMeasurement Fall2011 34PRE980,AdvancedTopicsinREMS Fall2011 5PRE931,SeminarinComputer‐BasedTesting Spring2011 14PRE980,AdvancedTopicsinREMS Spring2011 7PRE725,EducationalMeasurement Fall2010 58PRE980,AdvancedTopicsinREMS Fall2010 11PRE812,Meta‐analysis Spring2010 9PRE725,EducationalMeasurement Fall2009 54PRE598,UnderstandingResearch(McNairScholars) Spring2009 12PRE725,EducationalMeasurement Fall2008 64PRE598,UnderstandingResearch(McNairScholars) Spring2008 19PRE812,Meta‐analysis Spring2008 20PRE725,EducationalMeasurement Fall2007 40PRE918,CurrentIssuesandTrends Fall2007 2PRE725,EducationalMeasurement Spring2007 25PRE998,SeminarinComputerBasedTesting Spring2007 5PRE725,EducationalMeasurement Fall2006 39
B. UndergraduateAdvisingRecord:NotApplicable
C. GraduateandPostgraduateAdvisingRecord
CommitteeChair:Doctoral.(Ph.D.dateisdateoffinaldefense)
Pan,Qianqian,(Research,Evaluation,Measurement,&Statistics),Fall2014‐presentThompson,WilliamJake,(Research,Evaluation,Measurement,&Statistics),Fall2014‐
presentLao,Hongling,(Research,Evaluation,Measurement,&Statistics),Spring2013‐presentScheuring,Sylvia;(Research,Evaluation,Measurement,&Statistics)2009‐present
Neal Kingston CV 3
Tiemann,Gail;(Research,Evaluation,Measurement,&Statistics)Ph.D.May2015.AnInvestigationofAnswerChangingonaLarge‐scaleComputer‐basedEducationalAssessment
Loughran,Jessica,(Research,Evaluation,Measurement,&Statistics),Ph.D.December2014.DifferentialItemFunctioningforEnglishLanguageLearnersonMathItems:TheInfluenceofLinguisticComplexityFeatures.
Atalmis,Erkan;(Research,Evaluation,Measurement,&Statistics)Ph.D.May2014.TheImpactofNumberofOptionsofMultiple‐ChoiceQuestionsonItemandTestQuality.
Clark,Amy,(Research,Evaluation,Measurement,&Statistics),Ph.D.August2013.Validationofacognitivediagnosticmodelacrossmultipleformsofareadingcomprehensionassessment.
Zhao,Fei;(Research,Evaluation,Measurement,&Statistics)Ph.D.July2013.UsingNoncompensatoryModelsinCognitiveDiagnosticMathematicsAssessments:AnEvaluationBasedonEmpiricalData
Gu,Fei;(Research,Evaluation,Measurement,&Statistics)Ph.D.May2013.UsingParametricandResidual‐basedBootstraptoAssesstheAbsoluteGoodness‐of‐fitforStateSpaceModel
Zheng,Chunmei;(Research,Evaluation,Measurement,&Statistics)Ph.D.April2013.ExaminationofParameterEstimatesWhenViolatingtheOrthogonalityAssumptionoftheBifactorItemResponseModel.
Chen,Jie;(Research,Evaluation,Measurement,&Statistics)Ph.D.August2012.ImpactofInstructionalSensitivityonHigh‐StakesAchievementTestItems:AComparisonofMethods.
Wang,Wenhao;(Research,Evaluation,Measurement,&Statistics)Ph.D.May2012.AreAllItemResponseFunctionsMonotonicallyIncreasing?
CommitteeChair:Masters.
Clark,Amy;(Research,Evaluation,Measurement,&Statistics)2010‐2011Gu,Fei;(Research,Evaluation,Measurement,&Statistics)2006‐2009
Othergraduatecommitteeservice: Doctoral
Alsheri,Khalid;(EducationalTechnology)2009‐2013Bastion,Susan;(Research,Evaluation,Measurement,&Statistics),2008‐presentCarvajal,Jorge;(Research,Evaluation,Measurement,&Statistics)2007‐2010Cho,Hyun‐jeong;(SpecialEducation)2008‐2009Howarter,Stephani,(Research,Evaluation,Measurement,&Statistics)2012‐2015Kim,MinJung;(Research,Evaluation,Measurement,&Statistics)2010‐2015Kim,Sooji;(MusicTherapy)2007‐2008Lee,JaeHoon;(QuantitativePsychology)2007‐2009Mark,Carolyn;(SpecialEducation)2010‐2011Meiers,Christopher;(Research,Evaluation,Measurement,&Statistics),2009‐presentMerrilat,Linda;(EducationalTechnology)2007‐2008Montgomery,Melinda;(Research,Evaluation,Measurement,&Statistics),2011‐2014Moshirnia,Andrew;(EducationalTechnology)2007‐2008Nash,Brook;(Research,Evaluation,Measurement,&Statistics),2010‐2012O’Brian,Joseph;(Research,Evaluation,Measurement,&Statistics),2014‐presentSalawani,Gita;(QuantitativePsychology)2008
Neal Kingston CV 4
Selig,James;(QuantitativePsychology)2009(honors)Stevens,Sheridan;(SpecialEducation)2006Suh,Hong;(Research,Evaluation,Measurement,&Statistics)2007‐2010Theoharris,Rachelle;(SpecialEducation)2007‐2009Wolkowitz,Amanda;(Research,Evaluation,Measurement,&Statistics)2007‐2008(2008
winnerofSOEbestdissertation)
Master’sFolger,Allison;(Research,Evaluation,Measurement,&Statistics)2010‐11Hinojos,Belinda;(CounselingPsychology)2006Moeder,Michelle;(CounselingPsychology)2007‐08Nash,Brooke;(Research,Evaluation,Measurement,&Statistics)2007Wu,YelinaPing;(ClinicalChildPsychology)2006‐07
PostdoctoralFellows:
Cho,Hyun‐jeong,2009‐2011D. HonorsandAwardsforTeaching
None
KUPROFESSIONALPERFORMANCERECORD
A. JobResponsibilities ProgramCoordinator,Research,Evaluation,Measurement,andStatisticstrack2010‐2011 Director,CenterforEducationalTestingandEvaluation,2009‐2012 InterimDepartmentChair,PsychologyandResearchinEducation,Fall2009 Co‐Director,CenterforEducationalTestingandEvaluation,2008‐09 AssociateDepartmentChair,PsychologyandResearchinEducation,2008‐10 AssociateProfessor,PrograminResearch,Evaluation,Measurement,andStatistics2006–
present
B. HonorsandAwardsforProfessionalPerformanceMember,PhiBetaDelta,AlphaPiChapter,UniversityofKansas,2010‐present
RESEARCHRECORD(*indicatesco‐authorwasanadviseeatthetimetheworkwasprepared)
A. ResearchPublicationsand/orCreativeWorks
Books1. Kingston,N.M.&Clark,A.K.(2014).TestFraud:StatisticalDetectionand
Methodology.NewYork:Routledge.MajorPublications(*indicatesstudentwithwhomIhavecollaborated)2. Kingston,N.M.,Karvonen,M.,Bechard,S.,&Erickson,K.(inpress).The
PhilosophicalUnderpinningsandKeyFeaturesoftheDynamicPeerreviewed
Neal Kingston CV 5
LearningMapsAlternateAssessment.NationalSocietyfortheStudyofEducationYearbook.
3. Kingston,N.M.,Broaddus,A.,&*Lao,H.(2015).Some Thoughts on “Using Learning Progressions to Design Vertical Scales that Support Coherent Inferences about Student Growth.” Measurement:InterdisciplinaryResearch&Perspectives,13(3‐4),195‐199.
4. Cho,H.J.,&Kingston,N.(2015).Examiningteachers’decisionsontest‐typeassignmentforstatewideassessments.TheJournalofSpecialEducation,49(1),16‐27.(PublishedonlineSeptember2013).
5. Popham,W.J.,Berliner,D.C.,Kingston,N.,Fuhrman,S.H.,Ladd,S.M.,Charbonneau,J.&Chatterji,M.(2014).Cantoday'sstandardizedtestsyieldinstructionallyusefuldata?Challenges,promisesandthestateoftheart,QualityAssuranceinEducation,22(4),300‐316.
6. Adjei,S.,Selent,D.,Heffernan,N.,Pardos,Z.,Broaddus,A.,Kingston,N.(2014)RefiningLearningMapswithDataFittingTechniques:SearchingforBetterFittingLearningMaps.InPardos&Stamper(Eds.)The2014ProceedingsofInternationalEducationalDataMiningSociety.
7. Cho,H.&Kingston,N.M.(2014).UnderstandingTestTypeAssignment:WhyDoSpecialEducatorsMakeUnexpectedTestTypeAssignments?PsychologyintheSchools.
8. Kingston,N.M.&Clark,A.K.(2014).IntroductioninNealM.KingstonandAmyK.Clark(Eds.)TestFraud:StatisticalDetectionandMethodology.NewYork:Routledge.
9. Clark,A.K.&Kingston,N.M.(2014).ABriefHistoryofResearchonTestFraudDetectionandPreventioninNealM.KingstonandAmyK.Clark(Eds.)TestFraud:StatisticalDetectionandMethodology.NewYork:Routledge.
10. *Tiemann,G.C.&Kingston,N.M.(2014).AnExplorationofAnswerChangingBehavioronaComputer‐BasedHigh‐StakesAchievementTestinNealM.KingstonandAmyK.Clark(Eds.)TestFraud:StatisticalDetectionandMethodology.NewYork:Routledge.
11. Ginsberg,R.&Kingston,N.M.(2014).CaughtinaVise:TheChallengesFacingTeacherPreparationinanEraofAccountability.TeachersCollegeRecordVolume116(1),2014,p.‐http://www.tcrecord.orgIDNumber:17295,DateAccessed:1/14/20149:30:47PM
12. Kingston,N.M.,*Tiemann,G.C.,&*Loughran,J.T.(2013).Commentaryon“ConstructMapsasaFoundationforStandardSetting.”Measurement:InterdisciplinaryResearch&Perspectives,11,181‐184.
13. Cho,H.&Kingston,N.M.(2013).WhyIEPTeamsAssignLowPerformersWithMildDisabilitiestotheAlternateAssessmentBasedonAlternateAchievementStandards.JournalofSpecialEducation,47,162‐174.
14. Cho,H.,Wehmeyer,M.&Kingston,N.M.(2013).FactorsthatPredictElementaryEducators’PerceptionsandPracticeinTeachingSelf‐Determination.PsychologyintheSchools,50:770‐780.
15. Kingston,N.M.&*Anderson,G.(2013)TheEfficacyofUsingStateStandards‐BasedAssessmentsforPredictingStudentSuccessin
InvitedPeerreviewedPeerReviewedPeerreviewedPeerReviewedInvitedInvitedInvitedPeerReviewedInvitedPeerReviewedPeerReviewedPeerReviewed
Neal Kingston CV 6
CommunityCollegeClasses.EducationalMeasurement:IssuesandPractice32(3):3‐10.
16. Kingston,N.M.(2013).EducationalTestingCaseStudies.InJamesWollackandJohnFremer(Eds.),HandbookofTestSecurity.NewYork:Routledge.
17. Kingston,N.M.,*Scheuring,S.T.,&Kramer,L.B.(2013).TestDevelopmentStrategies.InKurtGeisinger(Ed.)APAHandbookofTestingandAssessmentinPsychology.Washington,DC:APABooks.
18. Kingston,N.M.&Kramer,L.B.(2013).HighStakesTestConstructionandTestUse.InT.Little(Ed.)OxfordHandbookofQuantitativeMethods.OxfordUniversityPress.
19. *Gu,F.,Little,T.,&Kingston,N.M.(2013)MisestimationofReliabilityUsingCoefficientAlphaandStructuralEquationModelingwhenAssumptionsofTau‐EquivalenceandUncorrelatedErrorsareViolated.Methodology,9,30‐40.(PublishedonlineFebruary2012).
20. *Zheng,C.,Erickson,A.G.,Kingston,N.M.&Noonan,P.(2012).TheRelationshipamongSelf‐Determination,Self‐Concept,andAcademicAchievementforStudentswithLearningDisabilities.JournalofLearningDisabilities,46(2),1‐13.
21. Kingston,N.M.&Nash,B.(2012).HowManyFormativeAssessmentAngelscanDanceontheHeadofaMeta‐AnalyticPin:.2.EducationalMeasurement:IssuesandPractice,31(4):18–19.
22. Cho,H.J.,Lee,J,andKingston,N.M.(2012).ExaminingtheEffectivenessofTestAccommodationUsingDIFandaMixtureIRTModel.AppliedMeasurementinEducation,25(4):281‐304.
23. Cho,H.J.&Kingston,N.M.(2012).WhyIndividualizedEducationProgramTeamsAssignLow‐PerformingStudentswithMildDisabilitiestotheAlternateAssessmentAlternateAchievementStandards.JournalofSpecialEducation.(PublishedonlineFebruary15,2012).
24. Kingston,N.M.,*Tiemann,G.C.,Miller,H.L.,&Foster,D.(2012).AnAnalysisoftheDiscrete‐OptionMultipleChoiceItemType.PsychologicalTestandAssessmentModeling,54,3‐20.
25. Cho,H.,Wehmeyer,M.,&Kingston,N.M.(2012)TheImpactofSocialandClassroomEcologicalFactorsonPromotingSelf‐DeterminationinElementarySchool.PreventingSchoolFailure,56,19‐28.(PublishedonlineDecember15,2011).
26. Kingston,N.M.&*Tiemann,G.C.(2011)SettingPerformanceStandardsonComplexAssessments:TheBodyofWorkMethod.InG.J.Cizek(Ed.)Settingperformancestandards:Concepts,methods,andperspectives,SecondEdition.Mahwah,NJ:LawrenceErlbaum.
27. Kingston,N.M.&*Nash,B.(2011).FormativeAssessment:AMeta‐AnalysisandaCallforResearch.EducationalMeasurement:IssuesandPractice,30:4,28–37.
28. *Gu,F.,Skorupski,W.,Hoyle,L.,&Kingston,N.M.(2011).StandardErrorsandConfidenceIntervalsfromBootstrappingforItemParametersintheTwo‐andThree‐ParameterLogisticRamseyCurve‐IRTModels.AppliedPsychologicalMeasurement,35:568–571.
PeerReviewedPeerReviewedPeerReviewedPeerReviewedPeerReviewedPeerReviewedPeerreviewedPeerreviewedPeerreviewedPeerreviewedPeerreviewedPeerreviewedPeerreviewed
Neal Kingston CV 7
29. Cho,H.&Kingston,N.M.(2011).CapturingImplicitPolicyfromNCLBTestTypeAssignments:AnalysisofCharacteristicsandPerformanceofStudentsTakingAlternateAssessmentsBasedonModifiedAchievementStandards.ExceptionalChildren78:58‐72.
30. Cho,H.,Wehmeyer,M.&Kingston,N.M.(2011).ElementaryTeachers’KnowledgeandUseofInterventionsandBarrierstoPromotingStudentSelf‐Determination.JournalofSpecialEducation,45:149‐156.(Publishedonline2010)
31. Bechard,S.,Sheinker,J.,Abell,R.,Barton,K.,Burling,K.,Camacho,C.,Cameto,R.,Haertel,G.,Hansen,E.,Johnstone,C.,Kingston,N.,Murray,E.,Parker,C.,Redfield,D.,Rodriquez,J.,andTucker,B.(2010).MeasuringCognitionofStudentswithDisabilitiesUsingTechnology‐EnabledAssessments:RecommendationsforaNationalResearchAgenda.TheJournalofTechnology,Learning,andAssessment,Vol.10,No.4.
32. Kingston,N.M.(2009).Comparabilityofcomputer‐andpaper‐administeredmultiple‐choicetestsforK‐12populations:asynthesis.AppliedMeasurementinEducation22:22‐37.
33. Kingston,N.M.(2007).Futurechallengestopsychometrics:Validity,Validity,Validity.InC.R.RaoandS.Sinharay(Ed.)HandbookofStatistics,26:Psychometrics.Amsterdam,TheNetherlands:Elsevier.
34. Kingston,N.M.andEhringhaus,M.(2005).Useoftechnologyandprinciplesofuniversaldesigntoimprovethevalidityandfairnessoflicensuretests.InJ.LMountyandD.S.Martin(Ed.)AssessingDeafAdults.Washington,DC:GallaudetUniversityPress.
35. Kingston,N.M.,Kahl,S.R.,Sweeney,K.P.,andBay,L.(2001).Settingperformancestandardsusingthebodyofworkmethod.InG.J.Cizek(Ed.)Settingperformancestandards:Concepts,methods,andperspectives.Mahwah,NJ:LawrenceErlbaum,Publishers.
36. Kingston,N.M.andReidy,E.(1997).Kentucky’saccountabilityandassessmentsystems.InJ.Millman(Ed.).Gradingteachers,gradingschools:Isstudentachievementavalidevaluationmeasure?ThousandOaks,CA:CorwinPublishers.
37. Kingston,N.M.andReidy,E.(1997).KIRISmeetsthecritics:Alittlelightandmuchheat.InJ.Millman(Ed.).Gradingteachers,gradingschools:Isstudentachievementavalidevaluationmeasure?ThousandOaks,CA:CorwinPublishers.
38. Kingston,N.M.(1993).Standardsettingincompensatoryversusnon‐compensatorylicensuretestingprograms.CLEARExamReview4:24‐27.
39. Kingston,N.M.andDorans,N.J.(1985).Theanalysisofitem‐abilityregressions:AnexploratoryIRTmodelfittool.AppliedPsychologicalMeasurement9:281‐288.
40. Dorans,N.J.andKingston,N.M.(1985).Theeffectsofviolationsofuni‐dimensionalityontheestimationofitemandabilityparametersandonitemresponsetheoryequatingoftheGREverbalscale.JournalofEducationalMeasurement22:249‐262.
PeerreviewedPeerreviewedPeerreviewedPeerreviewedPeerReviewedInvitedPeerreviewedInvitedPeerreviewedPeerreviewedPeerreviewedPeerreviewed
Neal Kingston CV 8
41. Kingston,N.M.andDorans,N.J.(1984).ItemlocationeffectsandtheirimplicationsforIRTequatingandadaptivetesting.AppliedPsychologicalMeasurement8:147‐154.
Peerreviewed
UnderSubmission42. Atalmis,E.&Kingston,N.M.(submitted).Three,Four,andNoneoftheAboveOptions
inMultiple‐ChoiceTest.AppliedMeasurementinEducation.43. Atalmis,E.&Kingston,N.M.(submitted).The Impact of Homogeneity of Answer
Choices on Item Difficulty and Discrimination.AppliedMeasurementinEducation.44. Cho,H.J.,Im,S.K.,Deci,E.L.,Kingston,N.M.,&Lee,J.H.(submitted).Motivational
regulationprofilefromSelf‐DeterminationTheory:Theprominenceofqualityofmotivation.JournalofEducationalPsychology.
45. Cho,H.J.,Im,S.K.,Deci,E.L.,Kingston,N.M.,&Lee,J.H.(submitted).BeyondGoalAchievementOrientationTheory:Anotherlookatthequalityofacademicmotivation.JournalofPersonalityandSocialPsychology.
46. Cho,H.J.,Im,S.K.,Deci,E.L.,Kingston,N.M.,&Lee,J.H.(submitted).TheimpactofsocialcontextualfactorsthatpredictKoreanstudents’senseofautonomyself‐regulationandacademicperformance.JournalofPersonalityandSocialPsychology.
47. Kingston,N.M.,Frank,E.&Perkins,K.(submitted).Relationship between Instructional Sensitivity and the Item Characteristics of a Kinesiology Test. Applied Measurement in Education.
Minorworks*indicatesstudentwithwhomIhavecollaborated48. Kingston,N.(2016).ShiftingtheParadigmofLarge‐ScaleAchievement
Assessment.InRice,M.andHaaheim,E.,eds.,MerrillAdvancedStudiesCenterWhitePaperNo.119:ResearchInnovationasaPathwaytotheFuture(page#s).Lawrence,KS:UniversityofKansasMerrillAdvancedStudiesCenter.
49. Kingston,N.M.(2014).Thevalueofstandardsetting:Apersonalmeandering.NCMENewsletter22(4):7.
50. Almond,P.,Kingston,N.,Michaels,H.,Roeber,E.,Warren,S.,Winter,P.,&Mark,C.(2012).Technicalconsiderationsfordevelopingassessmentsthatincludespecialpopulationsandarebasedonorganizedlearningmodels.MenloPark,CA:SRIInternationalandLawrence,KS:CenterforEducationalTestingandEvaluation.
51. Kingston,N.M.(2012).It’s1938:AlookbackatthefirstyearofNCME.NCMENewsletter20(3):2‐3.
52. Kingston,N.,Chin,T.,Geisinger,K.,andMcKinley,R.(2010).FinalReport,ThirdPartyEquatingVerificationoftheNYSGrades3‐8ELAandMathematicsTests,BurosInstituteforAssessmentConsultationandOutreach.
53. Bechard,S.,Sheinker,J.,Abell,R.,Barton,K.,Blackorby,J.,Burling,K.,Camacho,C.,Cameto,R.,Haertel,G.,Hansen,E.,Johnstone,C.,Kingston,N.,Murray,E.,Parker,C.,Redfield,D.,Rodriquez,J.,andTucker,B.(2010).MeasuringCognitionofStudentswithDisabilitiesUsingTechnology‐EnabledAssessments:RecommendationsforaResearch
InvitedInvitedInvitedInvitedInvitedInvited
Neal Kingston CV 9
Agenda.Dover,NH:MeasuredProgress,andMenloPark,CA:SRIInternational.
54. Irwin,P.M.,Kingston,N.M.,Skorupski,W.P.,Glasnapp,D.R.,&Poggio,J.P.(2009).TechnicalManualfortheKansasAssessmentsinScience.
55. Peyton,V.,Kingston,N.M.,Skorupski,W.,Glasnapp,D.R.,andPoggio,J.P.(2009).KansasEnglishLanguageProficiencyAssessment(KELPA)TechnicalManual.
56. Irwin,P.M.,Kingston,N.M.,Glasnapp,D.R.,&Poggio,J.P.(2008).TechnicalManualfortheKansasAssessmentsofModifiedMeasures(KAMM)andKansasAlternateAssessments(KAA)inScience.
57. *Tiemann,G.C.andKingston,N.M.(2010).Non‐Directionalhypothesistesting.InN.Salkind(Ed.)EncyclopediaofResearchDesign.ThousandOaks,CA:SagePublishing.
58. Kingston,N.M.(2010).SequentialTestsofStatisticalHypotheses(Wald)[TheAnnalsofMathematicalStatistics,16,2,117].InN.Salkind(Ed.)EncyclopediaofResearchDesign.ThousandOaks,CA:SagePublishing.
59. Kingston,N.M.(2010).Computerizedadaptivetesting.InN.Salkind(Ed.)EncyclopediaofResearchDesign.ThousandOaks,CA:SagePublishing.
60. Kingston,N.M.and*Tiemann,G.C.(2010).SpearmanBrownprophecyformula.InN.Salkind(Ed.)EncyclopediaofResearchDesign.ThousandOaks,CA:SagePublishing.
61. *Chen,J.,Kingston,N.M.,*Tiemann,G.&*Gu,F.(2010).Hypothesis.InN.Salkind(Ed.)EncyclopediaofResearchDesign.ThousandOaks,CA:SagePublishing.
62. *Gu,F.andKingston,N.M.(2010).Scatterplot.InN.Salkind(Ed.)EncyclopediaofResearchDesign.ThousandOaks,CA:SagePublishing.
63. Kingston,N.M.(2009).SAT.InB.Kerr(Ed.)EncyclopediaofGiftedness,Creativity,andTalent.ThousandOaks,CA:SagePublishing.
64. Kingston,N.M.(2009).ACTCollegeAdmissionsTest.InB.Kerr(Ed.)EncyclopediaofGiftedness,Creativity,andTalent.ThousandOaks,CA:SagePublishing.
65. Kingston,N.M.(2009).Self‐reportinstruments.InS.Lopez(Ed.)EncyclopediaofPositivePsychology.Malden,MA:BlackwellPublishing.
66. Kingston,N.M.(2008).Standardizedtests.InN.Salkind(Ed.)EncyclopediaofEducationalPsychology.ThousandOaks,CA:SagePublishing.
67. Kingston,N.M.(2008).Norm‐Referencedtests.InN.Salkind(Ed.)EncyclopediaofEducationalPsychology.ThousandOaks,CA:SagePublishing.
68. Dings,J.,Childs,R.,andKingston,N.M.(2002).Effectsofmatrixsamplingonstudentscorecomparabilityinconstructedresponseandmultiple‐choiceassessments.Washington,DC:CouncilofChiefStateSchoolOfficers.
InvitedInvitedInvitedInvitedInvitedInvitedInvitedInvitedInvitedInvitedInvitedInvitedInvitedInvitedPeerreviewedPeerreviewed
Neal Kingston CV 10
69. Dings,J.,Gong,B.,&Kingston,N.(1995)KIRISAccountabilityCycleITechnicalManual.Frankfort,KY:KentuckyStateDepartmentofEducation.
70. Kingston,N.M.,Leary,L.,andWightman,L.(1988).AnexploratorystudyoftheapplicabilityofitemresponsetheorymethodstotheGraduateManagementAdmissionsTest.LosAngeles:GraduateManagementAdmissionsCouncil.
71. Schaeffer,G.A.andKingston,N.M.(1988).StrengthoftheanalyticalfactoroftheGREGeneralTestinseveralsubgroups:afull‐informationfactoranalysisapproach.RR88‐5.Princeton,N.J.:EducationalTestingService.
72. McKinley,R.L.andKingston,N.M.(1987).ExploringtheuseofIRTequatingfortheGRESubjectTestinMathematics.RR87‐21.Princeton,N.J.:EducationalTestingService.
73. Kingston,N.M.(1986).AssessingthedimensionalityoftheGMATVerbalandQuantitativeMeasuresusingfull‐informationfactoranalysis.RR86‐13.Princeton,N.J.:EducationalTestingService.
74. Kingston,N.M.andHolland,P.W.(1986).AlternativemethodsofequatingtheGREGeneralTest.GREBoardProfessionalReport81‐16P.Princeton,N.J.:EducationalTestingService.
75. Kingston,N.M.,Leary,L.F.,andWightman,L.E.(1985).AnexploratorystudyoftheapplicabilityofitemresponsetheorymethodstotheGraduateManagementAdmissionTest.RR85‐34.Princeton,N.J.:EducationalTestingService.
76. Kingston,N.M.andTurner,N.J.(1984).AnalysisofscorechangepatternsofexamineesrepeatingtheGraduateRecordExaminationsGeneralTest.GREBoardProfessionalReport83‐5P.Princeton,N.J.:EducationalTestingService.
77. Kingston,N.M.(1984).ReanalysisofthepsychometriccharacteristicsoftheGREGeneralTest.Unpublishedmanuscript.Princeton,N.J.:EducationalTestingService.
78. Kingston,N.M.(1983).Choosingaprocedureforselectingasubsetofvariablesthatmaximizescriterion‐relatedcross‐validity.Unpublisheddoctoraldissertation.
79. Kingston,N.M.andDorans,N.J.(1982).ThefeasibilityofusingitemresponsetheoryasapsychometricmodelfortheGREAptitudeTest.GREBoardProfessionalReport79‐12P.Princeton,N.J.:EducationalTestingService.
80. Kingston,N.M.andDorans,N.J.(1982).Theeffectofthepositionofanitemwithinatestonitemrespondingbehavior:ananalysisbasedonitemresponsetheory.GREBoardProfessionalReport79‐12bP.Princeton,N.J.:EducationalTestingService.
81. Kingston,N.M.andLivingston,S.A.(1981).EffectivenessoftheGraduateRecordExaminationsforpredictingfirstyeargrades:1979‐80summaryreportoftheGraduateRecordExaminationsValidityStudyService.Princeton,N.J.:EducationalTestingService.
PeerreviewedPeerreviewedPeerreviewedPeerreviewedPeerreviewedPeerreviewedPeerreviewedPeerreviewedPeerreviewedPeerreviewedPeerreviewedPeerreviewed
Neal Kingston CV 11
B. ScholarlyPresentations
MajorPresentations*indicatesstudentwithwhomIhavecollaborated82. Kingston,N.M.(October2015)StayFound:HowMapscanImproveOutcomesin
Education.PresentationatKUElevate,OverlandPark,KS.83. Kingston,N.M.,Broaddus,A.,&Gaylor,C.(August2015).Shifting the Paradigm of
Achievement Assessment or Help!; I’m Lost; Does Anyone Have a Map? Paper presented at the 2015 CRESST Conference, Redondo Beach, CA.
84. Clark,A.,Karvonen,M.,Kingston,N.M.,&*Anderson,G.(April2015).Designing Alternate Assessment Score Reports that Maximize Instructional Impact.PaperpresentedattheannualmeetingoftheNationalCouncilforMeasurementinEducation,Chicago,IL.
85. Kingston,N.M.(April2015).StandardSettingandGrowthMeasurementinaLearningMapsEnvironment.Presentedaspartofthesymposium,PsychometricsinaLearningMapsEnvironment,attheannualmeetingoftheNationalCouncilforMeasurementinEducation,Chicago,IL.
86. Popham,J.,Kingston,N.M.,Fremer,J.,&Way.D.(April2015).Theimportanceofinstructionalsensitivity:AcolloquyAmongCombatants.DebateattheannualmeetingoftheNationalCouncilforMeasurementinEducation,Chicago,IL.
87. *Loughran,J.&Kingston,N.M.(April2015).DIFDetectionandPredictionwithDifferentFocalGroupDesignations.PaperpresentedattheannualmeetingoftheNationalCouncilforMeasurementinEducation,Chicago,IL.
88. Wells‐Moreaux,S.,Karvonen,M.,&Kingston,N.M.(April2015).AccessibilitybyDesign:ImprovingAlternateAssessmentsforStudentswithSignificantCognitiveDisabilities.PaperpresentedattheannualmeetingoftheCouncilforExceptionalChildren,SanDiego,CA.
89. Kingston,N.M.&Broaddus,A.(March2015).LearningMapsastheBasisforEducationalAssessment.PaperpresentedattheannualmeetingoftheAssociationofTestPublishers,RanchoMirage,CA.
90. Kingston,N.M.(March2015).SecurityattheForefront.InvitedSpeakerattheannualmeetingoftheAssociationofTestPublishers,RanchoMirage,CA.
91. Kingston,N.M.(January2015).TheDynamicLearningMapsAlternateAssessmentSystem.PaperpresentedattheannualmeetingoftheNationalAssociationofPrivateSpecialEducationCenters,NewOrleans,LA.
92. *Tiemann,G.C.,Miller,H.,Kingston,N.M.,&Foster,D.(October2014).ProtectingItemContentviatheDiscrete‐OptionMultiple‐ChoiceItemType.PaperpresentedattheannualmeetingoftheConferenceonTestSecurity,IowaCity,IA.
93. Kingston,N.M;Clark,A.K.,Pardos,Z;Lee,S.Y.(April2014).Determiningareasonablestartingplaceforaninstructionallyembeddeddynamicassessment:HeuristicversusBayesianNetworkAnalysis.PaperpresentedattheannualmeetingoftheAmericanEducationalResearchAssociation,Philadelphia,PA.
94. Clark,A.K.&Kingston,N.M.(April2014).Comparisonofattributecodingproceduresforretrofittingcognitivediagnosticmodels.PosterpresentedattheannualmeetingoftheAmericanEducationalResearchAssociation,Philadelphia,PA.
95. Zhao,F.&Kingston,N.M.(April2014).CognitiveDiagnosticModelComparisonsUsingEmpiricalData.PaperpresentedattheannualmeetingoftheNationalCouncilforMeasurementinEducation,Philadelphia,PA.
Neal Kingston CV 12
96. Wang,W.&Kingston,N.M.,MichaelF.Hock;GailC.Tiemann;MarciaH.Davis;StephenM.Tonks(April2014).ApplicationoftheHierarchicalItemResponseModeltoaComputerAdaptiveTestofGradedResponseData.PaperpresentedattheannualmeetingoftheAmericanEducationalResearchAssociation,Philadelphia,PA.
97. Chen,J.,Kingston,N.,Wang,X.,Richards,C.,&Meisner,R.(April,2014).Featuresofessayresponsesassociatedwiththeaccuracyofhumanscoring.Paperpresentedatthe76thAnnualMeetingofNationalCouncilonMeasurementinEducation,Philadelphia,PA.
98. Chen,J.&Kingston,N.M.(November2013).AComparisonofEmpiricalandJudgmentalApproachesforDetectingInstructionallySensitiveItems.PaperpresentedattheConferenceonInstructionalSensitivity,Lawrence,KS.
99. Longabach,T.,Chen,J.&Kingston,N.M.(November2013).Relationshipbetweentestitemcognitivecomplexity,content,andinstructionalsensitivity.PaperpresentedattheConferenceonInstructionalSensitivity,Lawrence,KS.
100. Kingston,N.M.(October2013).DevelopmentofanAssessmentforStudentswithSignificantCognitiveDisabilitiesBasedonaVeryLarge,FineGrainedLearningMap.Paperpresentedatthe2013meetingoftheInternationalAssociationforEducationalAssessment,TelAviv,Israel.
101. *Tiemann,G.C.&Kingston,N.M.(2013).Answerchangingandresponsetimeoncomputer‐basedhighstakesachievementtests.Posterpresentedatthe2013ConferenceontheStatisticalDetectionofPotentialTestFraud,Madison,WI.
102. Kingston,N.M.&Nitsch,C.(2013)Howintheworldcananalternateassessmentmeettheneedsofstudentsandparents?Invitedpresentationatthe2013ArcNationalConvention,Seattle,WA.
103. Kingston,N.M.(2013).LearningModelsandLearningAnalytics.Presentedaspartofthesymposium,“It’snotjustforonlineshopping:Usinganalyticsforimprovedlearningandachievement.Invitedpresentationatthe2013OSEPProjectDirectorsMeeting.
104. Davis,M.H.,Tonks,S.M.,Hock,M.F.,Kingston,N.M.,*Tiemann,G.C.&Wang,W.MeasurementofAdolescentReadingMotivation.Posterpresentedatthe2013meetingoftheAmericanEducationalResearchAssociation,SanFrancisco,CA.
105. Davis,M.H.,Tonks,S.M.,Hock,M.F.,Kingston,N.M.,*Tiemann,G.C.&Wang,W.MeasuringSocialReadingMotivationinAdolescents.(2013).Paperpresentedatthe2013meetingoftheAmericanEducationalResearchAssociation,SanFrancisco,CA.
106. Kingston,N.M.(2013).TheAlternateAssessmentConsortiaforStudentswithSignificantCognitiveDisabilities:ProgresstoDate‐PART2.Paperpresentedatthe2013meetingoftheCouncilforExceptionalChildren,SanAntonio,TX.
107. *Wang,W.andKingston,N.M.(2012).Areallitemresponsefunctionsmonotonicallyincreasing?Posterpresentedatthe2012meetingoftheAmericanPsychologicalAssociation,Orlando,FL.
108. Kingston,N.M.and*Tiemann,G.C.(2012).AnExplorationofAnswer‐ChangingonaComputer‐basedHigh‐StakesAchievementTest:ItemView.PaperpresentedattheJointStatisticalMeeting,SanDiego,CA.
109. *Tiemann,G.C.andKingston,N.M.(2012).AnExplorationofAnswer‐ChangingonaComputer‐basedHigh‐StakesAchievementTest.PaperpresentedattheConferenceonthestatisticaldetectionofpotentialtestfraud,Lawrence,KS.
110. *Anderson,G.andKingston,NM.(2012).ProvidingUsefulInformationtoGuideStudentLearning:AReviewofStateLevelIndividualStudentReports.Paper
Neal Kingston CV 13
presentedatthe2012AnnualConventionoftheNationalCouncilonMeasurementinEducation(NCME),Vancouver,Canada.
111. *Chen,J.,Kingston,N.M.(2012).AComparisonofMantel‐HaenszelTestsandLogisticRegressionforDetectingInstructionallySensitiveItems.Posterpresentedatthe2012AnnualConventionoftheNationalCouncilonMeasurementinEducation(NCME),Vancouver,Canada.
112. *Zhao,F.,*Wang,W.,&Kingston,N.M.(2012).OntheUseofNonparametricIRTTechniquesforChecking3PLIRTModelFit.Paperpresentedatthe2012AnnualConventionoftheNationalCouncilonMeasurementinEducation(NCME),Vancouver,Canada.
113. *Zheng,C.,Erickson,A.G.,Kingston,N.,&Noonan,P.(April2012).CanSelf‐DeterminationPredictAcademicAchievementforStudentswithDisabilities?PaperpresentedatAmericanEducationalResearchAssociation,Vancouver,Canada.
114. *Zheng,C.,Erickson,A.G.,Kingston,N.,&Noonan,P.(April2012).PsychometricAnalysisoftheArc’sSelf‐DeterminationScaleforStudentswithDisabilities.PaperpresentedatNationalCouncilonMeasurementinEducation,Vancouver,Canada.
115. Cho,H.&Kingston,N.M.(April2012).UnderstandingAlternateAssessmentMisassignmentandHowtoPreventIt.PaperpresentedattheannualmeetingoftheCouncilforExceptionalChildren,Denver,CO.
116. Cho,H.J.,&Kingston,N.(April,2012).ExaminingtheeffectivenessoftestaccommodationusingDIFandamixtureIRTModel.PaperpresentedtoannualmeetingoftheAmericanEducationResearchAssociation:Vancouver,Canada.
117. Templin,J.,Kingston,N.M.,&*Wang,W.(October2011).PsychometricIssuesinFormativeAssessment:MeasuringStudentLearningThroughouttheAcademicYearUsingInterimAssessments.PaperpresentedattheMarylandAssessmentConference,CollegePark,MD.
118. Kingston,N.M.,*Wang,W.,*Broaddus,A.,&Kramer,L.(August2011).KansasInterimAssessmentValidityEvidenceBasedontheRelationshipbetweenInterimandSummativeAssessmentScores.PaperpresentedattheannualmeetingoftheAmericanPsychologicalAssociation,Washington,DC.
119. *Broadus,A.,Kingston,N.M.,&Kramer,L.(August2011).ValidityEvidenceBasedontheConsequencesofInterimAssessments.PaperpresentedattheannualmeetingoftheAmericanPsychologicalAssociation,Washington,DC.
120. Kramer,L.Kingston,N.M.,&*Broadus,A.,(August2011)ValidityEvidenceBasedonInterimAssessmentContent.PaperpresentedattheannualmeetingoftheAmericanPsychologicalAssociation,Washington,DC.
121. *Wang,W.,McKinley,R.,Kingston,N.M.,&*Broaddus,A.(August2011).ValidityEvidenceBasedontheInternalStructureofanInterimAssessment.PaperpresentedattheannualmeetingoftheAmericanPsychologicalAssociation,Washington,DC.
122. Kingston,N.M.(August2011).AlignmentofCommonCoreStandardsandAlternateAssessmentsforStudentswiththeMostSignificantCognitiveDisabilities.OfficeofSpecialEducationProgramsLeadershipMegaConference,Alexandria,VA.
123. Kingston,N.M.(June2011).PreparingALLStudentsforlife,work,andcitizenship:Thenextgenerationofalternateassessments.OfficeofSpecialEducationProgramsProjectDirectors’Conference,Washington,DC.
124. Kingston,N.M.(June2011).PreparingALLStudentsforlife,work,andcitizenship:Thenextgenerationofalternateassessments.NationalConferenceonStudentAssessment,Orlando,FL.
Neal Kingston CV 14
125. Cho,H.J.&Kingston,N.M.(April2011).CapturingImplicitPolicyfromNCLBTestTypeAssignments.AnnualmeetingoftheCouncilforExceptionalChildren.Washington,DC.
126. *Zhao,F.&Kingston,N.M.(April2011).TheEffectsofPhonologicalAwarenessonBilingual/ESLStudents'EarlyLiteracyDevelopment.AnnualmeetingoftheAmericanEducationalResearchAssociation,NewOrleans,LA.
127. *Anderson,G.&Kingston,N.M.(April2011).TheEfficacyofUsingStateStandards‐BasedAssessmentsforPredictingStudentSuccessinCommunityCollegeClasses.AnnualmeetingoftheNationalCouncilonMeasurementinEducation,NewOrleans,LA.
128. *Kim,M.&Kingston,N.M.(April2011).TheEfficacyofCurriculum‐basedmeasurement:AMeta‐Analysis.AnnualmeetingoftheAmericanEducationalResearchAssociation,NewOrleans,LA.
129. *Chiu,P.,Irwin,P.,&Kingston,N.M.(May2010).HowMuchTimedoesaTest‐TakerTakeifaTest‐TakerdoesTakeTime?NationalCouncilonMeasurementinEducation,Denver,CO.
130. Wolkowitz,A.Templin,J.&Kingston,N.M.(May2010).AnAnalysisoftheTimeandDayoftheWeekthatStudentsPerformBestonAssessments.NationalCouncilonMeasurementinEducation,Denver,CO.
131. *Gu,F.Little,T.,Kingston,NM.(May2010)CoefficientAlphaandStructuralEquationModelingBasedReliabilityEstimatesundertheViolationofEssentialTau‐EquivalenceandUncorrelatedErrors:ASimulationStudy.AmericanEducationalResearchAssociation,Denver,CO.
132. Kingston,N.M.,Foster,D.,Miller,H.L.,&*Tiemann,G.(February2010).BuildingaBetterMousetrap:UsingDiscreteOptionstoImprovetheMultiple‐ChoiceQuestion.AssociationofTestPublishers.
133. Kingston,N.M.(June2009).Large‐ScaleFormativeAssessment:Panacea,TransitionalTool,orOxymoron.39thannualNationalConferenceonStudentAssessment,LosAngeles,CA.
134. Kingston,N.M.and*Nash,B.(April2009).TheEfficacyofFormativeAssessment:AMeta‐Analysis.AmericanEducationalResearchAssociation,SanDiego,CA.
135. Kingston,N.M.and*Zhao,F.(April2009).WhatHaveWeLearnedabouttheStructureofLearningfrom30YearsofResearchonIntegratedCognitive‐PsychometricModels?NotMuch.NationalCouncilonMeasurementinEducation,SanDiego,CA.
136. Kingston,N.M.(April2007).ComparabilityofComputer‐andPaper‐AdministeredMultiple‐ChoiceTestsforK‐12Populations:ASynthesisof89Studies.NationalCouncilonMeasurementinEducation,Chicago,IL.
137. Kingston,N.M.(2005).Hottopicsintesting.CASMA‐ACTInvitationalConference,IowaCity,IA.
138. Kingston,N.M.(2004).Alternativeapproachestotheimplementationofcomputerizedstatewideaccountabilitytestingsystems.34thannualLarge‐ScaleAssessmentConferenceoftheChiefCouncilofStateSchoolOfficers,Boston,MA.
139. Kingston,N.M.(2003).K‐12computer‐basedtesting:isthereaplacefordataintheimplementationdecision‐makingprocess?33rdannualLarge‐ScaleAssessmentConferenceoftheCouncilofChiefStateSchoolOfficers,SanAntonio,TX.
140. Kingston,N.M.andEhringhaus,M.(2002).Thefutureofuniversaldesign(orsinceitisalreadytomorrowwhycan’tweuseyesterday’stechnologyyet?).Gallaudet
Neal Kingston CV 15
ResearchInstituteConference–HighStakesTesting:AreDeafandHardofHearingStudentsBeingLeftBehind?Washington,DC.
141. Kingston,N.M.(2002).Itemreview101:reviewingitemsandtestsfrommultipleperspectives.32ndannualLarge‐ScaleAssessmentConferenceoftheCouncilofChiefStateSchoolOfficers,PalmDesert,CA.
142. Kingston,N.M.(2002).Comparabilityofscoresfromcomputer‐andpaper‐basedadministrationsforstudentsingradesK‐12.32ndannualLarge‐ScaleAssessmentConferenceoftheCouncilofChiefStateSchoolOfficers,PalmDesert,CA.
143. Kingston,N.M.(2002).GeorgiaCRCT:Thelargest,mostcomprehensiveK‐12web‐basedtestingsystemgoesoperational.32ndannualLarge‐ScaleAssessmentConferenceoftheCouncilofChiefStateSchoolOfficers,PalmDesert,CA.
144. Dings,J.,Childs,R.,andKingston,N.M.(2002).Effectsofmatrixsamplingonstudentscorecomparabilityinconstructedresponseandmultiple‐choiceassessments.NationalCouncilforMeasurementinEducation,Seattle,WA.
145. Kingston,N.M.(2001).Evaluatingthevalidityanddefensibilityofthebodyofworkstandardsettingprocedure.31stannualLarge‐ScaleAssessmentConferenceoftheCouncilofChiefStateSchoolOfficers,Houston,TX.
146. Kingston,N.M.(2001).Implicationsofmatrixsamplingforstatetestingprograms.31stannualLarge‐ScaleAssessmentConferenceoftheCouncilofChiefStateSchoolOfficers,Houston,TX.
147. Kingston,N.M.,(2000).Dodgingbullets:minimizingtheprobabilityofanalysisandreportingproblems.30thannualLarge‐ScaleAssessmentConference,Snowbird,UT.
148. Kingston,N.M.,(2000).Combiningmultiplesourcesofinformationinthesettingofperformancestandards.30thannualLarge‐ScaleAssessmentConference,Snowbird,UT.
149. Kingston,N.M.(2000).Accountabilitythroughschoolreportcards:effortsofseveralstates.30thannualLarge‐ScaleAssessmentconference,Snowbird,UT.
150. Kingston,N.M.,(2000),Bodyofworkstandardsettingmethod:MassachusettsComprehensiveAssessmentSystem.NationalCouncilonMeasurementinEducationAnnualMeeting,NewOrleans,LA.
151. Sweeney,K.,Kahl,S.R.,Kingston,N.M.,Bay,L.(2000)ClassroomTeacherJudgmentandBodyofWorkMethod:WyomingComprehensiveAssessmentSystem(WyCAS).AnnualmeetingoftheAmericanResearchAssociation,NewOrleans,LA.
152. Kingston,N.M.andNellhaus,J.(1999).Standard‐settingfortheMassachusettsComprehensiveAssessmentSystem:thebodyofworkmethod.29thannualLarge‐ScaleAssessmentconference,Snowbird,UT.
153. Kingston,N.M.(1998).Developmentofaprototypeofacomputerizedaccommodationsversionofastandards‐basedassessment.28thannualLarge‐ScaleAssessmentConference,ColoradoSprings,CO.
154. Kingston,N.M.(1998).Assessingadequateyearlyprogressinastandards‐basedcomprehensivetestingenvironment:holygrailorholyterror.28thannualLarge‐ScaleAssessmentConference,ColoradoSprings,CO.
155. Kingston,N.M.(1997).Scoringstudentresponsesthroughimaging:Evidencethatnewtechnologywillsolveamajorconcernofperformanceassessment.27thannualLarge‐ScaleAssessmentConference,ColoradoSprings,CO.
156. Kingston,N.M.(1996).Respondingtocriticismsofperformanceassessment.CouncilofChiefStateSchoolOfficers26thannualLarge‐ScaleAssessmentConference,Phoenix,AZ.
Neal Kingston CV 16
157. Dings,J.andKingston,N.M.(1996).Effectsofstudentsandtasksongainscoresusedincomplexschoolaccountabilitydecisions.NationalCouncilforMeasurementandEvaluation,NewYork,NY.
158. Kingston,N.M.andDings,J.(1995).Estimatingtheaccuracyofcomplexschoolaccountabilitydecisions.Symposium:Performanceassessment:therhetoricmeetsthereality(andtheyarebothdoingquitefine,thankyou).NationalCouncilforMeasurementandEvaluation,SanFrancisco,CA.
159. Kehoe,J.F.,Kingston,N.M.,andMcCormick,D.J.(1993).Practicalconsiderationsforlow‐costcomputerizedtesting.Symposium:Computerandmultimediatestingfornewskillsandabilities:Practicalissues.SocietyforIndustrialandOrganizationalPsychology,SanFrancisco,CA.
160. Kingston,N.M.(1993).Increasingopportunityviatechnology‐basedtesting.Symposium:Assessment,diversity,andAmerica2000.AmericanCounselingSociety,Atlanta,GA.
161. Kingston,N.M.(1989).Aninvestigationoftwotypesofselectioneffectsonvaliditycoefficients.Symposium:Alternativeapproachestoproblemsinvolvedinthevalidationofhighereducationadmissiontests.NationalCouncilonMeasurementinEducation,SanFrancisco,CA.
162. Kingston,N.M.,Schneider,L.M.,andBriel,J.B.(1988).OvercomingstatisticaldifficultiesincomparingthepredictiveaccuracyoftheGREGeneralTestandundergraduategradesforsubgroupsbasedongenderandethnicity.Symposium:Solvingperennialmethodologicalproblemsinvalidityresearch.AmericanPsychologicalAssociation,Atlanta,GA.
163. Kingston,N.M.(1988).UsinganEnglishlanguagegraduateadmissionstestfornon‐nativespeakersofEnglish:perilsandpitfalls.NationalAssociationforForeignStudentAffairs,Washington,DC.
164. Kingston,N.M.(1988).UseofGREscoresandtheundergraduategrade‐pointaveragetopredictgraduateschoolsuccess.AmericanAssociationofCollegiateRegistrarsandAdmissionsOfficers,Nashville,TN.
165. Kingston,N.M.andMcKinley,R.L.(1988).AssessingthestructureoftheGREGeneralTestusingconfirmatorymultidimensionalitemresponsetheory.Symposium:Itemresponsetheorymeetsmultidimensionaltests.AmericanEducationalResearchAssociation,NewOrleans,LA.
166. McKinley,R.L.andKingston,N.M.(1988).ConfirmatoryanalysisofteststructureusingmultidimensionalIRT.NationalCouncilonMeasurementinEducation,NewOrleans,LA.
167. Kingston,N.M.andStocking,M.L.(1986).PsychometricissuesforIRT‐basedtestconstruction.Symposium:Itemresponsetheorybasedtestdevelopment.AmericanPsychologicalAssociation,Washington,DC.
168. Kingston,N.M.,Durso,R.V.,andSchneider,L.M.(1986).TheGraduateRecordExam‐inationsValidityStudyService:yesterdayandtomorrow.Symposium:Designingavalidityresearchservice.NationalCouncilonMeasurementinEducation,SanFrancisco,CA.
169. Kingston,N.M.(1985).ComparisonofbiasandrootmeansquarederrorforfourvariantsofIRTtruescoreequating.FourthEuropeanMeetingofthePsychometricSociety,Cambridge,England.
Neal Kingston CV 17
170. Kingston,N.M.(1985).Assessingguessingbehaviorusingthethree‐parameterlogisticmodel.Symposium:Dynamicsofguessingbehavior:methodologicalapproaches.NationalCouncilonMeasurementinEducation,Chicago,IL.
171. Kingston,N.M.(1985).TheincrementalvalidityoftheGREanalyticalmeasureforvariousdepartmenttypes.Symposium:TheGREAnalyticalTest:Newmeasureforgraduateschooldecisionmaking.AmericanEducationalResearchAssociation,Chicago,IL.
172. Kingston,N.M.(1984).Analysisofshiftsinscaleandconstructthroughtheuseofrepeaterdata.AmericanEducationalResearchAssociation,NewOrleans,LA.
173. Kingston,N.M.andDorans,N.J.(1983).AssessinglocalindependenceforIRT:factoranalysisofitemintercorrelationsafterpartialingoutestimatedtheta.PsychometricSociety,LosAngeles,CA.
174. Kingston,N.M.andDorans,N.J.(1982).EquatingofGREAptitudeTestscoresusingitemresponsetheory:theeffectofmultidimensionality.Symposium:RecentdevelopmentsinequatingatETS.AmericanPsychologicalAssociation,Washington,DC.
175. Dorans,N.J.andKingston,N.M.(1982).Implicationsofitempoolfungibilityforinnovativetestingmodesandequatingmethods.Symposium:Topicsinitemresponsetheory.PsychometricSociety,Montreal.
176. Kingston,N.M.,Livingston,S.A.,andTurner,N.J.(1982).Predictingsuccessingraduateschool:189validitystudies.Symposium:Interpretingdatathrougheternallysmudgedglasses:thecontinuingsagaofgraduateandprofessionalschoolvalidationresearch.AmericanEducationalResearchAssociation,NewYork,NY.
177. Dorans,N.J.andKingston,N.M.(1981).AssessingthelocalindependenceassumptionofitemresponsetheoryinGREitemtypesandpopulations.PsychometricSociety,ChapelHill,NC.
178. Kingston,N.M.andDorans,N.J.(1981).Theeffectofthepositionofanitemwithinatestonitemrespondingbehavior:ananalysisbasedonitemresponsetheory.Symposium:Practiceeffects:problemsandsolutions.NationalCouncilonMeasurementinEducation,LosAngeles,CA.
179. Kingston,N.M.andDorans,N.J.(1981).Woulditbeadvantageoustousethethree‐parameterlogisticmodelasapsychometricbasefortheGREAptitudeTest?Symposium:Assessingthefeasibilityofusingitemresponsetheoryforoperationaltestingprograms.AmericanEducationalResearchAssociation,LosAngeles,CA.
180. Kingston,N.M.andWhite,E.B.(1980).Itemresponsetheorystatistics,classicaltestanditemstatistics:whatdoesitallmeanwhenyousitdowntoconstructatest?AmericanEducationalResearchAssociation,Boston,MA.
SelectedMinorPresentations
181. Kingston,N.M.(2013)ToolsforEfficientlyEnhancingtheValidityofInferencesBasedonTestScores:LearningMapsandTechnologyEnhancedItemEditors.EducationalTestingService,Princeton,NJ.
182. *Beals‐Erickson,S.&Kingston,N.M.OriginalandAdaptedDialecticalBehaviorTherapyforAdultsversusAdolescents:AMeta‐Analysis.(2012).Paperpresentedatthe2012meetingoftheNationalConferenceonClinicalChildandAdolescentPsychology,Lawrence,KS.
Neal Kingston CV 18
183. Kingston,N.M.(2009).Formative,SchmormativeorIjustwanttohelpmystudentslearn(andmaybedobetteronthosedarnstatetests).KansasFallAssessmentConference.
184. Kingston,N.M.(2009).TheRoleofaSharedItemBankintheRe‐inventionoftheModifiedAssessmentinKansas.KansasFallAssessmentConference.
185. Kingston,N.M.(2009).Interimassessmentasanintegralpartofastateassessmentprogram.KansasFallAssessmentConference.
186. Kingston,N.M.(2008).TheAnatomyofaScoring:AForensicAnalysisoftheGradingofanOpen‐EndedTestItem.KingFahdUniversityofPetroleumandMinerals,Dharhan,SaudiArabia.
187. Kingston,N.M.(2008).AdvancesinFormativeAssessment:ABriefBackground.38thannualNationalConferenceonStudentAssessment,Orlando,FL
188. Kingston,N.M.(2008).ConsiderationsfortheDevelopmentandUseofOpen‐EndedTestItems,KingFahdUniversityofPetroleumandMinerals,Dharhan,SaudiArabia.
C. Grantsand/orotherFundedProjects
ExternalFunding
1.FundedProposals(61grantsvaluedat$112.7millionasPIorCo‐PIfrom2009to
present)1. Perie,M.,Kingston,N.M.andKarvonen,M.(Co‐PI).Alaska
MeasuresProgressScienceandScienceAlternateAssessments,AlaskaDepartmentofEducation(2015‐2016,$1,181,802)
2. KingstonN.M.(P.I.)andKarvonen,M.DynamicLearningMapsAlternateAssessmentforNewYorkState.NewYorkState.(2015‐2020,$13,120,000).
3. Kingston,N.M.(P.I.)andBroaddus,A.UseofLearningMapsasanOrganizingStructureforFormativeAssessment.UnitedStatesDepartmentofEducation(EnhancedAssessmentGrantProgram)(2015‐2019,$5,677,983).
4. KingstonN.M.(P.I.)andKarvonen,M.DesignandDevelopmentofaDynamicLearningMapsAssessment‐SocialStudies,OklahomaStateDepartmentofEducation(2015‐2016,$1,548,534)
5. KingstonN.M.(P.I.)andKarvonen,M.DynamicLearningMapsAlternateAssessment.UtahOfficeofStateEducation.(2015‐2020,$2,707,036).
6. KingstonN.M.(P.I.)andKarvonen,M.DynamicLearningMapsAlternateAssessment.ColoradoDepartmentofEducation.(2015,$102,760).
7. KingstonN.M.(P.I.)andKarvonen,M.DynamicLearningMapsAlternateAssessment.WestVirginiaDepartmentofEducation.(2015‐2016,$224,328).
8. KingstonN.M.(P.I.)andKarvonen,M.DynamicLearningMapsAlternateAssessment.NewJerseyDepartmentofEducation.(2015,$206,620).
SoleSourceCompetitiveCompetitiveSoleSourceSoleSourceSoleSourceSoleSourceSoleSourceSoleSource
Neal Kingston CV 19
9. KingstonN.M.(P.I.)andKarvonen,M.DynamicLearningMapsAlternateAssessment.IllinoisStateBoardofEducation.(2015,$239,240).
10. Kingston,N.M.(PI).ImplementationofaDynamicLearningMapsAlternateAssessment,StateofMississippi(2014‐2015,$73,200)
11. Kingston,N.M.(PI).ImplementationofaDynamicLearningMapsAlternateAssessment,StateofVermont(2014‐2015,$8,000)
12. Kingston,N.M.(PI).ImplementationofaDynamicLearningMapsAlternateAssessment,ChoctawTribalSchools(2014‐2015,$2,917)
13. Kingston,N.M.(PI).ImplementationofaDynamicLearningMapsAlternateAssessmentMiccosukeeTribalSchools(2014‐2015,$2,293)
14. Kingston,N.M.(PI).Developmentofalearningmapprototypecompletewithenhancedlearningprogressionsandvisualizations.GatesFoundation(2014‐15,$212,022)
15. Perie,M.andKingston,N.M.(Co‐PI).AlaskaEnglishLanguageArtsandMathematicsAssessments,StateofAlaska(2014‐2020,$25,000,000)
16. Kingston,N.M.(PI)andPerie,M.PsychometricservicesforArizonaDepartmentofEducation,ArizonaDepartmentofEducation(2014‐15,$107,190)
17. Perie,M.andKingston,N.M.(Co‐PI).KansasAssessmentProgram2014‐15,KansasStateDepartmentofEducation(2014‐2015,$5,500,000)
18. Perie,M.andKingston,N.M.(Co‐PI).KansasAssessmentProgramSpecialEducation2014‐15,KansasStateDepartmentofEducation(2014‐2015,$2,000,000)
19. Kingston,N.M.(PI).DesignandDevelopmentofaDynamicLearningMapsAlternateAssessment,VirginiaDepartmentofEducation(2014‐2015,$20,000)
20. Kingston,N.M.(PI).DesignandDevelopmentofaDynamicLearningMapsAlternateAssessment,AlaskaDepartmentofEducation(2014‐2015,$15,460)
21. Kingston,N.M.(PI).DesignandDevelopmentofaDynamicLearningMapsAlternateAssessment,StateofNewHampshire(2014‐2015,$16,667)
22. Perie,M.andKingston,N.M.(Co‐PI).DynamicLearningMaps–Science,KansasStateDepartmentofEducation(2014‐2015,$500,000)
23. Kingston,N.M.(PI).DesignandDevelopmentofaDynamicLearningMapsAlternateAssessment,NorthDakotaDepartmentofPublicInstruction(2014‐2015,$11,840)
24. Kingston,N.M.(PI).DesignandDevelopmentofaDynamicLearningMapsAlternateAssessment,StateofWisconsin(2014‐2015,$152,920)
CompetitiveSoleSourceSoleSourceSoleSourceInvitationalandCompetitiveCompetitiveSoleSourceSoleSourceSoleSourceSoleSourceSoleSourceSoleSourceSoleSourceSoleSourceSoleSourceSoleSourceSoleSource
Neal Kingston CV 20
25. Kingston,N.M.(PI).DesignandDevelopmentofaDynamicLearningMapsAlternateAssessmentSystem,Lancaster,PA(2014‐2015,$30,000)
26. Perie,M.andKingston,N.M.(Co‐PI).DesignandDevelopmentofaDynamicLearningMapsAssessment,KansasStateDepartmentofEducation(2014‐2015,$250,000)
27. Kingston,N.M.(PI).DesignandDevelopmentofaDynamicLearningMapsAlternateAssessment,StateofIowa(2014‐2015,$547,040)
28. Kingston,N.M.(PI).DesignandDevelopmentofaDynamicLearningMapsAssessment‐Science,OklahomaStateDepartmentofEducation(2014‐2015,$610,000)
29. Kingston,N.M.(PI).DesignandDevelopmentofaDynamicLearningMapsAssessment,OklahomaStateDepartmentofEducation(2014‐2015,$200,000)
30. Kingston,N.M.(PI).DesignandDevelopmentofaDynamicLearningMapsAlternateAssessment,StateofMissouri(2014‐2015,$687,250)
31. Kingston,N.M.(PI).DesignandDevelopmentofaDynamicLearningMapsAssessment,ColoradoDepartmentofEducation(2014‐2015,$20,000)
32. Kingston,N.M.(PI).DesignandDevelopmentofaDynamicLearningMapsAlternateAssessment,IllinoisStateBoardofEducation(2013‐2018,$50,000)
33. Kingston,N.M.(PI).DesignandDevelopmentofaDynamicLearningMapsAlternateAssessment,NorthDakotaDepartmentofPublicInstruction(2013‐2015,$48,333)
34. Kingston,N.M.(PI).DesignandDevelopmentofaDynamicLearningMapsAlternateAssessment,AlaskaDepartmentofEducation(2013‐2015,$45,000)
35. Kingston,N.M.(PI)andPerie,M.KansasAssessmentProgram2013‐14,KansasStateDepartmentofEducation(2013‐2014,$4,620,000).
36. Kingston,N.M.(PI).DesignandDevelopmentofaDynamicLearningsMapsAlternateAssessment,ColoradoDepartmentofEducation(2013‐2014,$16,668)
37. Kingston,N.M.(PI).cPass,MississippiDepartmentofEducation(2013‐2014,$42,000)
38. Perie,Marianne(PI),Kingston,N.M.(Co‐PI).TeacherLeadership,KansasStateDepartmentofEducation(2013‐2014,$47,835)
39. Perie,Marianne(PI),Kingston,N.M.(Co‐PI).CareerCompetencyQualification,KansasDepartmentofEducation(2013,$125,000)
40. Kingston,N.M.(PI).ColoradoPerformanceTasks,ColoradoDepartmentofHigherEducation(2013,$56,695)
SoleSourceSoleSourceSoleSourceSoleSourceSoleSourceSoleSourceSoleSourceSoleSourceSoulSourceSoleSourceSoleSourceSoleSourceSoleSourceSoleSourceSoleSourceSoleSourceSoleSourceSoleSource
Neal Kingston CV 21
41. Kingston,N.M.(PI).DesignandDevelopmentofaDynamicLearningMapsAlternateAssessment,VermontDepartmentofEducation(2012‐2014,$34,000)
42. Kingston,N.M.(PI).KansasAssessmentProgram2012‐13TAC,KansasStateDepartmentofEducation(2012‐2013,$70,000)
43. Kingston,N.M.(PI).KansasAssessmentProgram2012‐13KansasStateDepartmentofEducation(2012‐2013,$90,000)
44. Kingston,N.M.(PI).KansasAssessmentProgram,KansasStateDepartmentofEducation(2012‐2013,$4,500,000)
45. Kingston,N.M.(PI).cPass,ColoradoDepartmentofEducation.(2012‐2014,$300,000)
46. Kingston,N.M.(PI).cPass,MississippiDepartmentofEducation.(2012‐2013,$42,000)
47. Kingston,N.M.(PI).DesignandDevelopmentofaDynamicLearningMapsAlternateAssessment,VirginiaDepartmentofEducation(2012‐2013,$51,310)
48. Kingston,N.M.(PI).KansasAssessmentProgram,KansasStateDepartmentofEducation(2011‐2013,$4,325,829)
49. Kingston,N.M.(PI).KansasCareerandTechnicalEducationAssessmentSystem.KansasStateDepartmentofEducation(2011‐2014,$987,460)
50. Kingston,N.M.(PI).DesignandDevelopmentofaDynamicLearningMapsAlternateAssessment,StateofWashingtonOfficeofSuperintendent(2011‐2014,$75,000)
51. Hock,M.,Kingston,N.M.(Co‐PI),Davis,M.,Tonks,S.&Brasseur,I.,DevelopmentandValidationofOnlineAdaptiveReadingMotivationMeasures,Re‐submitted2010IES,(Co‐PI)(2011‐14,$1,738,808)
52. Kingston,N.M.(PI).DesignandDevelopmentofaDynamicLearningMapsAlternateAssessment.SubmittedJuly2010OSEP,(2010‐2015,$24,875,111requested)Fundedfor$25,026,112
53. Embretsen,S.,Walker,B.,Poggio,J.,Kingston,N.M.(Co‐PI),&Meyen,E.AnAdaptiveTestingSystemforDiagnosingSourcesofMathematicsDifficulties.Submitted2010IES,(2010‐2013,$1,854,393)
54. Kingston,N.M.(PI).KansasReadingandMathematicsAssessments,FY2010‐11(GeneralandKAMMAssessments).Submitted2010KansasStateDepartmentofEducation,(2010‐2012$2,270,992)
55. Kingston,N.M.(PI).KansasReadingandMathematicsAssessments,FY2010‐11(AlternateAssessment,KELPA,andSpecialProjects)Submitted2010KansasStateDepartmentofEducation.(2010‐2012,$1,358,000)
56. Kingston,N.M.(PI).AlternateAssessmentDesignReadingProject.Submitted2010KansasStateDepartmentofEducation(2010‐2011,EAGpass‐through,$127,200)
SoleSourceSoleSourceSoleSourceSoleSourceSoleSourceSoleSourceCompetitiveCompetitiveCompetitiveCompetitiveSoleSourceSoleSourceSoleSourceSoleSourceSolesourceSoleSourceSoleSource
Neal Kingston CV 22
57. Kingston,N.M.(PI).KansasFocalPointAssessments.KansasStateDepartmentofEducation(2010‐11,$54,364)
58. Kingston,N.M.(PI).GMATTechnicalManualDevelopment.Submitted2009GraduateManagementAdmissionsCouncil.(2010,$23,661)
59. Kingston,N.M.(PI).KansasReadingandMathematicsAssessments,FY2009‐10(GeneralandKAMMAssessments).Submitted2009KansasStateDepartmentofEducation,(2009‐2011$2,420,000)
60. Kingston,N.M.(PI).KansasReadingandMathematicsAssessments,FY2009‐10(AlternateAssessment,KELPA,andSpecialProjects).Submitted2009KansasStateDepartmentofEducation.(2009‐2011,$1,352,500)
61. Kingston,N.M.(PI).ResearchontheFoster(DOMC)ItemType.Submitted2009BrighamYoungUniversity.(2009‐2010,$2,500)
62. Kingston,N.M.(PI)&McKinley,R.CombiningmultipleIRTparameterestimates,EducationalTestingService
63. Kingston,N.M.(PI),McKinley,R,&Schaeffer,G.ExploringtheUseofIRTEquatingfortheGRESubjectTestinMathematics,GraduateRecordExaminationsBoard
64. Kingston,N.M.(PI).EstimatingEquatingFunctionsonStandardizedTestPopulations,EducationalTestingService
65. Kingston,N.M.(PI),Leary,L.&Wightman,L.AnExploratoryStudyoftheApplicabilityofItemResponseTheorytotheGraduateManagementAdmissionsTest,GraduateManagementAdmissionsCouncil
66. Kingston,N.M.(PI).EvaluationoftheRestructuredGraduateRecordExaminationsGeneralTest:AnalysisofScoreChangePatternsforRepeaters,GraduateRecordExaminationsBoard
67. Kingston,N.M.(PI)andDorans,N.J.FeasibilityofusingItemResponseTheoryasaPsychometricBasisfortheGraduateRecordExaminationsAptitudeTest,GraduateRecordExaminationsBoard
SoleSourceCompetitiveCompetitiveCompetitiveCompetitiveCompetitiveCompetitive
2.ProposalsunderReview68. Templin,J.T.,Bradshaw,L.,andKingston,N.M.(SeniorStaff).
EvolvingLearningMaps:StatisticalMethodstoImproveDynamicMap‐BasedPsychometrics.SubmittedtoIESAugust2014(2015‐2017,$899,883).
69. Huan,J.,Hill,M.,Kingston,N.M.(Co‐PI),Davis,R.,Vadlani,P.EstablishingaGraduateTrainingProgramSupportingDataEnabledAnalysisandOptimizationoftheFood‐Energy‐WaterNexus.SubmittedtoNSF(2016‐2020,$2,971,449).
CompetitiveCompetitive
Neal Kingston CV 23
3.ProposalsSubmitted,NotFunded70. Perie, M. & Kingston, N.M. (Co-PI) Development and
Implementation of the Connecticut Mastery Test (CMT) and Connecticut Academic Performance Test (CAPT) in Science (2015-2020, $3,998,063).
71. Kingston,N.M.(PI).METAMath:SearchingwithMETAcognitiveAwarenessinMathematics.SubmittedtoNSF(2015‐2019,$197,080)
72. Kingston,N.M.(PI,KUSubcontracttoTexasChristianUniversity)METAMath:SearchingwithMETAcognitiveAwarenessinMathematics.SubmittedtoIESSeptember2014(2015‐2018,$124,372).
73. Huan,J.,Alexander,W.P.,Blumenstiel,J.P.,Ginther,D.K.,&Kuzuczera,K.Kingston,N.M.(SeniorStaff).K‐DEESE:EstablishinganInterdisciplinaryDataEnabledScienceandEngineeringTrainingProgramattheUniversityofKansas.SubmittedtoNSFJuly2014(2015‐20,$2,917,932).
74. Kingston,N.M.(PI),Cho,H.J.(Co‐PI),andDeci,E.(Co‐PI)RelationshipsofSelf‐DeterminationandSchoolEngagementonAcademicPerformanceScoresduringSecondarySchool.Re‐submittedtoIESJune2012(2012‐15,$961,719)
75. Kingston,N.M.(PI)andChen,J.(Co‐PI)FactorsInfluencingInstructionalSensitivity.SubmittedSeptember2012IES(2013‐2015,$669,675).
76. Kingston,N.M.(PI),Cho,H.J.andWalsh,T.J.(Co‐PI)CapturingExpertJudgmentstoHelpIEPTeamsmakeBetterAccountabilityTest.SubmittedtoIESSeptember2012(2013‐2015,$1,253,971).
77. Thomas,K.(PI),Broaddus,A.(Co‐PI),andKingston,NM(Co‐PI)UsingCognitiveModelstoInterpretStudentReasoningandGuideMathematicsInstruction:InformingElementaryTeachers'PracticewithaMathematicsLearningMap.SubmittedtoIESSeptember2012(2013‐2015,$1,485,466).
78. Kingston,N.M.(PI,KUSubcontracttoUniversityofOregon)PathwaystoProficiency.SubmittedtoIESSeptember2012(2013‐2017,$300,000).
79. Kingston,N.M.(PI)andCho,H.J.RelationshipsofSelf‐DeterminationandSchoolEngagementonAcademicPerformanceScoresduringSecondarySchool.Re‐submittedJune2011IES(2012‐15,$924,208)
80. Kingston,N.M.(PI)ARDMSPsychometricServices.SubmittedSeptember2011toARDMS(2011‐2013,$54,962forCETEcomponent).
81. Kingston,N.M.(PI)andCho,H.J.RelationshipsofSelf‐DeterminationandSchoolEngagementonAcademicPerformanceScoresduringSecondarySchool.SubmittedSeptember2010IES(2011‐14,$573,789)
CompetitiveCompetitiveCompetitiveCompetitiveCompetitiveCompetitiveCompetitiveCompetitiveCompetitiveCompetitiveCompetitiveCompetitiveCompetitive
Neal Kingston CV 24
82. Kingston,N.M.(PI)&Skorupski,W.P.(Co‐PI).CollaborativeResearch:BeyondDisciplines:ANationalCollaborationtoBuildCapacityforCross‐DisciplinaryConceptInventoryAssessmentandResearch,Submitted2011NSF(2011‐2015,$968,187)
83. Hock,M.,Kingston,N.M.(Co‐PI),Davis,M.,Tonks,S.&Brasseur,I.,DevelopmentandValidationofOnlineAdaptiveReadingMotivationMeasures,Submitted2009IES,(Co‐PI)Requested2010‐13($1,496,606)
84. Kingston,N.M.(PI)&Skorupski,W.P.TheDevelopment,Validation,andImplementationofIntegratedPsychometric‐CognitiveModelstoSupportBetterInstructionandProduceMoreUsefulTestScores.Submitted2007,IES.(2008‐2011,$760,892).Notfunded.
85. Kingston,N.M.(PI).IntegratingPsychometricandCognitiveModels‐AResearchSynthesis.Submitted2007,NSF.(2007‐2008,$96,994).Notfunded.
86. Ault,M.,Huffman,D.,Kingston,N.M.(Co‐PI),Friedman‐Nimz,R.,Tiemann,G.,Holvoet,J.,RubiStarDI:AssessmenttoSupportDifferentiatedInstructioninMiddleSchoolScience,Submitted2007,IEF.(2008‐2011,$499,274).Notfunded.
CompetitiveCompetitiveCompetitiveCompetitive
InternalFunding87. Kingston,N.M.(PI).Development,Validation,and
ImplementationofIntegratedPsychometricCurricularModelstoBetterSupportInstructionandProducemoreUsefulTestScores.Requested2007‐2009($5,000)
D. HonorsandAwardsforResearch
DistinguishedMentorfortheCommunityofInterestonCareerPaths:AcademiaorIndustry,AERADivisionD,January2011
SERVICERECORD
A. UniversityofKansasServiceActivity Role Dates Category2013StrategicInitiativeTheme(SIT)ResearchSummitPlanningCommitteeKansasUniversityCenterforResearchResearchInvestmentCouncilCRMDA/Assist/Assoc.ProfessorSearchCommitteeJudicialBoardQuantitativePsych.Assist.ProfessorSearchCommitteeQuantitativePsych.Assist.ProfessorSearch
MemberTrusteeMemberMemberMemberMemberMember
20132012‐20162012‐20152009‐20102008‐20102008‐20092007‐2008
University
Neal Kingston CV 25
CommitteeAdHocAdvisoryCommitteeonStudentEvaluationofFaculty
Member
2006‐2007
ServiceAwardCommitteePersonnelCommitteeTechnologyCommitteeResearchinMeasurement,Statistics,andEvaluationAwardProgramAdHocCommitteeonTeacherPreparationGraduateStudiesCommitteeSchoolofEducationStrategicPlanningCommitteeCenterforPsychoeducationalServicesAdvisoryCouncil
MemberMemberMemberCo‐chairMemberMemberMemberMember
20132012‐20152011‐20142009‐present2008‐20092007‐20102007‐20092006‐2008
School
Research,Eval.,Measurement,&StatisticsTrackPsychologyandResearchinEducationTollefsonFellowshipCommitteePsychologyandResearchinEducationFacultyEvaluationCommitteeEduc.Psych.andRes.FacultySearchCommittee
CoordinatorInterimChairCo‐chairAssoc.ChairMemberMember
2010‐2011Fall20092008‐20122008‐201020082006‐2007
Department
B. ProfessionalServiceoutsidetheUniversityActivity Role DatesCCSSOStudentswithDisabilitiesAssessmentAdvisoryTaskForce
Member 2013
OnlineAssessmentCross‐ConsortiumTechnologyCollaborationGroup
Member 2013‐
GEDTechnicalAdvisoryCommittee Member 2008‐2015ConferenceonInstructionalSensitivity Chair 2014‐20152015ConferenceontheStatisticalDetectionofPotentialTestFraud
Chair
2014‐2015
InternationalAssociationforEducationalAssessment2015ConferenceCommittee
Chair 2013‐2015
2014ConferenceontheStatisticalDetectionofPotentialTestFraud
PlanningCom.
2013‐2014
2013ConferenceonInstructionalSensitivity Co‐chair 2012‐20132013ConferenceontheStatisticalDetectionofPotentialTestFraud
PlanningCom. 2012‐2013
2012ConferenceontheStatisticalDetectionofPotentialTestFraud
Chair 2011‐2012
2012ColloquiumonOrganizedLearningModels PlanningCom. 2012NationalCouncilonDisabilityExpertPanelonGraduationOutcomesandAssessmentTools
Member 2012
EdvantiaTechnicalAdvisoryGroup Member 2012NCME75thAnniversaryPlanningCommittee Chair 2010‐2013
Neal Kingston CV 26
ATP2010AnnualConferenceProgramCommittee ViceChair 2009‐2010NSFREESEPeerReviewPanel Member 20092009ColloquiumonUniversallyDesignedTechnologyEnhancedAssessments
PlanningCom. 2009
KaplanCatalystTechnicalAdvisoryCommittee Member 2008‐2010AERADivisionDEditorialCommittee Member 2008‐2009UnitedStatesDepartmentofEducationWorkshoponFormativeAssessment
Member 2008
UnitedStatesDepartmentofEducationWorkshoponUseofPortfoliosinNCLBAssessmentPrograms
Member 2008
UtahStateOfficeofEducationComputer‐BasedTestingSummit
Member 2007
JointCommitteeonTestingPractices Member 2006‐2007NewHampshireStateDepartmentofEducationAdvisoryCommitteeonScoreReporting
Member 2000
CareerChannelAdvisoryGroup Member 1991NationalResearchCouncilWorkshoponConfidentialityofGraduateData
Member
1988
DefenseAdvisoryCouncilonMilitaryPersonnelTesting Member 1987‐1988NCME1984Conference Co‐chair 1983‐1984
AdhocReviewer(beganrecordkeepingApril2013) DatesEducationalandPsychologicalMeasurement(EPM‐13‐0069)AppliedMeasurementinEducation(108‐040‐3)
April2013April2013
