Placement Testing Dr. Edward Morante Faculty to Faculty Webinar April 19, 2012 Sponsored by Lone...
-
Upload
mervyn-casey -
Category
Documents
-
view
212 -
download
0
Transcript of Placement Testing Dr. Edward Morante Faculty to Faculty Webinar April 19, 2012 Sponsored by Lone...
![Page 1: Placement Testing Dr. Edward Morante Faculty to Faculty Webinar April 19, 2012 Sponsored by Lone Star College.](https://reader035.fdocuments.in/reader035/viewer/2022070401/56649f175503460f94c2dd74/html5/thumbnails/1.jpg)
Placement Testing
Dr. Edward Morante
Faculty to Faculty WebinarApril 19, 2012
Sponsored by
Lone Star College
![Page 2: Placement Testing Dr. Edward Morante Faculty to Faculty Webinar April 19, 2012 Sponsored by Lone Star College.](https://reader035.fdocuments.in/reader035/viewer/2022070401/56649f175503460f94c2dd74/html5/thumbnails/2.jpg)
Dr. Edward A. Morante
EdD – 1974 Counseling Psychology, Teachers College, Columbia University Master’s Thesis: Multivariate analysis of the success of a placement process at a school for disabled students Research Assistant for Dr. Robert Thorndike, noted professor of testing and measurement
35 years in higher education 13 years Director of Counseling at the university level 8 years as Director of the Basic Skills Assessment Program, New Jersey Department of Higher Education, which developed the first state wide placement test in the US, the first state wide assessment of Developmental Education programs in that state, assessing learning outcomes at two and four-year colleges including the first state wide assessment of sophomore learning outcomes 14 years in a Southern California community college as a counselor, Dean of Educational Research, Resources and Technology; Dean of Student Services and Resources; and Academic Senate President
![Page 3: Placement Testing Dr. Edward Morante Faculty to Faculty Webinar April 19, 2012 Sponsored by Lone Star College.](https://reader035.fdocuments.in/reader035/viewer/2022070401/56649f175503460f94c2dd74/html5/thumbnails/3.jpg)
Dr. Edward A. MoranteDistinguished Faculty – National Center for Developmental Education’s Kellogg Institute for 23 years, presenting on placement and assessment
Member of the Assessment Council of Western Governors University for 10 years where he helped develop an elaborate system of student assessment needed for degree attainment
National TRIO trainer for 10 years on assessment, placement, and evaluation
Achieving the Dream data coach from the beginning
Consultant, presenter, grant writer, program evaluator for 25 years, including head of the team that evaluated Florida’s statewide placement test (CLAST) and member of the team that evaluated the Texas statewide placement test
![Page 4: Placement Testing Dr. Edward Morante Faculty to Faculty Webinar April 19, 2012 Sponsored by Lone Star College.](https://reader035.fdocuments.in/reader035/viewer/2022070401/56649f175503460f94c2dd74/html5/thumbnails/4.jpg)
Today’s Agenda
• Definition & Purpose• Important factors• Placement tests vs. SAT & ACT• Best practices• Predictive validity of placement tests• Evaluating placement instruments and
policies
![Page 5: Placement Testing Dr. Edward Morante Faculty to Faculty Webinar April 19, 2012 Sponsored by Lone Star College.](https://reader035.fdocuments.in/reader035/viewer/2022070401/56649f175503460f94c2dd74/html5/thumbnails/5.jpg)
Definition
A placement test is a basic skills achievement test that measures skills proficiency (e.g., in reading, writing and/or mathematics).
![Page 6: Placement Testing Dr. Edward Morante Faculty to Faculty Webinar April 19, 2012 Sponsored by Lone Star College.](https://reader035.fdocuments.in/reader035/viewer/2022070401/56649f175503460f94c2dd74/html5/thumbnails/6.jpg)
Purpose
To assist entering college students in the selection of beginning courses
![Page 7: Placement Testing Dr. Edward Morante Faculty to Faculty Webinar April 19, 2012 Sponsored by Lone Star College.](https://reader035.fdocuments.in/reader035/viewer/2022070401/56649f175503460f94c2dd74/html5/thumbnails/7.jpg)
Important Factors
• Reliability: Essential for score consistency; Calculated reliability coefficients should approach or exceed .90
![Page 8: Placement Testing Dr. Edward Morante Faculty to Faculty Webinar April 19, 2012 Sponsored by Lone Star College.](https://reader035.fdocuments.in/reader035/viewer/2022070401/56649f175503460f94c2dd74/html5/thumbnails/8.jpg)
Important Factors
• Reliability• Validity: Essential for measuring what
the test is supposed to measure;
content / skills / behaviors
… college entrance =
reading
writing
math
![Page 9: Placement Testing Dr. Edward Morante Faculty to Faculty Webinar April 19, 2012 Sponsored by Lone Star College.](https://reader035.fdocuments.in/reader035/viewer/2022070401/56649f175503460f94c2dd74/html5/thumbnails/9.jpg)
Important Factors
• Reliability• Validity• Criterion-referenced, with standards &
proficiencies developed by faculty
![Page 10: Placement Testing Dr. Edward Morante Faculty to Faculty Webinar April 19, 2012 Sponsored by Lone Star College.](https://reader035.fdocuments.in/reader035/viewer/2022070401/56649f175503460f94c2dd74/html5/thumbnails/10.jpg)
Important Factors
• Reliability• Validity• Criterion-referenced• Power test, where students
demonstrate skills within a reasonable time. “Speededness” should be avoided.
![Page 11: Placement Testing Dr. Edward Morante Faculty to Faculty Webinar April 19, 2012 Sponsored by Lone Star College.](https://reader035.fdocuments.in/reader035/viewer/2022070401/56649f175503460f94c2dd74/html5/thumbnails/11.jpg)
Important Factors
• Reliability• Validity• Criterion-referenced• Power test• Decreased opportunity to guess
![Page 12: Placement Testing Dr. Edward Morante Faculty to Faculty Webinar April 19, 2012 Sponsored by Lone Star College.](https://reader035.fdocuments.in/reader035/viewer/2022070401/56649f175503460f94c2dd74/html5/thumbnails/12.jpg)
Important Factors
• Reliability• Validity• Criterion-referenced• Power test• Decreased opportunity to guess• Alternate form for contingencies
![Page 13: Placement Testing Dr. Edward Morante Faculty to Faculty Webinar April 19, 2012 Sponsored by Lone Star College.](https://reader035.fdocuments.in/reader035/viewer/2022070401/56649f175503460f94c2dd74/html5/thumbnails/13.jpg)
Important Factors
• Reliability• Validity• Criterion-referenced• Power test• Decreased opportunity to guess• Alternate form for contingencies• Cost
![Page 14: Placement Testing Dr. Edward Morante Faculty to Faculty Webinar April 19, 2012 Sponsored by Lone Star College.](https://reader035.fdocuments.in/reader035/viewer/2022070401/56649f175503460f94c2dd74/html5/thumbnails/14.jpg)
Important Factors
• Reliability• Validity• Criterion-referenced• Power test• Decreased opportunity to guess• Alternate form for contingencies• Cost• No bias
![Page 15: Placement Testing Dr. Edward Morante Faculty to Faculty Webinar April 19, 2012 Sponsored by Lone Star College.](https://reader035.fdocuments.in/reader035/viewer/2022070401/56649f175503460f94c2dd74/html5/thumbnails/15.jpg)
SAT / ACT vs. placement tests
SAT / ACTSelect most likely to succeedPredict successHigher order skillsNo developmental level questions
Placement InstrumentsAssess basic skillsReady to enter college classes?Assess developmental levels
![Page 16: Placement Testing Dr. Edward Morante Faculty to Faculty Webinar April 19, 2012 Sponsored by Lone Star College.](https://reader035.fdocuments.in/reader035/viewer/2022070401/56649f175503460f94c2dd74/html5/thumbnails/16.jpg)
SAT/ ACT uses for placement
Multiple variablesHigh scoresAcademic achievementShould not override placement test results
![Page 17: Placement Testing Dr. Edward Morante Faculty to Faculty Webinar April 19, 2012 Sponsored by Lone Star College.](https://reader035.fdocuments.in/reader035/viewer/2022070401/56649f175503460f94c2dd74/html5/thumbnails/17.jpg)
Best Practice - timing
• Administer after college admittance and before orientation and registration
• Preparation for placement testing?
![Page 18: Placement Testing Dr. Edward Morante Faculty to Faculty Webinar April 19, 2012 Sponsored by Lone Star College.](https://reader035.fdocuments.in/reader035/viewer/2022070401/56649f175503460f94c2dd74/html5/thumbnails/18.jpg)
Best Practice - Process
• Do not make a placement based upon the results of one score of one test
(avoid error variance by using multiple variables)
![Page 19: Placement Testing Dr. Edward Morante Faculty to Faculty Webinar April 19, 2012 Sponsored by Lone Star College.](https://reader035.fdocuments.in/reader035/viewer/2022070401/56649f175503460f94c2dd74/html5/thumbnails/19.jpg)
Best Practice - Process
• Test all entering students• Collect available background info• Analyze these multiple data• Integrate information using multiple
variables• Make decisions about placement for each
student for each basic skills content area
![Page 20: Placement Testing Dr. Edward Morante Faculty to Faculty Webinar April 19, 2012 Sponsored by Lone Star College.](https://reader035.fdocuments.in/reader035/viewer/2022070401/56649f175503460f94c2dd74/html5/thumbnails/20.jpg)
Best - Multiple Variables
• Placement test and components• SAT / ACT• High School rank, GPA, course work• Motivation• Maturity• Family & Work• Support ….How can this be done quickly & efficiently?
![Page 21: Placement Testing Dr. Edward Morante Faculty to Faculty Webinar April 19, 2012 Sponsored by Lone Star College.](https://reader035.fdocuments.in/reader035/viewer/2022070401/56649f175503460f94c2dd74/html5/thumbnails/21.jpg)
Best - Multiple Variables
….How can this be done quickly & efficiently?
Work with the metrics of the test - Gordon
![Page 22: Placement Testing Dr. Edward Morante Faculty to Faculty Webinar April 19, 2012 Sponsored by Lone Star College.](https://reader035.fdocuments.in/reader035/viewer/2022070401/56649f175503460f94c2dd74/html5/thumbnails/22.jpg)
Predictive validity
Predictive validity is an inappropriate methodology for evaluating an achievement test such as a placement test. (recent CCRC report)
Assess skills
Assess proficiencies
![Page 23: Placement Testing Dr. Edward Morante Faculty to Faculty Webinar April 19, 2012 Sponsored by Lone Star College.](https://reader035.fdocuments.in/reader035/viewer/2022070401/56649f175503460f94c2dd74/html5/thumbnails/23.jpg)
Assessing
A test should be evaluated in the context of both the test itself and how it is used.
-Messick
![Page 24: Placement Testing Dr. Edward Morante Faculty to Faculty Webinar April 19, 2012 Sponsored by Lone Star College.](https://reader035.fdocuments.in/reader035/viewer/2022070401/56649f175503460f94c2dd74/html5/thumbnails/24.jpg)
Assessing
• Faculty examination of the content
• Sampling of skills
• Alignment w/ HS?
![Page 25: Placement Testing Dr. Edward Morante Faculty to Faculty Webinar April 19, 2012 Sponsored by Lone Star College.](https://reader035.fdocuments.in/reader035/viewer/2022070401/56649f175503460f94c2dd74/html5/thumbnails/25.jpg)
Assessing
Placement
Processes:
Is the process followed?
Who has override power?
Rigid or flexible?
![Page 26: Placement Testing Dr. Edward Morante Faculty to Faculty Webinar April 19, 2012 Sponsored by Lone Star College.](https://reader035.fdocuments.in/reader035/viewer/2022070401/56649f175503460f94c2dd74/html5/thumbnails/26.jpg)
Assessing
Placement
Processes:
How many changes are made by students after
placement?
![Page 27: Placement Testing Dr. Edward Morante Faculty to Faculty Webinar April 19, 2012 Sponsored by Lone Star College.](https://reader035.fdocuments.in/reader035/viewer/2022070401/56649f175503460f94c2dd74/html5/thumbnails/27.jpg)
Assessing
Are students placed appropriately?
Ask the experts . . .
![Page 28: Placement Testing Dr. Edward Morante Faculty to Faculty Webinar April 19, 2012 Sponsored by Lone Star College.](https://reader035.fdocuments.in/reader035/viewer/2022070401/56649f175503460f94c2dd74/html5/thumbnails/28.jpg)
Assessing
Are students placed appropriately?
Ask the experts . . .
Faculty!
![Page 29: Placement Testing Dr. Edward Morante Faculty to Faculty Webinar April 19, 2012 Sponsored by Lone Star College.](https://reader035.fdocuments.in/reader035/viewer/2022070401/56649f175503460f94c2dd74/html5/thumbnails/29.jpg)
Assessing
Faculty Assessment of Student Placement Survey
All faculty who teach all levels of developmental classes
+ All faculty who teach first level college ENGL & Math
• 4-6 Weeks – ask to individually rate the appropriateness
of each student’s placement
Entry proficiencies, not motivation, etc.
![Page 30: Placement Testing Dr. Edward Morante Faculty to Faculty Webinar April 19, 2012 Sponsored by Lone Star College.](https://reader035.fdocuments.in/reader035/viewer/2022070401/56649f175503460f94c2dd74/html5/thumbnails/30.jpg)
Assessing
Faculty Assessment of Student Placement Survey
Ratings system: Appropriately placed Should be placed in a lower level Should be placed in a higher level
Results compiled with an expected outcome of 80%
![Page 31: Placement Testing Dr. Edward Morante Faculty to Faculty Webinar April 19, 2012 Sponsored by Lone Star College.](https://reader035.fdocuments.in/reader035/viewer/2022070401/56649f175503460f94c2dd74/html5/thumbnails/31.jpg)
Last thought
Assessment and placement are only the beginning of the process. Student learning is the goal, and it is much more difficult to accomplish!
![Page 32: Placement Testing Dr. Edward Morante Faculty to Faculty Webinar April 19, 2012 Sponsored by Lone Star College.](https://reader035.fdocuments.in/reader035/viewer/2022070401/56649f175503460f94c2dd74/html5/thumbnails/32.jpg)
Questions?
![Page 33: Placement Testing Dr. Edward Morante Faculty to Faculty Webinar April 19, 2012 Sponsored by Lone Star College.](https://reader035.fdocuments.in/reader035/viewer/2022070401/56649f175503460f94c2dd74/html5/thumbnails/33.jpg)
Placement Testingwith Dr. Edward A. Morante
Faculty to Faculty Webinar Series