Administration Code for Kentucky’s Educational Assessment Program

Spring 2012

Recent loss of certification for Kentucky educators emphasizes

the seriousness of this topic.

Analysis by Vendor

• Large score changes for a student• Large mean score increases• Probability of matched response analysis• Pattern analysis• Comparison of individual student scores by

item type

Allegations

Sources of Allegations

• Inappropriate Assistance/Intervention by Staff• Test Security-Staff or Student (e.g. materials left

unattended)• Out-of-Order-Staff or Student (e.g. looking ahead in

test booklet)• Special Education (e.g. accommodation not in IEP)• Student Action (e.g. cheating)• Missing Materials (e.g. test missing from inventory)• Other (e.g. good faith feedback during test, not

providing necessary materials)

Steps in Filing Allegations

• Notarized statements• Supporting documentation (e.g.

administration code signature sheet(s), test schedule, etc.)

• Potential KDE site visit

Resolution of Allegations

• After significant time, the Testing Board of Review makes a recommendation to the Commissioner of Education who makes a final decision of…– Case closed OR– Scores lowered AND/OR– Training assigned for staff AND/OR– Names of staff sent to EPSB

Reward Programs

• Shall be consistent with those applied within the larger school program

• Individual results from checklists (e.g. for “Good Faith”) shall not be made available to students until the entire assessment has been administered.

• Local school board and activity funds cannot be used to fund reward programs. Donations may be used.

Organizers/Pre-Writing

• A specific organizer or pre-write method for “Good Faith” is not acceptable.

• Complete first drafts shall not be required.

Test Preparation Practice

• shall not increase students’ test scores on the statewide assessment without simultaneously increasing students’ ability to apply content to real-life situations.

Classroom Materials

Remove content and processes• No matter how small• No matter where it is located• No matter if it’s not tested in your room*Stretch the definition of “content” and

“processes” to the limit in order to be extra careful.

*Get a friend to double check your room.

Allowable Materials• Only as prescribed by the T. A. M. See the sections…

– Inventory of Test Materials– Additional Materials Provided by Schools

• No sharing of calculators unless you are positive that answers have been cleared.

• No leaving the testing areas to obtain materialsKDE's states that a 4-function calculator is sufficient.  However, when a mix of 4-function and scientific calculators is what you have available, be cautious about the perception given about who gets the scientific version.  We don't want students (or their parents) thinking that they got the 4-function version because they are not expected to do as well.  Distribute them randomly and be sure that any student can get the scientific version if they ask for one.  If this involves moving a calculator from one student to another or a few shared scientific ones, be sure that answers are cleared from memory before a calculator is given to a student.

There should not be a cessation of all normal instruction during the testing

window.There shall be no reviewing for the

test during the testing window.

The use of any accommodations shall not inappropriately interfere with or influence the administration of the

assessment to other students.

Test Security

• Test books should either be…– attended– double locked

Timing the Tests

• Students may not be given more time on a specific test part than specified in the T. A. M./T.A.S.

• Students shall not be allowed to work ahead to future test session parts or to return to past parts.

• Students shall not take more than a single school day to complete a testing session.

Texting

If this is observed, it is an indication that students might be cheating. This is challenging to monitor since kids are so sneaky about doing it. "Hands are to remain in plain sight" is a good policy to prevent it.

Student Movement During Test Sessions

• Students may not move about the testing room.

• Students may not be left alone in a testing room.

Proctors

• shall not engage in any behavior that would assist the students in responding to any test item. For example,– “You can do better.”—NO – “Good job.”—NO – “Do your best.”—YES

Knowledge of Specific Test Content

• Do not obtain deliberately. • Do not reveal to anyone.• Do not use to prepare students for the

assessment.

Student Responses

• Cannot be scored (including rough drafts)• Cannot be read in their entirety (even to

determine “Good Faith Effort”• Cannot be copied

Staff shall not alter student answers at any time.

• DO NOT erase anything, except for a stray mark

• DO NOT add anything

Disciplinary Problems Found During Visually Scanning Answers

• For example, inappropriate language or drawings.• Students shall not be allowed to modify their

initial response.• Students may be instructed to answer the

questions again on separate sheets of paper. The original responses, along with the rewritten ones clearly marked NOT TO BE SCORED—ITEMS RETAKEN FOR DISCIPLINARY PURPOSES, shall be submitted for scoring to the testing contractor.

Errors in testing materials should be reported to the B. A. C.

DO NOT take any individual action.

Live by the Code!

• This presentation highlights the most important points.

• No presentation takes the place of reading the code, which you should do!

• When in doubt, ask your B. A. C.

KDE conducts random site visits to analyze…

• Training• Testing Schedule• Extended Time• Materials Management• Test Security• Testing Environment• Accommodations• Exemptions• Return of Materials• Student Motivation

Questions…