Test security

Wisconsin Knowledge & Concepts Examination (WKCE) Test Security Training for ProctorsWisconsin Department of Public InstructionOffice of Educational Accountability06/19/2013

1Purpose of this TrainingTo emphasize the importance of test securityTo ensure the standardized administration of the tests To make sure that there is not an unfair advantage to some studentsTo improve the overall understanding of test security procedures

Security

2Test SecurityThe primary goal of WKCE test security is toprotect the integrity of the examinations through:

Securing the test materials at all times

Ensuring appropriate administration of the test

Consequences of Test Security ViolationsWhen the security of an item is breached, this may result in making the item unusable in future tests. The state then incurs additional costs associated with item development, which is already a very expensive process.

An unfair advantage may be provided to some students, making it difficult to draw meaningful conclusions about their performance.

4Consequences of Test Security ViolationsInvalidation of test results for individual students or groups of students.

This will result in Parents receive no scores on their childs report if a test is invalidatedPublic reporting will reflect all invalidated tests as not tested. This may reduce the percentage of students meeting proficiency.Schools may have a more difficult time meeting accountability requirements as a result.

5Stages of Test Administration During WhichTest Security Must be EnsuredPrior to testingDuring testingAfter testingDuring Item Analysis /data retreats

6List of Responsibilities at Proctor LevelRead the Test Security Manual, and the Accommodations GuidelinesRead and follow the directions as stated in the Test Administrators Manual Attend WKCE test administration training session prior to each test administration yearReview the Accommodation GuidelinesRemain in the room throughout the entire test administration Ensure that test materials are in a locked and secure location

7List of Responsibilities at Proctor LevelEnsure that students do not view the WKCE test materials prior to testing.Ensure that students do not receive improper assistance during testing.Ensure that completed student answer books are not reviewed for completeness of answers.Make sure that students are working in the correct place in their test books.Prevent students and others from talking about or sharing answers

List of Responsibilities at Proctor LevelReport all testing irregularities to the school assessment coordinator such as

Student going back to the previous sessionStudent cheatingUnallowable accommodations

Do not copy, alter, or modify of test materials, including photocopying student writing samples

9Calculator PolicyThe use of calculators varies by grade. There are clear directions for the use of calculators in the Test Administration Manual and the Policy Manual both of which can be accessed at http://oea.dpi.wi.gov/oea_publications.

It is important to review these policies carefully as inappropriate use of calculators during test administration may result in invalidation of test results.

Appropriate Use of Test Accommodations For use of allowable accommodations, please refer to the assessment matrix available at http://oea.dpi.wi.gov/oea_accommtrxIn the event that an accommodation is not on the matrix but necessary for a student to demonstrate their knowledge & skills in a content area , a non-standard accommodations request form should be submitted to DPI for consideration. This form is available at http://oea.dpi.wi.gov/oea_dacformsIf DPI agrees that the requested accommodation does not affect the validity of the test, it will be approved.If it does impact test validity, the school may use the accommodation but the student will be counted as not tested.

11After TestingAfter testing, all test booksthose to be scored and those not to be scored are to be returned to the school assessment coordinator Follow the procedures established by the school assessment coordinator for returning all used and unused testing materials, blank paper, and supplemental materials

Test Security Violations to AvoidUse of a non-allowed accommodation e.g. Reading the reading test.

Use of live test items for test preparation activities

Allowing the use of a calculator for computation sections in Mathematics

13Reporting Test Security ViolationsTest Security violations / irregularities should be reported to DPI at 608-267-1072A completed Incident report form should be submitted to your SAC and DACDistricts may be contacted to conduct further investigationDistricts might choose additional consequences as related to personnel contracts / issues

14Process for Handling Test Security ViolationsInitial Report Alleging Specific ViolationA test security violation is reported and received by the Department of Public Instruction from any individual, school, or district alleging that a specific breach in test security has occurred in an individual district or testing site via telephone, email, or submission of the test security violation form.Initial Internal Review of Alleged Test Security ViolationThe Office of Student Assessment (OSA) reviews all reports brought to the team to determine how best to resolve the allegation by analyzing the severity of the alleged breach of test security and the scope of potential harm the breach may bring to the integrity of the assessment results.Telephone Assistance from OSA to the District Assessment Coordinator (DAC)Invalidation of Test ScoresLetter from Director of OSA No Violation Determined/No ConsequencesDistricts may choose additional consequences regarding personnel issues.

15Thank You!For additional information, please contact osamail@dpi.wi.gov

16