Wisconsin Knowledge &Wisconsin Knowledge & Concepts Examination (WKCE) Concepts Examination (WKCE)

Test Security Training for Test Security Training for ProctorsProctors

Wisconsin Department of Wisconsin Department of Public InstructionPublic InstructionOffice of Educational Office of Educational

AccountabilityAccountability10/07/2011

Purpose of this TrainingPurpose of this Training

To emphasize the importance of test To emphasize the importance of test securitysecurity

To ensure the standardized To ensure the standardized administration of the tests administration of the tests

To make sure that there is not an To make sure that there is not an unfair advantage to some studentsunfair advantage to some students

To improve the overall understanding To improve the overall understanding of test security proceduresof test security procedures

Test SecurityTest Security

The primary goal of WKCE test security The primary goal of WKCE test security is tois to

protect the integrity of the protect the integrity of the examinations through:examinations through:

Securing the test materials at all Securing the test materials at all times times

Ensuring appropriate administration Ensuring appropriate administration of the testof the test

Consequences of Test Consequences of Test Security ViolationsSecurity Violations

When the security of an item is breached, When the security of an item is breached, this may result in making the item unusable this may result in making the item unusable in future tests. The state then incurs in future tests. The state then incurs additional costs associated with item additional costs associated with item development, which is already a very development, which is already a very expensive process.expensive process.

An unfair advantage may be provided to An unfair advantage may be provided to some students, making it difficult to draw some students, making it difficult to draw meaningful conclusions about their meaningful conclusions about their performance.performance.

Consequences of Test Consequences of Test Security ViolationsSecurity Violations

Invalidation of test results for individual students Invalidation of test results for individual students or groups of students. or groups of students.

This will result in This will result in Parents receive no scores on their child’s Parents receive no scores on their child’s

report if a test is invalidatedreport if a test is invalidated Public reporting on WINSS will reflect all Public reporting on WINSS will reflect all

invalidated tests as “not tested”. This may invalidated tests as “not tested”. This may reduce the percentage of students meeting reduce the percentage of students meeting proficiency.proficiency.

Schools may have a more difficult time Schools may have a more difficult time meeting Adequate yearly progress (AYP) meeting Adequate yearly progress (AYP) indicators as a result.indicators as a result.

Stages of Test Stages of Test Administration Administration During WhichDuring Which

Test Security Must be Test Security Must be EnsuredEnsured

Prior to testingPrior to testing During testingDuring testing After testingAfter testing During Item Analysis /data During Item Analysis /data

retreatsretreats

List of Responsibilities at List of Responsibilities at Proctor LevelProctor Level

Attend WKCE test administration training session Attend WKCE test administration training session prior to each test administrationprior to each test administration

Sign confidentiality form and return to school Sign confidentiality form and return to school assessment coordinator assessment coordinator

Ensure that test materials are in locked and Ensure that test materials are in locked and secure location before and after each testing secure location before and after each testing session session

Remain in the room throughout the entire test Remain in the room throughout the entire test administration administration

Read and follow the directions as stated in the Read and follow the directions as stated in the Test Administrator’s ManualTest Administrator’s Manual

List of Responsibilities at List of Responsibilities at Proctor LevelProctor Level

Report all testing irregularities to the school Report all testing irregularities to the school assessment coordinator such asassessment coordinator such as

– Student going back to the previous sessionStudent going back to the previous session– Student cheatingStudent cheating– Unallowable accommodationsUnallowable accommodations

Do not copy, alter/modify items (i.e photocopying Do not copy, alter/modify items (i.e photocopying student writing samples)student writing samples)

Follow testing policies for electronic devices Follow testing policies for electronic devices including calculators and cell phonesincluding calculators and cell phones

Calculator PolicyCalculator Policy

The use of calculators varies by grade. The use of calculators varies by grade. There are clear directions for the use of There are clear directions for the use of calculators in the Test Administration calculators in the Test Administration Manual and the Policy Manual both of which Manual and the Policy Manual both of which can be accessed at can be accessed at http://dpi.wi.gov/oea/publications.html. .

It is important to review these policies It is important to review these policies carefully as inappropriate use of calculators carefully as inappropriate use of calculators during test administration may result in during test administration may result in invalidation of test results.invalidation of test results.

Appropriate Use of Test Appropriate Use of Test Accommodations Accommodations

For use of allowable accommodations, please For use of allowable accommodations, please refer to the assessment matrix available at refer to the assessment matrix available at http://dpi.wi.gov/oea/accommtrx.html In the event that an accommodation is not on In the event that an accommodation is not on

the matrix but necessary for a student to the matrix but necessary for a student to demonstrate their knowledge & skills in a demonstrate their knowledge & skills in a content area , a non-standard accommodations content area , a non-standard accommodations request form should be submitted to DPI for request form should be submitted to DPI for consideration. This form is available at consideration. This form is available at http://www.dpi.wi.gov/oea/dacforms.html

– If DPI agrees that the requested accommodation does If DPI agrees that the requested accommodation does not affect the validity of the test, it will be approved.not affect the validity of the test, it will be approved.

– If it does impact test validity, the school may use the If it does impact test validity, the school may use the accommodation but the student will be counted as “not accommodation but the student will be counted as “not tested”.tested”.

After TestingAfter Testing

After testing, all test books—those to After testing, all test books—those to be scored and those not to be scoredbe scored and those not to be scored— are to be returned to the school — are to be returned to the school assessment coordinator assessment coordinator – Follow the procedures established by Follow the procedures established by

the school assessment coordinator for the school assessment coordinator for returning all used and unused testing returning all used and unused testing materials, blank paper, and materials, blank paper, and supplemental materials supplemental materials

List of Common Errors – List of Common Errors – Test Security Violations to Test Security Violations to

AvoidAvoid Use of a non-allowed accommodation Use of a non-allowed accommodation

e.g. Reading the reading test.e.g. Reading the reading test.

Use of live test items for test Use of live test items for test preparation activitiespreparation activities

Allowing the use of calculator for Allowing the use of calculator for computation sections in Mathematics computation sections in Mathematics

Reporting Test Security Reporting Test Security ViolationsViolations

Test Security violations / irregularities Test Security violations / irregularities should be reported to DPI at 608-267-1072should be reported to DPI at 608-267-1072

Districts may be contacted to conduct Districts may be contacted to conduct further investigationfurther investigation

Districts might choose additional Districts might choose additional consequences as related to personnel consequences as related to personnel contracts / issuescontracts / issues

Process for Handling Process for Handling Test Security ViolationsTest Security Violations

INITIAL REPORT ALLEGING A SPECIFIC VIOLATIONA test security violation is reported and received by the Department from any individual or school or district alleging that a specific breach in test security has occurred in an individual district or testing site.

INITIAL INTERNAL REVIEW OF POTENTIAL TEST SECURITY IRREGULARITYThe DPI Internal Test Security Review Team reviews all reports brought to the team to determine how best to resolve the allegation by analyzing the severity of the alleged breach of test security and the scope of potential harm the breach may bring to the integrity of assessment results.

Telephone assistance from OEA to the DAC .

Invalidation of test scores

Letter from the director of OEA

Approval / no consequences

Districts may choose additional consequences related to personnel contracts / issues.

For additional information, please contact oeamail@dpi.wi.gov