Badger Exam 3-8 Test Security Wisconsin Department of Public Instruction 2015.

20
Badger Exam 3-8 Badger Exam 3-8 Test Security Test Security Wisconsin Department of Wisconsin Department of Public Instruction Public Instruction 2015

Transcript of Badger Exam 3-8 Test Security Wisconsin Department of Public Instruction 2015.

Badger Exam 3-8Badger Exam 3-8 Test Security Test Security

Wisconsin Department of Wisconsin Department of

Public InstructionPublic Instruction

2015

Who is Responsible for Test Who is Responsible for Test Security?Security?

Everyone who works with the assessments, Everyone who works with the assessments, communicates test results, and/or receives testing communicates test results, and/or receives testing information is responsible for test security (also see information is responsible for test security (also see Test Security Roles and Responsibilities). This Test Security Roles and Responsibilities). This includes: includes:

Wisconsin Department of Public Instruction (DPI) staffWisconsin Department of Public Instruction (DPI) staffDistrict Administrators (DA)District Administrators (DA)District Assessment Coordinators (DACs)District Assessment Coordinators (DACs)School Assessment Coordinators (SACs)School Assessment Coordinators (SACs)Students, parents, and the community at largeStudents, parents, and the community at largeCertified and non-certified school staffCertified and non-certified school staffCooperative Educational Service Agency (CESA) staffCooperative Educational Service Agency (CESA) staff

Confidentiality AgreementsConfidentiality Agreements

The DAC, SAC, DTC, STC, and TA forms are The DAC, SAC, DTC, STC, and TA forms are available online in the TOMS system as electronic available online in the TOMS system as electronic sign offs. The CESA staff, district and school staff sign offs. The CESA staff, district and school staff forms are available as hard copy forms. Any forms are available as hard copy forms. Any district/school staff who have access to the test or district/school staff who have access to the test or reports (providing accommodations, setting up reports (providing accommodations, setting up tests etc.) without access to TOMS do not sign the tests etc.) without access to TOMS do not sign the electronic confidentiality forms in TOMS. These electronic confidentiality forms in TOMS. These individuals must sign hard copy confidentiality individuals must sign hard copy confidentiality forms and submit the form to their DAC/SAC. This forms and submit the form to their DAC/SAC. This applies to the CESA staff who has access to any applies to the CESA staff who has access to any testing materials or data.testing materials or data.

Security Throughout the Testing Security Throughout the Testing ProcessProcess

Test security incidents are behaviors Test security incidents are behaviors prohibited:prohibited:

Prior to testingPrior to testing During testingDuring testing After testingAfter testing

Whether intentional or by accident, failure Whether intentional or by accident, failure to comply with security rules, either by to comply with security rules, either by staff or students constitutes a test staff or students constitutes a test security incident.security incident.

ImproprietyImpropriety

Low level security incidentLow level security incident Unusual circumstances that have a low Unusual circumstances that have a low

impact on the individual or group of impact on the individual or group of students who are testing and have a low students who are testing and have a low risk of potentially affecting student risk of potentially affecting student performance on the test, test security, or performance on the test, test security, or test validity. Must be reported to DPI test validity. Must be reported to DPI within 24 hours.within 24 hours.

For a list of examples see the Test Security Manual. http://oea.dpi.wi.gov/assessment/Smarter/security

Irregularity Irregularity

Medium level security incidentMedium level security incident Unusual circumstances that impact an Unusual circumstances that impact an

individual or group of students who are individual or group of students who are testing and may potentially affect student testing and may potentially affect student performance on the test, test security, or performance on the test, test security, or test validity. Must be reported to DPI test validity. Must be reported to DPI within 24 hours.within 24 hours.

For a list of examples see the Test Security Manual. http://oea.dpi.wi.gov/assessment/Smarter/security

Breach Breach

High level security incidentHigh level security incident An event that poses a significant threat to An event that poses a significant threat to

the validity of the test. These the validity of the test. These circumstances have external implications circumstances have external implications and may result the removal of the test and may result the removal of the test question from the item bank. A breach question from the item bank. A breach must be reported immediatelymust be reported immediately

For a list of examples see the Test Security Manual. http://oea.dpi.wi.gov/assessment/Smarter/security

Security of the Testing Security of the Testing EnvironmentEnvironment

Remove or cover all instructional materialsRemove or cover all instructional materials that might that might assist students in answering questions displayed on bulletin assist students in answering questions displayed on bulletin boards, chalkboards, dry-erase boards, or on charts (e.g., boards, chalkboards, dry-erase boards, or on charts (e.g., wall charts that contain literary definitions, maps, wall charts that contain literary definitions, maps, mathematics formulas, etc.). mathematics formulas, etc.).

Ensure adequate spacing between students. (enough space Ensure adequate spacing between students. (enough space minimize opportunities to look at each other’s monitor, or minimize opportunities to look at each other’s monitor, or they should be provided with tabletop partitions or other they should be provided with tabletop partitions or other visual barriers.)visual barriers.)

Place a “TESTING—DO NOT DISTURB” sign on the door of Place a “TESTING—DO NOT DISTURB” sign on the door of the testing room the testing room

Provide a quiet environment void of distractionsProvide a quiet environment void of distractions Place a “No Cell phones or other unauthorized electronic Place a “No Cell phones or other unauthorized electronic

devices” sign in the room.devices” sign in the room.

General Security RemindersGeneral Security Reminders

Unauthorized staff, other adults, or students not Unauthorized staff, other adults, or students not participating in the assessment are not allowed in the room participating in the assessment are not allowed in the room during administration. Only students participating in the during administration. Only students participating in the assessment may view test questions. assessment may view test questions.

Digital, electronic, or manual devices are not to be used to Digital, electronic, or manual devices are not to be used to record or retain test items, reading passages, or writing record or retain test items, reading passages, or writing prompts.prompts.

Do not review, discuss, or analyze test items, stimuli, Do not review, discuss, or analyze test items, stimuli, reading passages, or writing prompts at any time, including reading passages, or writing prompts at any time, including before, during, or after testing. before, during, or after testing.

Test Items and Materials must not be discussed with or Test Items and Materials must not be discussed with or released to anyone via any media, including fax, e-mail, released to anyone via any media, including fax, e-mail, social media websites, etc. social media websites, etc.

Do not use any test items, stimuli, reading passages, or Do not use any test items, stimuli, reading passages, or writing prompts for instruction.writing prompts for instruction.

Test TicketsTest Tickets

Test tickets include confidential information necessary Test tickets include confidential information necessary for students to log in to the test delivery system.for students to log in to the test delivery system.Test Tickets should be secured at all times.Test Tickets should be secured at all times.Ensure that the test tickets are provided to students only at the Ensure that the test tickets are provided to students only at the beginning of each testing session and collected at the end of the beginning of each testing session and collected at the end of the testing session.testing session.Ensure that the test tickets are distributed to the appropriate Ensure that the test tickets are distributed to the appropriate students.students.If students did not complete the test, test tickets should be If students did not complete the test, test tickets should be stored until the subsequent test session. stored until the subsequent test session. Destroy the test tickets securely after complete administration Destroy the test tickets securely after complete administration of the assessment.of the assessment.Staff shall not logon to Badger Exam using student credentials.Staff shall not logon to Badger Exam using student credentials.

Calculator PolicyCalculator Policy

The calculators are embedded in the The calculators are embedded in the Badger Exam and calculators should not Badger Exam and calculators should not be provided to students. Please refer to be provided to students. Please refer to the Usability, Accessibility, and the Usability, Accessibility, and Accommodations Guide (UAAG) regarding Accommodations Guide (UAAG) regarding the students with dyscalculia disability and the students with dyscalculia disability and students using the Braille accommodations students using the Braille accommodations for specific calculator accommodation.for specific calculator accommodation.

Print On DemandPrint On Demand The Print on Demand feature is for extremely rare instances The Print on Demand feature is for extremely rare instances

(e.g., photosensitive epilepsy) where a student’s condition (e.g., photosensitive epilepsy) where a student’s condition prevents him or her from accessing material online. All other prevents him or her from accessing material online. All other students should access the assessment in the online format. students should access the assessment in the online format.

The decision to allow this accommodation must be based on The decision to allow this accommodation must be based on each individual student’s need and documented in a student’s each individual student’s need and documented in a student’s IEP or 504 plan. IEP or 504 plan.

This request must be submitted to DPI at least two weeks This request must be submitted to DPI at least two weeks prior to Badger Exam via the Request for Print on demand prior to Badger Exam via the Request for Print on demand accommodation form available at accommodation form available at http://oea.dpi.wi.gov/assessment/formshttp://oea.dpi.wi.gov/assessment/forms. .

DPI staff will review the request and if approved, activate the DPI staff will review the request and if approved, activate the accommodation in TOMS. accommodation in TOMS.

The printed materials shall be destroyed securely and a The printed materials shall be destroyed securely and a completed confirmation of destruction form, available at completed confirmation of destruction form, available at http://oea.dpi.wi.gov/assessment/formshttp://oea.dpi.wi.gov/assessment/forms, must be submitted., must be submitted.

Accommodations and AccessibilityAccommodations and Accessibility

State and federal laws require that state assessments must State and federal laws require that state assessments must allow for the inclusion of all students, including students allow for the inclusion of all students, including students with disabilities and English Language Learners, to the with disabilities and English Language Learners, to the extent practicable. extent practicable.

The Smarter Balanced The Smarter Balanced Usability, Accessibility, and Usability, Accessibility, and Accommodations GuidelinesAccommodations Guidelines (UAAG) are intended for (UAAG) are intended for school-level personnel and decision-making teams as they school-level personnel and decision-making teams as they prepare for and implement the Badger Exam. prepare for and implement the Badger Exam.

The UAAG provides information for classroom teachers, The UAAG provides information for classroom teachers, English development educators, special education teachers, English development educators, special education teachers, and related services personnel to use in selecting and and related services personnel to use in selecting and administering universal tools, designated supports, and administering universal tools, designated supports, and accommodations for those students who need them. accommodations for those students who need them.

TOMS SecurityTOMS Security

TOMS is a secure website used to manage the Badger TOMS is a secure website used to manage the Badger Exam. TOMS is used to store all students’ demographic Exam. TOMS is used to store all students’ demographic information. This information will be reviewed and information. This information will be reviewed and updated before testing. TOMS is also used to initiate updated before testing. TOMS is also used to initiate testing for students and access score reports. Access testing for students and access score reports. Access to various features in TOMS is dependent upon the to various features in TOMS is dependent upon the user role. When accessing TOMS:user role. When accessing TOMS:

Staff shall not share their logon credentials with Staff shall not share their logon credentials with others. others. Security guidelines must be followed at all times. Security guidelines must be followed at all times. Student data shall be kept confidential at all times per Student data shall be kept confidential at all times per the FERPA and other data security guidelines.the FERPA and other data security guidelines.

Process to Report Security Process to Report Security IncidentIncident

Administrators, certified and non-certified school Administrators, certified and non-certified school staff, students and parents must adhere to ethical staff, students and parents must adhere to ethical procedure in testing. procedure in testing. School or district staff must immediately report all incidents of School or district staff must immediately report all incidents of test administration improprieties, irregularities, and breaches to test administration improprieties, irregularities, and breaches to the DAC and to the DPI Office of Student Assessment (OSA). the DAC and to the DPI Office of Student Assessment (OSA). The report of an incident may be submitted to the OSA by The report of an incident may be submitted to the OSA by telephone, fax, letter, e-mail, or by submitting an Incident telephone, fax, letter, e-mail, or by submitting an Incident Report Form.Report Form.Depending on the perceived severity of the allegation, the OSA Depending on the perceived severity of the allegation, the OSA may ask the school district to conduct a thorough fact-finding may ask the school district to conduct a thorough fact-finding investigation of the alleged irregularity and report the results of investigation of the alleged irregularity and report the results of its investigation to the DPI within two weeks. its investigation to the DPI within two weeks.

For more information see the Test Security Manual. http://oea.dpi.wi.gov/assessment/Smarter/security

Consequences of Test Security Consequences of Test Security ViolationsViolations

Consequences of violations may include invalidation Consequences of violations may include invalidation of student test results and could result in civil of student test results and could result in civil legal liability for copyright violations. legal liability for copyright violations.

At either the school or school district level, a test violation At either the school or school district level, a test violation could result in the loss of a year’s test results for the could result in the loss of a year’s test results for the grade(s) and subject(s) affected by the test irregularity. grade(s) and subject(s) affected by the test irregularity. Which would show on the public data site as “not tested”.Which would show on the public data site as “not tested”.

There will be no opportunity to retest. There will be no opportunity to retest. When test results are invalidated, the student(s) do not When test results are invalidated, the student(s) do not

receive test results for those content areas. receive test results for those content areas. The school district should be prepared to explain this to The school district should be prepared to explain this to

students’ parents. students’ parents.

AppealsAppeals

Some situations may result in the need to reset, Some situations may result in the need to reset, reopen, invalidate, or restore individual student reopen, invalidate, or restore individual student assessments. When this happens the DAC must assessments. When this happens the DAC must submit an appeal through TOMs. Some examples of submit an appeal through TOMs. Some examples of when a DAC might submit an appeal would be:when a DAC might submit an appeal would be:A test security breach that resulted in an invalidation.A test security breach that resulted in an invalidation.A student was ill and unable to complete a PT portion of the A student was ill and unable to complete a PT portion of the assessment within the 10 days and needs the expired test assessment within the 10 days and needs the expired test reopened.reopened.

Professional judgment should be applied on a case-Professional judgment should be applied on a case-by-case basis. Once the appeal is reviewed by DPI, by-case basis. Once the appeal is reviewed by DPI, the DAC will receive an e-mail from the DAC will receive an e-mail from [email protected]@ets.org with a resolution (approval or denial with a resolution (approval or denial of request). of request).

Types of AppealsTypes of Appeals

Reset - Reset - Resetting a student’s test removes that Resetting a student’s test removes that test from the system and enables the student to test from the system and enables the student to start a new test from the beginningstart a new test from the beginning..

Invalidate - Invalidate - Invalidated tests will not be scored Invalidated tests will not be scored and the student will not count as a test participant. and the student will not count as a test participant.

Reopen - Reopen - Reopening a test allows a student to Reopening a test allows a student to access a test that has already been expired or access a test that has already been expired or submittedsubmitted

Restore - Restore - A test that has been reset in error can A test that has been reset in error can be restored to its previous status and restarted be restored to its previous status and restarted where the student left off.where the student left off.In addition to submitting the reset appeal request, the DAC must report to DPI via the incident form. For more information see the Test Security Manual. http://oea.dpi.wi.gov/assessment/Smarter/security

Questions may be submitted to [email protected] Questions may be submitted to [email protected]