Caveon Webinar Series - Learning and Teaching Best Practices in Test Security - June 2015
Caveon Webinar Series - Conducting Test Security Investigations in School Districts and LEAsppt...
-
Upload
caveon-test-security -
Category
Education
-
view
219 -
download
0
Transcript of Caveon Webinar Series - Conducting Test Security Investigations in School Districts and LEAsppt...
![Page 1: Caveon Webinar Series - Conducting Test Security Investigations in School Districts and LEAsppt show](https://reader038.fdocuments.in/reader038/viewer/2022110218/587bf78c1a28ab7c668b4d6f/html5/thumbnails/1.jpg)
www.caveon.com1
Caveon Webinar SeriesConducting Test Security
Investigations in Districts and LEAs
May 25, 2016
![Page 2: Caveon Webinar Series - Conducting Test Security Investigations in School Districts and LEAsppt show](https://reader038.fdocuments.in/reader038/viewer/2022110218/587bf78c1a28ab7c668b4d6f/html5/thumbnails/2.jpg)
www.caveon.com2
Today’s Presenters
Steve Addicott Marc Weinstein
![Page 3: Caveon Webinar Series - Conducting Test Security Investigations in School Districts and LEAsppt show](https://reader038.fdocuments.in/reader038/viewer/2022110218/587bf78c1a28ab7c668b4d6f/html5/thumbnails/3.jpg)
www.caveon.com3
Agenda for Today• What’s going on in K-12 testing• The impact of a security incident• Preparing for an incident, before one
occurs• Building your Security Incident
Response Plan • Conducting an internal investigation• Summary• Q&A
![Page 4: Caveon Webinar Series - Conducting Test Security Investigations in School Districts and LEAsppt show](https://reader038.fdocuments.in/reader038/viewer/2022110218/587bf78c1a28ab7c668b4d6f/html5/thumbnails/4.jpg)
www.caveon.com4
What’s Happening Out There?• Recent, real-life situations some
districts are facing:o “Disappearance” of Austin High Students
Sparked Questionso 50 Students Face Grade Tampering
Allegationso Two Colorado Springs Teachers May Have
Shared Test Information with Studentso U. of Iowa Investigates Possible Cheating
in Online Courseso 3 Face Expulsion in Coast Guard
Academy Cheating Probe
![Page 5: Caveon Webinar Series - Conducting Test Security Investigations in School Districts and LEAsppt show](https://reader038.fdocuments.in/reader038/viewer/2022110218/587bf78c1a28ab7c668b4d6f/html5/thumbnails/5.jpg)
www.caveon.com5
What is at stake?
Consider what you are protecting
Validity of assessments Accountability determinations Educational resource decisions Professional evaluations Exam content Funding Public trust and confidence Public Welfare
![Page 6: Caveon Webinar Series - Conducting Test Security Investigations in School Districts and LEAsppt show](https://reader038.fdocuments.in/reader038/viewer/2022110218/587bf78c1a28ab7c668b4d6f/html5/thumbnails/6.jpg)
www.caveon.com6
SECURITY = TEST SCORE VALIDITY
Test Security = Exam Integrity
Exam Integrity = Test Score Validity
![Page 7: Caveon Webinar Series - Conducting Test Security Investigations in School Districts and LEAsppt show](https://reader038.fdocuments.in/reader038/viewer/2022110218/587bf78c1a28ab7c668b4d6f/html5/thumbnails/7.jpg)
www.caveon.com7
Test Security is an Ongoing ProcessInvestigations Serve an Important Function In Every Step of the Process
Protect
Detect
Respond
Improve
![Page 8: Caveon Webinar Series - Conducting Test Security Investigations in School Districts and LEAsppt show](https://reader038.fdocuments.in/reader038/viewer/2022110218/587bf78c1a28ab7c668b4d6f/html5/thumbnails/8.jpg)
www.caveon.com8
Before an Incident Occurs• Know your test security processes and
procedures• All programs have vulnerabilities. Know
yours.• Ensure all testing staff is thoroughly
trained• Identify all stakeholders in the testing
process• Create your Security Incident Response
Plan
![Page 9: Caveon Webinar Series - Conducting Test Security Investigations in School Districts and LEAsppt show](https://reader038.fdocuments.in/reader038/viewer/2022110218/587bf78c1a28ab7c668b4d6f/html5/thumbnails/9.jpg)
www.caveon.com9
What is an SIRP?Security Incident Response Plan• Dictates what to do when a testing
irregularity occurs• Creates a consistent methodology for
treating infractions and breaches• Establishes protocols for penalties
imposed when incidents occuro Decision-makingo Escalation Patho Communications
![Page 10: Caveon Webinar Series - Conducting Test Security Investigations in School Districts and LEAsppt show](https://reader038.fdocuments.in/reader038/viewer/2022110218/587bf78c1a28ab7c668b4d6f/html5/thumbnails/10.jpg)
www.caveon.com10
Security Incident Response Plan
Key Components of an SIRP• Agreements in place• Policies in place• Practices in place for analysis and
monitoring• Incident response matrix• Investigative strategies• Communications plan
![Page 11: Caveon Webinar Series - Conducting Test Security Investigations in School Districts and LEAsppt show](https://reader038.fdocuments.in/reader038/viewer/2022110218/587bf78c1a28ab7c668b4d6f/html5/thumbnails/11.jpg)
www.caveon.com11
Key Functions
• Management• Budgeting• Analysis – Statistical analysis; monitoring
of the internet; etc.• Training– Staff training and awareness• Investigations– First line investigation
processes
![Page 12: Caveon Webinar Series - Conducting Test Security Investigations in School Districts and LEAsppt show](https://reader038.fdocuments.in/reader038/viewer/2022110218/587bf78c1a28ab7c668b4d6f/html5/thumbnails/12.jpg)
www.caveon.com12
Seven Step Incident Investigation Process
![Page 13: Caveon Webinar Series - Conducting Test Security Investigations in School Districts and LEAsppt show](https://reader038.fdocuments.in/reader038/viewer/2022110218/587bf78c1a28ab7c668b4d6f/html5/thumbnails/13.jpg)
www.caveon.com13
Incident Investigation Process
• Identify and document triggering incidento Tip lineo Proctor reportso Statistical analyseso Mediao Web monitoring
![Page 14: Caveon Webinar Series - Conducting Test Security Investigations in School Districts and LEAsppt show](https://reader038.fdocuments.in/reader038/viewer/2022110218/587bf78c1a28ab7c668b4d6f/html5/thumbnails/14.jpg)
www.caveon.com14
Incident Investigation Process
• Determine scope of potential harmo What is the impacto Who is involvedo Effect on test scores?
![Page 15: Caveon Webinar Series - Conducting Test Security Investigations in School Districts and LEAsppt show](https://reader038.fdocuments.in/reader038/viewer/2022110218/587bf78c1a28ab7c668b4d6f/html5/thumbnails/15.jpg)
www.caveon.com15
Incident Investigation Process• Complete initial incident report as
required by applicable policies and procedureso Leveraging SIRPo Disseminate it appropriatelyo Escalation and communication
![Page 16: Caveon Webinar Series - Conducting Test Security Investigations in School Districts and LEAsppt show](https://reader038.fdocuments.in/reader038/viewer/2022110218/587bf78c1a28ab7c668b4d6f/html5/thumbnails/16.jpg)
www.caveon.com16
Incident Investigation Process
• Identify evidence availableo Varies by the nature of the incidento May include myriad physical and electronic
documents and correspondences
![Page 17: Caveon Webinar Series - Conducting Test Security Investigations in School Districts and LEAsppt show](https://reader038.fdocuments.in/reader038/viewer/2022110218/587bf78c1a28ab7c668b4d6f/html5/thumbnails/17.jpg)
www.caveon.com17
Incident Investigation Process
• Initial report/allegation• Documentary evidence• Forensic data analysis• Comparison data• Physical evidence• Electronic evidence• Witness statements
![Page 18: Caveon Webinar Series - Conducting Test Security Investigations in School Districts and LEAsppt show](https://reader038.fdocuments.in/reader038/viewer/2022110218/587bf78c1a28ab7c668b4d6f/html5/thumbnails/18.jpg)
www.caveon.com18
Incident Investigation Process
• Instruct administrators, educators, students, vendors and others to preserve relevant evidence
• Know document/data retention policies• Collect all relevant evidence• Preserve chain of custody for all
documents and electronic evidence• Review/analyze all evidence• Conduct interviews after reviewing all
relevant evidence
![Page 19: Caveon Webinar Series - Conducting Test Security Investigations in School Districts and LEAsppt show](https://reader038.fdocuments.in/reader038/viewer/2022110218/587bf78c1a28ab7c668b4d6f/html5/thumbnails/19.jpg)
www.caveon.com19
Incident Investigation Process
• Gather and preserve evidenceo Leverage case management software
solutionso Role based accesso Collaboration
![Page 20: Caveon Webinar Series - Conducting Test Security Investigations in School Districts and LEAsppt show](https://reader038.fdocuments.in/reader038/viewer/2022110218/587bf78c1a28ab7c668b4d6f/html5/thumbnails/20.jpg)
www.caveon.com20
Incident Investigation Process• Interviews and Witness statements
o Nature of incident will help identify witnesses to interview Person who reported triggering incident Test participants
School Assessment CoordinatorStudentsTest AdministratorProctor
Administrators Educators
![Page 21: Caveon Webinar Series - Conducting Test Security Investigations in School Districts and LEAsppt show](https://reader038.fdocuments.in/reader038/viewer/2022110218/587bf78c1a28ab7c668b4d6f/html5/thumbnails/21.jpg)
www.caveon.com21
Incident Investigation Process
• Analyze evidenceo Decision-making criteria o Outputs and reporting
![Page 22: Caveon Webinar Series - Conducting Test Security Investigations in School Districts and LEAsppt show](https://reader038.fdocuments.in/reader038/viewer/2022110218/587bf78c1a28ab7c668b4d6f/html5/thumbnails/22.jpg)
www.caveon.com22
Incident Investigation Process
• Report findings in accordance with applicable policies and procedureso Consider the audience: courts, appeal
boards, board of education, licensure committee, etc.
o Objective, never subjective
![Page 23: Caveon Webinar Series - Conducting Test Security Investigations in School Districts and LEAsppt show](https://reader038.fdocuments.in/reader038/viewer/2022110218/587bf78c1a28ab7c668b4d6f/html5/thumbnails/23.jpg)
www.caveon.com23
Resources
• Handbook of Test Security• TILSA Guidebooks• Caveon Webinar Series• NCME Whitepapers• Operational Best Practices• Caveon District Investigations Training
Workshop• www.cespcert.org
![Page 24: Caveon Webinar Series - Conducting Test Security Investigations in School Districts and LEAsppt show](https://reader038.fdocuments.in/reader038/viewer/2022110218/587bf78c1a28ab7c668b4d6f/html5/thumbnails/24.jpg)
www.caveon.com24
Key Points Summarized
• SEAs & LEAs are operating in a crucible
• Test security incidents may impact the validity of test scores
• An ounce of prevention is worth a pound of cure
• Importance of both formal, approved SIRP and investigation process
![Page 25: Caveon Webinar Series - Conducting Test Security Investigations in School Districts and LEAsppt show](https://reader038.fdocuments.in/reader038/viewer/2022110218/587bf78c1a28ab7c668b4d6f/html5/thumbnails/25.jpg)
www.caveon.com25
Q&A
![Page 26: Caveon Webinar Series - Conducting Test Security Investigations in School Districts and LEAsppt show](https://reader038.fdocuments.in/reader038/viewer/2022110218/587bf78c1a28ab7c668b4d6f/html5/thumbnails/26.jpg)
www.caveon.com26
Thank You! Follow Caveon on twitter @caveonCheck out our blog www.caveon.com/blogLinkedIn Group “Caveon Test Security”
Steve [email protected]
Marc [email protected]