Weathering the Storm - What to Do Before, During & After a Storm
Caveon Webinar Series: Weathering the Perfect Test Security Storm - February 2015
-
Upload
caveon-test-security -
Category
Education
-
view
86 -
download
0
Transcript of Caveon Webinar Series: Weathering the Perfect Test Security Storm - February 2015
![Page 1: Caveon Webinar Series: Weathering the Perfect Test Security Storm - February 2015](https://reader034.fdocuments.in/reader034/viewer/2022042818/55ad1a981a28abe03c8b48a2/html5/thumbnails/1.jpg)
Jennifer Miller, Caveon Test Security
Dennis Maynes, Caveon Test Security
Michelle Croft, ACT
Weathering the Perfect Test Security Storm in Educational Assessments
February 25, 2015
Caveon Webinar Series presents:
![Page 2: Caveon Webinar Series: Weathering the Perfect Test Security Storm - February 2015](https://reader034.fdocuments.in/reader034/viewer/2022042818/55ad1a981a28abe03c8b48a2/html5/thumbnails/2.jpg)
Agenda for Today
• Elements of the Perfect Storm
(Jennifer Miller)
• Fallout from the storm
(Michelle Croft)
• Weathering the storm
(Dennis Maynes)
![Page 3: Caveon Webinar Series: Weathering the Perfect Test Security Storm - February 2015](https://reader034.fdocuments.in/reader034/viewer/2022042818/55ad1a981a28abe03c8b48a2/html5/thumbnails/3.jpg)
Introduction
![Page 4: Caveon Webinar Series: Weathering the Perfect Test Security Storm - February 2015](https://reader034.fdocuments.in/reader034/viewer/2022042818/55ad1a981a28abe03c8b48a2/html5/thumbnails/4.jpg)
The Perfect Storm
• Test scores are tied to school funding.• Performance evaluations are tied to test
scores.• The responsibility of test security is placed in
the hands of those who are motivated to cheat.
• Security threats and vulnerabilities are increasing.
![Page 5: Caveon Webinar Series: Weathering the Perfect Test Security Storm - February 2015](https://reader034.fdocuments.in/reader034/viewer/2022042818/55ad1a981a28abe03c8b48a2/html5/thumbnails/5.jpg)
NCLB (2001)
“Adequate yearly progress”
Federal funding goes to struggling
schools, but…..
…with funding come sanctions
NCLB & Funding
![Page 6: Caveon Webinar Series: Weathering the Perfect Test Security Storm - February 2015](https://reader034.fdocuments.in/reader034/viewer/2022042818/55ad1a981a28abe03c8b48a2/html5/thumbnails/6.jpg)
• Each state sets timeline and definition for AYP.
• Schools held accountable for performance of all students, not just the average performance.
• Schools that do not meet AYP for two years in a row are subject to immediate interventions.
– Technical assistance
– Severe corrective actions
Adequate Yearly Progress
![Page 7: Caveon Webinar Series: Weathering the Perfect Test Security Storm - February 2015](https://reader034.fdocuments.in/reader034/viewer/2022042818/55ad1a981a28abe03c8b48a2/html5/thumbnails/7.jpg)
ESEA Flexibility Waiver
• Announced in 2011 to allow flexibility from some specific NCLB requirements.
• State-developed plans where turnaround interventions are implemented at “priority” schools.
• Requires student growth data as part of educator evaluations.
![Page 8: Caveon Webinar Series: Weathering the Perfect Test Security Storm - February 2015](https://reader034.fdocuments.in/reader034/viewer/2022042818/55ad1a981a28abe03c8b48a2/html5/thumbnails/8.jpg)
Parks Middle School in Atlanta
“school in need of improvement” 2001-2005
In 2006, “Unless fifty-eight per cent of students passed the math portion of the test and sixty-seven per cent passed in language arts, the state could shut down the school.”
State Assessments and School Funding
The New Yorker, 21 July 2014
Governor’s investigation in Georgia found cheating in 44 APS schools, with almost 200 educators potentially involved.
![Page 9: Caveon Webinar Series: Weathering the Perfect Test Security Storm - February 2015](https://reader034.fdocuments.in/reader034/viewer/2022042818/55ad1a981a28abe03c8b48a2/html5/thumbnails/9.jpg)
“Investigators found ‘organized and systemicmisconduct’ …and said administrators created a‘culture of fear, intimidation and retaliation.’The administrators used data as an ‘abusive andcruel weapon’ to coax employees into crossingethical lines”
Los Angeles Times, 6 September 2014
State Assessments and School Funding
![Page 10: Caveon Webinar Series: Weathering the Perfect Test Security Storm - February 2015](https://reader034.fdocuments.in/reader034/viewer/2022042818/55ad1a981a28abe03c8b48a2/html5/thumbnails/10.jpg)
Performance Evaluations and Test Scores
States are moving to performance-based compensation and using test scores to evaluate teachers
Administrators(Superintendents, etc.)
Teachers
![Page 11: Caveon Webinar Series: Weathering the Perfect Test Security Storm - February 2015](https://reader034.fdocuments.in/reader034/viewer/2022042818/55ad1a981a28abe03c8b48a2/html5/thumbnails/11.jpg)
• 2012 El Paso Independent School District.
• Lorenzo Garcia, Superintendent.
• Discouraged and/or prevented low-performing students from taking the TAKS.
• 381 students 170 students
• Garcia received almost $60K in bonuses.
New York Times, 13 October 2012
Use of Test Scores for Personal Gain
![Page 12: Caveon Webinar Series: Weathering the Perfect Test Security Storm - February 2015](https://reader034.fdocuments.in/reader034/viewer/2022042818/55ad1a981a28abe03c8b48a2/html5/thumbnails/12.jpg)
Test Security in the Hands of Teachers
"If the IRS notified you that your tax return had irregularities,and they wanted you to recheck it yourself, everybody willwrite back and say, 'I checked my taxes, and they're fine.‘”
– Greg Cizek
![Page 13: Caveon Webinar Series: Weathering the Perfect Test Security Storm - February 2015](https://reader034.fdocuments.in/reader034/viewer/2022042818/55ad1a981a28abe03c8b48a2/html5/thumbnails/13.jpg)
Test Security in the Hands of Teachers
Teachers feeling the pressure:
Survey of Educators in Michigan
• 29% felt pressure to cheat on standardized tests.
• 34% felt pressure to help students.• 21% knew other educators who helped
students.• 8% admitted to changing answer sheets.
“Survey: Nearly 30% of Michigan Teachers Report Pressure to Cheat,” Detroit Free Press, July 27, 2011
![Page 14: Caveon Webinar Series: Weathering the Perfect Test Security Storm - February 2015](https://reader034.fdocuments.in/reader034/viewer/2022042818/55ad1a981a28abe03c8b48a2/html5/thumbnails/14.jpg)
Threats are Increasing
• Cheating technology is becoming more sophisticated.
• Threats and CBT.• Threats associated with
consortia membership (PARCC and SBAC).
• Threats with Social Media.
thegreenhead.com
![Page 15: Caveon Webinar Series: Weathering the Perfect Test Security Storm - February 2015](https://reader034.fdocuments.in/reader034/viewer/2022042818/55ad1a981a28abe03c8b48a2/html5/thumbnails/15.jpg)
• Harm to Students
• Tarnished Reputations
• Lost Credibility
• Negative Media Attention
•$$$$$
Fallout from the Storm
![Page 16: Caveon Webinar Series: Weathering the Perfect Test Security Storm - February 2015](https://reader034.fdocuments.in/reader034/viewer/2022042818/55ad1a981a28abe03c8b48a2/html5/thumbnails/16.jpg)
Harm to Students“As a graduating senior from a tarnished schoolsystem, I have to worry every time I apply to acollege…good grades isn’t considered a reward initself anymore because those grades come from aschool system of perceived cheaters…it’s no joke forstudents who have to overcome the perception of amorally bankrupt school system.”
Fallout from the Storm
Jenn Steckl APS School Districtyouthradio.org27 October 2014
![Page 17: Caveon Webinar Series: Weathering the Perfect Test Security Storm - February 2015](https://reader034.fdocuments.in/reader034/viewer/2022042818/55ad1a981a28abe03c8b48a2/html5/thumbnails/17.jpg)
Negative Media Attention
• APS Scandal, Atlanta Journal Constitution, 2008.
• Cheating in 44 APS schools.• Prosecution of 12 educators under RICO• Trial ongoing…
Fallout from the Storm
![Page 18: Caveon Webinar Series: Weathering the Perfect Test Security Storm - February 2015](https://reader034.fdocuments.in/reader034/viewer/2022042818/55ad1a981a28abe03c8b48a2/html5/thumbnails/18.jpg)
Pa Schools, The Notebook, 2009• Anomalies in 89 Schools - Cheating?
• As school starts, no action against Philly principals where cheating is suspected, suspected, 8/24/2012.
• Two District administrators surrender licenses in cheating scandal, 4/3/2013.• District to release report on cheating investigation at 19 schools, 7/22/2013.• 138 Philadelphia educators implicated in cheating probes, 2/5/2014.• SRC to vote on terminating three principals related to cheating investigation,
1/16/2014.• Two former principals charged in state cheating investigation, 9/25/2014.• Former principal now eighth educator charged in cheating probe, 1/7/2015.
Fallout from the Storm
thenotebook.org
![Page 19: Caveon Webinar Series: Weathering the Perfect Test Security Storm - February 2015](https://reader034.fdocuments.in/reader034/viewer/2022042818/55ad1a981a28abe03c8b48a2/html5/thumbnails/19.jpg)
Fallout from the Storm
District of Columbia
• USA Today article (2011).• Entire year of items released.• Solicited bids for external
investigators to increase transparency.
![Page 20: Caveon Webinar Series: Weathering the Perfect Test Security Storm - February 2015](https://reader034.fdocuments.in/reader034/viewer/2022042818/55ad1a981a28abe03c8b48a2/html5/thumbnails/20.jpg)
• Budget
• Strategy
• Implement a Comprehensive Program
Weathering the Storm
![Page 21: Caveon Webinar Series: Weathering the Perfect Test Security Storm - February 2015](https://reader034.fdocuments.in/reader034/viewer/2022042818/55ad1a981a28abe03c8b48a2/html5/thumbnails/21.jpg)
• Strategy
• Create Mission and Vision Statements
• Assess Threats and Vulnerabilities
• Review and Allocate Resources
• Establish a Communications Plan
Weathering the Storm
![Page 22: Caveon Webinar Series: Weathering the Perfect Test Security Storm - February 2015](https://reader034.fdocuments.in/reader034/viewer/2022042818/55ad1a981a28abe03c8b48a2/html5/thumbnails/22.jpg)
• Implement a Comprehensive Program
• Protection
• Detection
• Response
• Improvement
Weathering the Storm
![Page 23: Caveon Webinar Series: Weathering the Perfect Test Security Storm - February 2015](https://reader034.fdocuments.in/reader034/viewer/2022042818/55ad1a981a28abe03c8b48a2/html5/thumbnails/23.jpg)
Weathering the Storm
Comprehensive Program
Protect
Detect
Respond
Improve
![Page 24: Caveon Webinar Series: Weathering the Perfect Test Security Storm - February 2015](https://reader034.fdocuments.in/reader034/viewer/2022042818/55ad1a981a28abe03c8b48a2/html5/thumbnails/24.jpg)
“Never before have so many had so muchreason to cheat. Students’ scores are now usedto determine whether teachers and principalsare good or bad, whether teachers should get abonus or be fired, whether a school is a successor failure…”
New York Times, 31 July 2011
![Page 25: Caveon Webinar Series: Weathering the Perfect Test Security Storm - February 2015](https://reader034.fdocuments.in/reader034/viewer/2022042818/55ad1a981a28abe03c8b48a2/html5/thumbnails/25.jpg)
Audience Questions
25
![Page 26: Caveon Webinar Series: Weathering the Perfect Test Security Storm - February 2015](https://reader034.fdocuments.in/reader034/viewer/2022042818/55ad1a981a28abe03c8b48a2/html5/thumbnails/26.jpg)
Thank you!
- Follow Caveon on twitter @caveon
- Check out our blog…www.caveon.com/blog
- LinkedIn Group – “Caveon Test Security”
Jennifer Miller
Data Forensics Coordinator,
Caveon [email protected]
Michelle Croft
Principal Research Associate,
Dennis Maynes
Chief Scientist, Caveon [email protected]