A Case Study of Predictive Analytics in Child Protective...
Transcript of A Case Study of Predictive Analytics in Child Protective...
![Page 1: A Case Study of Predictive Analytics in Child Protective ...globalprivacyassembly.org/wp-content/uploads/2015/... · A Case Study of Predictive Analytics in Child Protective Services.](https://reader034.fdocuments.in/reader034/viewer/2022042301/5ecba9b1fcd97c11280cf164/html5/thumbnails/1.jpg)
Government by Algorithm? A Case Study of Predictive Analytics in Child Protective Services
Rhema VaithianathanSeptember 2017
![Page 2: A Case Study of Predictive Analytics in Child Protective ...globalprivacyassembly.org/wp-content/uploads/2015/... · A Case Study of Predictive Analytics in Child Protective Services.](https://reader034.fdocuments.in/reader034/viewer/2022042301/5ecba9b1fcd97c11280cf164/html5/thumbnails/2.jpg)
Research Team
Rhema Vaithianathan, Auckland University of Technology
Emily Putnam-Hornstein, University of Southern California
Erin Dalton, Allegheny County
Alex Chouldechova, Carnegie Mellon University
![Page 3: A Case Study of Predictive Analytics in Child Protective ...globalprivacyassembly.org/wp-content/uploads/2015/... · A Case Study of Predictive Analytics in Child Protective Services.](https://reader034.fdocuments.in/reader034/viewer/2022042301/5ecba9b1fcd97c11280cf164/html5/thumbnails/3.jpg)
Agenda
Discuss the use of predictive risk modelling in child protection in the US
Contrast with use in Criminal Justice
Outline why there is more community acceptance in child protection
![Page 4: A Case Study of Predictive Analytics in Child Protective ...globalprivacyassembly.org/wp-content/uploads/2015/... · A Case Study of Predictive Analytics in Child Protective Services.](https://reader034.fdocuments.in/reader034/viewer/2022042301/5ecba9b1fcd97c11280cf164/html5/thumbnails/4.jpg)
Predictive Risk Models [algorithms]
Automatic risk scoring tool which generates a risk score for an adverse event based on large administrative dataset
Uses data collected by Governments as part of its business process to identify individuals who will have a bad outcome
![Page 5: A Case Study of Predictive Analytics in Child Protective ...globalprivacyassembly.org/wp-content/uploads/2015/... · A Case Study of Predictive Analytics in Child Protective Services.](https://reader034.fdocuments.in/reader034/viewer/2022042301/5ecba9b1fcd97c11280cf164/html5/thumbnails/5.jpg)
Background
2013, American Journal of Preventive Medicine, 45(3)
![Page 6: A Case Study of Predictive Analytics in Child Protective ...globalprivacyassembly.org/wp-content/uploads/2015/... · A Case Study of Predictive Analytics in Child Protective Services.](https://reader034.fdocuments.in/reader034/viewer/2022042301/5ecba9b1fcd97c11280cf164/html5/thumbnails/6.jpg)
Obstacles
![Page 7: A Case Study of Predictive Analytics in Child Protective ...globalprivacyassembly.org/wp-content/uploads/2015/... · A Case Study of Predictive Analytics in Child Protective Services.](https://reader034.fdocuments.in/reader034/viewer/2022042301/5ecba9b1fcd97c11280cf164/html5/thumbnails/7.jpg)
US: Child Protection Overview
![Page 8: A Case Study of Predictive Analytics in Child Protective ...globalprivacyassembly.org/wp-content/uploads/2015/... · A Case Study of Predictive Analytics in Child Protective Services.](https://reader034.fdocuments.in/reader034/viewer/2022042301/5ecba9b1fcd97c11280cf164/html5/thumbnails/8.jpg)
The Problem3.6 million referrals of abuse and neglect every year
1 in 3 US children experience an investigation by age 18
1 in 7 US children are substantiated as victims
![Page 9: A Case Study of Predictive Analytics in Child Protective ...globalprivacyassembly.org/wp-content/uploads/2015/... · A Case Study of Predictive Analytics in Child Protective Services.](https://reader034.fdocuments.in/reader034/viewer/2022042301/5ecba9b1fcd97c11280cf164/html5/thumbnails/9.jpg)
Current Practice
![Page 10: A Case Study of Predictive Analytics in Child Protective ...globalprivacyassembly.org/wp-content/uploads/2015/... · A Case Study of Predictive Analytics in Child Protective Services.](https://reader034.fdocuments.in/reader034/viewer/2022042301/5ecba9b1fcd97c11280cf164/html5/thumbnails/10.jpg)
A New Approach
![Page 11: A Case Study of Predictive Analytics in Child Protective ...globalprivacyassembly.org/wp-content/uploads/2015/... · A Case Study of Predictive Analytics in Child Protective Services.](https://reader034.fdocuments.in/reader034/viewer/2022042301/5ecba9b1fcd97c11280cf164/html5/thumbnails/11.jpg)
Allegheny County, PA, US
![Page 12: A Case Study of Predictive Analytics in Child Protective ...globalprivacyassembly.org/wp-content/uploads/2015/... · A Case Study of Predictive Analytics in Child Protective Services.](https://reader034.fdocuments.in/reader034/viewer/2022042301/5ecba9b1fcd97c11280cf164/html5/thumbnails/12.jpg)
![Page 13: A Case Study of Predictive Analytics in Child Protective ...globalprivacyassembly.org/wp-content/uploads/2015/... · A Case Study of Predictive Analytics in Child Protective Services.](https://reader034.fdocuments.in/reader034/viewer/2022042301/5ecba9b1fcd97c11280cf164/html5/thumbnails/13.jpg)
Model
Score tells us the risk that the child will be removed from home in 2 years and placed in foster care…
![Page 14: A Case Study of Predictive Analytics in Child Protective ...globalprivacyassembly.org/wp-content/uploads/2015/... · A Case Study of Predictive Analytics in Child Protective Services.](https://reader034.fdocuments.in/reader034/viewer/2022042301/5ecba9b1fcd97c11280cf164/html5/thumbnails/14.jpg)
Results
![Page 15: A Case Study of Predictive Analytics in Child Protective ...globalprivacyassembly.org/wp-content/uploads/2015/... · A Case Study of Predictive Analytics in Child Protective Services.](https://reader034.fdocuments.in/reader034/viewer/2022042301/5ecba9b1fcd97c11280cf164/html5/thumbnails/15.jpg)
Results
![Page 16: A Case Study of Predictive Analytics in Child Protective ...globalprivacyassembly.org/wp-content/uploads/2015/... · A Case Study of Predictive Analytics in Child Protective Services.](https://reader034.fdocuments.in/reader034/viewer/2022042301/5ecba9b1fcd97c11280cf164/html5/thumbnails/16.jpg)
Injury Validation
Score of 20 versus 1?
21 times more likely to be admitted for a self-inflicted injury17 times more likely to admitted for physical assault
![Page 17: A Case Study of Predictive Analytics in Child Protective ...globalprivacyassembly.org/wp-content/uploads/2015/... · A Case Study of Predictive Analytics in Child Protective Services.](https://reader034.fdocuments.in/reader034/viewer/2022042301/5ecba9b1fcd97c11280cf164/html5/thumbnails/17.jpg)
California
![Page 18: A Case Study of Predictive Analytics in Child Protective ...globalprivacyassembly.org/wp-content/uploads/2015/... · A Case Study of Predictive Analytics in Child Protective Services.](https://reader034.fdocuments.in/reader034/viewer/2022042301/5ecba9b1fcd97c11280cf164/html5/thumbnails/18.jpg)
Single data source...
![Page 19: A Case Study of Predictive Analytics in Child Protective ...globalprivacyassembly.org/wp-content/uploads/2015/... · A Case Study of Predictive Analytics in Child Protective Services.](https://reader034.fdocuments.in/reader034/viewer/2022042301/5ecba9b1fcd97c11280cf164/html5/thumbnails/19.jpg)
Percentage of child/referral events in each decile with the
child placed in foster care within 24 months(state average: 10%)
![Page 20: A Case Study of Predictive Analytics in Child Protective ...globalprivacyassembly.org/wp-content/uploads/2015/... · A Case Study of Predictive Analytics in Child Protective Services.](https://reader034.fdocuments.in/reader034/viewer/2022042301/5ecba9b1fcd97c11280cf164/html5/thumbnails/20.jpg)
External Validation [preliminary]
![Page 21: A Case Study of Predictive Analytics in Child Protective ...globalprivacyassembly.org/wp-content/uploads/2015/... · A Case Study of Predictive Analytics in Child Protective Services.](https://reader034.fdocuments.in/reader034/viewer/2022042301/5ecba9b1fcd97c11280cf164/html5/thumbnails/21.jpg)
Maltreatment Near-Fatalities & Fatalities among children under 5 years
52%
22%
0.0% 0.5%
74%
<1%
![Page 22: A Case Study of Predictive Analytics in Child Protective ...globalprivacyassembly.org/wp-content/uploads/2015/... · A Case Study of Predictive Analytics in Child Protective Services.](https://reader034.fdocuments.in/reader034/viewer/2022042301/5ecba9b1fcd97c11280cf164/html5/thumbnails/22.jpg)
Criminal Justice Use Case
![Page 23: A Case Study of Predictive Analytics in Child Protective ...globalprivacyassembly.org/wp-content/uploads/2015/... · A Case Study of Predictive Analytics in Child Protective Services.](https://reader034.fdocuments.in/reader034/viewer/2022042301/5ecba9b1fcd97c11280cf164/html5/thumbnails/23.jpg)
Releasing prisoners on bail
US has the highest incarceration rates in the world
The majority of people in jail have not been convicted but are awaiting trial
Use of predictive risk models to help judges decide whether to release prisoners on bail
Predicts if prisoner will recidivate
Use is found to be racially biased
![Page 24: A Case Study of Predictive Analytics in Child Protective ...globalprivacyassembly.org/wp-content/uploads/2015/... · A Case Study of Predictive Analytics in Child Protective Services.](https://reader034.fdocuments.in/reader034/viewer/2022042301/5ecba9b1fcd97c11280cf164/html5/thumbnails/24.jpg)
Source:Julia Angwin, Jeff Larson, Surya Mattu andLauren Kirchner, ProPublica
![Page 25: A Case Study of Predictive Analytics in Child Protective ...globalprivacyassembly.org/wp-content/uploads/2015/... · A Case Study of Predictive Analytics in Child Protective Services.](https://reader034.fdocuments.in/reader034/viewer/2022042301/5ecba9b1fcd97c11280cf164/html5/thumbnails/25.jpg)
Contrasting Allegheny Case vs. Criminal Justice Case
![Page 26: A Case Study of Predictive Analytics in Child Protective ...globalprivacyassembly.org/wp-content/uploads/2015/... · A Case Study of Predictive Analytics in Child Protective Services.](https://reader034.fdocuments.in/reader034/viewer/2022042301/5ecba9b1fcd97c11280cf164/html5/thumbnails/26.jpg)
CAREFUL IMPLEMENTATION
![Page 27: A Case Study of Predictive Analytics in Child Protective ...globalprivacyassembly.org/wp-content/uploads/2015/... · A Case Study of Predictive Analytics in Child Protective Services.](https://reader034.fdocuments.in/reader034/viewer/2022042301/5ecba9b1fcd97c11280cf164/html5/thumbnails/27.jpg)
EMPHASIS OF HUMAN IN THE DECISION LOOP
This is not your new process This is the process
![Page 28: A Case Study of Predictive Analytics in Child Protective ...globalprivacyassembly.org/wp-content/uploads/2015/... · A Case Study of Predictive Analytics in Child Protective Services.](https://reader034.fdocuments.in/reader034/viewer/2022042301/5ecba9b1fcd97c11280cf164/html5/thumbnails/28.jpg)
TRANSPARENCY
2017, Yale Journal of Law & Technology, Forthcoming
“ only one of the jurisdictions, Allegheny County, was able to furnish both the actual predictive algorithms itused (including a complete list of factors
and the weight each factor is given) and substantial detail about how they was developed” (page 26)
![Page 29: A Case Study of Predictive Analytics in Child Protective ...globalprivacyassembly.org/wp-content/uploads/2015/... · A Case Study of Predictive Analytics in Child Protective Services.](https://reader034.fdocuments.in/reader034/viewer/2022042301/5ecba9b1fcd97c11280cf164/html5/thumbnails/29.jpg)
Conclusion
Next steps - implementing an algorithm at birth to predict which child will be notified to child protection
![Page 30: A Case Study of Predictive Analytics in Child Protective ...globalprivacyassembly.org/wp-content/uploads/2015/... · A Case Study of Predictive Analytics in Child Protective Services.](https://reader034.fdocuments.in/reader034/viewer/2022042301/5ecba9b1fcd97c11280cf164/html5/thumbnails/30.jpg)
www.csda.aut.ac.nz
Twitter@AUTCSDA@rvaithianathan
LinkedInAUT Centre for Social Data Analytics
Connect with us