Algorithms in the Child Welfare System: What Have We Learned?
Alexandra Chouldechova, Ph.D.Principal Researcher, Microsoft Research NYC
Estella Loomis McCandless Associate Professor of Statistics and Public Policy, Heinz College of Information Systems and Public Policy, Carnegie Mellon University
Simons Foundation Presidential Lectures are free public colloquia centered on four main themes: Biology, Physics, Mathematics and Computer Science, and Neuroscience and Autism Science. These curated, high-level scientific talks feature leading scientists and mathematicians and are intended to foster discourse and drive discovery among the broader NYC-area research community. We invite those interested in the topic to join us for this weekly lecture series.
Recent estimates suggest that one in three children will experience at least one maltreatment investigation in their childhood, one in 17 will spend time in foster care, and one in 100 will be involved in a case where parental rights are terminated. As agencies around the country work to screen and respond to the over 4 million child maltreatment referrals that come in annually, they are increasingly incorporating predictive risk modeling (PRM) approaches into their decision-making processes. PRMs take large volumes of administrative data available on individuals associated with a case or referral and distill the information into a single risk score reflecting the likelihood of some near-term adverse event. From the very start, the use of predictive analytics in the child welfare system has been highly contentious. There is concern that those experiencing poverty and Black and brown communities — who are overrepresented at all points in the child welfare system — will only be further disadvantaged by deploying such tools.
In this talk, Alex Chouldechova will describe some of the actively deployed PRMs and discuss what recent studies have revealed about the impact of PRMs on decision-making and racial disparities in the system. She will also discuss several studies of affected community perspectives on the use of algorithms in child welfare. Throughout, she will highlight the emerging demands for procedural, informational, distributive, and interpersonal justice. Finally, she will reflect on the role of research and technology in systems widely perceived as unjust.