From Automating Inequality by Virginia Eubanks pg 167:
Parents in Allegheny County helped me articulate an inchoate idea that had been echoing in my head since I started my research. In Indiana, Los Angeles, and Allegheny County, technologists and administrators explained to me that new high-tech tools in public services increase transparency and decrease discrimination. They claimed that there is no way to know what is going on in the head of a welfare caseworker, a homeless service provider, or an intake call screener without using big data to identify patterns in their decision-making. I find the philosophy that sees human beings as unknowable black boxes and machines as transparent deeply troubling. It seems to me a worldview that surrenders any attempt at empathy and forecloses the possibility of ethical development. The presumption that human decision-making is opaque and inaccessible is an admission that we have abandoned a social commitment to try to understand each other. Poor and working-class people in Allegheny County want and deserve more: a recognition of their humanity, an understanding of their context, and the potential for connection and community.
Mark Carrigan 