Algorithms for Justice?
Learning goals
After completing this assignment, students should be able to:
- Explain the concept of predictive policing and give an example of how it has been used
- Explain how criminal recidivism scores might be racially biased
- Explain why and how a variable like zip code can act as a proxy for race in a predictive algorithm
Content
- Read:
- Supplementary reading (optional):
- O’Neil (2016), Ch. 5 - Civilian Casualties
- ProPublica GitHub repository
- Northpointe rebuttal
- Rudin, Wang, and Coker (2020)
- Colando and Hardin (2024)
- Baumer (2024)
In-class activity
Teach the rest of the class:
How did Lum and Isaac demonstrate that the use of the ProdPol predictive policing algorithm would have resulted in bias by the Oakland Police Department? What data sources did they use? What is selection bias? What is confirmation bias?
How does Northpointe’s COMPAS algorithm assess risk? What factors does it include? How does race factor into the calculation? Is the algorithm a “black box”? How did ProPublica conduct its investigation? Where did it find the data?
Consider Table 2.1 from DF. Why do the authors argue for the set of terms on the right? What is co-liberation? What is the difference between equality and equity?
What is The Man Factory? What role does it play in STEM Education? Is Smith College part of the Man Factory? How would you explain these concepts to, say, the Smith College Board of Trustees?
Assignment
Respond to the following prompts on a single piece of paper.
In one paragraph, explain how algorithms for criminal recidivism or predictive policing could be racially biased, even when they don’t include race as an input variable.
In one or two paragraphs, briefly weigh the pros and cons of using algorithms like COMPAS and PredPol for criminal justice. What are the benefits? What are the dangers?
In one paragraph, reflect on your own feelings about algorithms in the criminal justice space in light of your response to the previous question.
Submission
Hand in before leaving the classroom.
Rubric
| Criteria | Zero | One |
|---|---|---|
| Overall Quality | Incomplete or missing submission. Student did not make an earnest effort to complete the assignment. Formatting errors make the submission unreadable. | Student accurately summarizes the content of the documentary. Student’s reflection is thoughtful and genuine. |