For a complete list, see my
Google Scholar.
Cultural Evaluation
"
Position: To Make Text-to-Image Models that Work for Marginalized Communities, We Need New Measurement Practices for the Long Tail"
Nari Johnson, Deepthi Sudharsan, Theo Holroyd, Samantha Dalal, Siobhan Mackenzie Hall, Jennifer Wortman Vaughan, Daniela Massiceti, Cecily Morrison
Preprint
"
Provocation: Who benefits from "inclusion" in Generative AI?"
Samantha Dalal, Siobhan Mackenzie Hall, Nari Johnson
Spotlight Presentation at the NeurIPS Workshop on Evaluating Evaluations, 2024
AI Governance, AI in the Public Sector
"
Legacy Procurement Practices Shape How U.S. Cities Govern AI: Understanding Government Employees' Practices, Challenges, and Needs"
Nari Johnson, Elise Silva, Harrison Leon, Motahhare Eslami, Beth Schwanke, Ravit Dotan, Hoda Heidari
Spotlight Presentation at the NeurIPS Regulatable ML Workshop, 2024
ACM FAccT 2025
"
The Fall of an Algorithm: Characterizing the Dynamics Toward Abandonment"
Nari Johnson, Sanika Moharana, Christina N. Harrington, Nazanin Andalibi, Hoda Heidari, Motahhare Eslami
ACM FAccT 2024
AI Evaluation & Explainability
"
Where Does My Model Underperform? A Human Evaluation of Slice Discovery Algorithms"
Nari Johnson, Ángel Alexander Cabrera, Gregory Plumb, Ameet Talwalkar
Spotlight Presentation at the ICML Workshop on Spurious Correlations, Invariance, and Stability, 2023
Best Paper Award at AAAI Conference on Human Computation and Crowdsourcing (HCOMP), 2023
White paper, "
Procuring Public-Sector AI: Guidance for Local Governments". May 2025.
Public comment, "
Re: RFI for Responsible Procurement of Artificial Intelligence in Government OMB-2024-0004". April 2024.