For a complete list, see my
Google Scholar.
Generative AI Evaluation and Measurement
"
Measuring Cultural Erasure Harms in Generative Text-to-Image Models"
Nari Johnson, Deepthi Sudharsan, Hamna, Samantha Dalal, Theo Holroyd, Anja Thieme, Hoda Heidari, Daniela Massiceti, Jennifer Wortman Vaughan, Cecily Morrison
In submission to ACM FAccT 2026 (available upon request).
"
Position: How can AI researchers scaffold community participation in generative AI evaluation?"
Nari Johnson, Deepthi Sudharsan, Hamna, Samantha Dalal, Theo Holroyd, Anja Thieme, Hoda Heidari, Daniela Massiceti, Jennifer Wortman Vaughan, Cecily Morrison
Working draft (available upon request).
"
Position: To Make Text-to-Image Models that Work for Marginalized Communities, We Need New Measurement Practices for the Long Tail"
Nari Johnson, Deepthi Sudharsan, Theo Holroyd, Samantha Dalal, Siobhan Mackenzie Hall, Jennifer Wortman Vaughan, Daniela Massiceti, Cecily Morrison
Preprint
"
Provocation: Who benefits from "inclusion" in Generative AI?"
Samantha Dalal, Siobhan Mackenzie Hall, Nari Johnson
Spotlight Presentation at the NeurIPS Workshop on Evaluating Evaluations, 2024
"
Where Does My Model Underperform? A Human Evaluation of Slice Discovery Algorithms"
Nari Johnson, Ángel Alexander Cabrera, Gregory Plumb, Ameet Talwalkar
Spotlight Presentation at the ICML Workshop on Spurious Correlations, Invariance, and Stability, 2023
Best Paper Award at AAAI Conference on Human Computation and Crowdsourcing (HCOMP), 2023
AI Governance, AI in the Public Sector
"
Transparency in public procurement: How do AI vendors disclose information about the AI systems they sell to U.S. local governments?"
Nari Johnson*, Blaine Kuehnert*, Ravit Dotan, Hoda Heidari
In submission to ACM FAccT 2026 (available upon request).
"
Legacy Procurement Practices Shape How U.S. Cities Govern AI: Understanding Government Employees' Practices, Challenges, and Needs"
Nari Johnson, Elise Silva, Harrison Leon, Motahhare Eslami, Beth Schwanke, Ravit Dotan, Hoda Heidari
Spotlight Presentation at the NeurIPS Regulatable ML Workshop, 2024
ACM FAccT 2025
"
The Fall of an Algorithm: Characterizing the Dynamics Toward Abandonment"
Nari Johnson, Sanika Moharana, Christina N. Harrington, Nazanin Andalibi, Hoda Heidari, Motahhare Eslami
ACM FAccT 2024
White paper, "
Procuring Public-Sector AI: Guidance for Local Governments". May 2025.
Public comment, "
Re: RFI for Responsible Procurement of Artificial Intelligence in Government OMB-2024-0004". April 2024.