Abstract:Algorithm audits are powerful tools for studying black-box systems without direct knowledge of their inner workings. While very effective in examining technical components, the method stops short of a sociotechnical frame, which would also consider users themselves as an integral and dynamic part of the system. Addressing this limitation, we propose the concept of sociotechnical auditing: auditing methods that evaluate algorithmic systems at the sociotechnical level, focusing on the interplay between algorithms and users as each impacts the other. Just as algorithm audits probe an algorithm with varied inputs and observe outputs, a sociotechnical audit (STA) additionally probes users, exposing them to different algorithmic behavior and measuring their resulting attitudes and behaviors. As an example of this method, we develop Intervenr, a platform for conducting browser-based, longitudinal sociotechnical audits with consenting, compensated participants. Intervenr investigates the algorithmic content users encounter online, and also coordinates systematic client-side interventions to understand how users change in response. As a case study, we deploy Intervenr in a two-week sociotechnical audit of online advertising (N = 244) to investigate the central premise that personalized ad targeting is more effective on users. In the first week, we observe and collect all browser ads delivered to users, and in the second, we deploy an ablation-style intervention that disrupts normal targeting by randomly pairing participants and swapping all their ads. We collect user-oriented metrics (self-reported ad interest and feeling of representation) and advertiser-oriented metrics (ad views, clicks, and recognition) throughout, along with a total of over 500,000 ads. Our STA finds that targeted ads indeed perform better with users, but also that users begin to acclimate to different ads in only a week, casting doubt on the primacy of personalized ad targeting given the impact of repeated exposure. In comparison with other evaluation methods that only study technical components, or only experiment on users, sociotechnical audits evaluate sociotechnical systems through the interplay of their technical and human components.

Youth as Peer Auditors: Engaging Teenagers with Algorithm Auditing of Machine Learning Applications

Learning about algorithm auditing in five steps: scaffolding how high school youth can systematically and critically evaluate machine learning applications

Not Just Training, Also Testing: High School Youths' Perspective-Taking through Peer Testing Machine Learning-Powered Applications

The Potential of Diverse Youth as Stakeholders in Identifying and Mitigating Algorithmic Bias for a Future of Fairer AI

Reimagining AI: Exploring Speculative Design Workshops for Supporting BIPOC Youth Critical AI Literacies

Pragmatic auditing: a pilot-driven approach for auditing Machine Learning systems

Everyday Algorithm Auditing: Understanding the Power of Everyday Users in Surfacing Harmful Algorithmic Behaviors

Investigating Youths' Everyday Understanding of Machine Learning Applications: a Knowledge-in-Pieces Perspective

Participation and Division of Labor in User-Driven Algorithm Audits: How Do Everyday Users Work together to Surface Algorithmic Harms?

Sociotechnical Audits: Broadening the Algorithm Auditing Lens to Investigate Targeted Advertising

Towards algorithm auditing: managing legal, ethical and technological risks of AI, ML and associated algorithms

The algorithm audit: Scoring the algorithms that score us

AI Audit: A Card Game to Reflect on Everyday AI Systems

Experiencing Algorithms: How Young People Understand, Feel About, and Engage With Algorithmic News Selection on Social Media

An Algorithmic Equity Toolkit for Technology Audits by Community Advocates and Activists

Making Sense of Machine Learning: Integrating Youth's Conceptual, Creative, and Critical Understandings of AI

Supporting Adolescent Engagement with Artificial Intelligence–Driven Digital Health Behavior Change Interventions

Learning about Data, Algorithms, and Algorithmic Justice on TikTok in Personally Meaningful Ways

Teenagers and Artificial Intelligence: Bootcamp Experience and Lessons Learned

Problematic Machine Behavior: A Systematic Literature Review of Algorithm Audits