Dislocated Accountabilities in the AI Supply Chain: Modularity and Developers' Notions of Responsibility

David Gray Widder,Dawn Nafus

DOI: https://doi.org/10.1177/20539517231177620

2023-06-21

Abstract:Responsible artificial intelligence guidelines ask engineers to consider how their systems might harm. However, contemporary artificial intelligence systems are built by composing many preexisting software modules that pass through many hands before becoming a finished product or service. How does this shape responsible artificial intelligence practice? In interviews with 27 artificial intelligence engineers across industry, open source, and academia, our participants often did not see the questions posed in responsible artificial intelligence guidelines to be within their agency, capability, or responsibility to address. We use Suchman's "located accountability" to show how responsible artificial intelligence labor is currently organized and to explore how it could be done differently. We identify cross-cutting social logics, like modularizability, scale, reputation, and customer orientation, that organize which responsible artificial intelligence actions do take place and which are relegated to low status staff or believed to be the work of the next or previous person in the imagined "supply chain." We argue that current responsible artificial intelligence interventions, like ethics checklists and guidelines that assume panoptical knowledge and control over systems, could be improved by taking a located accountability approach, recognizing where relations and obligations might intertwine inside and outside of this supply chain.

Computers and Society,Human-Computer Interaction,Software Engineering

What problem does this paper attempt to address?

The problem that this paper attempts to solve is the lack of a sense of responsibility caused by the dispersion of responsibility in the artificial intelligence (AI) supply chain. Specifically, the paper explores how, in the development process of contemporary artificial intelligence systems, due to the use of a large number of pre - existing software modules and the fact that these modules will be processed by multiple parties before becoming final products or services, this modular production method has affected responsible AI practices. By interviewing 27 AI engineers from industry, open - source communities, and academia, the author found that the interviewees often believe that the issues in the responsible AI guidelines are beyond their duties, capabilities, and responsibilities and cannot be solved. The paper uses Suchman's concept of "locating responsibility" to show how current responsible AI labor is organized and explores how to organize this labor in different ways in order to better address the potential harms that AI may bring.

The core question of the paper is: **How can responsible AI practices be effectively organized and implemented in a highly modular AI supply chain?**