Do Responsible AI Artifacts Advance Stakeholder Goals? Four Key Barriers Perceived by Legal and Civil Stakeholders

Anna Kawakami,Daricia Wilkinson,Alexandra Chouldechova

2024-08-22

Abstract:The responsible AI (RAI) community has introduced numerous processes and artifacts (e.g., Model Cards, Transparency Notes, Data Cards) to facilitate transparency and support the governance of AI systems. While originally designed to scaffold and document AI development processes in technology companies, these artifacts are becoming central components of regulatory compliance under recent regulations such as the EU AI Act. Much prior work has explored the design of new RAI artifacts or their use by practitioners within technology companies. However, as RAI artifacts begin to play key roles in enabling external oversight, it becomes critical to understand how stakeholders--particularly those situated outside of technology companies who govern and audit industry AI deployments--perceive the efficacy of RAI artifacts. In this study, we conduct semi-structured interviews and design activities with 19 government, legal, and civil society stakeholders who inform policy and advocacy around responsible AI efforts. While participants believe that RAI artifacts are a valuable contribution to the broader AI governance ecosystem, many are concerned about their potential unintended, longer-term impacts on actors outside of technology companies (e.g., downstream end-users, policymakers, civil society stakeholders). We organize these beliefs into four barriers that help explain how RAI artifacts may (inadvertently) reconfigure power relations across civil society, government, and industry, impeding civil society and legal stakeholders' ability to protect downstream end-users from potential AI harms. Participants envision how structural changes, along with changes in how RAI artifacts are designed, used, and governed, could help redirect the role of artifacts to support more collaborative and proactive external oversight of AI systems. We discuss research and policy implications for RAI artifacts.

Computers and Society,Human-Computer Interaction

What problem does this paper attempt to address?

The problems that this paper attempts to solve mainly focus on understanding the effectiveness and impact of Multi - Actor Responsible AI (RAI) artifacts in law, regulation, and civil society. Specifically, through semi - structured interviews and design activities, the researchers explored how 19 stakeholders from government, legal, and civil society organizations perceive the effectiveness of these RAI artifacts and their expectations for improving the design and use of these artifacts. The study focuses on how these stakeholders think that current RAI artifacts may unintentionally reshape the power relationships among government, industry, and society, thereby hindering the ability to externally supervise AI systems, especially for the protection of downstream end - users and other aspects of society.

The core questions of the study are:
1. How do legal/regulatory and civil society stakeholders perceive the effectiveness of multi - actor responsible AI artifacts?
2. What are the implications for improving the design and use of multi - actor responsible AI artifacts?

Through these questions, the researchers aim to reveal four main obstacles in the current design and use of RAI artifacts and make improvement suggestions to promote more active and collaborative cross - sector AI governance efforts. These four obstacles include:
1. **End - users are placed in a secondary position**: In the design and use of RAI artifacts, the rights and interests of end - users are often not the primary consideration.
2. **Selectively presenting commendable AI models**: The industry tends to only present those AI models that perform well while ignoring high - risk models.
3. **Over - relying on transparency as a change mechanism**: Relying solely on transparency to drive change may not be sufficient and more substantial measures are required.
4. **Shifting the responsibility of responsible use to end - users**: Some RAI artifacts are designed to shift the responsibility of ensuring the responsible use of AI systems to end - users.

By identifying these obstacles, the researchers hope to promote structural changes, improve the design, use, and governance of RAI artifacts, and thus better support cross - sector AI governance.