Unravelling Responsibility for AI

Zoe Porter,Philippa Ryan,Phillip Morgan,Joanna Al-Qaddoumi,Bernard Twomey,John McDermid,Ibrahim Habli

2024-05-08

Abstract:It is widely acknowledged that we need to establish where responsibility lies for the outputs and impacts of AI-enabled systems. But without a clear and precise understanding of what "responsibility" means, deliberations about where responsibility lies will be, at best, unfocused and incomplete and, at worst, misguided. To address this concern, this paper draws upon central distinctions in philosophy and law to clarify the concept of responsibility for AI for policymakers, practitioners, researchers and students from non-philosophical and non-legal backgrounds. Taking the three-part formulation "Actor A is responsible for Occurrence O," the paper unravels the concept of responsibility to clarify that there are different possibilities of who is responsible for AI, the senses in which they are responsible, and aspects of events they are responsible for. Criteria and conditions for fitting attributions of responsibility in the core senses (causal responsibility, role-responsibility, liability responsibility and moral responsibility) are articulated to promote an understanding of when responsibility attributions would be inappropriate or unjust. The analysis is presented with a graphical notation to facilitate informal diagrammatic reasoning and discussion about specific cases. It is illustrated by application to a scenario of a fatal collision between an autonomous AI-enabled ship and a traditional, crewed vessel at sea.

Artificial Intelligence,Computers and Society,Robotics

What problem does this paper attempt to address?

### Problems the Paper Attempts to Solve

The paper aims to address the issue of responsibility attribution for the outputs and impacts of artificial intelligence (AI) systems. Specifically, the authors point out that although many ethical principles, international organizations, and legal regulations emphasize the importance of clear responsibility attribution, discussions on this topic can become unfocused, incomplete, or even misleading without a clear and precise concept of responsibility. Therefore, the paper clarifies the concept of "responsibility" by drawing on core distinctions in philosophy and law, so that policymakers, practitioners, researchers, and students without a professional background can better understand and discuss the issue of AI responsibility.

### Main Content

1. **Decomposition of the Concept of Responsibility**:
- The paper divides responsibility into four different types: causal responsibility, role responsibility, legal responsibility, and moral responsibility.
- Each type of responsibility has its specific conditions and standards to ensure the appropriateness and fairness of responsibility attribution.

2. **Classification of Responsible Entities**:
- The paper classifies responsible entities into three categories: AI-based systems, individuals, and institutions.
- AI-based systems cannot bear legal or moral responsibility because they are not legal or moral entities.
- Individuals and institutions can bear legal and moral responsibility.

3. **Causal Responsibility**:
- Causal responsibility refers to an agent being the cause of an event.
- The paper proposes the NESS (Necessary Element of a Sufficient Set) standard to determine causal relationships, meaning an agent must be one of the necessary elements leading to the event.

4. **Role Responsibility**:
- Role responsibility refers to the tasks, moral obligations, and legal obligations an agent undertakes in their specific role.
- The paper proposes standards for the effective fulfillment of role responsibility, including clarity, appropriateness, feasibility, and coordination with other tasks and obligations.

5. **Legal Responsibility**:
- Legal responsibility refers to an agent being subject to legal sanctions for violating legal provisions.
- The paper divides legal responsibility into criminal responsibility and civil responsibility and discusses the specific conditions and standards for these responsibilities.

6. **Moral Responsibility**:
- Moral responsibility refers to an agent being subject to moral condemnation as the author of an event.
- The paper distinguishes between two forms of moral responsibility: attributability and accountability.

### Application Case

The paper applies the above conceptual analysis method to a specific case—a fatal collision between an autonomous AI ship and a traditional manned ship—to demonstrate how to allocate responsibility in a real-world scenario.

### Conclusion

By systematically decomposing and clarifying the concept of responsibility, the paper provides a solid conceptual foundation for policymakers, practitioners, and researchers, helping them avoid conceptual confusion and misunderstanding when discussing AI responsibility issues. This not only helps ensure the fairness of responsibility attribution but also enhances public trust in AI technology and promotes cooperation among various stakeholders.