Abstract:Every day, millions of administrative transactions take place. Insurance policies, credit appraisals, permit and welfare applications, to name a few, are created, invoked, and assessed. Though often treated as banalities of modern life, these transactions often carry significant importance. To the extent that such decisions are embodied in a governmental, administrative process, they must meet the requirements set out in administrative law, one of which being the requirement of explainability. Increasingly, many of these tasks are being fully or semi-automated through algorithmic decision making (ADM) systems. Fearing the opaqueness of the dreaded black box of these ADM systems, countless ethical guidelines have been produced for combatting the lack of computational transparency. Rather than adding yet another ethical framework to an already overcrowded ethics-based literature, we focus on a concrete legal approach, and ask: what does explainability actually require? Using a comparative approach, we investigate the extent to which such decisions may be made using computational tools and under what rubric their compatibility with the legal requirement of explainability can be examined. We assess what explainability actually demands with regard to both human and computer-aided decision-making and which recent legislative trends, if any, can be observed. We also critique the field’s unwillingness to apply the standard of explainability already enshrined in administrative law: the human standard. Finally, we introduce what we call the “administrative Turing test” which could be used to continually validate and strengthen AI-supported decision-making. With this approach, we provide a benchmark of explainability on which future applications of algorithmic decision-making can be measured in a broader European context, without creating an undue burden on its implementation.

Impact of Legal Requirements on Explainability in Machine Learning

Explainable AI under contract and tort law: legal incentives and technical challenges

Explainability of Artificial Intelligence Models: Technical Foundations and Legal Principles

The Case Against Explainability

How should AI decisions be explained? Requirements for Explanations from the Perspective of European Law

Post-Hoc Explanations Fail to Achieve their Purpose in Adversarial Contexts

Privacy Meets Explainability: A Comprehensive Impact Benchmark

Explainability for Machine Learning Models: From Data Adaptability to User Perception

Privacy Implications of Explainable AI in Data-Driven Systems

Explainable artificial intelligence (XAI) post-hoc explainability methods: risks and limitations in non-discrimination law

Flexible and Context-Specific AI Explainability: A Multidisciplinary Approach

Dealing with Explainability Requirements for Machine Learning Systems

The privacy-explainability trade-off: unraveling the impacts of differential privacy and federated learning on attribution methods

Explainable machine learning for public policy: Use cases, gaps, and research directions

Proposed Guidelines for the Responsible Use of Explainable Machine Learning

Fairness and Explainability in Automatic Decision-Making Systems. A challenge for computer science and law

Accountable and Explainable Methods for Complex Reasoning over Text

What's in the Box? The Legal Requirement of Explainability in Computationally Aided Decision-Making in Public Administration

Interpretability and Transparency of Machine Learning in File Fragment Analysis with Explainable Artificial Intelligence

On the Relationship Between Interpretability and Explainability in Machine Learning

Making Things Explainable vs Explaining: Requirements and Challenges under the GDPR