Abstract:Artificial Intelligence (AI) Auditability is a core requirement for achieving responsible AI system design. However, it is not yet a prominent design feature in current applications. Existing AI auditing tools typically lack integration features and remain as isolated approaches. This results in manual, high-effort, and mostly one-off AI audits, necessitating alternative methods. Inspired by other domains such as finance, continuous AI auditing is a promising direction to conduct regular assessments of AI systems. The issue remains, however, since the methods for continuous AI auditing are not mature yet at the moment. To address this gap, we propose the Auditability Method for AI (AuditMAI), which is intended as a blueprint for an infrastructure towards continuous AI auditing. For this purpose, we first clarified the definition of AI auditability based on literature. Secondly, we derived requirements from two industrial use cases for continuous AI auditing tool support. Finally, we developed AuditMAI and discussed its elements as a blueprint for a continuous AI auditability infrastructure.

What problem does this paper attempt to address?

The paper aims to address two major challenges in artificial intelligence (AI) auditing and proposes a method for continuous AI auditing infrastructure. Specifically, the current AI auditing methods have the following issues: 1. **Unclear definition and requirements of AI auditability**: The terminology and vocabulary used in existing AI auditing methods vary, leading to different expectations and requirements. Although AI auditability is often mentioned as an important characteristic for building responsible algorithmic systems, specific implementation recommendations and requirements are still lacking. 2. **Lack of automated AI auditing methods**: Most existing AI auditing methods are one-time external audits, mainly used for post-hoc detection. Most published governance processes focus on manual tracking and data collection. Continuous AI auditing practices have not yet been established. To overcome these challenges, the authors propose AuditMAI (AI Auditability Method), a framework for achieving continuous AI auditing. The framework is based on three levels: knowledge, process, and architecture. By analyzing the literature and the needs of two industrial use cases, the authors clarified the definition of AI auditability and proposed four key requirements: 1. **Logging of relevant auditable artifacts**: It is necessary to identify relevant audit information at different lifecycle stages of the AI system. 2. **Flexibility in the collection mechanism of auditable artifacts**: AI systems handle multimodal data, requiring flexible collection mechanisms to adapt to different audit objectives. 3. **Automation in the collection, transformation, and management of auditable artifacts**: Since auditable artifacts come from multiple components and are in various formats, automated tools are needed to manage and integrate these artifacts. 4. **Ease of analyzing auditable artifacts**: Query interfaces and predefined queries should be provided so that auditors from different backgrounds can easily analyze the artifacts. Ultimately, the authors propose the AuditMAI framework, which combines knowledge management, process understanding, and architecture design to provide a comprehensive solution for continuous AI auditing.

AuditMAI: Towards An Infrastructure for Continuous AI Auditing

Artificial Intelligence in Auditing: A Conceptual Framework for Auditing Practices

Towards AI Accountability Infrastructure: Gaps and Opportunities in AI Audit Tooling

Auditing of AI: Legal, Ethical and Technical Approaches

Ethics-Based Auditing to Develop Trustworthy AI

AI auditing: The Broken Bus on the Road to AI Accountability

Closing the AI Accountability Gap: Defining an End-to-End Framework for Internal Algorithmic Auditing

Assessing the Auditability of AI-integrating Systems: A Framework and Learning Analytics Case Study

Designing an ML Auditing Criteria Catalog as Starting Point for the Development of a Framework

Advancing AI Audits for Enhanced AI Governance

A Framework for Assurance Audits of Algorithmic Systems

AI in Auditing: A Comprehensive Review of Applications, Benefits and Challenges

From Transparency to Accountability and Back: A Discussion of Access and Evidence in AI Auditing

The Necessity of AI Audit Standards Boards

Artificial intelligence application in auditing

Who Audits the Auditors? Recommendations from a field scan of the algorithmic auditing ecosystem

Auditing the AI auditors: A framework for evaluating fairness and bias in high stakes AI predictive models.

Auditing AI for Whom? A Community-Centric Approach to Rebuilding Public Trust in Singapore

Pragmatic auditing: a pilot-driven approach for auditing Machine Learning systems

Integrating data analytics in teaching audit with machine learning and artificial intelligence

Conformity Assessments and Post-market Monitoring: A Guide to the Role of Auditing in the Proposed European AI Regulation