Abstract:With the rapid advancement of AI, there is a growing trend to integrate AI into decision-making processes. However, AI systems may exhibit biases that lead decision-makers to draw unfair conclusions. Notably, the COMPAS system used in the American justice system to evaluate recidivism was found to favor racial majority groups; specifically, it violates a fairness standard called equalized odds. Various measures have been proposed to assess AI fairness. We present a framework for auditing AI fairness, involving third-party auditors and AI system providers, and we have created a tool to facilitate systematic examination of AI systems. The tool is open-sourced and publicly available. Unlike traditional AI systems, we advocate a transparent white-box and statistics-based approach. It can be utilized by third-party auditors, AI developers, or the general public for reference when judging the fairness criterion of AI systems.

What problem does this paper attempt to address?

The paper attempts to address the issue of ensuring the fairness of Artificial Intelligence (AI) systems and proposes a transparent auditing framework to evaluate quantitative biases in AI systems. Specifically, the paper focuses on the following aspects: 1. **Background and Motivation**: - With the rapid development of AI technology, more and more decision-making processes are beginning to rely on AI systems. However, these AI systems may have biases, leading to unfair decisions. - For example, the COMPAS system used in the U.S. judicial system has been found to be unfair to minorities and disadvantaged groups, particularly violating the fairness standard of "equal opportunity." 2. **Research Objectives**: - Propose a comprehensive framework for auditing the fairness of AI systems. - This framework involves third-party auditors and AI system providers, aiming to evaluate the fairness of AI systems through a transparent approach. - Develop an open-source tool to help third-party auditors, AI developers, or the public assess the fairness standards of AI systems. 3. **Main Contributions**: - Define multiple fairness metrics, such as disparate impact, demographic parity, conditional statistical parity, overall accuracy equality, mean difference, equal opportunity, predictive equality, conditional use accuracy equality, predictive parity, equal calibration, positive balance, and negative balance. - Provide a Python package that supports common data set formats (such as CSV), enabling users to conveniently conduct fairness assessments. - Validate the effectiveness and accuracy of the framework through practical applications, such as analyzing the COMPAS dataset from ProPublica. 4. **Application Example**: - The paper conducts a detailed analysis of the COMPAS dataset using the proposed framework, confirming that African American defendants indeed face unfair scoring in the COMPAS system, consistent with ProPublica's findings. In summary, the paper aims to help various parties better evaluate and ensure the fairness of AI systems by proposing a transparent and systematic auditing framework, thereby reducing bias and unfair phenomena.

Ensuring Fairness with Transparent Auditing of Quantitative Bias in AI Systems

Auditing the AI auditors: A framework for evaluating fairness and bias in high stakes AI predictive models.

Peer-induced Fairness: A Causal Approach for Algorithmic Fairness Auditing

FairCompass: Operationalising Fairness in Machine Learning

Fairway: SE Principles for Building Fairer Software

A Framework for Assurance Audits of Algorithmic Systems

Bias and Fairness in Computer Vision Applications of the Criminal Justice System

Black-Box Access is Insufficient for Rigorous AI Audits

Auditing fairness under unawareness through counterfactual reasoning

Fairness Assessment for Artificial Intelligence in Financial Industry

Bias, Fairness, and Accountability with AI and ML Algorithms

FairAIED: Navigating Fairness, Bias, and Ethics in Educational AI Applications

The Right Tool for the Job: Open-Source Auditing Tools in Machine Learning

Assessing the Fairness of AI Systems: AI Practitioners' Processes, Challenges, and Needs for Support

Bias, Fairness and Accountability with Artificial Intelligence and Machine Learning Algorithms

Addressing Bias and Fairness Issues in Artificial Intelligence

AI Fairness: from Principles to Practice

Fairness Score and process standardization: framework for fairness certification in artificial intelligence systems

Algorithmic fairness in artificial intelligence for medicine and healthcare

Aequitas: A Bias and Fairness Audit Toolkit

From Transparency to Accountability and Back: A Discussion of Access and Evidence in AI Auditing