Abstract:One of the difficulties of artificial intelligence is to ensure that model decisions are fair and free of bias. In research, datasets, metrics, techniques, and tools are applied to detect and mitigate algorithmic unfairness and bias. This study examines the current knowledge on bias and unfairness in machine learning models. The systematic review followed the PRISMA guidelines and is registered on OSF plataform. The search was carried out between 2021 and early 2022 in the Scopus, IEEE Xplore, Web of Science, and Google Scholar knowledge bases and found 128 articles published between 2017 and 2022, of which 45 were chosen based on search string optimization and inclusion and exclusion criteria. We discovered that the majority of retrieved works focus on bias and unfairness identification and mitigation techniques, offering tools, statistical approaches, important metrics, and datasets typically used for bias experiments. In terms of the primary forms of bias, data, algorithm, and user interaction were addressed in connection to the preprocessing, in-processing, and postprocessing mitigation methods. The use of Equalized Odds, Opportunity Equality, and Demographic Parity as primary fairness metrics emphasizes the crucial role of sensitive attributes in mitigating bias. The 25 datasets chosen span a wide range of areas, including criminal justice image enhancement, finance, education, product pricing, and health, with the majority including sensitive attributes. In terms of tools, Aequitas is the most often referenced, yet many of the tools were not employed in empirical experiments. A limitation of current research is the lack of multiclass and multimetric studies, which are found in just a few works and constrain the investigation to binary-focused method. Furthermore, the results indicate that different fairness metrics do not present uniform results for a given use case, and that more research with varied model architectures is necessary to standardize which ones are more appropriate for a given context. We also observed that all research addressed the transparency of the algorithm, or its capacity to explain how decisions are taken.

Aequitas: A Bias and Fairness Audit Toolkit

AI Fairness 360: An extensible toolkit for detecting and mitigating algorithmic bias

Auditing the AI auditors: A framework for evaluating fairness and bias in high stakes AI predictive models.

Aequitas Flow: Streamlining Fair ML Experimentation

The Right Tool for the Job: Open-Source Auditing Tools in Machine Learning

Automated Directed Fairness Testing

An Algorithmic Equity Toolkit for Technology Audits by Community Advocates and Activists

Ensuring Fairness with Transparent Auditing of Quantitative Bias in AI Systems

Bias and Unfairness in Machine Learning Models: A Systematic Review on Datasets, Tools, Fairness Metrics, and Identification and Mitigation Methods

Peer-induced Fairness: A Causal Approach for Algorithmic Fairness Auditing

AI Fairness: from Principles to Practice

EARN Fairness: Explaining, Asking, Reviewing and Negotiating Artificial Intelligence Fairness Metrics Among Stakeholders

Navigating Fairness in Radiology AI: Concepts, Consequences,and Crucial Considerations

Fairness via AI: Bias Reduction in Medical Information

Towards Standardizing AI Bias Exploration

A Survey on Bias and Fairness in Machine Learning

The algorithm audit: Scoring the algorithms that score us

Fair by design: A sociotechnical approach to justifying the fairness of AI-enabled systems across the lifecycle

Fairness in AI: challenges in bridging the gap between algorithms and law

A Genealogical Approach to Algorithmic Bias