Abstract:With the widespread use of artificial intelligence (AI) systems and applications in our everyday lives, accounting for fairness has gained significant importance in designing and engineering of such systems. AI systems can be used in many sensitive environments to make important and life-changing decisions; thus, it is crucial to ensure that these decisions do not reflect discriminatory behavior toward certain groups or populations. More recently some work has been developed in traditional machine learning and deep learning that address such challenges in different subdomains. With the commercialization of these systems, researchers are becoming more aware of the biases that these applications can contain and are attempting to address them. In this survey, we investigated different real-world applications that have shown biases in various ways, and we listed different sources of biases that can affect AI applications. We then created a taxonomy for fairness definitions that machine learning researchers have defined to avoid the existing bias in AI systems. In addition to that, we examined different domains and subdomains in AI showing what researchers have observed with regard to unfair outcomes in the state-of-the-art methods and ways they have tried to address them. There are still many future directions and solutions that can be taken to mitigate the problem of bias in AI systems. We are hoping that this survey will motivate researchers to tackle these issues in the near future by observing existing work in their respective fields.

Fairness in Machine Learning: Definition, Testing, Debugging, and Application

Fairness Testing of Deep Image Classification with Adequacy Metrics

Fairness Testing: A Comprehensive Survey and Analysis of Trends

Bias, Fairness and Accountability with Artificial Intelligence and Machine Learning Algorithms

Fairness issues, current approaches, and challenges in machine learning models

What is Fair? Defining Fairness in Machine Learning for Health

What-is and How-to for Fairness in Machine Learning: A Survey, Reflection, and Perspective

A Survey on Bias and Fairness in Machine Learning

A novel approach for assessing fairness in deployed machine learning algorithms

Fairness for machine learning software in education: A systematic mapping study

Long-Term Fairness Inquiries and Pursuits in Machine Learning: A Survey of Notions, Methods, and Challenges

The invisible power of fairness. How machine learning shapes democracy

A Review on Fairness in Machine Learning

On the Legal Compatibility of Fairness Definitions

AI Fairness–From Machine Learning to Federated Learning

Towards Fair Machine Learning Software: Understanding and Addressing Model Bias Through Counterfactual Thinking

Bias, Fairness, and Accountability with AI and ML Algorithms

50 Years of Test (Un)fairness: Lessons for Machine Learning

Training Data Debugging for the Fairness of Machine Learning Software

Fairness-aware machine learning: a perspective