Abstract:The cause-to-effect analysis can help us decompose all the likely causes of a problem, such as an undesirable business situation or unintended harm to the individual(s). This implies that we can identify how the problems are inherited, rank the causes to help prioritize fixes, simplify a complex problem and visualize them. In the context of machine learning (ML), one can use cause-to-effect analysis to understand the reason for the biased behavior of the system. For example, we can examine the root causes of biases by checking each feature for a potential cause of bias in the model. To approach this, one can apply small changes to a given feature or a pair of features in the data, following some guidelines and observing how it impacts the decision made by the model (i.e., model prediction). Therefore, we can use cause-to-effect analysis to identify the potential bias-inducing features, even when these features are originally are unknown. This is important since most current methods require a pre-identification of sensitive features for bias assessment and can actually miss other relevant bias-inducing features, which is why systematic identification of such features is necessary. Moreover, it often occurs that to achieve an equitable outcome, one has to take into account sensitive features in the model decision. Therefore, it should be up to the domain experts to decide based on their knowledge of the context of a decision whether bias induced by specific features is acceptable or not. In this study, we propose an approach for systematically identifying all bias-inducing features of a model to help support the decision-making of domain experts. We evaluated our technique using four well-known datasets to showcase how our contribution can help spearhead the standard procedure when developing, testing, maintaining, and deploying fair/equitable machine learning systems.

Validity Concerns of Using Machine Learning in Management Research

Statistical Thinking, Machine Learning

Towards Fair Machine Learning Software: Understanding and Addressing Model Bias Through Counterfactual Thinking

Unraveling overoptimism and publication bias in ML-driven science

Fix Fairness, Don't Ruin Accuracy: Performance Aware Fairness Repair using AutoML

A Comprehensive Empirical Study of Bias Mitigation Methods for Machine Learning Classifiers

Using Machine Bias To Measure Human Bias

Pitfalls of Machine Learning-Based Personnel Selection

Correcting User Decisions Based on Incorrect Machine Learning Decisions

Machine Learning Bias in Computer Vision: Why do I have to care?

Impact of Missing Values in Machine Learning: A Comprehensive Analysis

The Prevalence of Errors in Machine Learning Experiments

Bias, Fairness, and Accountability with AI and ML Algorithms

Use and Misuse of Machine Learning in Anthropology

Understanding Bias in Machine Learning

Evaluation Gaps in Machine Learning Practice

The Risks of Machine Learning Systems

Fairness, Accuracy, and Unreliable Data

Machine Learning in Environmental Research: Common Pitfalls and Best Practices.

Detection and Evaluation of bias-inducing Features in Machine learning

Reducing Subgroup Differences in Personnel Selection Through the Application of Machine Learning