Abstract:The widespread use of machine learning and data-driven algorithms for decision making has been steadily increasing over many years. The areas in which this is happening are diverse: healthcare, employment, finance, education, the legal system to name a few; and the associated negative side effects are being increasingly harmful for society. Negative data \emph{bias} is one of those, which tends to result in harmful consequences for specific groups of people. Any mitigation strategy or effective policy that addresses the negative consequences of bias must start with awareness that bias exists, together with a way to understand and quantify it. However, there is a lack of consensus on how to measure data bias and oftentimes the intended meaning is context dependent and not uniform within the research community. The main contributions of our work are: (1) The definition of Uniform Bias (UB), the first bias measure with a clear and simple interpretation in the full range of bias values. (2) A systematic study to characterize the flaws of existing measures in the context of anti employment discrimination rules used by the Office of Federal Contract Compliance Programs, additionally showing how UB solves open problems in this domain. (3) A framework that provides an efficient way to derive a mathematical formula for a bias measure based on an algorithmic specification of bias addition. Our results are experimentally validated using nine publicly available datasets and theoretically analyzed, which provide novel insights about the problem. Based on our approach, we also design a bias mitigation model that might be useful to policymakers.

A Note on Bias to Complete

The (Dis)unity of psychological (social) bias

Evaluating and Mitigating Social Bias for Large Language Models in Open-ended Settings

Breaking Bias, Building Bridges: Evaluation and Mitigation of Social Biases in LLMs via Contact Hypothesis

Steering LLMs Towards Unbiased Responses: A Causality-Guided Debiasing Framework

Ask LLMs Directly, "What shapes your bias?": Measuring Social Bias in Large Language Models

Cognitive Bias in Decision-Making with LLMs

Covert Bias: The Severity of Social Views' Unalignment in Language Models Towards Implicit and Explicit Opinion

An Unintentional, Robust, and Replicable Pro-Black Bias in Social Judgment

Exploring Subjectivity for more Human-Centric Assessment of Social Biases in Large Language Models

Social Bias Frames: Reasoning about Social and Power Implications of Language

A Comprehensive Empirical Study of Bias Mitigation Methods for Machine Learning Classifiers

Bias by Default?

A Principled Approach for a New Bias Measure

Different Bias Under Different Criteria: Assessing Bias in LLMs with a Fact-Based Approach

Bias Unveiled: Investigating Social Bias in LLM-Generated Code

Do the Right Thing, Just Debias! Multi-Category Bias Mitigation Using LLMs

Towards Identifying Social Bias in Dialog Systems: Framework, Dataset, and Benchmark

BiasAlert: A Plug-and-play Tool for Social Bias Detection in LLMs

Towards Understanding and Mitigating Social Biases in Language Models

Dynamics of Opinions with Social Biases.