Abstract:The burgeoning field of Natural Language Processing (NLP) stands at a critical juncture where the integration of fairness within its frameworks has become an imperative. This PhD thesis addresses the need for equity and transparency in NLP systems, recognizing that fairness in NLP is not merely a technical challenge but a moral and ethical necessity, requiring a rigorous examination of how these technologies interact with and impact diverse human populations. Through this lens, this thesis undertakes a thorough investigation into the development of equitable NLP methodologies and the evaluation of biases that prevail in current systems. First, it introduces an innovative algorithm to mitigate biases in multi-class classifiers, tailored for high-risk NLP applications, surpassing traditional methods in both bias mitigation and prediction accuracy. Then, an analysis of the Bios dataset reveals the impact of dataset size on discriminatory biases and the limitations of standard fairness metrics. This awareness has led to explorations in the field of explainable AI, aiming for a more complete understanding of biases where traditional metrics are limited. Consequently, the thesis presents COCKATIEL, a model-agnostic explainability method that identifies and ranks concepts in Transformer models, outperforming previous approaches in sentiment analysis tasks. Finally, the thesis contributes to bridging the gap between fairness and explainability by introducing TaCo, a novel method to neutralize bias in Transformer model embeddings. In conclusion, this thesis constitutes a significant interdisciplinary endeavor that intertwines explicability and fairness to challenge and reshape current NLP paradigms. The methodologies and critiques presented contribute to the ongoing discourse on fairness in machine learning, offering actionable solutions for more equitable and responsible AI systems.

TaCo: Targeted Concept Erasure Prevents Non-Linear Classifiers From Detecting Protected Attributes

LEACE: Perfect linear concept erasure in closed form

Linear Adversarial Concept Erasure

Erasing Undesirable Concepts in Diffusion Models with Adversarial Preservation

Kernelized Concept Erasure

Probing Classifiers are Unreliable for Concept Removal and Detection

Circumventing Concept Erasure Methods For Text-to-Image Generative Models

Noise-tolerant fair classification

STEREO: Towards Adversarially Robust Concept Erasing from Text-to-Image Generation Models

Learning fair representations via an adversarial framework

FAIR-TAT: Improving Model Fairness Using Targeted Adversarial Training

Unsupervised Concept Discovery Mitigates Spurious Correlations

Fairness in Machine Learning with Tractable Models

Inference-Time Rule Eraser: Fair Recognition via Distilling and Removing Biased Rules

R.A.C.E.: Robust Adversarial Concept Erasure for Secure Text-to-Image Diffusion Model

Counterfactually Fair Representation

Counterfactual Fairness in Text Classification through Robustness

Advancing Fairness in Natural Language Processing: From Traditional Methods to Explainability

Fair Classification with Noisy Protected Attributes: A Framework with Provable Guarantees

fairBERTs: Erasing Sensitive Information Through Semantic and Fairness-aware Perturbations