Abstract:Although machine learning algorithms demonstrate impressive performance, their trustworthiness remains a critical issue, particularly concerning fairness when implemented in real-world applications. Many notions of group fairness aim to minimize disparities in performance across protected groups. However, it can inadvertently reduce performance in certain groups, leading to sub-optimal outcomes. In contrast, Min-max group fairness notion prioritizes the improvement for the worst-performing group, thereby advocating a utility-promoting approach to fairness. However, it has been proven that existing efforts to achieve Min-max fairness exhibit limited effectiveness. In response to this challenge, we leverage the recently proposed "Neural Collapse'' framework to re-examine Empirical Risk Minimization (ERM) training, specifically investigating the root causes of poor performance in minority groups. The layer-peeled model is employed to decompose a network into two parts: an encoder to learn latent representation, and a subsequent classifier, with a systematic characterization of their training behaviors being conducted. Our analysis reveals that while classifiers achieve maximum separation, the separability of representations is insufficient, particularly for minority groups. This indicates the sub-optimal performance in minority groups stems from less separable representations, rather than classifiers. To tackle this issue, we introduce a novel strategy that incorporates a frozen classifier to directly enhance representation. Furthermore, we introduce two easily implemented loss functions to guide the learning process. The experimental assessments carried out on real-world benchmark datasets spanning the domains of Computer Vision, Natural Language Processing, and Tabular data demonstrate that our approach outperforms existing state-of-the-art methods in promoting the Min-max fairness notion.

Fair Representation Learning: an Alternative to Mutual Information

Fair Representation Learning for Recommendation: A Mutual Information Perspective

Learning fair representations via an adversarial framework

Learning Disentangled Representation with Pairwise Independence

Self-Supervised Fair Representation Learning without Demographics

Bridging Fairness Gaps: A (Conditional) Distance Covariance Perspective in Fairness Learning

Debiasing Graph Representation Learning based on Information Bottleneck

Privacy for Fairness: Information Obfuscation for Fair Representation Learning with Local Differential Privacy

Learning Fair and Interpretable Representations via Linear Orthogonalization

Learning Interpretable Fair Representations

Fairness-aware Contrastive Learning with Partially Annotated Sensitive Attributes

Neural Collapse Inspired Debiased Representation Learning for Min-max Fairness

Fair Representation Learning through Implicit Path Alignment.

FLAC: Fairness-Aware Representation Learning by Suppressing Attribute-Class Associations

FAIRM: Learning invariant representations for algorithmic fairness and domain generalization with minimax optimality

Learning unbiased features

Learning fair representation with a parametric integral probability metric

Fair Data Representation for Machine Learning at the Pareto Frontier

Causality-Inspired Fair Representation Learning for Multimodal Recommendation

Enforcing Conditional Independence for Fair Representation Learning and Causal Image Generation