Abstract:Although machine learning algorithms demonstrate impressive performance, their trustworthiness remains a critical issue, particularly concerning fairness when implemented in real-world applications. Many notions of group fairness aim to minimize disparities in performance across protected groups. However, it can inadvertently reduce performance in certain groups, leading to sub-optimal outcomes. In contrast, Min-max group fairness notion prioritizes the improvement for the worst-performing group, thereby advocating a utility-promoting approach to fairness. However, it has been proven that existing efforts to achieve Min-max fairness exhibit limited effectiveness. In response to this challenge, we leverage the recently proposed "Neural Collapse'' framework to re-examine Empirical Risk Minimization (ERM) training, specifically investigating the root causes of poor performance in minority groups. The layer-peeled model is employed to decompose a network into two parts: an encoder to learn latent representation, and a subsequent classifier, with a systematic characterization of their training behaviors being conducted. Our analysis reveals that while classifiers achieve maximum separation, the separability of representations is insufficient, particularly for minority groups. This indicates the sub-optimal performance in minority groups stems from less separable representations, rather than classifiers. To tackle this issue, we introduce a novel strategy that incorporates a frozen classifier to directly enhance representation. Furthermore, we introduce two easily implemented loss functions to guide the learning process. The experimental assessments carried out on real-world benchmark datasets spanning the domains of Computer Vision, Natural Language Processing, and Tabular data demonstrate that our approach outperforms existing state-of-the-art methods in promoting the Min-max fairness notion.

Density-Based Discriminative Nonnegative Representation Model for Imbalanced Classification

A New Classifier for Imbalanced Data Based on a Generalized Density Ratio Model

A hybrid imbalanced classification model based on data density

Robust discriminative non-negative matrix factorization.

Towards Deeper Insights into Deep Learning from Imbalanced Data.

A Density-Based Random Forest for Imbalanced Data Classification

The Ensemble of Density-Sensitive SVDD Classifier Based on Maximum Soft Margin for Imbalanced Datasets.

A Density-based Under-sampling Algorithm for Imbalance Classification

Laplacian Regularized Nonnegative Representation for Clustering and Dimensionality Reduction

Sparse, Collaborative, or Nonnegative Representation: Which Helps Pattern Classification?

A New Sampling Approach for Classification of Imbalanced Data Sets with High Density.

Neural Networks Learn Specified Information for Imbalanced Data Classification

Fuzzy Support Vector Machine with Relative Density Information for Classifying Imbalanced Data

Deep Reinforcement Learning for Imbalanced Classification

A Density Weighted Fuzzy Outlier Clustering Approach for Class Imbalanced Learning

Probability Density Machine: A New Solution of Class Imbalance Learning

Rectified Encoder Network For High-Dimensional Imbalanced Learning

LSTMAE-DWSSLM: A Unified Approach for Imbalanced Time Series Data Classification

Representation-based Hyperspectral Image Classification with Imbalanced Data

Neural Collapse Inspired Debiased Representation Learning for Min-max Fairness

Density-based weighting for imbalanced regression