Abstract:Recent research has identified discriminatory behavior of automated prediction algorithms towards groups identified on specific protected attributes (e.g., gender, ethnicity, age group, etc.). When deployed in real-world scenarios, such techniques may demonstrate biased predictions resulting in unfair outcomes. Recent literature has witnessed algorithms for mitigating such biased behavior mostly by adding convex surrogates of fairness metrics such as demographic parity or equalized odds in the loss function, which are often not easy to estimate. This research proposes a novel in-processing based GroupMixNorm layer for mitigating bias from deep learning models. The GroupMixNorm layer probabilistically mixes group-level feature statistics of samples across different groups based on the protected attribute. The proposed method improves upon several fairness metrics with minimal impact on overall accuracy. Analysis on benchmark tabular and image datasets demonstrates the efficacy of the proposed method in achieving state-of-the-art performance. Further, the experimental analysis also suggests the robustness of the GroupMixNorm layer against new protected attributes during inference and its utility in eliminating bias from a pre-trained network.

What problem does this paper attempt to address?

### What problem does this paper attempt to solve? This paper aims to solve the discriminatory behavior of machine - learning models towards specific protected attributes (such as gender, race, age group, etc.) during the prediction process. When these models are deployed in the real world, they may produce biased prediction results, leading to unfair outcomes. Specifically, the paper focuses on how to mitigate this bias through new methods in deep - learning models. To achieve this goal, the authors propose a new **GroupMixNorm layer** to reduce the model's bias during the training process. The GroupMixNorm layer probabilistically mixes feature statistics between different protected - attribute groups, enabling the model to learn feature representations that are independent of the protected attributes. This helps improve the performance of multiple fairness metrics while having a relatively small impact on overall accuracy. #### Specific problem description 1. **Limitations of existing methods**: - **Pre - processing and post - processing methods**: These methods treat the classifier as a black box and only make adjustments on the input or output, which may lead to failure to achieve optimal accuracy. - **Existing constraint - optimization - based methods**: These methods usually ensure fairness by adding convex surrogate terms to the loss function, but these surrogate terms are difficult to estimate accurately. 2. **Proposed new method**: - **GroupMixNorm layer**: This layer introduces a new module in the neural network architecture. By probabilistically mixing the feature statistics of different protected - attribute groups during the training process, the model learns feature representations that are independent of the protected attributes. - **Distribution alignment**: The GroupMixNorm layer improves fairness by aligning the feature statistics of different groups, reducing the model's dependence on protected attributes. 3. **Experimental verification**: - The paper conducts experiments on multiple benchmark datasets (including structured and non - structured datasets) to verify the effectiveness of the GroupMixNorm layer. - The experimental results show that the GroupMixNorm layer can significantly improve multiple fairness metrics (such as demographic parity, equal opportunity, and equalized odds) while maintaining high accuracy. ### Summary The main objective of this paper is to solve the discriminatory behavior of deep - learning models towards specific protected attributes during the prediction process by introducing a new GroupMixNorm layer, thereby ensuring the fairness and accuracy of the model.

GroupMixNorm Layer for Learning Fair Models

MixNN: Protection of Federated Learning Against Inference Attacks by Mixing Neural Network Layers

Learning by Grouping: A Multilevel Optimization Framework for Improving Fairness in Classification without Losing Accuracy

Fairness-enhancing mixed effects deep learning improves fairness on in- and out-of-distribution clustered (non-iid) data

GBMix: Enhancing Fairness by Group-Balanced Mixup

Group Fairness by Probabilistic Modeling with Latent Fair Decisions

Towards A Holistic View of Bias in Machine Learning: Bridging Algorithmic Fairness and Imbalanced Learning

Multi-Layer Personalized Federated Learning for Mitigating Biases in Student Predictive Analytics

ProxiMix: Enhancing Fairness with Proximity Samples in Subgroups

Fairness without Demographics through Learning Graph of Gradients

Multi-fairness under class-imbalance

Mitigating Group Bias in Federated Learning for Heterogeneous Devices

Normalise for Fairness: A Simple Normalisation Technique for Fairness in Regression Machine Learning Problems

Learning Fair Classifiers via Min-Max F-divergence Regularization

Bayes-Optimal Fair Classification with Linear Disparity Constraints via Pre-, In-, and Post-processing

Simultaneous Improvement of ML Model Fairness and Performance by Identifying Bias in Data

Neural Collapse Inspired Debiased Representation Learning for Min-max Fairness

Marginal Debiased Network for Fair Visual Recognition

Learning fair representations via an adversarial framework

Latent Imitator: Generating Natural Individual Discriminatory Instances for Black-Box Fairness Testing

Fair Generalized Linear Mixed Models