Abstract:The integration of machine learning models in various real-world applications is becoming more prevalent to assist humans in their daily decision-making tasks as a result of recent advancements in this field. However, it has been discovered that there is a tradeoff between the accuracy and fairness of these decision-making tasks. In some cases, these AI systems can be unfair by exhibiting bias or discrimination against certain social groups, which can have severe consequences in real life. Inspired by one of the most well-known human learning skills called grouping, we address this issue by proposing a novel machine learning framework where the ML model learns to group a diverse set of problems into distinct subgroups to solve each subgroup using its specific sub-model. Our proposed framework involves three stages of learning, which are formulated as a three-level optimization problem: (i) learning to group problems into different subgroups; (ii) learning group-specific sub-models for problem-solving; and (iii) updating group assignments of training examples by minimizing the validation loss. These three learning stages are performed end-to-end in a joint manner using gradient descent. To improve fairness and accuracy, we develop an efficient optimization algorithm to solve this three-level optimization problem. To further reduce the risk of overfitting in small datasets, we incorporate domain adaptation techniques in the second stage of training. We further apply our method to neural architecture search. Extensive experiments on various datasets demonstrate our method's effectiveness and performance improvements in both fairness and accuracy. Our proposed Learning by Grouping can reduce overfitting and achieve state-of-the-art performances with fixed human-designed network architectures and searchable network architectures on various datasets.

A Unified Meta-learning Framework for Fair Ranking with Curriculum Learning

Fairness-Aware Meta-Learning via Nash Bargaining

Learn to be Fair without Labels: a Distribution-based Learning Framework for Fair Ranking

Comprehensive Fair Meta-learned Recommender System

Referee-Meta-Learning for Fast Adaptation of Locational Fairness

Maximizing Marginal Fairness for Dynamic Learning to Rank

Learning by Grouping: A Multilevel Optimization Framework for Improving Fairness in Classification without Losing Accuracy

Fair Learning-to-Rank from Implicit Feedback

Optimizing fairness tradeoffs in machine learning with multiobjective meta-models

Policy-Gradient Training of Fair and Unbiased Ranking Functions

Enhancing Fairness in Meta-learned User Modeling Via Adaptive Sampling

Meta Learning to Rank for Sparsely Supervised Queries

Model-based Unbiased Learning to Rank

Learning Fair Classifiers via Min-Max F-divergence Regularization

Unfairness Discovery and Prevention For Few-Shot Regression

Curriculum in Gradient-Based Meta-Reinforcement Learning

Bias Mitigation in Fine-tuning Pre-trained Models for Enhanced Fairness and Efficiency

Structural Learning of Diverse Ranking.

A Joint Optimization Framework of the Embedding Model and Classifier for Meta-Learning

MHRR: MOOCs Recommender Service With Meta Hierarchical Reinforced Ranking

Fair Meta-Learning: Learning How to Learn Fairly