Abstract:Federated learning (FL) strives to enable collaborative training of deep models on the distributed clients of different data without centrally aggregating raw data and hence improving data privacy. Nevertheless, a central challenge in training classification models in the federated system is learning with non-IID data. Most of the existing work is dedicated to eliminating the heterogeneous influence of non-IID data in a federated system. However, in many real-world FL applications, the co-occurrence of data heterogeneity and long-tailed distribution is unavoidable. The universal class distribution is long-tailed, causing them to become easily biased towards head classes, which severely harms the global model performance. In this work, we also discovered an intriguing fact that the classifier logit vector (i.e., pre-softmax output) introduces a heterogeneity drift during the learning process of local training and global optimization, which harms the convergence as well as model performance. Therefore, motivated by the above finding, we propose a novel logit calibration FL method to solve the joint problem of nonIID and long-tailed data in federated learning, called Federated Learning with Logit Calibration (FedLC). First, we presented a method to mitigate the local update drift by calculating the Wasserstein distance among adjacent client logits and then aggregating similar clients to regulate local training. Second, based on the model ensemble, a new distillation method with logit calibration and class weighting was proposed by exploiting the diversity of local models trained on heterogeneous data, which effectively alleviates the global drift problem under long-tailed distribution. Finally, we evaluated FedLC using a highly non-IID and long-tailed experimental setting, comprehensive experiments on several benchmark datasets demonstrated that FedLC achieved superior performance compared with state-of-the-art FL methods, which fully illustrated the effectiveness of the logit calibration strategy.

FedCRAC: Improving Federated Classification Performance on Long-Tailed Data Via Classifier Representation Adjustment and Calibration

Federated Learning With Long-Tailed Data via Representation Unification and Classifier Rectification

FedFA: Federated Learning With Feature Anchors to Align Features and Classifiers for Heterogeneous Data

FedLF: Adaptive Logit Adjustment and Feature Optimization in Federated Long-Tailed Learning

FedCR: Personalized Federated Learning Based on Across-Client Common Representation with Conditional Mutual Information Regularization.

Federated Learning on Heterogeneous and Long-Tailed Data via Classifier Re-Training with Federated Features

Logit Calibration for Non-IID and Long-Tailed Data in Federated Learning.

FedReMa: Improving Personalized Federated Learning via Leveraging the Most Relevant Clients

FedTC: A Personalized Federated Learning Method with Two Classifiers

Integrating Local Real Data with Global Gradient Prototypes for Classifier Re-Balancing in Federated Long-Tailed Learning

FedCME: Client Matching and Classifier Exchanging to Handle Data Heterogeneity in Federated Learning

FedCD: A Classifier Debiased Federated Learning Framework for Non-IID Data

Bilateral Improvement in Local Personalization and Global Generalization in Federated Learning.

Decoupled Federated Learning on Long-Tailed and Non-IID Data with Feature Statistics

FedCal: Achieving Local and Global Calibration in Federated Learning via Aggregated Parameterized Scaler

Exploring Personalization Via Federated Representation Learning on Non-Iid Data.

FCA: Taming Long-tailed Federated Medical Image Classification by Classifier Anchoring

FedAC: An Adaptive Clustered Federated Learning Framework for Heterogeneous Data

FedCRL: Personalized Federated Learning with Contrastive Shared Representations for Label Heterogeneity in Non-IID Data

Federated Class-Incremental Learning with New-Class Augmented Self-Distillation

Exploring Amplified Heterogeneity Arising from Heavy-Tailed Distributions in Federated Learning