Abstract:Federated Long-Tailed Learning (Fed-LT), a paradigm wherein data collected from decentralized local clients manifests a globally prevalent long-tailed distribution, has garnered considerable attention in recent times. In the context of Fed-LT, existing works have predominantly centered on addressing the data imbalance issue to enhance the efficacy of the generic global model while neglecting the performance at the local level. In contrast, conventional Personalized Federated Learning (pFL) techniques are primarily devised to optimize personalized local models under the presumption of a balanced global data distribution. This paper introduces an approach termed Federated Local and Generic Model Training in Fed-LT (FedLoGe), which enhances both local and generic model performance through the integration of representation learning and classifier alignment within a neural collapse framework. Our investigation reveals the feasibility of employing a shared backbone as a foundational framework for capturing overarching global trends, while concurrently employing individualized classifiers to encapsulate distinct refinements stemming from each client's local features. Building upon this discovery, we establish the Static Sparse Equiangular Tight Frame Classifier (SSE-C), inspired by neural collapse principles that naturally prune extraneous noisy features and foster the acquisition of potent data representations. Furthermore, leveraging insights from imbalance neural collapse's classifier norm patterns, we develop Global and Local Adaptive Feature Realignment (GLA-FR) via an auxiliary global classifier and personalized Euclidean norm transfer to align global features with client preferences. Extensive experimental results on CIFAR-10/100-LT, ImageNet, and iNaturalist demonstrate the advantage of our method over state-of-the-art pFL and Fed-LT approaches.

FedLD: Federated Learning for Privacy-Preserving Collaborative Landslide Detection

A federated learning based approach for predicting landslide displacement considering data security

Privacy-Preserving Federated Learning Against Label-Flipping Attacks on Non-IID Data

LF3PFL: A Practical Privacy-Preserving Federated Learning Algorithm Based on Local Federalization Scheme

LDP-Fed+: A robust and privacy-preserving federated learning based classification framework enabled by local differential privacy

Towards Federated Long-Tailed Learning

Fed-CAD: Federated Learning with Correlation-aware Adaptive Local Differential Privacy

Secure Decentralized Aggregation to Prevent Membership Privacy Leakage in Edge-based Federated Learning

Data Valuation and Detections in Federated Learning

FedLoGe: Joint Local and Generic Federated Learning under Long-tailed Data

FedFDP: Fairness-Aware Federated Learning with Differential Privacy

Mitigating Backdoors in Federated Learning with FLD

Harnessing Distributed Deep Learning for Landslide Displacement Prediction: A Multi-Model Collaborative Approach Amidst Data Silos

A Lightweight and Accuracy-Lossless Privacy-Preserving Method in Federated Learning

FLea: Addressing Data Scarcity and Label Skew in Federated Learning via Privacy-preserving Feature Augmentation

Local Differential Privacy Based Membership-Privacy-Preserving Federated Learning for Deep-Learning-Driven Remote Sensing

Federated Learning Privacy: Attacks, Defenses, Applications, and Policy Landscape - A Survey

Tackling Data Heterogeneity in Federated Learning via Loss Decomposition

Federated Large Language Models: Current Progress and Future Directions

A Hybrid Self-Supervised Learning Framework for Vertical Federated Learning

Advancements in Federated Learning: Models, Methods, and Privacy