Abstract:In the context of federated learning, smart terminal devices inherently exhibit various factors such as personalized user behaviors, regional differences, and heterogeneous hardware configurations due to their unique data capturing capabilities. Consequently, they inevitably present non-independent and identically distributed (Non-IID) data during the training process, making it challenging for traditional federated learning methods to achieve desired model performance and convergence effects when dealing with such complex data distributions. To address this challenge, researchers have explored data augmentation techniques, adaptive optimization algorithms, and improved model aggregation rules. However, these methods often fail to deliver satisfactory performance when confronted with Non-IID problems. In this paper, we propose a federated learning framework based on a greedy algorithm (FedGA). Unlike traditional approaches that rely on global parameter averaging aggregation, FedGA progressively searches for partially optimal models and aggregates them to obtain the global model. We first gather client data information and finely classify all clients, employing two strategies to optimize client data distribution: (1) for clients with imbalanced quantities, we utilize data sampling methods to balance client data; (2) for clients with imbalanced class distributions, we introduce a complementary federated meta-learning method, called FedComMeta, to improve the data distribution of client groups. Experimental results demonstrate that in scenarios involving Non-IID data, FedGA achieves significant improvements in model performance compared to existing methods such as FedAvg, FedProx, and Astraea, validating the effectiveness and superiority of our approach in handling Non-IID data distributions.

FedProc: Prototypical Contrastive Federated Learning on Non-IID data

FedProc: Prototypical contrastive federated learning on Non-IID data

FedCD: A Classifier Debiased Federated Learning Framework for Non-IID Data

FedDC: Federated Learning with Non-IID Data via Local Drift Decoupling and Correction

Federated Learning from Pre-Trained Models: A Contrastive Learning Approach

FedFC: an Efficient Personalized Federated Learning Method on Non-iid Data

MP-FedCL: Multi-Prototype Federated Contrastive Learning for Edge Intelligence

Grouped Federated Learning Algorithm Based on Non-IID Data

MP-FedCL: Multiprototype Federated Contrastive Learning for Edge Intelligence

FedCL: An Efficient Federated Unsupervised Learning for Model Sharing in IoT.

Communication-efficient federated continual learning for distributed learning system with Non-IID data

FedGA: A Greedy Approach to Enhance Federated Learning with Non-IID Data

DSFedCon: Dynamic Sparse Federated Contrastive Learning for Data-Driven Intelligent Systems

Federated Optimization Via Knowledge Codistillation.

Cross-Silo Prototypical Calibration for Federated Learning with Non-IID Data

MpFedcon : Model-Contrastive Personalized Federated Learning with the Class Center

FedAA: Using Non-sensitive Modalities to Improve Federated Learning while Preserving Image Privacy

Towards Optimal Customized Architecture for Heterogeneous Federated Learning with Contrastive Cloud-Edge Model Decoupling

FedPer++: Toward Improved Personalized Federated Learning on Heterogeneous and Imbalanced Data

An Enhanced Federated Prototype Learning Method under Domain Shift