Abstract:In the context of federated learning, smart terminal devices inherently exhibit various factors such as personalized user behaviors, regional differences, and heterogeneous hardware configurations due to their unique data capturing capabilities. Consequently, they inevitably present non-independent and identically distributed (Non-IID) data during the training process, making it challenging for traditional federated learning methods to achieve desired model performance and convergence effects when dealing with such complex data distributions. To address this challenge, researchers have explored data augmentation techniques, adaptive optimization algorithms, and improved model aggregation rules. However, these methods often fail to deliver satisfactory performance when confronted with Non-IID problems. In this paper, we propose a federated learning framework based on a greedy algorithm (FedGA). Unlike traditional approaches that rely on global parameter averaging aggregation, FedGA progressively searches for partially optimal models and aggregates them to obtain the global model. We first gather client data information and finely classify all clients, employing two strategies to optimize client data distribution: (1) for clients with imbalanced quantities, we utilize data sampling methods to balance client data; (2) for clients with imbalanced class distributions, we introduce a complementary federated meta-learning method, called FedComMeta, to improve the data distribution of client groups. Experimental results demonstrate that in scenarios involving Non-IID data, FedGA achieves significant improvements in model performance compared to existing methods such as FedAvg, FedProx, and Astraea, validating the effectiveness and superiority of our approach in handling Non-IID data distributions.

FedSiam-DA: Dual-aggregated Federated Learning Via Siamese Network for Non-Iid Data

FedSiam-DA: Dual-aggregated Federated Learning via Siamese Network under Non-IID Data

FedDGP: Disentangling Global and Personal Models for Federated Learning

FedPSE: Personalized Sparsification with Element-wise Aggregation for Federated Learning

Optimizing Federated Learning on Non-IID Data Using Local Shapley Value.

MSSA-FL: High-Performance Multi-stage Semi-asynchronous Federated Learning with Non-IID Data.

Adaptive Federated Learning on Non-IID Data with Resource Constraint

FedSA: A Semi-Asynchronous Federated Learning Mechanism in Heterogeneous Edge Computing

FedDA: Resource-adaptive Federated Learning with Dual-Alignment Aggregation Optimization for Heterogeneous Edge Devices

Dual Adversarial Federated Learning on Non-IID Data

FedRDS: Federated Learning on Non-IID Data Via Regularization and Data Sharing

Client Selection for Federated Learning With Non-IID Data in Mobile Edge Computing

Semi-Supervised Federated Learning with Non-Iid Data: Algorithm and System Design

FedSSA: Semantic Similarity-based Aggregation for Efficient Model-Heterogeneous Personalized Federated Learning

Lazy Aggregation for Heterogeneous Federated Learning

FedDUAL: A Dual-Strategy with Adaptive Loss and Dynamic Aggregation for Mitigating Data Heterogeneity in Federated Learning

Towards addressing aggregation deviation for model training in resource-scarce edge environment

FedASA: A Personalized Federated Learning with Adaptive Model Aggregation for Heterogeneous Mobile Edge Computing

FedSAE: A Novel Self-Adaptive Federated Learning Framework in Heterogeneous Systems

FedGA: A Greedy Approach to Enhance Federated Learning with Non-IID Data

Communication-efficient federated continual learning for distributed learning system with Non-IID data