Abstract:In the context of federated learning, smart terminal devices inherently exhibit various factors such as personalized user behaviors, regional differences, and heterogeneous hardware configurations due to their unique data capturing capabilities. Consequently, they inevitably present non-independent and identically distributed (Non-IID) data during the training process, making it challenging for traditional federated learning methods to achieve desired model performance and convergence effects when dealing with such complex data distributions. To address this challenge, researchers have explored data augmentation techniques, adaptive optimization algorithms, and improved model aggregation rules. However, these methods often fail to deliver satisfactory performance when confronted with Non-IID problems. In this paper, we propose a federated learning framework based on a greedy algorithm (FedGA). Unlike traditional approaches that rely on global parameter averaging aggregation, FedGA progressively searches for partially optimal models and aggregates them to obtain the global model. We first gather client data information and finely classify all clients, employing two strategies to optimize client data distribution: (1) for clients with imbalanced quantities, we utilize data sampling methods to balance client data; (2) for clients with imbalanced class distributions, we introduce a complementary federated meta-learning method, called FedComMeta, to improve the data distribution of client groups. Experimental results demonstrate that in scenarios involving Non-IID data, FedGA achieves significant improvements in model performance compared to existing methods such as FedAvg, FedProx, and Astraea, validating the effectiveness and superiority of our approach in handling Non-IID data distributions.

Reschedule Gradients: Temporal Non-IID Resilient Federated Learning

Take History as a Mirror in Heterogeneous Federated Learning

Gradient Scheduling with Global Momentum for Asynchronous Federated Learning in Edge Environment

A Derivative-Incorporated Adaptive Gradient Method for Federated Learning

Adaptive Gradient Sparsification for Efficient Federated Learning: An Online Learning Approach

FedGSNR: Accelerating Federated Learning on Non-IID Data via Maximum Gradient Signal to Noise Ratio

FedGA: A Greedy Approach to Enhance Federated Learning with Non-IID Data

FedAgg: Adaptive Federated Learning with Aggregated Gradients

Gradient Masked Averaging for Federated Learning

Byzantine-resilient Federated Learning Employing Normalized Gradients on Non-IID Datasets

Adaptive Federated Learning on Non-IID Data with Resource Constraint

Federated Learning Algorithm Based on Adaptive Gradient Fusion

Accelerating Federated Learning by Selecting Beneficial Herd of Local Gradients

Lazy Aggregation for Heterogeneous Federated Learning

Pfedgf: Enabling Personalized Federated Learning Via Gradient Fusion

Gradient-Congruity Guided Federated Sparse Training

Gradient-Leakage Resilient Federated Learning

FedHyper: A Universal and Robust Learning Rate Scheduler for Federated Learning with Hypergradient Descent

Local-Global Knowledge Distillation in Heterogeneous Federated Learning with Non-IID Data

FedDA: Faster Framework of Local Adaptive Gradient Methods via Restarted Dual Averaging

Decentralised Federated Learning with Adaptive Partial Gradient Aggregation