Abstract:In the context of federated learning, smart terminal devices inherently exhibit various factors such as personalized user behaviors, regional differences, and heterogeneous hardware configurations due to their unique data capturing capabilities. Consequently, they inevitably present non-independent and identically distributed (Non-IID) data during the training process, making it challenging for traditional federated learning methods to achieve desired model performance and convergence effects when dealing with such complex data distributions. To address this challenge, researchers have explored data augmentation techniques, adaptive optimization algorithms, and improved model aggregation rules. However, these methods often fail to deliver satisfactory performance when confronted with Non-IID problems. In this paper, we propose a federated learning framework based on a greedy algorithm (FedGA). Unlike traditional approaches that rely on global parameter averaging aggregation, FedGA progressively searches for partially optimal models and aggregates them to obtain the global model. We first gather client data information and finely classify all clients, employing two strategies to optimize client data distribution: (1) for clients with imbalanced quantities, we utilize data sampling methods to balance client data; (2) for clients with imbalanced class distributions, we introduce a complementary federated meta-learning method, called FedComMeta, to improve the data distribution of client groups. Experimental results demonstrate that in scenarios involving Non-IID data, FedGA achieves significant improvements in model performance compared to existing methods such as FedAvg, FedProx, and Astraea, validating the effectiveness and superiority of our approach in handling Non-IID data distributions.

Enhancing Federated Learning Efficiency with Generative Model-Based Data Augmentation for Non-IID Data

Data Augmentation Scheme for Federated Learning with Non-Iid Data

FedGA: A Greedy Approach to Enhance Federated Learning with Non-IID Data

Mitigating Data Heterogeneity in Federated Learning with Data Augmentation

Federated Data Augmentation Algorithm for Non-independent and Identical Distributed Data

GFL: Federated Learning on Non-IID data via Privacy-preserving Synthetic data

Communication-Efficient Federated Data Augmentation on Non-IID Data

Optimizing Federated Learning on Non-IID Data Using Local Shapley Value.

Federated Learning Empowered by Generative Content

Federated Learning with GAN-based Data Synthesis for Non-IID Clients.

Federated Learning with Data-Agnostic Distribution Fusion

Data-free knowledge distillation via generator-free data generation for Non-IID federated learning

FedKG: Model-Optimized Federated Learning for Local Client Training with Non-IID Private Data

FedGen: Personalized Federated Learning with Data Generation for Enhanced Model Customization and Class Imbalance

A Distributed Generative Adversarial Network for Data Augmentation under Vertical Federated Learning

Advocating for the Silent: Enhancing Federated Generalization for Non-Participating Clients

Federated Synthetic Data Generation with Differential Privacy

FedGM: Heterogeneous Federated Learning Via Generative Learning and Mutual Distillation

Grouped Federated Learning Algorithm Based on Non-IID Data

Enhancing Generalization Robustness of Federated Learning in Highly Heterogeneous Environments

Federated Learning with Auxiliary Generator