Abstract:Federated Learning (FL) has been widely used to facilitate distributed and privacy-preserving machine learning in recent years. Different from centralized training that usually has independent and identically distributed (IID) distribution of all users' data, FL suffers from significant communication cost and model performance degradation due to the non-IID data from individual edge devices. Existing work calibrates the local models using a global anchor or sharing global data. However, these studies either assume that the central server has the global dataset or require participating devices to share raw data, which incurs additional communication costs and privacy concerns. In this paper, we propose SlaugFL , a novel selective GAN-based data augmentation scheme for communication-efficient edge FL, which selects representative devices to share specific local class prototypes with the central server for GAN model training and improves FL performance with the trained GAN. Specifically, on the server side, we generate diverse labeled candidate data with the help of powerful generative models (the stable diffusion model and ChatGPT). To ensure that the GAN-generated data possesses a similar domain to the devices' local data, we leverage these selected local class prototypes to pick desired GAN training samples from the labeled candidate data. On the device side, we propose a dual-calibration approach consisting of two calibration manners. Concretely, we augment devices' non-IID data with the trained GAN model, where devices utilize the trained GAN model to generate the IID dataset. Thus, the device's local model can be directly calibrated with the augmented data. With the generated IID data, we yield privacy-free (p-f) global class prototypes which can be employed to further calibrate devices' local models. Combining these two calibrations effectively improves devices' local models. Extensive experimental results show that SlaugFL can significantly reduce the communication cost (up to 52.49%) while achieving the same accuracy, compared to the state-of-the-art work.

RCFL-GAN: Resource-Constrained Federated Learning with Generative Adversarial Networks

Afl-gan: Adaptive Federated Learning for Generative Adversarial Network with Resource Constraints

FedDGP: Disentangling Global and Personal Models for Federated Learning

Efficient Ring-Topology Decentralized Federated Learning with Deep Generative Models for Medical Data in Ehealthcare Systems

Adaptive Federated Learning on Non-IID Data with Resource Constraint

A Resource-Adaptive Approach for Federated Learning under Resource-Constrained Environments

IFL-GAN: Improved Federated Learning Generative Adversarial Network With Maximum Mean Discrepancy Model Aggregation

GANFed: GAN-Based Federated Learning with Non-IID Datasets in Edge IoTs

Efficient Ring-topology Decentralized Federated Learning with Deep Generative Models for Industrial Artificial Intelligent

An Optimization Method for Non-IID Federated Learning Based on Deep Reinforcement Learning

SlaugFL: Efficient Edge Federated Learning with Selective GAN-based Data Augmentation

HFL-GAN: scalable hierarchical federated learning GAN for high quantity heterogeneous clients

AFed: Algorithmic Fair Federated Learning

A Novel Federated Learning Scheme for Generative Adversarial Networks

Reinforcement Learning As a Catalyst for Robust and Fair Federated Learning: Deciphering the Dynamics of Client Contributions

Generalized Federated Learning via Gradient Norm-Aware Minimization and Control Variables

PFL-GAN: When Client Heterogeneity Meets Generative Models in Personalized Federated Learning

Pattern Recognition and Computer Vision, Third Chinese Conference, PRCV 2020, Nanjing, China, October 16-18, 2020, Proceedings, Part I.

A Fair Federated Learning Framework with Reinforcement Learning.

FedKG: Model-Optimized Federated Learning for Local Client Training with Non-IID Private Data

FedCAR: Cross-client Adaptive Re-weighting for Generative Models in Federated Learning