Abstract:Federated Learning (FL) has been widely used to facilitate distributed and privacy-preserving machine learning in recent years. Different from centralized training that usually has independent and identically distributed (IID) distribution of all users' data, FL suffers from significant communication cost and model performance degradation due to the non-IID data from individual edge devices. Existing work calibrates the local models using a global anchor or sharing global data. However, these studies either assume that the central server has the global dataset or require participating devices to share raw data, which incurs additional communication costs and privacy concerns. In this paper, we propose SlaugFL , a novel selective GAN-based data augmentation scheme for communication-efficient edge FL, which selects representative devices to share specific local class prototypes with the central server for GAN model training and improves FL performance with the trained GAN. Specifically, on the server side, we generate diverse labeled candidate data with the help of powerful generative models (the stable diffusion model and ChatGPT). To ensure that the GAN-generated data possesses a similar domain to the devices' local data, we leverage these selected local class prototypes to pick desired GAN training samples from the labeled candidate data. On the device side, we propose a dual-calibration approach consisting of two calibration manners. Concretely, we augment devices' non-IID data with the trained GAN model, where devices utilize the trained GAN model to generate the IID dataset. Thus, the device's local model can be directly calibrated with the augmented data. With the generated IID data, we yield privacy-free (p-f) global class prototypes which can be employed to further calibrate devices' local models. Combining these two calibrations effectively improves devices' local models. Extensive experimental results show that SlaugFL can significantly reduce the communication cost (up to 52.49%) while achieving the same accuracy, compared to the state-of-the-art work.

Client-Edge-Cloud Hierarchical Federated Learning Based on Generative Adversarial Networks

HFL-GAN: scalable hierarchical federated learning GAN for high quantity heterogeneous clients

Cloud–Edge–End Collaborative Federated Learning: Enhancing Model Accuracy and Privacy in Non-IID Environments

A Novel Federated Learning Scheme for Generative Adversarial Networks

PerFED-GAN: Personalized Federated Learning via Generative Adversarial Networks

Pattern Recognition and Computer Vision, Third Chinese Conference, PRCV 2020, Nanjing, China, October 16-18, 2020, Proceedings, Part I.

A New Distributed Method for Training Generative Adversarial Networks

Ensemble-Based Distributed Learning for Generative Adversarial Networks.

Towards Optimal Customized Architecture for Heterogeneous Federated Learning with Contrastive Cloud-Edge Model Decoupling

GANFed: GAN-Based Federated Learning with Non-IID Datasets in Edge IoTs

Lightweight Privacy-Preserving GAN Framework for Model Training and Image Synthesis

FedGen: Personalized Federated Learning with Data Generation for Enhanced Model Customization and Class Imbalance

Adaptive Clustered Federated Learning for Heterogeneous Data in Edge Computing

A Personalized Federated Cloud-Edge Collaboration Framework Via Cross-Client Knowledge Distillation

EFFGAN: Ensembles of fine-tuned federated GANs

Cloud-Edge-Client Collaborative Learning in Digital Twin Empowered Mobile Networks

SlaugFL: Efficient Edge Federated Learning with Selective GAN-based Data Augmentation

PaDPaF: Partial Disentanglement with Partially-Federated GANs

Fedsemgan: A Semi-Supervised Federated Learning-Based Edge-Cloud Collaborative Framework for Medical Diagnosis Service

Cloud-Edge Collaborative Large Model Services: Challenges and Solutions

Mitigating Cross-client GANs-based Attack in Federated Learning