Abstract:This work studies training generative adversarial networks under the federated learning setting. Generative adversarial networks (GANs) have achieved advancement in various real-world applications, such as image editing, style transfer, scene generations, etc. However, like other deep learning models, GANs are also suffering from data limitation problems in real cases. To boost the performance of GANs in target tasks, collecting images as many as possible from different sources becomes not only important but also essential. For example, to build a robust and accurate bio-metric verification system, huge amounts of images might be collected from surveillance cameras, and/or uploaded from cellphones by users accepting agreements. In an ideal case, utilize all those data uploaded from public and private devices for model training is straightforward. Unfortunately, in the real scenarios, this is hard due to a few reasons. At first, some data face the serious concern of leakage, and therefore it is prohibitive to upload them to a third-party server for model training; at second, the images collected by different kinds of devices, probably have distinctive biases due to various factors, e.g., collector preferences, geo-location differences, which is also known as “domain shift”. To handle those problems, we propose a novel generative learning scheme utilizing a federated learning framework. Following the configuration of federated learning, we conduct model training and aggregation on one center and a group of clients. Specifically, our method learns the distributed generative models in clients, while the models trained in each client are fused into one unified and versatile model in the center. To the best of our knowledge, this is the first work on touching GAN training under a federated learning setting. We perform extensive experiments to compare different federation strategies, and empirically examine the effectiveness of federation under different levels of parallelism and data skewness.

Ensemble-Based Distributed Learning for Generative Adversarial Networks.

A New Distributed Method for Training Generative Adversarial Networks

A Novel Federated Learning Scheme for Generative Adversarial Networks

A lightweight ensemble discriminator for Generative Adversarial Networks

Distributed Generative Adversarial Net

MD-GAN: Multi-Discriminator Generative Adversarial Networks for Distributed Datasets

LDGAN: Latent Determined Ensemble Helps Removing IID Data Assumption and Cross-node Sampling in Distributed GANs

DANCE: Distributed Generative Adversarial Networks with Communication Compression

Training Generative Adversarial Networks in One Stage

Pattern Recognition and Computer Vision, Third Chinese Conference, PRCV 2020, Nanjing, China, October 16-18, 2020, Proceedings, Part I.

A Graph Neural Network Based Decentralized Learning Scheme

Learning Geographically Distributed Data for Multiple Tasks Using Generative Adversarial Networks.

SCGAN: Semi-Centralized Generative Adversarial Network for Image Generation in Distributed Scenes

Distributed Spatio-Temporal Generative Adversarial Networks

Multi-modal AsynDGAN: Learn From Distributed Medical Image Data without Sharing Private Information

Massive Data Generation for Deep Learning-aided Wireless Systems Using Meta Learning and Generative Adversarial Network

Adversarial Learning of Portable Student Networks.

Generative Adversarial Network for Wireless Communication: Principle, Application, and Trends

Detecting GAN-based Privacy Attack in Distributed Learning

Ensemble Data Augmentation for Imbalanced Fault Diagnosis.

EFFGAN: Ensembles of fine-tuned federated GANs