Abstract:Generative Adversarial Networks (GANs) have been widely used for generating synthetic data for cases where there is a limited size real-world dataset or when data holders are unwilling to share their data samples. Recent works showed that GANs, due to overfitting and memorization, might leak information regarding their training data samples. This makes GANs vulnerable to Membership Inference Attacks (MIAs). Several defense strategies have been proposed in the literature to mitigate this privacy issue. Unfortunately, defense strategies based on differential privacy are proven to reduce extensively the quality of the synthetic data points. On the other hand, more recent frameworks such as PrivGAN and PAR-GAN are not suitable for small-size training datasets. In the present work, the overfitting in GANs is studied in terms of the discriminator, and a more general measure of overfitting based on the Bhattacharyya coefficient is defined. Then, inspired by Fano's inequality, our first defense mechanism against MIAs is proposed. This framework, which requires only a simple modification in the loss function of GANs, is referred to as the maximum entropy GAN or MEGAN and significantly improves the robustness of GANs to MIAs. As a second defense strategy, a more heuristic model based on minimizing the information leaked from generated samples about the training data points is presented. This approach is referred to as mutual information minimization GAN (MIMGAN) and uses a variational representation of the mutual information to minimize the information that a synthetic sample might leak about the whole training data set. Applying the proposed frameworks to some commonly used data sets against state-of-the-art MIAs reveals that the proposed methods can reduce the accuracy of the adversaries to the level of random guessing accuracy with a small reduction in the quality of the synthetic data samples.

A White-Box Generator Membership Inference Attack Against Generative Models

The Secret Revealer: Generative Model-Inversion Attacks Against Deep Neural Networks

Towards Efficient Data Free Blackbox Adversarial Attack

NetGuard: Protecting Commercial Web APIs from Model Inversion Attacks Using GAN-generated Fake Samples

Generalization in Generative Adversarial Networks: A Novel Perspective from Privacy Protection.

Black-Box Training Data Identification in GANs via Detector Networks

Generated Distributions Are All You Need for Membership Inference Attacks Against Generative Models

Tunable Privacy Risk Evaluation of Generative Adversarial Networks

GAN-Leaks: A Taxonomy of Membership Inference Attacks against Generative Models

A GAN-Based Defense Framework Against Model Inversion Attacks.

Monte Carlo and Reconstruction Membership Inference Attacks against Generative Models

Privacy Re-identification Attacks on Tabular GANs

Reconstruction and Membership Inference Attacks against Generative Models

Privacy-preserving Generative Framework Against Membership Inference Attacks

Preserving Privacy in GANs Against Membership Inference Attack

White-box Membership Inference Attacks against Diffusion Models

Black-box Membership Inference Attacks against Fine-tuned Diffusion Models

Reinforcement Learning-Based Black-Box Model Inversion Attacks

An Empirical Study on the Membership Inference Attack against Tabular Data Synthesis Models

Property Inference Attacks Against GANs

Black-Box Based Limited Query Membership Inference Attack