Abstract:Deep learning has been successfully utilized in many applications, but it is vulnerable to adversarial samples. To address this vulnerability, a generative adversarial network (GAN) has been used to train a robust classifier. This paper presents a novel GAN model and its implementation to defend against L∞ and L2 constraint gradient-based adversarial attacks. The proposed model is inspired by some of the related work, but it includes multiple new designs such as a dual generator architecture, four new generator input formulations, and two unique implementations with L∞ and L2 norm constraint vector outputs. The new formulations and parameter settings of GAN are proposed and evaluated to address the limitations of adversarial training and defensive GAN training strategies, such as gradient masking and training complexity. Furthermore, the training epoch parameter has been evaluated to determine its effect on the overall training results. The experimental results indicate that the optimal formulation of GAN adversarial training must utilize more gradient information from the target classifier. The results also demonstrate that GANs can overcome gradient masking and produce effective perturbation to augment the data. The model can defend PGD L2 128/255 norm perturbation with over 60% accuracy and PGD L∞ 8/255 norm perturbation with around 45% accuracy. The results have also revealed that robustness can be transferred between the constraints of the proposed model. In addition, a robustness-accuracy tradeoff was discovered, along with overfitting and the generalization capabilities of the generator and classifier. These limitations and ideas for future work will be discussed.

Adversarial network training using higher-order moments in a modified Wasserstein distance

Some Theoretical Insights into Wasserstein GANs

Training Generative Adversarial Networks in One Stage

Wasserstein Generative Adversarial Networks

A New Distributed Method for Training Generative Adversarial Networks

Language Modeling with Generative Adversarial Networks

Evaluation of GAN-Based Model for Adversarial Training

From GAN to WGAN

How Well Generative Adversarial Networks Learn Distributions

Adversarial Lipschitz Regularization

SGAN: An Alternative Training of Generative Adversarial Networks

Inferential Wasserstein generative adversarial networks

Gang of GANs: Generative Adversarial Networks with Maximum Margin Ranking

Optimizing Latent Distributions for Non-Adversarial Generative Networks

Kolmogorov-Smirnov GAN

Shared Loss between Generators of GANs

Online Kernel based Generative Adversarial Networks

A Wasserstein perspective of Vanilla GANs

Optimal 1-Wasserstein Distance for WGANs

Adaptive Spectral Normalization for Generative Models