Abstract:Deep learning has been successfully utilized in many applications, but it is vulnerable to adversarial samples. To address this vulnerability, a generative adversarial network (GAN) has been used to train a robust classifier. This paper presents a novel GAN model and its implementation to defend against L∞ and L2 constraint gradient-based adversarial attacks. The proposed model is inspired by some of the related work, but it includes multiple new designs such as a dual generator architecture, four new generator input formulations, and two unique implementations with L∞ and L2 norm constraint vector outputs. The new formulations and parameter settings of GAN are proposed and evaluated to address the limitations of adversarial training and defensive GAN training strategies, such as gradient masking and training complexity. Furthermore, the training epoch parameter has been evaluated to determine its effect on the overall training results. The experimental results indicate that the optimal formulation of GAN adversarial training must utilize more gradient information from the target classifier. The results also demonstrate that GANs can overcome gradient masking and produce effective perturbation to augment the data. The model can defend PGD L2 128/255 norm perturbation with over 60% accuracy and PGD L∞ 8/255 norm perturbation with around 45% accuracy. The results have also revealed that robustness can be transferred between the constraints of the proposed model. In addition, a robustness-accuracy tradeoff was discovered, along with overfitting and the generalization capabilities of the generator and classifier. These limitations and ideas for future work will be discussed.

Direct Adversarial Training: An Adaptive Method to Penalize Lipschitz Continuity of the Discriminator

Direct Adversarial Training: A New Approach for Stabilizing The Training Process of GANs

A New Perspective on Stabilizing GANs Training: Direct Adversarial Training

Direct Adversarial Training for GANs

Understanding the Effectiveness of Lipschitz-Continuity in Generative Adversarial Nets

Soft Generative Adversarial Network: Combating Mode Collapse in Generative Adversarial Network Training Via Dynamic Borderline Softening Mechanism

Evaluation of GAN-Based Model for Adversarial Training

Towards Efficient and Unbiased Implementation of Lipschitz Continuity in GANs

Adversarial Lipschitz Regularization

Adaptive Weighted Discriminator for Training Generative Adversarial Networks

Stabilizing Training of Generative Adversarial Nets via Langevin Stein Variational Gradient Descent

CAGAN: Consistent Adversarial Training Enhanced GANs.

Training Generative Adversarial Networks by Auxiliary Adversarial Example Regulator

Understanding the Effectiveness of Lipschitz Constraint in Training of GANs Via Gradient Analysis.

Stabilizing Training of Generative Adversarial Networks through Regularization

Discriminator Modification in GAN for Text-to-Image Generation

Instability analysis for generative adversarial networks and its solving techniques

CHAIN: Enhancing Generalization in Data-Efficient GANs via lipsCHitz continuity constrAIned Normalization

LD-GAN: Learning perturbations for adversarial defense based on GAN structure

Training Generative Adversarial Networks by Solving Ordinary Differential Equations