Abstract:Training deep neural networks (DNNs) with altered data, known as adversarial training, is essential for improving their robustness. A significant challenge emerges as the robustness strengthened during training often diminishes during inference, resulting in drops in robust pronounced accuracy. Contemporary strategies either necessitate excessively large training data or risk compromising the natural accuracy of non-adversarial images. Our analysis identifies that the inherent vulnerability of DNNs to adversarial attacks stems from certain input space segments that are inadequately populated by training data, leading to decision-making voids with incorrect predictions. The minimum number of training samples required for successful adversarial training can be attained by maximizing the representativeness of the samples. In light of this, we put forth an advanced training data augmentation method anchored on a Generative Adversarial Network. The generated samples are evaluated by the image classifier during training and selected based on their confidence scores. Evaluations on public datasets, such as Tiny-ImageNet, MS COCO, and CIFAR-100, using various deep neural networks (DNNs), including Vision Transformer, MobileNet, and WideResNet, under recent attacks like DifAttack, SQBA, and AutoAttack, confirm that our method significantly enhances the adversarial robustness of DNN image classifiers. Our method outperforms state-of-the-art adversarial training methods by 35.66% on Tiny-ImageNet, 13.53% on MS COCO, and 13.06% on CIFAR-100.

Towards Robust DNNs: an Taylor Expansion-Based Method for Generating Powerful Adversarial Examples.

Attack As Defense: Characterizing Adversarial Examples Using Robustness.

Improved Forward-Backward Propagation To Generate Adversarial Examples

Randomized Adversarial Training via Taylor Expansion

Improving Model Robustness Against Adversarial Examples with Redundant Fully Connected Layer.

Towards Robust Training of Neural Networks by Regularizing Adversarial Gradients

Improving Deep Neural Network Robustness with Siamese Empowered Adversarial Training

NATTACK: Learning the Distributions of Adversarial Examples for an Improved Black-Box Attack on Deep Neural Networks

Deep Defense: Training DNNs with Improved Adversarial Robustness

DeepDefense: Training Deep Neural Networks with Improved Robustness.

Are You Confident That You Have Successfully Generated Adversarial Examples?

Towards Imperceptible and Robust Adversarial Example Attacks Against Neural Networks

Generating Adversarial Examples with Adversarial Networks

Latent Adversarial Defence with Boundary-guided Generation

A Direct Approach to Robust Deep Learning Using Adversarial Networks

Adversarial robustness improvement for deep neural networks

Minimizing Adversarial Training Samples for Robust Image Classifiers: Analysis and Adversarial Example Generator Design

Learning Defense Transformers for Counterattacking Adversarial Examples

Adversarial Examples: Attacks and Defenses for Deep Learning

Enhance DNN Adversarial Robustness and Efficiency via Injecting Noise to Non-Essential Neurons

DCVAE-adv: A Universal Adversarial Example Generation Method for White and Black Box Attacks