Abstract:Deep neural networks have achieved remarkable success in machine learning, computer vision, and pattern recognition in the last few decades. Recent studies, however, show that neural networks (both shallow and deep) may be easily fooled by certain imperceptibly perturbed input samples called adversarial examples. Such security vulnerability has resulted in a large body of research in recent years because real-world threats could be introduced due to the vast applications of neural networks. To address the robustness issue to adversarial examples particularly in pattern recognition, robust adversarial training has become one mainstream. Various ideas, methods, and applications have boomed in the field. Yet, a deep understanding of adversarial training including characteristics, interpretations, theories, and connections among different models has remained elusive. This paper presents a comprehensive survey trying to offer a systematic and structured investigation on robust adversarial training in pattern recognition. We start with fundamentals including definition, notations, and properties of adversarial examples. We then introduce a general theoretical framework with gradient regularization for defending against adversarial samples - robust adversarial training with visualizations and interpretations on why adversarial training can lead to model robustness. Connections will also be established between adversarial training and other traditional learning theories. After that, we summarize, review, and discuss various methodologies with defense/training algorithms in a structured way. Finally, we present analysis, outlook, and remarks on adversarial training.

A Survey on Model Robustness under Adversarial Example

Attack As Defense: Characterizing Adversarial Examples Using Robustness.

Extracting Robust Models with Uncertain Examples

Opportunities and Challenges in Deep Learning Adversarial Robustness: A Survey

On Model Robustness Against Adversarial Examples

A survey of robust adversarial training in pattern recognition: Fundamental, theory, and methodologies

Holistic Adversarial Robustness of Deep Learning Models

Adversarial Robustness of Deep Neural Networks: A Survey from a Formal Verification Perspective

Re-thinking Model Robustness from Stability: a New Insight to Defend Adversarial Examples

Advanced Techniques for Improving Model Robustness in Adversarial Machine Learning

The security of machine learning in an adversarial setting: A survey

A Survey of Robustness and Safety of 2D and 3D Deep Learning Models Against Adversarial Attacks

A Comprehensive Survey of Robust Deep Learning in Computer Vision

A Comprehensive Evaluation Framework for Deep Model Robustness

A Survey of Defense Methods Against Adversarial Examples

Recent Advances in Adversarial Training for Adversarial Robustness

A Survey and Evaluation of Adversarial Attacks for Object Detection

From Adversarial Arms Race to Model-centric Evaluation: Motivating a Unified Automatic Robustness Evaluation Framework

Robustness Certification Research on Deep Learning Models:A Survey

Testing Robustness Against Unforeseen Adversaries

MultiRobustBench: Benchmarking Robustness Against Multiple Attacks