Abstract:Deep convolutional neural networks have achieved great success in recent years. They have been widely used in various applications such as optical and SAR image scene classification, object detection and recognition, semantic segmentation, and change detection. However, deep neural networks rely on large-scale high-quality training data, and can only guarantee good performance when the training and test data are independently sampled from the same distribution. Deep convolutional neural networks are found to be vulnerable to subtle adversarial perturbations. This adversarial vulnerability prevents the deployment of deep neural networks in security-sensitive applications such as medical, surveillance, autonomous driving and military scenarios. This paper first presents a holistic view of security issues for deep convolutional neural network-based image recognition systems. The entire information processing chain is analyzed regarding safety and security risks. In particular, poisoning attacks and evasion attacks on deep convolutional neural networks are analyzed in detail. The root causes of adversarial vulnerabilities of deep recognition models are also discussed. Then, we give a formal definition of adversarial robustness and present a comprehensive review of adversarial attacks, adversarial defense, and adversarial robustness evaluation. Rather than listing existing research, we focus on the threat models for the adversarial attack and defense arms race. We perform a detailed analysis of several representative adversarial attacks on SAR image recognition models and provide an example of adversarial robustness evaluation. Finally, several open questions are discussed regarding recent research progress from our workgroup. This paper can be further used as a reference to develop more robust deep neural network-based image recognition models in dynamic adversarial scenarios.

Holistic Adversarial Robustness of Deep Learning Models

Robustness of Deep Learning Models on Graphs: A Survey

Attack As Defense: Characterizing Adversarial Examples Using Robustness.

Opportunities and Challenges in Deep Learning Adversarial Robustness: A Survey

Adversarial Robustness of Deep Neural Networks: A Survey from a Formal Verification Perspective

A Survey of Robustness and Safety of 2D and 3D Deep Learning Models Against Adversarial Attacks

Impact of Architectural Modifications on Deep Learning Adversarial Robustness

A Comprehensive Survey of Robust Deep Learning in Computer Vision

A Survey on Model Robustness under Adversarial Example

Optimism in the Face of Adversity: Understanding and Improving Deep Learning Through Adversarial Robustness

Adversarial robustness improvement for deep neural networks

Improving Model Robustness Against Adversarial Examples with Redundant Fully Connected Layer.

The Pros and Cons of Adversarial Robustness

Robustness in deep learning models for medical diagnostics: security and adversarial challenges towards robust AI applications

Adversarial Robustness of Deep Convolutional Neural Network-based Image Recognition Models: A Review

A Comprehensive Evaluation Framework for Deep Model Robustness

Advanced Techniques for Improving Model Robustness in Adversarial Machine Learning

Fairness Increases Adversarial Vulnerability

Adversarial Attacks and Defenses in Deep Learning: From a Perspective of Cybersecurity

Benchmarking Adversarial Robustness on Image Classification

Exploring the Adversarial Frontier: Quantifying Robustness via Adversarial Hypervolume