Abstract:Adversarial phenomenon has been widely observed in machine learning (ML) systems, especially in those using deep neural networks, describing that ML systems may produce inconsistent and incomprehensible predictions with humans at some particular cases. This phenomenon poses a serious security threat to the practical application of ML systems, and several advanced attack paradigms have been developed to explore it, mainly including backdoor attacks, weight attacks, and adversarial examples. For each individual attack paradigm, various defense paradigms have been developed to improve the model robustness against the corresponding attack paradigm. However, due to the independence and diversity of these defense paradigms, it is difficult to examine the overall robustness of an ML system against different kinds of attacks.This survey aims to build a systematic review of all existing defense paradigms from a unified perspective. Specifically, from the life-cycle perspective, we factorize a complete machine learning system into five stages, including pre-training, training, post-training, deployment, and inference stages, respectively. Then, we present a clear taxonomy to categorize and review representative defense methods at each individual stage. The unified perspective and presented taxonomies not only facilitate the analysis of the mechanism of each defense paradigm but also help us to understand connections and differences among different defense paradigms, which may inspire future research to develop more advanced, comprehensive defenses.

Opportunities and Challenges in Deep Learning Adversarial Robustness: A Survey

Attack As Defense: Characterizing Adversarial Examples Using Robustness.

Robustness of Deep Learning Models on Graphs: A Survey

Holistic Adversarial Robustness of Deep Learning Models

Optimism in the Face of Adversity: Understanding and Improving Deep Learning Through Adversarial Robustness

Towards Deep Learning Models Resistant to Adversarial Attacks

Adversarial Robustness of Deep Neural Networks: A Survey from a Formal Verification Perspective

Recent Advances in Adversarial Training for Adversarial Robustness

A Comprehensive Survey of Robust Deep Learning in Computer Vision

Adversarial Attacks and Defences: A Survey

Adversarial Attacks and Defenses in Machine Learning-Powered Networks: A Contemporary Survey

A Survey on Model Robustness under Adversarial Example

Defenses in Adversarial Machine Learning: A Survey

Impact of Architectural Modifications on Deep Learning Adversarial Robustness

A survey on adversarial attacks and defences

Optimization and Optimizers for Adversarial Robustness

A Survey of Robustness and Safety of 2D and 3D Deep Learning Models Against Adversarial Attacks

Robust Deep Reinforcement Learning Through Adversarial Attacks and Training : A Survey

Adversarial robustness improvement for deep neural networks

Local Competition and Uncertainty for Adversarial Robustness in Deep Learning