Abstract:Deep neural networks (DNNs) have achieved remarkable success in various tasks (e.g., image classification, speech recognition, and natural language processing (NLP)). However, researchers have demonstrated that DNN-based models are vulnerable to adversarial examples, which cause erroneous predictions by adding imperceptible perturbations into legitimate inputs. Recently, studies have revealed adversarial examples in the text domain, which could effectively evade various DNN-based text analyzers and further bring the threats of the proliferation of disinformation. In this paper, we give a comprehensive survey on the existing studies of adversarial techniques for generating adversarial texts written by both English and Chinese characters and the corresponding defense methods. More importantly, we hope that our work could inspire future studies to develop more robust DNN-based text analyzers against known and unknown adversarial techniques. We classify the existing adversarial techniques for crafting adversarial texts based on the perturbation units, helping to better understand the generation of adversarial texts and build robust models for defense. In presenting the taxonomy of adversarial attacks and defenses in the text domain, we introduce the adversarial techniques from the perspective of different NLP tasks. Finally, we discuss the existing challenges of adversarial attacks and defenses in texts and present the future research directions in this emerging and challenging field.

Improving the Reliability of Deep Neural Networks in NLP: A Review

Adversarial Attacks on Deep Learning Models in Natural Language Processing: A Survey

Towards a Robust Deep Neural Network Against Adversarial Texts: A Survey.

Adversarial Attacks and Defenses in Images, Graphs and Text: A Review

Adversarial Examples: Attacks and Defenses for Deep Learning

Towards a Robust Deep Neural Network in Texts: A Survey

Adversarial Attacks and Defenses Against Deep Neural Networks: A Survey

Adversarial Attack and Defense on Deep Neural Network-Based Voice Processing Systems: An Overview

Interpreting Adversarial Examples in Deep Learning: A Review

Improving Model Robustness Against Adversarial Examples with Redundant Fully Connected Layer.

Adversarial Examples: Opportunities and Challenges

Adversarial robustness improvement for deep neural networks

Adversarial Robustness of Deep Neural Networks: A Survey from a Formal Verification Perspective

Adversarial examples: attacks and defences on medical deep learning systems

Text Adversarial Attacks and Defenses: Issues, Taxonomy, and Perspectives

A Survey of Defense Methods Against Adversarial Examples

How Can We Deal with Adversarial Examples?

Adversarial Examples on Object Recognition: A Comprehensive Survey

Adversarial example detection for DNN models: a review and experimental comparison

Towards Evaluating the Robustness of Neural Networks