Abstract: Currently, natural language processing (NLP) models are wildly used in various scenarios. However, NLP models, like all deep models, are vulnerable to adversarially generated text. Numerous works have been working on mitigating the vulnerability from adversarial attacks. Nevertheless, there is no comprehensive defense in existing works where each work targets a specific attack category or suffers from the limitation of computation overhead, irresistible to adaptive attack, etc. In this paper, we exhaustively investigate the adversarial attack algorithms in NLP, and our empirical studies have discovered that the attack algorithms mainly disrupt the importance distribution of words in a text. A well-trained model can distinguish subtle importance distribution differences between clean and adversarial texts. Based on this intuition, we propose TextDefense, a new adversarial example detection framework that utilizes the target model's capability to defend against adversarial attacks while requiring no prior knowledge. TextDefense differs from previous approaches, where it utilizes the target model for detection and thus is attack type agnostic. Our extensive experiments show that TextDefense can be applied to different architectures, datasets, and attack methods and outperforms existing methods. We also discover that the leading factor influencing the performance of TextDefense is the target model's generalizability. By analyzing the property of the target model and the property of the adversarial example, we provide our insights into the adversarial attacks in NLP and the principles of our defense method.

Towards a Robust Deep Neural Network in Texts: A Survey

Towards a Robust Deep Neural Network Against Adversarial Texts: A Survey.

Towards a Robust Deep Neural Network in Text Domain A Survey

A Survey on Adversarial Attacks and Defenses in Text

Repairing Adversarial Texts Through Perturbation

Adversarial Attacks on Deep Learning Models in Natural Language Processing: A Survey

Text Adversarial Attacks and Defenses: Issues, Taxonomy, and Perspectives

Adversarial Attack and Defense Technologies in Natural Language Processing: A Survey

Adversarial Attacks and Defenses in Images, Graphs and Text: A Review

Improving the Reliability of Deep Neural Networks in NLP: A Review

MPAT: Building Robust Deep Neural Networks against Textual Adversarial Attacks

TREATED: Towards Universal Defense Against Textual Adversarial Attacks

Adversarial Attacks and Defense on Texts: A Survey

Interpreting Adversarial Examples in Deep Learning: A Review

Physical World Adversarial Attacks on Images and Texts

TextDefense: Adversarial Text Detection based on Word Importance Entropy

Generating Adversarial Texts for Recurrent Neural Networks

Searching for an Effective Defender: Benchmarking Defense Against Adversarial Word Substitution

Textual Adversarial Attack As Combinatorial Optimization

Text's Armor: Optimized Local Adversarial Perturbation Against Scene Text Editing Attacks

TREATED:Towards Universal Defense against Textual Adversarial Attacks