Abstract:Adversarial attack against natural language has been a hot topic in the field of artificial intelligence security in recent years. It is mainly to study the methods and implementation of generating adversarial examples. The purpose is to better deal with the vulnerability and security of deep learning systems. According to whether the attacker understands the deep learning model structure, the adversarial attack is divided into black-box attack and white-box attack. In this paper, we propose a hybrid adversarial attack for different application scenarios. Firstly, we propose a novel black-box attack method of generating adversarial examples to trick the word-level sentiment classifier, which is based on differential evolution (DE) algorithm to generate semantically and syntactically similar adversarial examples. Compared with existing genetic algorithm based adversarial attacks, our algorithm can achieve a higher attack success rate while maintaining a lower word replacement rate. At the 10% word substitution threshold, we have increased the attack success rate from 58.5% to 63%. Secondly, when we understand the model architecture and parameters, etc., we propose a white-box attack with gradient-based perturbation against the same sentiment classifier. In this attack, we use a Euclidean distance and cosine distance combined metric to find the most semantically and syntactically similar substitution, and we introduce the coefficient of variation (CV) factor to control the dispersion of the modified words in the adversarial examples. More dispersed modifications can increase human imperceptibility and text readability. Compared with the existing global attack, our attack can increase the attack success rate and make modification positions in generated examples more dispersed. We’ve increased the global search success rate from 75.8% to 85.8%. Finally, we can deal with different application scenarios by using these two attack methods, that is, whether we understand the internal structure and parameters of the model, we can all generate good adversarial examples.

LexicalAT: Lexical-Based Adversarial Reinforcement Training for Robust Sentiment Classification

Misleading Sentiment Analysis: Generating Adversarial Texts by the Ensemble Word Addition Algorithm

Adversarial Training for Improving Model Robustness? Look at Both Prediction and Interpretation

Generating Fluent Chinese Adversarial Examples for Sentiment Classification

Towards Improving Adversarial Training of NLP Models

Generating Natural Language Adversarial Examples on a Large Scale with Generative Models

Combating Word-level Adversarial Text with Robust Adversarial Training.

Reinforced Counterfactual Data Augmentation for Dual Sentiment Classification.

Grey-box Adversarial Attack And Defence For Sentiment Classification

Rule-based adversarial sample generation for text classification

Better Robustness by More Coverage: Adversarial Training with Mixup Augmentation for Robust Fine-tuning

A Hybrid Adversarial Attack for Different Application Scenarios

Sentiment Classification with Adversarial Learning and Attention Mechanism.

Enhance Robustness of Sequence Labelling with Masked Adversarial Training.

Rethinking Textual Adversarial Defense for Pre-trained Language Models

Fast Adversarial Training against Textual Adversarial Attacks

Research on Aspect-Level Sentiment Analysis Based on Adversarial Training and Dependency Parsing

Self-Supervised Contrastive Learning with Adversarial Perturbations for Defending Word Substitution-based Attacks

Robust Textual Embedding Against Word-level Adversarial Attacks

Adversarial Learning of Sentiment Word Representations for Sentiment Analysis.

A Robust Adversarial Training Approach to Machine Reading Comprehension