Abstract:Deep Neural Networks (DNNs) have been shown to be vulnerable to adversarial examples. The existence of adversarial examples significantly hinders the development of deep learning technologies in domains with high-security requirements. However, current defense methods often lack universality, being effective only against specific adversarial attacks. This study focuses on analyzing adversarial examples through changes in model attention, classifying attack algorithms into attention-shifting and attention-attenuation categories. To counter attention-shifting attacks, a defense module named Feature Pyramid-based Attention Space-guided (FPAS) is proposed, which spatially retracts the shifting attention in adversarial examples, thereby enhancing the model's overall defense capability. Attention-based Non-Local (ANL) is a proposed defense module to counter attention-attenuation attacks. This module enhances the model's focus on critical features, efficiently constructing a robust defense model with low implementation cost and minimal intrusion into the original model. By integrating FPAS and ANL into the Wide-ResNet model within a boosting framework, the study demonstrates their synergistic defense capability. Even with eight adversarial samples embedded with adversarial patches, our FPAS_at and ANL_at models demonstrated significant improvements over the baseline, enhancing the average defense rate by 5.47% and 7.74%, respectively. Extensive experiments confirm that this universal defense strategy offers comprehensive protection against adversarial attacks at a lower implementation cost compared to current mainstream defense methods, while also being adaptable for integration with existing defense strategies to further enhance adversarial robustness.

Universal Rules for Fooling Deep Neural Networks based Text Classification

Training NLI Models Through Universal Adversarial Attack

Fooling Neural Network Interpretations - Adversarial Noise to Attack Images.

Generating Universal Language Adversarial Examples by Understanding and Enhancing the Transferability Across Neural Models

A Black-box NLP Classifier Attacker

A Universal Defense Strategy Against Adversarial Attacks Based on Attention-Guided

Generating natural adversarial examples with universal perturbations for text classification

On the Transferability of Adversarial Attacksagainst Neural Text Classifier

TREATED: Towards Universal Defense Against Textual Adversarial Attacks

Deep Text Classification Can Be Fooled

Universal Adversarial Perturbation for Text Classification

Improving the Reliability of Deep Neural Networks in NLP: A Review

AdvFoolGen: Creating Persistent Troubles for Deep Classifiers

TREATED:Towards Universal Defense against Textual Adversarial Attacks

Text Laundering: Mitigating Malicious Features Through Knowledge Distillation of Large Foundation Models.

Exploring the Vulnerability of Natural Language Processing Models via Universal Adversarial Texts

Bypassing DARCY Defense: Indistinguishable Universal Adversarial Triggers

Is BERT Really Robust? A Strong Baseline for Natural Language Attack on Text Classification and Entailment

Adversarial Attack? Don't Panic

DeepFool: A Simple and Accurate Method to Fool Deep Neural Networks

TransFool: An Adversarial Attack against Neural Machine Translation Models