Abstract:Recently, it was found that deep neural networks (DNNs) are susceptible to adversarial input perturbations. Most defense strategies adopt the denoising method based on preprocessing, which mitigates the impacts of adversarial perturbations on DNNs by learning the distributions of nonadversarial datasets and projecting adversarial inputs into the learned nonadversarial manifolds. However, existing defense strategies commonly focus on reconstructing clean images while ignoring the role of adversarial perturbations, which results in the reconstructed images failing to achieve the visual quality and classification accuracy of the original clean images, and the induced adversarial robustness improvement is limited. This paper proposes a feature decoupling-interaction network (FDIN), which introduces the concepts of clean features and adversarial features to separate the two kinds of features from the input adversarial examples (AEs) in a feature decoupling-interaction manner. The clean features are used to reconstruct the input image so that it is infinitely close to the original clean image, and the adversarial features are used to reconstruct the adversarial perturbations. Adversarial perturbations are removed from the adversarial examples across multiple cross cycles to improve further the reconstructed image's visual quality and classification accuracy. The features of the original clean image are used as prior knowledge to guide the network to learn the clean features of the adversarial examples and improve the classification accuracy of the model on the clean examples. In addition, a classification loss function based on the Carlini & Wagner (CW) attack algorithm is used instead of the conventional cross-entropy loss function to improve the adversarial robustness of the FDIN. The experimental results show that the proposed method achieves better defense performance than the current state-of-the-art methods on both standard tests and various attack tests and even exceeds the test accuracy of the target classifier on the original test set.

Enhancing Adversarial Robustness for Image Classification by Regularizing Class Level Feature Distribution

An Adversarial Attack Via Feature Contributive Regions

Feature Augmentation for Adversarial Robustness

Adversarial Training with Bi-directional Likelihood Regularization for Visual Classification

Improving the Robustness of Deep Convolutional Neural Networks Through Feature Learning

Towards a High Robust Neural Network Via Feature Matching

Exploring Robust Features for Improving Adversarial Robustness

Inter-feature Relationship Certifies Robust Generalization of Adversarial Training

Towards Robust Neural Networks via Orthogonal Diversity

Enhancing Adversarial Robustness via Uncertainty-Aware Distributional Adversarial Training

Adversarial Training Can Provably Improve Robustness: Theoretical Analysis of Feature Learning Process Under Structured Data

Feature decoupling and interaction network for defending against adversarial examples

Feature Denoising for Improving Adversarial Robustness

Enhancing Robust Representation in Adversarial Training: Alignment and Exclusion Criteria

Towards Robust Training of Neural Networks by Regularizing Adversarial Gradients

Progressive Diversified Augmentation for General Robustness of DNNs: A Unified Approach.

Improving Adversarial Robustness via Decoupled Visual Representation Masking

General Adversarial Defense via Pixel Level and Feature Level Distribution Alignment

Enhancing Adversarial Training with Feature Separability

Two-Way Feature-Aligned and Attention-Rectified Adversarial Training