Abstract:Recently, it was found that deep neural networks (DNNs) are susceptible to adversarial input perturbations. Most defense strategies adopt the denoising method based on preprocessing, which mitigates the impacts of adversarial perturbations on DNNs by learning the distributions of nonadversarial datasets and projecting adversarial inputs into the learned nonadversarial manifolds. However, existing defense strategies commonly focus on reconstructing clean images while ignoring the role of adversarial perturbations, which results in the reconstructed images failing to achieve the visual quality and classification accuracy of the original clean images, and the induced adversarial robustness improvement is limited. This paper proposes a feature decoupling-interaction network (FDIN), which introduces the concepts of clean features and adversarial features to separate the two kinds of features from the input adversarial examples (AEs) in a feature decoupling-interaction manner. The clean features are used to reconstruct the input image so that it is infinitely close to the original clean image, and the adversarial features are used to reconstruct the adversarial perturbations. Adversarial perturbations are removed from the adversarial examples across multiple cross cycles to improve further the reconstructed image's visual quality and classification accuracy. The features of the original clean image are used as prior knowledge to guide the network to learn the clean features of the adversarial examples and improve the classification accuracy of the model on the clean examples. In addition, a classification loss function based on the Carlini & Wagner (CW) attack algorithm is used instead of the conventional cross-entropy loss function to improve the adversarial robustness of the FDIN. The experimental results show that the proposed method achieves better defense performance than the current state-of-the-art methods on both standard tests and various attack tests and even exceeds the test accuracy of the target classifier on the original test set.

Denoising Autoencoder-based Defensive Distillation as an Adversarial Robustness Algorithm

Attack As Defense: Characterizing Adversarial Examples Using Robustness.

Distillation as a Defense to Adversarial Perturbations Against Deep Neural Networks

Towards Evaluating the Robustness of Neural Networks

Enhanced Attacks on Defensively Distilled Deep Neural Networks.

Improving Defensive Distillation using Teacher Assistant

LDN-RC: a Lightweight Denoising Network with Residual Connection to Improve Adversarial Robustness

Enhanced countering adversarial attacks via input denoising and feature restoring

Detect and defense against adversarial examples in deep learning using natural scene statistics and adaptive denoising

DSCAE: a Denoising Sparse Convolutional Autoencoder Defense Against Adversarial Examples

Transferable Adversarial Defense by Fusing Reconstruction Learning and Denoising Learning

A Feature Guided Denoising Network For Adversarial Defense

Diffusion Denoising as a Certified Defense against Clean-label Poisoning

Feature decoupling and interaction network for defending against adversarial examples

D3R-Net: Denoising Diffusion-Based Defense Restore Network for Adversarial Defense in Remote Sensing Scene Classification

Detecting Adversarial Image Examples in Deep Neural Networks with Adaptive Noise Reduction

Eliminating Adversarial Noise Via Information Discard and Robust Representation Restoration.

Revisiting the Benefits of Knowledge Distillation Against Adversarial Examples

DeepDefense: Training Deep Neural Networks with Improved Robustness.

Evaluation of Defensive Methods for DNNs against Multiple Adversarial Evasion Models

Mitigating Gradient-based Adversarial Attacks via Denoising and Compression