Abstract:Deep neural networks (DNNs) are widely used to handle many difficult tasks, such as image classification and malware detection, and achieve outstanding performance. However, recent studies on adversarial examples, which have maliciously undetectable perturbations added to their original samples that are indistinguishable by human eyes but mislead the machine learning approaches, show that machine learning models are vulnerable to security attacks. Though various adversarial retraining techniques have been developed in the past few years, none of them is scalable. In this paper, we propose a new iterative adversarial retraining approach to robustify the model and to reduce the effectiveness of adversarial inputs on DNN models. The proposed method retrains the model with both Gaussian noise augmentation and adversarial generation techniques for better generalization. Furthermore, the ensemble model is utilized during the testing phase in order to increase the robust test accuracy. The results from our extensive experiments demonstrate that the proposed approach increases the robustness of the DNN model against various adversarial attacks, specifically, fast gradient sign attack, Carlini and Wagner (C&W) attack, Projected Gradient Descent (PGD) attack, and DeepFool attack. To be precise, the robust classifier obtained by our proposed approach can maintain a performance accuracy of 99% on average on the standard test set. Moreover, we empirically evaluate the runtime of two of the most effective adversarial attacks, i.e., C&W attack and BIM attack, to find that the C&W attack can utilize GPU for faster adversarial example generation than the BIM attack can. For this reason, we further develop a parallel implementation of the proposed approach. This parallel implementation makes the proposed approach scalable for large datasets and complex models.

Improving Deep Neural Network Robustness with Siamese Empowered Adversarial Training

Attack As Defense: Characterizing Adversarial Examples Using Robustness.

Towards Robust DNNs: an Taylor Expansion-Based Method for Generating Powerful Adversarial Examples.

Improving Model Robustness Against Adversarial Examples with Redundant Fully Connected Layer.

DeepDefense: Training Deep Neural Networks with Improved Robustness.

Deep Defense: Training DNNs with Improved Adversarial Robustness

Improving adversarial robustness of deep neural networks by using semantic information

Adversarial robustness improvement for deep neural networks

ROBUSTNESS OF DEEP NEURAL NETWORKS TO ADVERSARIAL EXAMPLES

Towards Deep Learning Models Resistant to Adversarial Attacks

Adversarial Examples: Attacks and Defenses for Deep Learning

Robust Machine Learning Against Adversarial Samples at Test Time

Dual Head Adversarial Training.

Secure Machine Learning Against Adversarial Samples at Test Time

Enhancing adversarial robustness for deep metric learning via neural discrete adversarial training

An Ensemble Learning-Based Cooperative Defensive Architecture Against Adversarial Attacks

Improving the Robustness of Deep Neural Networks via Adversarial Training with Triplet Loss

Security Analysis and Enhancement of Model Compressed Deep Learning Systems under Adversarial Attacks

Adversarial Example Defense Based on the Supervision

Detecting Adversarial Examples on Deep Neural Networks with Mutual Information Neural Estimation