Abstract:Deep learning (DL) has demonstrated remarkable achievements in various fields. Nevertheless, DL models encounter significant challenges in detecting and defending against adversarial samples (AEs). These AEs are meticulously crafted by adversaries, introducing imperceptible perturbations to clean data to deceive DL models. Consequently, AEs pose potential risks to DL applications. In this paper, we propose an effective framework for enhancing the robustness of DL models against adversarial attacks. The framework leverages convolutional neural networks (CNNs) for feature learning, Deep Neural Networks (DNNs) with softmax for classification, and a defense mechanism to identify and exclude AEs. Evasion attacks are employed to create AEs to evade and mislead the classifier by generating malicious samples during the test phase of DL models i.e., CNN and DNN, using the Fast Gradient Sign Method (FGSM), Basic Iterative Method (BIM), Projected Gradient Descent (PGD), and Square Attack (SA). A protection layer is developed as a detection mechanism placed before the DNN classifier to identify and exclude AEs. The detection mechanism incorporates a machine learning model, which includes one of the following: Fuzzy ARTMAP, Random Forest, K-Nearest Neighbors, XGBoost, or Gradient Boosting Machine. Extensive evaluations are conducted on the MNIST, CIFAR-10, SVHN, and Fashion-MNIST data sets to assess the effectiveness of the proposed framework. The experimental results indicate the framework's ability to effectively and accurately detect AEs generated by four popular attacking methods, highlighting the potential of our developed framework in enhancing its robustness against AEs.

Towards Robust Deep Learning with Ensemble Networks and Noisy Layers

Attack As Defense: Characterizing Adversarial Examples Using Robustness.

Improving Model Robustness Against Adversarial Examples with Redundant Fully Connected Layer.

Ensemble Methods as a Defense to Adversarial Perturbations Against Deep Neural Networks

A Direct Approach to Robust Deep Learning Using Adversarial Networks

On the Certified Robustness for Ensemble Models and Beyond

Guardian of the Ensembles: Introducing Pairwise Adversarially Robust Loss for Resisting Adversarial Attacks in DNN Ensembles

Training Robust Deep Neural Networks via Adversarial Noise Propagation

A Framework for Robust Deep Learning Models Against Adversarial Attacks Based on a Protection Layer Approach

Dynamic ensemble selection based on Deep Neural Network Uncertainty Estimation for Adversarial Robustness

Revisiting Ensembles in an Adversarial Context: Improving Natural Accuracy

Enhance DNN Adversarial Robustness and Efficiency via Injecting Noise to Non-Essential Neurons

Ensemble-in-One: Ensemble Learning Within Random Gated Networks for Enhanced Adversarial Robustness.

Analyzing the Noise Robustness of Deep Neural Networks

Towards Deep Learning Models Resistant to Adversarial Attacks

Local Competition and Uncertainty for Adversarial Robustness in Deep Learning

Towards Robustness against Unsuspicious Adversarial Examples

Certifying Joint Adversarial Robustness for Model Ensembles

Unifying Bilateral Filtering and Adversarial Training for Robust Neural Networks

EnResNet: ResNets Ensemble Via the Feynman-Kac Formalism for Adversarial Defense and Beyond