Abstract:Deep neural networks (DNNs) are widely used to handle many difficult tasks, such as image classification and malware detection, and achieve outstanding performance. However, recent studies on adversarial examples, which have maliciously undetectable perturbations added to their original samples that are indistinguishable by human eyes but mislead the machine learning approaches, show that machine learning models are vulnerable to security attacks. Though various adversarial retraining techniques have been developed in the past few years, none of them is scalable. In this paper, we propose a new iterative adversarial retraining approach to robustify the model and to reduce the effectiveness of adversarial inputs on DNN models. The proposed method retrains the model with both Gaussian noise augmentation and adversarial generation techniques for better generalization. Furthermore, the ensemble model is utilized during the testing phase in order to increase the robust test accuracy. The results from our extensive experiments demonstrate that the proposed approach increases the robustness of the DNN model against various adversarial attacks, specifically, fast gradient sign attack, Carlini and Wagner (C&W) attack, Projected Gradient Descent (PGD) attack, and DeepFool attack. To be precise, the robust classifier obtained by our proposed approach can maintain a performance accuracy of 99% on average on the standard test set. Moreover, we empirically evaluate the runtime of two of the most effective adversarial attacks, i.e., C&W attack and BIM attack, to find that the C&W attack can utilize GPU for faster adversarial example generation than the BIM attack can. For this reason, we further develop a parallel implementation of the proposed approach. This parallel implementation makes the proposed approach scalable for large datasets and complex models.

CMW-Net:an Adaptive Robust Algorithm for Sample Selection and Label Correction

A Label Noise Robust Stacked Auto-Encoder Algorithm for Inaccurate Supervised Classification Problems

CMW-Net: Learning a Class-Aware Sample Weighting Mapping for Robust Deep Learning

Synergistic Network Learning and Label Correction for Noise-robust Image Classification

An Ensemble Noise-Robust K-fold Cross-Validation Selection Method for Noisy Labels

Combating Label Noise With A General Surrogate Model For Sample Selection

Multi-Label Adaptive Batch Selection by Highlighting Hard and Imbalanced Samples

An joint end-to-end framework for learning with noisy labels

IdentifyMix: an Efficient Two-Stage Learning Approach to Combating Label Noise

Temporal Calibrated Regularization for Robust Noisy Label Learning.

Co-assistant Networks for Label Correction

Mitigating Memorization in Sample Selection for Learning with Noisy Labels

SSS-Net: A Shadowed-Sets-based Semi-Supervised Sample Selection Network for Classification on Noise Labeled Images

Making Deep Neural Networks Robust to Label Noise: Cross-Training with a Novel Loss Function

SCNet: semi-supervised and contrastive learning against noisy labels with two selection strategy approach

Robust Deep Softmax Regression Against Label Noise for Unsupervised Domain Adaptation.

Making Deep Neural Networks Robust to Label Noise: A Reweighting Loss and Data Filtration

An improved sample selection framework for learning with noisy labels

Labeling malicious communication samples based on semi-supervised deep neural network

An Uncertainly Dynamic Loss Correction and Global Sample Selection Method for Webly Supervised Fine-Grained Visual Classification.

Secure Machine Learning Against Adversarial Samples at Test Time