Abstract:Deep neural networks can be easily fooled into making incorrect predictions through corruption of the input by adversarial perturbations: human-imperceptible artificial noise. So far adversarial training has been the most successful defense against such adversarial attacks. This work focuses on improving adversarial training to boost adversarial robustness. We first analyze, from an instance-wise perspective, how adversarial vulnerability evolves during adversarial training. We find that during training an overall reduction of adversarial loss is achieved by sacrificing a considerable proportion of training samples to be more vulnerable to adversarial attack, which results in an uneven distribution of adversarial vulnerability among data. Such "uneven vulnerability", is prevalent across several popular robust training methods and, more importantly, relates to overfitting in adversarial training. Motivated by this observation, we propose a new adversarial training method: Instance-adaptive Smoothness Enhanced Adversarial Training (ISEAT). It jointly smooths both input and weight loss landscapes in an adaptive, instance-specific, way to enhance robustness more for those samples with higher adversarial vulnerability. Extensive experiments demonstrate the superiority of our method over existing defense methods. Noticeably, our method, when combined with the latest data augmentation and semi-supervised learning techniques, achieves state-of-the-art robustness against $\ell_{\infty}$-norm constrained attacks on CIFAR10 of 59.32% for Wide ResNet34-10 without extra data, and 61.55% for Wide ResNet28-10 with extra data. Code is available at <a class="link-external link-https" href="https://github.com/TreeLLi/Instance-adaptive-Smoothness-Enhanced-AT" rel="external noopener nofollow">this https URL</a>.

Adversarial Robustness Enhancement for Deep Learning-Based Soft Sensors: An Adversarial Training Strategy Using Historical Gradients and Domain Adaptation

Attack As Defense: Characterizing Adversarial Examples Using Robustness.

When Deep Learning-Based Soft Sensors Encounter Reliability Challenges: A Practical Knowledge-Guided Adversarial Attack and Its Defense

Deep Subdomain Learning Adaptation Network: A Sensor Fault-Tolerant Soft Sensor for Industrial Processes

Boosting Adversarial Training in Safety-Critical Systems Through Boundary Data Selection

Knowledge-Aided Generative Adversarial Network: A Transfer Gradient-Less Adversarial Attack for Deep Learning-Based Soft Sensors

Boosting Adversarial Training with Hardness-Guided Attack Strategy

RobustDA: Lightweight Robust Domain Adaptation for Evolving Data at Edge

Dynamic Label Adversarial Training for Deep Learning Robustness Against Adversarial Attacks

Feature Augmentation for Adversarial Robustness

Improved Adversarial Training Through Adaptive Instance-wise Loss Smoothing

Toward Enhanced Adversarial Robustness Generalization in Object Detection: Feature Disentangled Domain Adaptation for Adversarial Training

Development of an Adversarial Transfer Learning-Based Soft Sensor in Industrial Systems

Improving the Generalization of Adversarial Training with Domain Adaptation

Towards Deep Learning Models Resistant to Transfer-based Adversarial Attacks via Data-centric Robust Learning

Enhancing adversarial robustness for deep metric learning via neural discrete adversarial training

Adversarial Training-Based Deep Layer-Wise Probabilistic Network for Enhancing Soft Sensor Modeling of Industrial Processes

Learn from the Past: A Proxy based Adversarial Defense Framework to Boost Robustness

Squeeze Training for Adversarial Robustness.

Robust Machine Learning Against Adversarial Samples at Test Time

Self-Adaptive Logit Balancing for Deep Learning Robustness in Computer Vision