Abstract:Adversarial examples have been shown to be the severe threat to deep neural networks (DNNs). One of the most effective adversarial defense methods is adversarial training (AT) through minimizing the adversarial risk $R_{adv}$, which encourages both the benign example $x$ and its adversarially perturbed neighborhoods within the $\ell_{p}$-ball to be predicted as the ground-truth label. In this work, we propose a novel defense method, the robust training (RT), by jointly minimizing two separated risks ($R_{stand}$ and $R_{rob}$), which is with respect to the benign example and its neighborhoods respectively. The motivation is to explicitly and jointly enhance the accuracy and the adversarial robustness. We prove that $R_{adv}$ is upper-bounded by $R_{stand} + R_{rob}$, which implies that RT has similar effect as AT. Intuitively, minimizing the standard risk enforces the benign example to be correctly predicted, and the robust risk minimization encourages the predictions of the neighbor examples to be consistent with the prediction of the benign example. Besides, since $R_{rob}$ is independent of the ground-truth label, RT is naturally extended to the semi-supervised mode ($i.e.$, SRT), to further enhance the adversarial robustness. Moreover, we extend the $\ell_{p}$-bounded neighborhood to a general case, which covers different types of perturbations, such as the pixel-wise ($i.e.$, $x + \delta$) or the spatial perturbation ($i.e.$, $ AX + b$). Extensive experiments on benchmark datasets not only verify the superiority of the proposed SRT method to state-of-the-art methods for defensing pixel-wise or spatial perturbations separately, but also demonstrate its robustness to both perturbations simultaneously. The code for reproducing main results is available at \url{<a class="link-external link-https" href="https://github.com/THUYimingLi/Semi-supervised_Robust_Training" rel="external noopener nofollow">this https URL</a>}.

TRAP: Tailored Robustness Assessment for Index Advisors Via Adversarial Perturbation

Breaking It Down: An In-Depth Study of Index Advisors

Improving Model Robustness by Adaptively Correcting Perturbation Levels with Active Queries.

Robustness of Updatable Learning-based Index Advisors Against Poisoning Attack

Towards Robustness of Text-to-SQL Models Against Natural and Realistic Adversarial Table Perturbation.

Perturbation-Invariant Adversarial Training for Neural Ranking Models: Improving the Effectiveness-Robustness Trade-Off

Exploring Transferable and Robust Adversarial Perturbation Generation Across Network Hierarchy

Leveraging Dynamic and Heterogeneous Workload Knowledge to Boost the Performance of Index Advisors

Optimization and Optimizers for Adversarial Robustness

Adversarial Robustness Overestimation and Instability in TRADES

Robust Weight Perturbation for Adversarial Training

Exploring the Adversarial Frontier: Quantifying Robustness via Adversarial Hypervolume

From Adversarial Arms Race to Model-centric Evaluation: Motivating a Unified Automatic Robustness Evaluation Framework

How many perturbations break this model? Evaluating robustness beyond adversarial accuracy

Strength-Adaptive Adversarial Training

Testing Robustness Against Unforeseen Adversaries

Demonstration of ViTA: Visualizing, Testing and Analyzing Index Advisors

Testing the Robustness of Learned Index Structures

Robust Deep Reinforcement Learning with Adaptive Adversarial Perturbations in Action Space

Toward Adversarial Robustness via Semi-supervised Robust Training

Bag of Tricks for Adversarial Training