Abstract:Recent works have indicated that deep neural networks (DNNs) are vulnerable to adversarial attacks, wherein an attacker perturbs an input example with human-imperceptible noise that can easily fool the DNNs, resulting in incorrect predictions. This severely limits the application of deep learning in security-critical scenarios, such as face authentication. Adversarial training (AT) is one of the most practical approaches to strengthening the robustness of DNNs. However, existing AT-based methods treat each training sample independently, thereby ignoring the underlying topological structure in the training data. To this end, in this paper, we take full advantage of the topology information and introduce a Topology Aligning Adversarial Training (TAAT) algorithm. TAAT aims to encourage the trained model to maintain consistency in the topological structure within the feature space of both natural and adversarial examples. To ensure the stability and efficiency of topology alignment, we further introduce a novel Knowledge-Guided (KG) training scheme. This scheme explicitly aligns local logit outputs with global topological structures, leveraging a robust auxiliary model to enhance the target model’s performance. To verify the effectiveness of the proposed method, we conduct extensive experiments on popular benchmark datasets ( e.g ., CIFAR and ImageNet) and evaluate the robustness against state-of-the-art adversarial attacks ( e.g ., PGD-attack and AutoAttack). The experimental results demonstrate that the proposed method has superior robustness over the previous state-of-the-art methods. Our code and pre-trained models are available at https://github.com/SkyKuang/TAAT.

Adversarial Training: A Survey

Adversarial Training of Deep Neural Networks Guided by Texture and Structural Information

Recent Advances in Adversarial Training for Adversarial Robustness

A survey of robust adversarial training in pattern recognition: Fundamental, theory, and methodologies

Adversarial Examples based on Object Detection tasks: A Survey

Adversarial Examples on Object Recognition: A Comprehensive Survey

Enhancing Adversarial Robustness Via Anomaly-aware Adversarial Training.

Adversarial Attacks in Computer Vision: a Survey

Bag of Tricks for Adversarial Training

Defense Against Adversarial Attacks Using Topology Aligning Adversarial Training

Case-Aware Adversarial Training

Blind Adversarial Training: Towards Comprehensively Robust Models Against Blind Adversarial Attacks.

Enhancing Robust Representation in Adversarial Training: Alignment and Exclusion Criteria

Adversarial Attacks and Defenses in Machine Learning-Powered Networks: A Contemporary Survey

On the Effectiveness of Adversarial Training Against Backdoor Attacks.

Accurate and Robust Scene Text Recognition via Adversarial Training.

Adversarial Training via Adaptive Knowledge Amalgamation of an Ensemble of Teachers

Adversarial Attacks and Defences: A Survey

Strength-Adaptive Adversarial Training

Adversarial Training with Anti-adversaries

Adversarial Attacks of Vision Tasks in the Past 10 Years: A Survey