Abstract:Adversarial training has achieved remarkable advancements in defending against adversarial attacks. Among them, fast adversarial training (FAT) is gaining attention for its ability to achieve competitive robustness with fewer computing resources. Existing FAT methods typically employ a uniform strategy that optimizes all training data equally without considering the influence of different examples, which leads to an imbalanced optimization. However, this imbalance remains unexplored in the field of FAT. In this paper, we conduct a comprehensive study of the imbalance issue in FAT and observe an obvious class disparity regarding their performances. This disparity could be embodied from a perspective of alignment between clean and robust accuracy. Based on the analysis, we mainly attribute the observed misalignment and disparity to the imbalanced optimization in FAT, which motivates us to optimize different training data adaptively to enhance robustness. Specifically, we take disparity and misalignment into consideration. First, we introduce self-knowledge guided regularization, which assigns differentiated regularization weights to each class based on its training state, alleviating class disparity. Additionally, we propose self-knowledge guided label relaxation, which adjusts label relaxation according to the training accuracy, alleviating the misalignment and improving robustness. By combining these methods, we formulate the Self-Knowledge Guided FAT (SKG-FAT), leveraging naturally generated knowledge during training to enhance the adversarial robustness without compromising training efficiency. Extensive experiments on four standard datasets demonstrate that the SKG-FAT improves the robustness and preserves competitive clean accuracy, outperforming the state-of-the-art methods.

GEAR: A Margin-based Federated Adversarial Training Approach

FAT: Federated Adversarial Training

Towards Desirable Decision Boundary by Moderate-Margin Adversarial Training

Delving into the Adversarial Robustness of Federated Learning

GANFAT:Robust federated adversarial learning with lable distribution skew

GANFAT: Robust Federated Adversarial Learning with Label Distribution Skew

Logit Calibration and Feature Contrast for Robust Federated Learning on Non-IID Data

Improving Fast Adversarial Training via Self-Knowledge Guidance

Towards Robust Federated Learning via Logits Calibration on Non-IID Data

Towards Well-trained Model Robustness in Federated Learning: an Adversarial- Example-Generation- Efficiency Perspective

Adaptive Selection of Loss Function for Federated Learning Clients Under Adversarial Attacks

Federated Adversarial Learning: A Framework with Convergence Analysis

FADE: Enabling Federated Adversarial Training on Heterogeneous Resource-Constrained Edge Devices

FedProphet: Memory-Efficient Federated Adversarial Training via Theoretic-Robustness and Low-Inconsistency Cascade Learning

Personalized Federated Learning on Long-Tailed Data Via Adversarial Feature Augmentation.

CalFAT: Calibrated Federated Adversarial Training with Label Skewness

Certified Federated Adversarial Training

FL-APB: Balancing Privacy Protection and Performance Optimization for Adversarial Training in Federated Learning

Federated Adversarial Debiasing for Fair and Transferable Representations

Revisiting and Exploring Efficient Fast Adversarial Training via LAW: Lipschitz Regularization and Auto Weight Averaging

Fast Adversarial Training with Smooth Convergence