Multi-Agent Adversarial Training Using Diffusion Learning

Ying Cao,Elsa Rizk,Stefan Vlaski,Ali H. Sayed

2023-03-03

Abstract:This work focuses on adversarial learning over graphs. We propose a general adversarial training framework for multi-agent systems using diffusion learning. We analyze the convergence properties of the proposed scheme for convex optimization problems, and illustrate its enhanced robustness to adversarial attacks.

Machine Learning,Artificial Intelligence,Multiagent Systems

What problem does this paper attempt to address?

The main objective of this paper is to address the problem of adversarial training in multi-agent systems. Specifically, the paper proposes a general adversarial training method based on a diffusion learning framework to enhance the robustness of multi-agent systems, enabling them to withstand adversarial attacks. By analyzing the convergence of convex optimization problems, the proposed scheme is shown to have stronger robustness in the face of adversarial perturbations.

The core contributions of the paper include:
1. **Proposing a new adversarial training algorithm**: This algorithm is suitable for a fully decentralized architecture, where each agent is an independent learning unit and information is shared through local neighborhood interactions.
2. **Addressing the problem of adversarial sample generation**: The paper considers the generation of adversarial samples and assumes that these perturbations are within a certain bounded range (e.g., ℓ2 norm constraint), which aids in the practical application of adversarial training.
3. **Theoretical analysis and proof**: For the case of strongly convex loss functions, the paper provides a detailed convergence analysis, proving that the algorithm can approach the global minimum after a sufficient number of iterations, thereby effectively minimizing performance degradation in the worst-case scenario.
4. **Experimental validation**: Experiments on the MNIST and CIFAR10 datasets validate the effectiveness and robustness of the algorithm, especially in the face of different types of adversarial attacks (such as FGM and DeepFool).

Overall, this research aims to improve the adversarial training methods of multi-agent systems, enhancing their security and robustness in practical application scenarios.