Abstract:As one of the important issues of multi-agent collaboration, the large-scale agents' cooperative attack–defense evolution requires a large number of agents to make stress-effective strategies to achieve their goals in complex environments. Multi-agent attack and defense in high-dimensional environments (3D obstacle scenarios) present the challenge of being able to accurately control high-dimensional state quantities. Moreover, the large scale makes the dynamic interactions in the attack and defense problems increase dramatically, which, using traditional optimal control techniques, can cause a dimensional explosion. How to model and solve the cooperative attack–defense evolution problem of large-scale agents in high-dimensional environments have become a challenge. We jointly considered energy consumption, inter-group attack and defense, intra-group collision avoidance, and obstacle avoidance in their cost functions. Meanwhile, the high-dimensional state dynamics were used to describe the motion of agents under environmental interference. Then, we formulated the cooperative attack–defense evolution of large-scale agents in high-dimensional environments as a multi-population high-dimensional stochastic mean-field game (MPHD-MFG), which significantly reduced the communication frequency and computational complexity. We tractably solved the MPHD-MFG with a generative-adversarial-network (GAN)-based method using the MFGs' underlying variational primal–dual structure. Based on our approach, we carried out an integrative experiment in which we analytically showed the fast convergence of our cooperative attack–defense evolution algorithm by the convergence of the Hamilton–Jacobi–Bellman equation's residual errors. The experiment also showed that a large number of drones can avoid obstacles and smoothly evolve their attack and defense behaviors while minimizing their energy consumption. In addition, the comparison with the baseline methods showed that our approach is advanced.

Multi-Agent Reach-Avoid Games: Two Attackers Versus One Defender and Mixed Integer Programming

Optimal Strategies and Cooperative Teaming for 3D Multiplayer Reach-Avoid Games

Reach‐avoid Games with Two Heterogeneous Defenders and One Attacker

Multi-player Reach-Avoid Game in Dynamic Environment

Reach-Avoid Games with Two Defenders and One Attacker: an Analytical Approach

Task Assignment for Multiplayer Reach-Avoid Games in Convex Domains via Analytical Barriers

Multiplayer Reach-Avoid Differential Games in 3D Space Inspired by Harris' Hawks' Cooperative Hunting Tactics

Optimal Saddle-Point Strategy of Reach-Avoid Game in Three-Dimensional Space

Pursuit-Evasion Games for Multi-agent Based on Reinforcement Learning with Obstacles

Receding Horizon Defense Strategy for Reach-Avoid Games with Uncertainties Via Pairwise Outcomes

Coordinated Defense Allocation in Reach-Avoid Scenarios with Efficient Online Optimization

Solutions for Multiple-Defender Single-Attacker Convex Target Guarding Games: Verification via Parametric Optimization

Receding Horizon Control Based Real-time Strategy for Missile Pursuit-evasion Game

Approximate Optimal Strategy for Multiagent System Pursuit–Evasion Game

Data-Driven Cooperative Multi-Task Assignment in Heterogeneous Multi-Agent Pursuit-Evade Game

Collaborative Constrained Target-Reaching Control in a Multiplayer Reach-Avoid Game

Defendable Region for the Multiplayer Reach-Avoid Game with Free Attacker Defender Velocity Ratio

Markov Potential Game with Final-time Reach-Avoid Objectives

Multiplayer Homicidal Chauffeur Reach-Avoid Games: A Pursuit Enclosure Function Approach

A Multi-Population Mean-Field Game Approach for Large-Scale Agents Cooperative Attack-Defense Evolution in High-Dimensional Environments

Cooperative attack-defense evolution of large-scale agents: a multi-population high-dimensional mean-field game approach.