Abstract:As one of the important issues of multi-agent collaboration, the large-scale agents' cooperative attack–defense evolution requires a large number of agents to make stress-effective strategies to achieve their goals in complex environments. Multi-agent attack and defense in high-dimensional environments (3D obstacle scenarios) present the challenge of being able to accurately control high-dimensional state quantities. Moreover, the large scale makes the dynamic interactions in the attack and defense problems increase dramatically, which, using traditional optimal control techniques, can cause a dimensional explosion. How to model and solve the cooperative attack–defense evolution problem of large-scale agents in high-dimensional environments have become a challenge. We jointly considered energy consumption, inter-group attack and defense, intra-group collision avoidance, and obstacle avoidance in their cost functions. Meanwhile, the high-dimensional state dynamics were used to describe the motion of agents under environmental interference. Then, we formulated the cooperative attack–defense evolution of large-scale agents in high-dimensional environments as a multi-population high-dimensional stochastic mean-field game (MPHD-MFG), which significantly reduced the communication frequency and computational complexity. We tractably solved the MPHD-MFG with a generative-adversarial-network (GAN)-based method using the MFGs' underlying variational primal–dual structure. Based on our approach, we carried out an integrative experiment in which we analytically showed the fast convergence of our cooperative attack–defense evolution algorithm by the convergence of the Hamilton–Jacobi–Bellman equation's residual errors. The experiment also showed that a large number of drones can avoid obstacles and smoothly evolve their attack and defense behaviors while minimizing their energy consumption. In addition, the comparison with the baseline methods showed that our approach is advanced.

Bio-Inspired Dynamic Collective Choice in Large-Population Systems: A Robust Mean-Field Game Perspective

A Dynamic Game Model of Collective Choice in Multi-Agent Systems

Dynamic Population Games: A Tractable Intersection of Mean-Field Games and Population Games

Direct Approach of Indefinite Linear-Quadratic Mean Field Games

Linear-Quadratic Stackelberg Mean Field Games and Teams with Arbitrary Population Sizes

Dynamic Optimization Problems for Mean-Field Stochastic Large-Population Systems

Collective Behavior Decision Based on Edge Dynamics

Discrete-time indefinite linear-quadratic mean field games and control: The finite-population case

Mixed Social Optima and Nash equilibrium in Linear-Quadratic-Gaussian Mean-field System

Consensus-Based Multipopulation Game Dynamics for Distributed Nash Equilibria Seeking and Optimization

Mean Field Game and Control for Switching Hybrid Systems

A Multi-Population Mean-Field Game Approach for Large-Scale Agents Cooperative Attack-Defense Evolution in High-Dimensional Environments

A Class of Mean-Field Games with Optimal Stopping and Its Inverse Problem

Evolutionary Poisson Games for Controlling Large Population Behaviors

Ε-Nash Mean-Field Games for Linear-Quadratic Systems with Random Jumps and Applications.

Robust Mean-Field Games with Partial Observations: A Complementary Strategy

Cooperative attack-defense evolution of large-scale agents: a multi-population high-dimensional mean-field game approach.

Anonymous Hedonic Game for Task Allocation in a Large-Scale Multiple Agent System

From Nash Equilibrium to Social Optimum and vice versa: a Mean Field Perspective

Dynamic generalized Nash equilibrium seeking for N-coalition noncooperative games

Zero-Sum Games between Large-Population Teams: Reachability-based Analysis under Mean-Field Sharing