Abstract:In this paper, the intelligent design for the pursuit-evasion game with large scale multi-pursuer and multi-evader has been investigated. Due to the vast number of agents, the notorious ”Curse of Dimensionality” can seriously challenge the traditional design in multi-player pursuit-evasion game, especially under harsh environment with limited communication resource to support information exchange among multi-players. To address this intractable challenge, the emerging Mean Field Games (MFG) theory has been utilized to solve the optimal pursuit-evasion strategies based on a new form of probability density function (PDF) instead of detailed information from all the other players/agents. As such, not only the information exchange is reduced, but also the computation dimension for the optimal strategy derivation is decreased. Specifically, the MFG has been integrated into the pursuit-evasion game to generate a hierarchical structure where the pursuers and the evaders form two mean field groups separately. To online solve the mean field equations, i.e., two coupled partial differential equations, the actor-critic reinforcement learning mechanism is adopted and further extended to a novel actor-critic-mass-opponent (ACMO) approach. In ACMO, the actor neural network estimates the optimal control, the critic neural network approximates the optimal cost function, the mass neural network learns the agent’s group PDF, and the opponent neural network predicts the opponents’ average states in the form of PDF that causes maximum cost for the agent’s group. The Lyapunov theory is utilized to provide the convergence analysis for all neural networks and the stability analysis for the closed-loop system. Eventually, a series of numerical simulations are conducted to demonstrate the effectiveness of the developed scheme.

Optimal Strategies and Cooperative Teaming for 3D Multiplayer Reach-Avoid Games

Multiplayer Reach-Avoid Differential Games in 3D Space Inspired by Harris' Hawks' Cooperative Hunting Tactics

Matching-Based Capture Strategies for 3D Heterogeneous Multiplayer Reach-Avoid Differential Games

Pursuit Winning Strategies for Reach-Avoid Games with Polygonal Obstacles

Bearing Angle Measurement Based Cooperative Pursuit-Evasion Game in Non-Convex Environments

Optimal Role Assignment for Multiplayer Reach-Avoid Differential Games in 3D Space

Multiple-to-one Orbital Pursuit: A Computational Game Strategy

Multi-Agent Cooperative Pursuit-Evasion Control Using Gene Expression Programming

Large Scale Pursuit-Evasion under Collision Avoidance Using Deep Reinforcement Learning.

Cooperative Strategies for Two-Evader-one-pursuer Reach-Avoid Differential Games.

Multiplayer Homicidal Chauffeur Reach-Avoid Games: A Pursuit Enclosure Function Approach

Task Assignment for Multiplayer Reach-Avoid Games in Convex Domains via Analytical Barriers

Reach-Avoid Games with Two Defenders and One Attacker: an Analytical Approach

A Maneuvering Strategy Based on Motion Camouflage in Three-Player Differential Game

Escape-avoid Games with Multiple Defenders along a Fixed Circular Orbit

A Novel Hierarchical Decomposition for Multi-Player Pursuit Evasion Differential Game with Superior Evaders

Multi-playerPursuit-EvasionGameswithOneSuperior Evader ⋆

Optimal Strategies for the Game with Two Faster 3D Pursuers and One Slower 2D Evader

Decentralized optimal large scale multi-player pursuit-evasion strategies: A mean field game approach with reinforcement learning

Approximate Optimal Strategy for Multiagent System Pursuit–Evasion Game

Distributed Task Allocation with Minimum Makespan for Heterogeneous Multiplayer Pursuit-Evasion Games