Abstract:In this article, we propose an approximate optimal control strategy for a class of nonlinear multiagent system pursuit–evasion games. Herein, multiple pursuers aim to capture multiple evaders trying to evade capture. Under the competitive framework, agents not only pursue their individual goals but also consider coordination with their teammates to achieve collective objectives. However, maintaining cohesion with teammates in existing distributed control methods has always been a challenge. To enhance team coordination, we employ a graph-theoretic approach to represent the relationships between agents. Based on this, we design a dynamic target graph algorithm to enhance the coordination among pursuers. The approximate optimal strategies for each agent are solved by utilizing the Hamilton–Jacobi–Isaacs equations of the system. As solving these equations becomes computationally intensive in multiagent scenarios, we propose a value-based single network adaptive critic network architecture. In addition, we consider scenarios where the numbers of agents on both sides are inconsistent and address the phenomenon of input saturation. Moreover, we provide sufficient conditions to prove the system's stability. Finally, simulations conducted in two representative scenarios, multiple-pursuer-one-evader and multiple-pursuer-multiple-evader, demonstrate the effectiveness of our proposed algorithm.

Multi-Agent Cooperative Pursuit-Evasion Control Using Gene Expression Programming

Large Scale Pursuit-Evasion under Collision Avoidance Using Deep Reinforcement Learning.

Cooperative Pursuit of Multiple Evade Rs Based on Location Information Only

Pursuit-Evasion Games for Multi-agent Based on Reinforcement Learning with Obstacles

Cooperative Pursuit With Multi-Pursuer and One Faster Free-Moving Evader

Pursuit-evasion Games of Multiple Cooperative Pursuers and an Evader: A Biological-Inspired Perspective

A PE Game with One Superior Hunter and Multi-Pursuer Against an Evader

Research on Pursuit-evasion Games with Multiple Heterogeneous Pursuers and a High Speed Evader

Multi-Player Pursuit Evasion Games with One Superior Evader

Adaptive Optimal Control via Q-Learning for Multi-Agent Pursuit-Evasion Games

Approximate Optimal Strategy for Multiagent System Pursuit–Evasion Game

Multi-playerPursuit-EvasionGameswithOneSuperior Evader ⋆

Cooperative Pursuit with Multiple Pursuers based on Deep Minimax Q-learning

A novel approach based on evolutionary game theoretic model for multi- player pursuit evasion

An Improved Approach Towards Multi-Agent Pursuit–Evasion Game Decision-Making Using Deep Reinforcement Learning

Safety-Critical Control for Multi-Agent Collaborative Pursuit

Optimal Strategies and Cooperative Teaming for 3D Multiplayer Reach-Avoid Games

Multiple-to-one Orbital Pursuit: A Computational Game Strategy

Cooperative Hunting Strategy with Multi-Pursuer and a Superior Evader

Coordinated control of multiple mobile robots in pursuit-evasion games

Cooperative Pursuit in a Non-closed Bounded Domain