Abstract:In this article, we propose an approximate optimal control strategy for a class of nonlinear multiagent system pursuit–evasion games. Herein, multiple pursuers aim to capture multiple evaders trying to evade capture. Under the competitive framework, agents not only pursue their individual goals but also consider coordination with their teammates to achieve collective objectives. However, maintaining cohesion with teammates in existing distributed control methods has always been a challenge. To enhance team coordination, we employ a graph-theoretic approach to represent the relationships between agents. Based on this, we design a dynamic target graph algorithm to enhance the coordination among pursuers. The approximate optimal strategies for each agent are solved by utilizing the Hamilton–Jacobi–Isaacs equations of the system. As solving these equations becomes computationally intensive in multiagent scenarios, we propose a value-based single network adaptive critic network architecture. In addition, we consider scenarios where the numbers of agents on both sides are inconsistent and address the phenomenon of input saturation. Moreover, we provide sufficient conditions to prove the system's stability. Finally, simulations conducted in two representative scenarios, multiple-pursuer-one-evader and multiple-pursuer-multiple-evader, demonstrate the effectiveness of our proposed algorithm.

Multi-agent Cooperative Pursuit Based on Extended Contract Net Protocol

Multi-Agent Cooperative Pursuit-Evasion Control Using Gene Expression Programming

Multiple-Pursuer Cooperative Multiple-Evader Games based on auction mechanism

Multi-robot Cooperative Pursuit Based on Combinatorial Auction Mechanism under Dynamic Environment

Large Scale Pursuit-Evasion under Collision Avoidance Using Deep Reinforcement Learning.

Bearing Angle Measurement Based Cooperative Pursuit-Evasion Game in Non-Convex Environments

Multi-robot Cooperative Pursuit Based on Task Bundle Auctions

Adaptive algorithm for multi-agent learning optimal cooperative pursuit strategy based on Markov game

Learning Effective Communication for Cooperative Pursuit with Multi-Agent Reinforcement Learning

Multi-Agent Pursuit-Evasion Game Based on Organizational Architecture.

Multiple-to-one Orbital Pursuit: A Computational Game Strategy

Safety-Critical Control for Multi-Agent Collaborative Pursuit

A PE Game with One Superior Hunter and Multi-Pursuer Against an Evader

Cooperative Pursuit With Multi-Pursuer and One Faster Free-Moving Evader

A cooperative pursuit-evasion game in wireless sensor and actor networks

Coordinated control of multiple mobile robots in pursuit-evasion games

Adaptive Optimal Control via Q-Learning for Multi-Agent Pursuit-Evasion Games

Cooperative Control for Multi-Player Pursuit-Evasion Games With Reinforcement Learning

Multi-Robot Cooperative Pursuit Algorithm for in An Unknown Environment

Multi-target Pursuit Formation of Multi-Agent Systems

Approximate Optimal Strategy for Multiagent System Pursuit–Evasion Game