Abstract:Cooperative pursuit with multiple pursuers is critical in swarm missions. For example, in order to capture a faster-moving evader, it becomes necessary to deploy multiple unmanned aerial vehicles to form an encirclement and approach the evader. In this paper, a cooperative pursuit strategy is developed by utilizing reinforcement learning techniques and pursuit-evasion games. Firstly, we propose a novel surrounding algorithm to form a complete encirclement based on the dynamics of pursuit-evasion games. Based on this surrounding algorithm, we employ reinforcement learning techniques to train cooperative pursuit strategies to capture the evader by surrounding and approaching the evader. In pursuit-evasion games and other non-cooperative games, it is assumed that the opponent can model the others' behaviors, adapt its adversarial strategies, and exploit the others' weaknesses. The cooperative pursuit strategy needs to consider the adversarial strategies taken by the evader and counteract them. To address this issue, we employ a Deep Minimax Q-learning algorithm to simultaneously learn the evader's adversarial strategy and the cooperative pursuit strategy that cannot be exploited by the evader. Finally, we present extensive numerical simulations to evaluate the performance of the proposed learning-based cooperative pursuit strategy in various scenarios.

Cooperative Hunting Strategy with Multi-Pursuer and a Superior Evader

Cooperative Pursuit of Multiple Evade Rs Based on Location Information Only

Cooperative Hunting Strategy with a Superior Evader Based on Differential Game

Multi-Agent Cooperative Pursuit-Evasion Control Using Gene Expression Programming

A PE Game with One Superior Hunter and Multi-Pursuer Against an Evader

Cooperative Pursuit With Multi-Pursuer and One Faster Free-Moving Evader

Bearing Angle Measurement Based Cooperative Pursuit-Evasion Game in Non-Convex Environments

Multi-Player Pursuit Evasion Games with One Superior Evader

Multi-playerPursuit-EvasionGameswithOneSuperior Evader ⋆

Multiple-to-one Orbital Pursuit: A Computational Game Strategy

Cooperative Strategies for Two-Evader-one-pursuer Reach-Avoid Differential Games.

Research on Pursuit-evasion Games with Multiple Heterogeneous Pursuers and a High Speed Evader

Cooperative Control for Multi-Player Pursuit-Evasion Games With Reinforcement Learning

Cooperative Pursuit with Multiple Pursuers based on Deep Minimax Q-learning

One Superior Pursuer and Multiple-Evader Differential Games with Two Lifelines

Optimal Strategies and Cooperative Teaming for 3D Multiplayer Reach-Avoid Games

Cooperative Nonlinear Guidance Strategies for Guaranteed Pursuit-Evasion

Optimal pursuit strategies for multi‐pursuer single‐evader games based on cooperative tracking

Cooperative Pursuit in a Non-closed Bounded Domain

Cooperative Strategy for Pursuit-Evasion Problem with Collision Avoidance

A Novel Hierarchical Decomposition for Multi-Player Pursuit Evasion Differential Game with Superior Evaders