Abstract:Cooperative pursuit with multiple pursuers is critical in swarm missions. For example, in order to capture a faster-moving evader, it becomes necessary to deploy multiple unmanned aerial vehicles to form an encirclement and approach the evader. In this paper, a cooperative pursuit strategy is developed by utilizing reinforcement learning techniques and pursuit-evasion games. Firstly, we propose a novel surrounding algorithm to form a complete encirclement based on the dynamics of pursuit-evasion games. Based on this surrounding algorithm, we employ reinforcement learning techniques to train cooperative pursuit strategies to capture the evader by surrounding and approaching the evader. In pursuit-evasion games and other non-cooperative games, it is assumed that the opponent can model the others' behaviors, adapt its adversarial strategies, and exploit the others' weaknesses. The cooperative pursuit strategy needs to consider the adversarial strategies taken by the evader and counteract them. To address this issue, we employ a Deep Minimax Q-learning algorithm to simultaneously learn the evader's adversarial strategy and the cooperative pursuit strategy that cannot be exploited by the evader. Finally, we present extensive numerical simulations to evaluate the performance of the proposed learning-based cooperative pursuit strategy in various scenarios.

Cooperative Pursuit of Multiple Evade Rs Based on Location Information Only

Bearing Angle Measurement Based Cooperative Pursuit-Evasion Game in Non-Convex Environments

Multi-Agent Cooperative Pursuit-Evasion Control Using Gene Expression Programming

Cooperative Hunting Strategy with Multi-Pursuer and a Superior Evader

Cooperative Pursuit With Multi-Pursuer and One Faster Free-Moving Evader

Large Scale Pursuit-Evasion under Collision Avoidance Using Deep Reinforcement Learning.

Multi-Player Pursuit Evasion Games with One Superior Evader

Multiple-to-one Orbital Pursuit: A Computational Game Strategy

Cooperative Hunting Strategy with a Superior Evader Based on Differential Game

Multi-playerPursuit-EvasionGameswithOneSuperior Evader ⋆

A PE Game with One Superior Hunter and Multi-Pursuer Against an Evader

Cooperative Pursuit in a Non-closed Bounded Domain

Cooperative Pursuit with Multiple Pursuers based on Deep Minimax Q-learning

Research on Pursuit-evasion Games with Multiple Heterogeneous Pursuers and a High Speed Evader

Pursuit-evasion Games of Multiple Cooperative Pursuers and an Evader: A Biological-Inspired Perspective

Cooperative Strategies for Two-Evader-one-pursuer Reach-Avoid Differential Games.

Optimal Strategies and Cooperative Teaming for 3D Multiplayer Reach-Avoid Games

Coordinated control of multiple mobile robots in pursuit-evasion games

One Superior Pursuer and Multiple-Evader Differential Games with Two Lifelines

Cooperative Control for Multi-Player Pursuit-Evasion Games With Reinforcement Learning

Pursuit-evasion Games of Multi-Players with a Single Faster Player