Abstract:A pursuit–evasion game is a classical maneuver confrontation problem in the multi-agent systems (MASs) domain. An online decision technique based on deep reinforcement learning (DRL) was developed in this paper to address the problem of environment sensing and decision-making in pursuit–evasion games. A control-oriented framework developed from the DRL-based multi-agent deep deterministic policy gradient (MADDPG) algorithm was built to implement multi-agent cooperative decision-making to overcome the limitation of the tedious state variables required for the traditionally complicated modeling process. To address the effects of errors between a model and a real scenario, this paper introduces adversarial disturbances. It also proposes a novel adversarial attack trick and adversarial learning MADDPG (A2-MADDPG) algorithm. By introducing an adversarial attack trick for the agents themselves, uncertainties of the real world are modeled, thereby optimizing robust training. During the training process, adversarial learning was incorporated into our algorithm to preprocess the actions of multiple agents, which enabled them to properly respond to uncertain dynamic changes in MASs. Experimental results verified that the proposed approach provides superior performance and effectiveness for pursuers and evaders, and both can learn the corresponding confrontational strategy during training.

Game-theoretic Utility Tree for Multi-Robot Cooperative Pursuit Strategy

A Hierarchical Game-Theoretic Decision-Making for Cooperative Multi-Agent Systems Under the Presence of Adversarial Agents

Large Scale Pursuit-Evasion under Collision Avoidance Using Deep Reinforcement Learning.

A Game-Theoretic Utility Network for Cooperative Multi-Agent Decisions in Adversarial Environments

Multi-Agent Cooperative Pursuit-Evasion Control Using Gene Expression Programming

Bearing Angle Measurement Based Cooperative Pursuit-Evasion Game in Non-Convex Environments

Pursuit-Evasion Games for Multi-agent Based on Reinforcement Learning with Obstacles

Cooperative Pursuit of Multiple Evade Rs Based on Location Information Only

An Improved Approach Towards Multi-Agent Pursuit–Evasion Game Decision-Making Using Deep Reinforcement Learning

Multiple-to-one Orbital Pursuit: A Computational Game Strategy

A Novel Cooperative Pursuit Strategy in Multiple Underwater Robots

Multi-robot Cooperative Pursuit Based on Task Bundle Auctions

Safety-Critical Control for Multi-Agent Collaborative Pursuit

Pursuit-evasion Game Strategy of USV Based on Deep Reinforcement Learning in Complex Multi-Obstacle Environment

TWGS:A tree decomposition based indoor pursuit-evasion game for robotic networks

Multi-robot Cooperative Pursuit Based on Combinatorial Auction Mechanism under Dynamic Environment

Collaborative Pursuit-Evasion Strategy of UAV/UGV Heterogeneous System in Complex Three-Dimensional Polygonal Environment

Multiple-Pursuer Cooperative Multiple-Evader Games based on auction mechanism

Research on Pursuit-evasion Games with Multiple Heterogeneous Pursuers and a High Speed Evader

Multi-Agent Pursuit-Evasion Game Based on Organizational Architecture.

Coordinated control of multiple mobile robots in pursuit-evasion games