Abstract:A pursuit–evasion game is a classical maneuver confrontation problem in the multi-agent systems (MASs) domain. An online decision technique based on deep reinforcement learning (DRL) was developed in this paper to address the problem of environment sensing and decision-making in pursuit–evasion games. A control-oriented framework developed from the DRL-based multi-agent deep deterministic policy gradient (MADDPG) algorithm was built to implement multi-agent cooperative decision-making to overcome the limitation of the tedious state variables required for the traditionally complicated modeling process. To address the effects of errors between a model and a real scenario, this paper introduces adversarial disturbances. It also proposes a novel adversarial attack trick and adversarial learning MADDPG (A2-MADDPG) algorithm. By introducing an adversarial attack trick for the agents themselves, uncertainties of the real world are modeled, thereby optimizing robust training. During the training process, adversarial learning was incorporated into our algorithm to preprocess the actions of multiple agents, which enabled them to properly respond to uncertain dynamic changes in MASs. Experimental results verified that the proposed approach provides superior performance and effectiveness for pursuers and evaders, and both can learn the corresponding confrontational strategy during training.

A Reinforcement Learning Solution to the Nonlinear Spacecraft Pursuit-Evasion Game Problem

A Model Predictive Stackelberg Solution to Orbital Pursuit-Evasion Game

Multiple-to-one Orbital Pursuit: A Computational Game Strategy

Reinforcement Learning-Based Decision-Making for Spacecraft Pursuit-Evasion Game in Elliptical Orbits

Bearing Angle Measurement Based Cooperative Pursuit-Evasion Game in Non-Convex Environments

Receding Horizon Control Based Real-time Strategy for Missile Pursuit-evasion Game

Large Scale Pursuit-Evasion under Collision Avoidance Using Deep Reinforcement Learning.

Pursuit-Evasion Games for Multi-agent Based on Reinforcement Learning with Obstacles

Numerical Solution of a Pursuit-Evasion Differential Game Involving Two Spacecraft in Low Earth Orbit

Integral Reinforcement Learning Based Dynamic Stackelberg Pursuit-Evasion Game for Unmanned Surface Vehicles

Guidance Strategy of Motion Camouflage for Spacecraft Pursuit-Evasion Game

Numerical solution for a class of pursuit-evasion problem in low earth orbit

An Improved Approach Towards Multi-Agent Pursuit–Evasion Game Decision-Making Using Deep Reinforcement Learning

Optimal Strategy for Aircraft Pursuit-evasion Games Via Self-play Iteration

Resilient Pursuit Evasion Guidance with Feedback Game Strategy

Optimal avoidance strategy based on nonlinear approximate analytic solution of non-cooperative differential game

Adaptive Double Fuzzy Systems Based Q-Learning for Pursuit-Evasion Game

An Open Loop Stackelberg Solution to Optimal Strategy for UAV Pursuit-Evasion Game

An Application of Continuous Deep Reinforcement Learning Approach to Pursuit-Evasion Differential Game

Synchronous Near-Optimal Control for Discrete-Time Nonlinear Pursuit-Evasion Game

Predictive Pursuit-Evasion Game Control Method for Approaching Space Non-Cooperative Target