Abstract:Aiming at the confrontation game problems between pursuit-evasion unmanned surface vehicles under complex multi-obstacle environment, a pursuit-evasion game strategy is proposed. Firstly, the multi-obstacle environment is set up, and the gaming situation can be judged by the perception between pursuit-evasion USVs. For the pursuers, the model training is performed based on multi-agent deep reinforcement learning, so that they can quickly plan a reasonable obstacle avoidance and pursuit route, and form an effective encirclement posture before the evader approaches the target point. Meanwhile, the credit assignment problem among the members of the pursuing group is considered. For the evader, deep reinforcement learning is combined with imitation learning to train the escape model, so that it can reach the preset point in as short a time as possible and avoid the obstacles on the way. Finally, an adversarial-evolutionary game training method under multiple random scenarios is designed and combined with curriculum learning to iteratively update the pursuit and escape models. Through the detailed comparative analysis of the model training process and simulation experiments, it is proved that the proposed two types of models have higher convergence efficiency and stability, and they can have higher intelligence to pursue, escape and avoid obstacles respectively.

An Open Loop Stackelberg Solution to Optimal Strategy for UAV Pursuit-Evasion Game

A Model Predictive Stackelberg Solution to Orbital Pursuit-Evasion Game

Optimal avoidance strategy based on nonlinear approximate analytic solution of non-cooperative differential game

A Payoff Augmentation Approach to Two Pursuers and One Evader Inertial Model Differential Game.

Integral Reinforcement Learning Based Dynamic Stackelberg Pursuit-Evasion Game for Unmanned Surface Vehicles

Multiple-to-one Orbital Pursuit: A Computational Game Strategy

Receding Horizon Control Based Real-time Strategy for Missile Pursuit-evasion Game

Collaborative Pursuit-Evasion Strategy of UAV/UGV Heterogeneous System in Complex Three-Dimensional Polygonal Environment

Cooperative Hunting Strategy with a Superior Evader Based on Differential Game

Resilient Pursuit Evasion Guidance with Feedback Game Strategy

Optimal Saddle-Point Strategy of Reach-Avoid Game in Three-Dimensional Space

Optimal Strategies for Large-Scale Pursuers Against One Evader: A Mean Field Game-Based Hierarchical Control Approach

A Pursuit-evasion Game Between Unmanned Aerial Vehicles

Research on Multi-UUV Pursuit-Evasion Games Strategies under the Condition of Strongly Manoeuvrable Evader

Cooperative Pursuit of Multiple Evade Rs Based on Location Information Only

Optimal Strategies and Cooperative Teaming for 3D Multiplayer Reach-Avoid Games

Adaptive Double Fuzzy Systems Based Q-Learning for Pursuit-Evasion Game

Pursuit-evasion Game Strategy of USV Based on Deep Reinforcement Learning in Complex Multi-Obstacle Environment

An escape strategy in orbital pursuit-evasion games with incomplete information

Guidance Strategy of Motion Camouflage for Spacecraft Pursuit-Evasion Game

Orbital Impulsive Pursuit-Evasion Game Formulation and Stackelberg Equilibrium Solutions