Abstract:This paper comprehensively investigates the problem of impulsive orbital pursuit-evasion games (OPEGs) by using an artificial intelligence-based approach. First, the mathematical model for the impulsive OPEGs in which the pursuer and evader both perform their orbital maneuvers by imposing the impulsive velocity increments is constructed. Second, the problem of impulsive OPEGs is transformed into a bilateral optimization problem with a minimum-maximum optimization index in terms of terminal time and multiple constraints such as maneuverability, total fuel consumption, and mission time, etc. To determine the optimal impulsive maneuvers for both sides, a PRD-MADDPG (Predict-Reward-Detect Multi-Agent Deep Deterministic Policy Gradient) algorithm in the frame of multi-agent reinforcement learning is designed. This novel algorithm uses the basic MADDPG to achieve the strategies training and learning, and applies the supplemental PRD to predict the change of game state during the interval between two adjacent impulsive maneuvers and incorporate these information into the algorithm training in the form of predicted reward. Finally, some pursuit-evasion missions near the Geosynchronous Earth Orbit are numerically analyzed to verify the validness and effectiveness of the algorithm. The results prove that the PRD-MADDPG algorithm is very efficient to find applicable strategies even considering rather complex constraints. It is also shown that the learning-based strategies can be effectively applied in the extended scenarios which are not seen in the training process. & COPY; 2023 COSPAR. Published by Elsevier B.V. All rights reserved.

Satellite Swarm Orbital Pursuit-Evasion Game Based on Multi-agent Proximal Policy Optimization Algorithm

Large Scale Pursuit-Evasion under Collision Avoidance Using Deep Reinforcement Learning.

Multiple-to-one Orbital Pursuit: A Computational Game Strategy

Pursuit-Evasion Games for Multi-agent Based on Reinforcement Learning with Obstacles

Multi-Agent Cooperative Pursuit-Evasion Control Using Gene Expression Programming

Bearing Angle Measurement Based Cooperative Pursuit-Evasion Game in Non-Convex Environments

A Model Predictive Stackelberg Solution to Orbital Pursuit-Evasion Game

Cooperative Pursuit of Multiple Evade Rs Based on Location Information Only

Distributed Pursuit-Evasion Game of Limited Perception USV Swarm Based on Multiagent Proximal Policy Optimization

Pursuit-evasion Game Strategy of USV Based on Deep Reinforcement Learning in Complex Multi-Obstacle Environment

PRD-MADDPG: an Efficient Learning-Based Algorithm for Orbital Pursuit-Evasion Game with Impulsive Maneuvers

Cooperative Pursuit with Multiple Pursuers based on Deep Minimax Q-learning

Orbital Pursuit–Evasion–Defense Linear-Quadratic Differential Game

An Improved Approach Towards Multi-Agent Pursuit–Evasion Game Decision-Making Using Deep Reinforcement Learning

Orbital satellite pursuit-evasion game-theoretical control

Reinforcement Learning-Based Decision-Making for Spacecraft Pursuit-Evasion Game in Elliptical Orbits

Optimal Strategies and Cooperative Teaming for 3D Multiplayer Reach-Avoid Games

Satellite proximate pursuit-evasion game with different thrust configurations

Approximate Optimal Strategy for Multiagent System Pursuit–Evasion Game

Adaptive Optimal Control via Q-Learning for Multi-Agent Pursuit-Evasion Games

Research on game strategy of spacecraft chase and escape based on adaptive augmented random search