Abstract:This paper comprehensively investigates the problem of impulsive orbital pursuit-evasion games (OPEGs) by using an artificial intelligence-based approach. First, the mathematical model for the impulsive OPEGs in which the pursuer and evader both perform their orbital maneuvers by imposing the impulsive velocity increments is constructed. Second, the problem of impulsive OPEGs is transformed into a bilateral optimization problem with a minimum-maximum optimization index in terms of terminal time and multiple constraints such as maneuverability, total fuel consumption, and mission time, etc. To determine the optimal impulsive maneuvers for both sides, a PRD-MADDPG (Predict-Reward-Detect Multi-Agent Deep Deterministic Policy Gradient) algorithm in the frame of multi-agent reinforcement learning is designed. This novel algorithm uses the basic MADDPG to achieve the strategies training and learning, and applies the supplemental PRD to predict the change of game state during the interval between two adjacent impulsive maneuvers and incorporate these information into the algorithm training in the form of predicted reward. Finally, some pursuit-evasion missions near the Geosynchronous Earth Orbit are numerically analyzed to verify the validness and effectiveness of the algorithm. The results prove that the PRD-MADDPG algorithm is very efficient to find applicable strategies even considering rather complex constraints. It is also shown that the learning-based strategies can be effectively applied in the extended scenarios which are not seen in the training process. & COPY; 2023 COSPAR. Published by Elsevier B.V. All rights reserved.

Delta-V Analysis for Impulsive Orbital Pursuit-Evasion Based on Reachable Domain Coverage

Time-Dependent Reachable Domain and Its Application to Impulsive Orbital Pursuit–Evasion Analysis

Impulsive guidance of optimal pursuit with conical imaging zone for the evader

Multiple-to-one Orbital Pursuit: A Computational Game Strategy

Reachable Domain with a Single Coplanar Impulse Considering the Target-Visit Constraint

A Model Predictive Stackelberg Solution to Orbital Pursuit-Evasion Game

An Analytical Solution of Space Rendezvous Path Planning

PRD-MADDPG: an Efficient Learning-Based Algorithm for Orbital Pursuit-Evasion Game with Impulsive Maneuvers

Analytical Pursuit-Evasion Game Strategy in Arbitrary Keplerian Reference Orbits

Entry Trajectory Optimization with Virtual Motion Camouflage Principle

Optimal Elliptic Orbital Maneuver with Continuous Radial Thrust on the Chaser Using Generating Functions

Analytical Delta-V Approximation for Nonlinear Programming of Multi-target Rendezvous and Flyby Trajectories

Spacecraft Orbital Pursuit–evasion Games with J2 Perturbations and Direction-Constrained Thrust

Analytical Optimal Solution for the Reachable Domain of Low-Thrust Spacecraft

Multi-impulse Pursuit-Evasion Game for GEO Spacecraft with Perceptual Delay

Study on Interception Control Strategies with Zero Effort Miss

Satellite proximate pursuit-evasion game with different thrust configurations

Escape from an Orbiting Pursuer with a Nonzero Capture Radius

Reachable Domain for Spacecraft with A Single Impulse

Numerical solution for a class of pursuit-evasion problem in low earth orbit

A Fuel Optimization Method for the Pursuer in the Spacecraft Pursuit-Evasion Game