Abstract:To realize rapid, safe and optimal avoidance for spacecraft in complex threat situations and incomplete-information conditions, and considering the problems in existing hierarchical decision-making modes, a learning-based spacecraft reactive anti-hostile-rendezvous (AHR) maneuver control framework is proposed in this paper. First, a fundamental AHR action planner based on the interfered fluid dynamical system (IFDS) is proposed, in which the avoidance strategies for hostile and non-adversarial threats are appropriately integrated. An avoidance strategy matched with the IFDS is further designed by specifically considering high-intensity confrontation situations where a threat maintains persistent pursuit. Then, the “state-action” solution methods based on deep reinforcement learning (DRL) and multi-agent-DRL (MADRL) methods for orbital avoidance maneuvers are proposed to control the avoidance time and directions by optimizing the IFDS parameters. In the offline training stage, the DRL method will first simulate the interactive processes between the spacecraft and non-adversarial threats so that the spacecraft can gradually adapt to complex space environments and generate the relative primary avoidance maneuver strategies. On this basis, for hostile threats, the MADRL-based solution method of orbit game strategies is further established, in which the spacecraft and hostile threats are constructed as two types of opposite agents to simulate the game processes so that the strategy levels can be bilaterally evolved and the AHR success rates can be improved. After training, the corresponding neural networks are extracted from the agents in the DRL-based and MADRL-based methods for reactive AHR maneuver control. Moreover, a progressive agent training mechanism matched with the above DRL-based and MADRL-based solution methods is proposed, which can reduce the invalid interactions in initial training episodes, improve the training efficiency, and enhance the generalization ability of orbital game strategies. Finally, the effectiveness of the proposed framework is demonstrated by simulations.

Autonomous Spacecraft Collision Avoidance with Multiple Space Debris Based on Reinforcement Learning

Autonomous spacecraft collision avoidance with a variable number of space debris based on safe reinforcement learning

Spacecraft Autonomous Decision-Planning for Collision Avoidance: a Reinforcement Learning Approach

Real-Time Terminal Guidance for Autonomous Spacecraft Capture of Free Floating Objects Using Model Predictive Control

Real-time 6 dof terminal guidance for autonomous spacecraft capture free floating objects using state dependent model predictive control

Spacecraft Proximity Maneuvering and Rendezvous with Collision Avoidance Based on Reinforcement Learning.

Maneuver Strategy for Active Spacecraft to Avoid Space Debris and Return to the Original Orbit

Mission Planning on Autonomous Avoidance for Spacecraft Confronting Orbital Debris

Trajectory Planning and Control of Spacecraft Avoiding Dynamic Debris Swarm

A Reinforcement Learning-based Decentralized Method of Avoiding Multi-UAV Collision in 3-D Airspace

Obstacle Avoidance for UAS in Continuous Action Space Using Deep Reinforcement Learning

Integrated Robust Navigation and Guidance for the Kinetic Impact of Near-Earth Asteroids Based on Deep Reinforcement Learning

Coordinated Control Based on Reinforcement Learning for Dual-Arm Continuum Manipulators in Space Capture Missions

Revisiting Space Mission Planning: A Reinforcement Learning-Guided Approach for Multi-Debris Rendezvous

Learning-based Spacecraft Reactive Anti-Hostile-rendezvous Maneuver Control in Complex Space Environments

Collision Avoidance for Cooperative Uavs with Rolling Optimization Algorithm Based on Predictive State Space

Model-Predictive Control with Stochastic Collision Avoidance Using Bayesian Policy Optimization

Autonomous Trajectory Generation Comparison for De-Orbiting with Multiple Collision Avoidance

Collision Probability Sliding Mode Guidance for Spacecraft Autonomous Obstacle Avoidance under State Uncertainty

Autonomous obstacle avoidance strategies in the mission of large space debris removal using potential function

A hierarchical reinforcement learning method for missile evasion and guidance