Abstract:The space environment around the Earth is becoming increasingly populated by both active spacecraft and space debris. To avoid potential collision events, significant improvements in Space Situational Awareness (SSA) activities and Collision Avoidance (CA) technologies are allowing the tracking and maneuvering of spacecraft with increasing accuracy and reliability. However, these procedures still largely involve a high level of human intervention to make the necessary decisions. For an increasingly complex space environment, this decision-making strategy is not likely to be sustainable. Therefore, it is important to successfully introduce higher levels of automation for key Space Traffic Management (STM) processes to ensure the level of reliability needed for navigating a large number of spacecraft. These processes range from collision risk detection to the identification of the appropriate action to take and the execution of avoidance maneuvers. This work proposes an implementation of autonomous CA decision-making capabilities on spacecraft based on Reinforcement Learning (RL) techniques. A novel methodology based on a Partially Observable Markov Decision Process (POMDP) framework is developed to train the Artificial Intelligence (AI) system on board the spacecraft, considering epistemic and aleatory uncertainties. The proposed framework considers imperfect monitoring information about the status of the debris in orbit and allows the AI system to effectively learn stochastic policies to perform accurate Collision Avoidance Maneuvers (CAMs). The objective is to successfully delegate the decision-making process for autonomously implementing a CAM to the spacecraft without human intervention. This approach would allow for a faster response in the decision-making process and for highly decentralized operations.

Deep Reinforcement Learning for Autonomous Spacecraft Inspection using Illumination

Deep Reinforcement Learning for Scalable Multiagent Spacecraft Inspection

Safe Spacecraft Inspection via Deep Reinforcement Learning and Discrete Control Barrier Functions

Demonstrating Reinforcement Learning and Run Time Assurance for Spacecraft Inspection Using Unmanned Aerial Vehicles

Deep Reinforcement Learning-Based Autonomous Mission Planning Method for High and Low Orbit Multiple Agile Earth Observing Satellites

Run Time Assured Reinforcement Learning for Six Degree-of-Freedom Spacecraft Inspection

Integrating Neural Radiance Fields with Deep Reinforcement Learning for Autonomous Mapping of Small Bodies

Space-Based Sensor Tasking Using Deep Reinforcement Learning

Image-Based Deep Reinforcement Learning with Intrinsically Motivated Stimuli: On the Execution of Complex Robotic Tasks

Autonomous Maneuver Planning for Small-Body Reconnaissance via Reinforcement Learning

Investigating the Impact of Choice on Deep Reinforcement Learning for Space Controls

Deep Reinforcement Learning for Rendezvous Guidance with Enhanced Angles-Only Observability

How To Train Your HERON

Space Noncooperative Object Active Tracking with Deep Reinforcement Learning.

Deep Q-Learning for Decentralized Multi-Agent Inspection of a Tumbling Target

Deep Learning Fault Diagnosis for Spacecraft Attitude Determination and Control

Space Non-cooperative Object Active Tracking with Deep Reinforcement Learning

Spacecraft Autonomous Decision-Planning for Collision Avoidance: a Reinforcement Learning Approach

Navigating Occluded Intersections with Autonomous Vehicles using Deep Reinforcement Learning

Self-Driving Telescopes: Autonomous Scheduling of Astronomical Observation Campaigns with Offline Reinforcement Learning

Adaptive Informative Path Planning Using Deep Reinforcement Learning for UAV-based Active Sensing