Abstract:The rapid development of the aerospace industry puts forward the urgent need for the evolution of autonomous spacecraft rendezvous technology, which has gained significant attention recently due to increased applications in various space missions. This article studies the relative position tracking problem of the autonomous spacecraft rendezvous under the requirement of collision avoidance. An exploration-adaptive deep deterministic policy gradient (DDPG) algorithm is proposed to train a definite control strategy for this mission. Similar to the DDPG algorithm, four neural networks are used in this method, where two of them are used to generate the deterministic policy, whereas the other two are used to score the obtained policy. Differently, adaptive noise is introduced to reduce the possibility of oscillations and divergences and to cut down the unnecessary computation by weakening the exploration of stabilization problems. In addition, in order to effectively and quickly adapt to some other similar scenarios, a metalearning-based idea is introduced by fine-tuning the prior strategy. Finally, two numerical simulations show that the trained control strategy can effectively avoid the oscillation phenomenon caused by the artificial potential function. Benefiting from this, the trained control strategy based on deep reinforcement learning technology can decrease the energy consumption by 16.44% during the close proximity phase, compared with the traditional artificial potential function method. Besides, after introducing the metalearning-based idea, a strategy available for some other perturbed scenarios can be trained in a relatively short period of time, which illustrates its adaptability.

Multiphase Autonomous Docking via Model-Based and Hierarchical Reinforcement Learning

Autonomous Six-Degree-of-Freedom Spacecraft Docking Maneuvers via Reinforcement Learning

Neural-based Control for CubeSat Docking Maneuvers

Learning Autonomous Docking Operation of Fully Actuated Autonomous Surface Vessel from Expert data

Reinforcement Learning for Docking Maneuvers with Prescribed Performance

Enhancing UAV Aerial Docking: A Hybrid Approach Combining Offline and Online Reinforcement Learning

Deep Reinforcement Learning for Continuous Docking Control of Autonomous Underwater Vehicles: A Benchmarking Study

Learning Aerial Docking Via Offline-to-Online Reinforcement Learning

Auv 3d Docking Control Using Deep Reinforcement Learning

Autonomous Satellite Docking via Adaptive Optimal Output Regulation: A Reinforcement Learning Approach

Real-time 6 dof terminal guidance for autonomous spacecraft capture free floating objects using state dependent model predictive control

Novel Docking Controller for Autonomous Aerial Refueling with Probe Direct Control and Learning-Based Preview Method

Reinforcement learning based robot navigation using illegal actions for autonomous docking of surface vehicles in unknown environments

Safe Autonomous Docking of Spacecraft: A RTT-conbined Output-constrained Recursive Control Method

Spacecraft Proximity Maneuvering and Rendezvous with Collision Avoidance Based on Reinforcement Learning.

Vision Based Docking of Multiple Satellites with an Uncooperative Target

Modeling of Cooperative Robotic Systems and Predictive Control Applied to Biped Robots and UAV-UGV Docking with Task Prioritization

Learning-Based 6-DOF Control for Autonomous Proximity Operations under Motion Constraints

Autonomous docking trajectory optimization for unmanned surface vehicle: A hierarchical method

Deep Bayesian Reinforcement Learning for Spacecraft Proximity Maneuvers and Docking

Saturated Adaptive Relative Motion Coordination of Docking Ports in Space Close-Range Rendezvous