Abstract:Reusable launch vehicles need to face complex and diverse environments during flight. The design of rocket recovery control law based on traditional deep reinforcement learning (DRL) makes it difficult to obtain a set of network architectures that can adapt to multiple scenarios and multi-parameter uncertainties, and the performance of deep reinforcement learning algorithm depends on manual trial and error of hyperparameters. To solve this problem, this paper proposes a self-learning control method for launch vehicle recovery based on neural architecture search (NAS), which decouples deep network structure search and reinforcement learning hyperparameter optimization. First, using network architecture search technology based on a multi-objective hybrid particle swarm optimization algorithm, the proximal policy optimization algorithm of deep network architecture is automatically designed, and the search space is lightweight design in the process. Secondly, in order to further improve the landing accuracy of the launch vehicle, the Bayesian optimization (BO) method is used to automatically optimize the hyperparameters of reinforcement learning, and the control law of the landing phase in the recovery process of the launch vehicle is obtained through training. Finally, the algorithm is transplanted to the rocket intelligent learning embedded platform for comparative testing to verify its online deployment capability. The simulation results show that the proposed method can satisfy the landing accuracy of the launch vehicle recovery mission, and the control effect is basically the same as the landing accuracy of the trained rocket model under the untrained condition of model parameter deviation and wind field interference, which verifies the generalization of the proposed method.

Addressing the Task of Rocket Recycling with Deep Reinforcement Learning

Spacecraft Attitude Maneuver Planning Based on Deep Reinforcement Learning under Complex Constraints

Rocket Landing Control with Random Annealing Jump Start Reinforcement Learning

Robot Simulation and Reinforcement Learning Training Platform Based on Distributed Architecture.

Realizing Stabilized Landing for Computation-Limited Reusable Rockets: A Quantum Reinforcement Learning Approach

A Deep Reinforcement Learning Strategy for UAV Autonomous Landing on a Platform

Real-time Control for Fuel-Optimal Moon Landing Based on an Interactive Deep Reinforcement Learning Algorithm

Applying Online Expert Supervision in Deep Actor-Critic Reinforcement Learning.

OPTIMIZATION ALGORITHM FOR INTERPLANETARY TRANSFER TRAJECTORIES OF SOLAR SAILCRAFT BASED ON DEEP REINFORCEMENT LEARNING

Reinforcement Learning to improve delta robot throws for sorting scrap metal

Autonomous spacecraft collision avoidance with a variable number of space debris based on safe reinforcement learning

A UAV Maneuver Decision-Making Algorithm for Autonomous Airdrop Based on Deep Reinforcement Learning

Optimizing Plastic Waste Collection in Water Bodies Using Heterogeneous Autonomous Surface Vehicles with Deep Reinforcement Learning

Deep reinforcement learning for unmanned aerial vehicles cluster task allocation

Autonomous Navigation of Unmanned Vehicle Through Deep Reinforcement Learning

Vanishing Bias Heuristic-guided Reinforcement Learning Algorithm

Asynchronous Curriculum Experience Replay: A Deep Reinforcement Learning Approach for UAV Autonomous Motion Control in Unknown Dynamic Environments

Autonomous Drone Racing with Deep Reinforcement Learning

Deep Reinforcement Learning for Truck-Drone Delivery Problem

Research on Self-Learning Control Method of Reusable Launch Vehicle Based on Neural Network Architecture Search

Learning to Recharge: UAV Coverage Path Planning through Deep Reinforcement Learning