Abstract:This article proposes an observer-based reinforcement learning (RL) control approach to address the optimal attitude-tracking problem and application for hypersonic vehicles in the reentry phase. Due to the unknown uncertainty and nonlinearity caused by parameter perturbation and external disturbance, accurate model information of hypersonic vehicles in the reentry phase is generally unavailable. For this reason, a novel synchronous estimation is proposed to construct a composite observer for hypersonic vehicles, which consists of a neural-network (NN)-based Luenberger-type observer and a synchronous disturbance observer. This solves the identification problem of nonlinear dynamics in the reference control and realizes the estimation of the system state when unknown nonlinear dynamics and unknown disturbance exist at the same time. By synthesizing the information from the composite observer, an RL tracking controller is developed to solve the optimal attitude-tracking control problem. To improve the convergence performance of critic network weights, concurrent learning is employed to replace the traditional persistent excitation condition with a historical experience replay manner. In addition, this article proves that the weight estimation error is bounded when the learning rate satisfies the given sufficient condition. Finally, the numerical simulation demonstrates the effectiveness and superiority of the proposed approaches to attitude-tracking control systems for hypersonic vehicles.

Attitude Control of Hypersonic Vehicle based on Reinforcement Learning

Model-free Maneuvering Control of Fixed-Wing UAVs Based on Deep Reinforcement Learning

A Learning-based Intelligent Control Method for Hypersonic Flight Vehicle

Attitude control of hypersonic vehicle based on risk assessment and switching strategy

Composite Observer-Based Optimal Attitude-Tracking Control With Reinforcement Learning for Hypersonic Vehicles

Neural Adaptive Control of Air-Breathing Hypersonic Vehicles Robust to Actuator Dynamics.

Robust adaptive dynamic programming based attitude tracking control for hypersonic vehicle

Online policy iteration ADP-based attitude-tracking control for hypersonic vehicles

Attitude tracking control of hypersonic vehicle based on an improved prescribed performance dynamic surface control

Direct neural discrete control of hypersonic flight vehicle

Adaptive Attitude Control For An Unmanned Scale Helicopter In Hover

Based on RBF Neural Network of Hypersonic Re-entry Vehicle Attitude Control

The Nonlinear Adaptive Attitude Control for Hypersonic Vehicle

Adaptive Control of Hypersonic Vehicles with Unknown Dynamics Based on Dual Network Architecture

Event-Triggered Deterministic Learning Control for Air-Breathing Hypersonic Vehicle

Deep Reinforcement Learning-Based Backstepping Control of Air-Breathing Hypersonic Vehicles with Actuator Constraints

Dual-mode Control of Hypersonic Vehicles

Attitude optimization control of hypersonic flight vehicle considering partially unknown control direction

Reinforcement Learning Control of Hypersonic Vehicles and Performance Evaluations

Attitude control for hypersonic vehicle's reentry phase with reaction jets

Active Disturbance Rejection Attitude Control for Hypersonic Vehicle Based on Intelligent Stochastic Robust Optimization Method