Abstract:In this paper, a robust three-dimensional trajectory tracking control scheme based on reinforcement learning is proposed for the glide phase of a hypersonic gliding vehicle (HGV) with time-varying uncertainties. First, the non-affine nonlinear full-state kinematics and dynamics model of the HGV glide phase is constructed. Then, without linearizing the system, the desired multiplanar reference trajectories for HGVs are planned based on the pseudo-spectral theory under the input constraints, initial conditions, and terminal conditions. Subsequently, the full-state error system is generated by subtracting the reference system state from the actual state of the HGV system with time-varying uncertainty. For the full-state HGV error system with time-varying uncertainty and input constraints, we design a reinforcement learning-based optimal control scheme for its nominal system and establish the equivalence between this optimal control and the robust control of the original HGV error system. A single-evaluation network structure is used in the concrete implementation to reduce the computational cost. A rigorous theory is given to demonstrate the uniform ultimate boundedness of the closed-loop system and the weight error. Finally, we perform simulation traces for reference trajectories with different optimization performances to verify the effectiveness of the proposed method. Note to Practitioners —There are various constraints and uncertainties in the glide phase of HGVs, which is the hinge connecting the initial descent phase and the terminal management phase. How to design robust trajectory tracking controllers for the glide phase of HGVs with complex environments and large span of flight parameters is of great significance to aerial guidance practitioners. In this paper, an RL-based three-dimensional trajectory robust tracking guidance method is proposed for the HGV glide phase system, which can resist time-varying uncertainties and satisfy flight constraints. The uniform ultimate boundedness of the closed-loop system is proved using the Lyapunov method. The proposed tracking algorithm is effective for reference trajectories with different performance indexes.

Reinforcement Learning Based Optimal Tracking Control for Hypersonic Flight Vehicle: A Model Free Approach.

Reinforcement Learning–Based Adaptive Attitude Control Method for a Class of Hypersonic Flight Vehicles Subject to Nonaffine Structure and Unmatched Disturbances

Neuro-adaptive Tracking Control of a Hypersonic Flight Vehicle with Uncertainties Using Reinforcement Synthesis.

Composite Observer-Based Optimal Attitude-Tracking Control With Reinforcement Learning for Hypersonic Vehicles

Meta-learning-based Fault-Tolerant Attitude Control of Hypersonic Flight Vehicle with Input Constraints

A Longitudinal Trajectory Tracking Method with L1 Adaptive Control for Hypersonic Reentry Vehicles

Adaptive learning-based optimal tracking control system design and analysis of a disturbed nonlinear hypersonic vehicle model

Hypersonic Vehicle Attitude-Tracking Control Using Model-Free Deep Reinforcement Learning

Mpc-Based Tracking Control for Air-Breathing Hypersonic Vehicles with Input Constraints

Iterative Learning Control Combination with Adaptive Sliding Mode Technique for a Hypersonic Vehicle

Adaptive Variable Structure Control of Input Delay Non-Minimum Phase Hypersonic Flight Vehicles

Reinforcement Learning Control of Hypersonic Vehicles and Performance Evaluations

An Optimal Tracking Control Method for Unmanned Helicopter Ship Approach

Reinforcement Learning-Based 3D Trajectory Tracking Control of Hypersonic Gliding Vehicles with Time-Varying Uncertainties

Nonlinear adaptive tracking control of non-minimum phase hypersonic flight vehicles with unknown input nonlinearity

Fuzzy Optimal Tracking Control of Hypersonic Flight Vehicles via Single-Network Adaptive Critic Design

Fuzzy-reconstruction-based Robust Tracking Control of an Air-Breathing Hypersonic Vehicle

Tracking control of air-breathing hypersonic vehicles with non-affine dynamics via improved neural back-stepping design

Learning-based Adaptive Disturbance Rejection Control for Hypersonic Vehicle

Reinforcement Learning-Based Optimal Tracking Control of an Unknown Unmanned Surface Vehicle.

Finite‐horizon optimal trajectory control of near space hypersonic vehicle with multi‐constraints