Abstract:In this paper, a robust three-dimensional trajectory tracking control scheme based on reinforcement learning is proposed for the glide phase of a hypersonic gliding vehicle (HGV) with time-varying uncertainties. First, the non-affine nonlinear full-state kinematics and dynamics model of the HGV glide phase is constructed. Then, without linearizing the system, the desired multiplanar reference trajectories for HGVs are planned based on the pseudo-spectral theory under the input constraints, initial conditions, and terminal conditions. Subsequently, the full-state error system is generated by subtracting the reference system state from the actual state of the HGV system with time-varying uncertainty. For the full-state HGV error system with time-varying uncertainty and input constraints, we design a reinforcement learning-based optimal control scheme for its nominal system and establish the equivalence between this optimal control and the robust control of the original HGV error system. A single-evaluation network structure is used in the concrete implementation to reduce the computational cost. A rigorous theory is given to demonstrate the uniform ultimate boundedness of the closed-loop system and the weight error. Finally, we perform simulation traces for reference trajectories with different optimization performances to verify the effectiveness of the proposed method. Note to Practitioners —There are various constraints and uncertainties in the glide phase of HGVs, which is the hinge connecting the initial descent phase and the terminal management phase. How to design robust trajectory tracking controllers for the glide phase of HGVs with complex environments and large span of flight parameters is of great significance to aerial guidance practitioners. In this paper, an RL-based three-dimensional trajectory robust tracking guidance method is proposed for the HGV glide phase system, which can resist time-varying uncertainties and satisfy flight constraints. The uniform ultimate boundedness of the closed-loop system is proved using the Lyapunov method. The proposed tracking algorithm is effective for reference trajectories with different performance indexes.

Robust Trajectory Planning for Hypersonic Glide Vehicle with Parametric Uncertainties

Robust Trajectory Planning for Hypersonic Glide Vehicle with Parametric Uncertainties

Multidisciplinary Design Optimization of Reentry-Powered Hypersonic Vehicles Based on Surrogate Model

Gaussian Distribution-Based Control Vector Parameterization Method for Constrained Hypersonic Vehicle Reentry Trajectory Optimization

Robust Attitude Control Design for a Hypersonic Vehicle with Multi-Constraints

Control Variable Parameterisation With Penalty Approach For Hypersonic Vehicle Reentry Optimisation

Piecewise Analytic Optimized Ascent Trajectory Design and Robust Adaptive Finite-Time Tracking Control for Hypersonic Boost-Glide Vehicle.

Stochastic Gradient Particle Swarm Optimization Based Entry Trajectory Rapid Planning for Hypersonic Glide Vehicles

Trajectory Optimization for Hypersonic Glide Vehicle with Multi-Constraints

Glide Trajectory Optimization for Hypersonic Vehicles Via Dynamic Pressure Control

Aircraft Robust Trajectory Optimization Using Nonintrusive Polynomial Chaos

Robust Ascent Trajectory Optimization for Hypersonic Vehicles Based on IGS-UMPSP

Reentry Trajectory Optimization for Hypersonic Glide Vehicle with Flexible Initial Conditions

Robust Control for Hypersonic Vehicles with Parametric and Unstructured Uncertainties

Robust Nonlinear Control for Hypersonic Vehicles Subject to Parameter Uncertainties and External Disturbances

Robust Adaptive Optimized Tracking Control For A Hypersonic Vehicle With Varying Uncertainties

Reinforcement Learning-Based 3D Trajectory Tracking Control of Hypersonic Gliding Vehicles with Time-Varying Uncertainties

Robust Adaptive Control For Hypersonic Gliding Vehicles Based On Neso

Multi-constrained Fast Trajectory Optimization of Glide Phase for Hypersonic Vehicle

Trajectory Planning for Hypersonic Vehicle With Multiple Constraints and Multiple Maneuvering Penetration Strategies

Robust Multiobjective Trajectory Optimization for Hypersonic Telescopic Wing Morphing Aircraft