Abstract:In this paper, a robust three-dimensional trajectory tracking control scheme based on reinforcement learning is proposed for the glide phase of a hypersonic gliding vehicle (HGV) with time-varying uncertainties. First, the non-affine nonlinear full-state kinematics and dynamics model of the HGV glide phase is constructed. Then, without linearizing the system, the desired multiplanar reference trajectories for HGVs are planned based on the pseudo-spectral theory under the input constraints, initial conditions, and terminal conditions. Subsequently, the full-state error system is generated by subtracting the reference system state from the actual state of the HGV system with time-varying uncertainty. For the full-state HGV error system with time-varying uncertainty and input constraints, we design a reinforcement learning-based optimal control scheme for its nominal system and establish the equivalence between this optimal control and the robust control of the original HGV error system. A single-evaluation network structure is used in the concrete implementation to reduce the computational cost. A rigorous theory is given to demonstrate the uniform ultimate boundedness of the closed-loop system and the weight error. Finally, we perform simulation traces for reference trajectories with different optimization performances to verify the effectiveness of the proposed method. Note to Practitioners —There are various constraints and uncertainties in the glide phase of HGVs, which is the hinge connecting the initial descent phase and the terminal management phase. How to design robust trajectory tracking controllers for the glide phase of HGVs with complex environments and large span of flight parameters is of great significance to aerial guidance practitioners. In this paper, an RL-based three-dimensional trajectory robust tracking guidance method is proposed for the HGV glide phase system, which can resist time-varying uncertainties and satisfy flight constraints. The uniform ultimate boundedness of the closed-loop system is proved using the Lyapunov method. The proposed tracking algorithm is effective for reference trajectories with different performance indexes.

A framework of trajectory design and optimization for the hypersonic gliding vehicle

Multidisciplinary Design Optimization of Reentry-Powered Hypersonic Vehicles Based on Surrogate Model

Trajectory Optimization for Hypersonic Glide Vehicle with Multi-Constraints

Multi-constrained Fast Trajectory Optimization of Glide Phase for Hypersonic Vehicle

Ascent and Glide Trajectory Optimization for Hypersonic Vehicle

Segmented Optimal Design of Ballistic Trajectory of Gliding Extended Range Projectile Subjected to Multiple Constraints

Design and optimization of hypersonic skip-glide trajectory

Glide Trajectory Optimization for Hypersonic Vehicles Via Dynamic Pressure Control

Research on Optimal Trajectory of Hypersonic Unpowered Glide Vehicle

Piecewise Analytic Optimized Ascent Trajectory Design and Robust Adaptive Finite-Time Tracking Control for Hypersonic Boost-Glide Vehicle.

Reentry Trajectory Optimization for Hypersonic Glide Vehicle with Flexible Initial Conditions

Multi-phase Trajectory Optimization for a Hypersonic Vehicle

Hypersonic Vehicle Guidance Based on Path-Following

Longitudinal integrated guidance and control scheme for hypersonic vehicle in glide phase

Analysis of optimal initial glide conditions for hypersonic glide vehicles

Reinforcement Learning-Based 3D Trajectory Tracking Control of Hypersonic Gliding Vehicles with Time-Varying Uncertainties

Multiple Leap Maneuver Trajectory Design and Tracking Method Based on Prescribed Performance Control during the Gliding Phase of Vehicles

Trajectory Optimization and Analysis for Near Spacecraft’s Unpowered Gliding Phase

Penetration Trajectory Optimization of Hypersonic Gliding Vehicles with Multiple Constraints

Optimal Trajectories of Hypersonic Vehicle for Global Reach

On-line Route Planning of Glide Phase for Hypersonic Cruise Vehicle