Abstract:In this paper, a robust three-dimensional trajectory tracking control scheme based on reinforcement learning is proposed for the glide phase of a hypersonic gliding vehicle (HGV) with time-varying uncertainties. First, the non-affine nonlinear full-state kinematics and dynamics model of the HGV glide phase is constructed. Then, without linearizing the system, the desired multiplanar reference trajectories for HGVs are planned based on the pseudo-spectral theory under the input constraints, initial conditions, and terminal conditions. Subsequently, the full-state error system is generated by subtracting the reference system state from the actual state of the HGV system with time-varying uncertainty. For the full-state HGV error system with time-varying uncertainty and input constraints, we design a reinforcement learning-based optimal control scheme for its nominal system and establish the equivalence between this optimal control and the robust control of the original HGV error system. A single-evaluation network structure is used in the concrete implementation to reduce the computational cost. A rigorous theory is given to demonstrate the uniform ultimate boundedness of the closed-loop system and the weight error. Finally, we perform simulation traces for reference trajectories with different optimization performances to verify the effectiveness of the proposed method. Note to Practitioners —There are various constraints and uncertainties in the glide phase of HGVs, which is the hinge connecting the initial descent phase and the terminal management phase. How to design robust trajectory tracking controllers for the glide phase of HGVs with complex environments and large span of flight parameters is of great significance to aerial guidance practitioners. In this paper, an RL-based three-dimensional trajectory robust tracking guidance method is proposed for the HGV glide phase system, which can resist time-varying uncertainties and satisfy flight constraints. The uniform ultimate boundedness of the closed-loop system is proved using the Lyapunov method. The proposed tracking algorithm is effective for reference trajectories with different performance indexes.

A new sliding mode tracking guidance based on three-dimensional trajectory

Hypersonic Vehicle Guidance Based on Path-Following

A New Three-dimensional Tracking Guidance Based on Full State Coupling

Diving Guidance Via Feedback Linearization and Sliding Mode Control

Diving Guidance with Maneuver Based on Feedback Linearization and Slide Mode Control

Pseudospectral-Based Rapid Trajectory Planning and Feedforward Linearization Guidance

Entry Trajectory Generation Based on Quasi-Three-dimensional Acceleration Guidance

Finite-time sliding mode based terminal area guidance with multiple constraints

Adaptive tracking guidance method in injection phase for hypersonic glide vehicles

Leap trajectory tracking control based on sliding mode theory for hypersonic gliding vehicle

Design of a Three-Dimensional CLOS Guidance Law Via Sliding Mode Control

Three-Dimensional Geometric Descent Guidance with Impact Angle Constraint

Reinforcement Learning-Based 3D Trajectory Tracking Control of Hypersonic Gliding Vehicles with Time-Varying Uncertainties

Three-dimensional Trajectory Tracking Guidance Law Based on Linear Quadratic Regulator

Lqr Tracking Guidance Law For Hypersonic Vehicle

A Global Sliding Mode Based Tracking Guidance Law with Fixed-Time Convergence for Reentry Vehicle

Sliding Mode Guidance Law Design Based on Terminal Angle Constraint

Autonomous Entry Guidance Based on 3-D Gliding Trajectory Analytical Solution

Entry Trajectory Generation with Complex Constraints Based on Three-Dimensional Acceleration Profile

Three-Dimensional Diving Guidance for Hypersonic Gliding Vehicle Via Integrated Design of FTNDO and AMSTSMC

Sliding Mode Guidance for 3D Gliding Motions with Bank Limitations