Abstract:A novel homing guidance law against maneuvering targets based on the deep deterministic policy gradient (DDPG) is proposed. The proposed guidance law directly maps the engagement state information to the acceleration of the interceptor, which is an end-to-end guidance policy. Firstly, the kinematic model of the interception process is described as a Markov decision process (MDP) that is applied to the deep reinforcement learning (DRL) algorithm. Then, an environment of training, state, action, and network structure is reasonably designed. Only the measurements of line-of-sight (LOS) angles and LOS rotational rates are used as state inputs, which can greatly simplify the problem of state estimation. Then, considering the LOS rotational rate and zero-effort-miss (ZEM), the Gaussian reward and terminal reward are designed to build a complete training and testing simulation environment. DDPG is used to deal with the RL problem to obtain a guidance law. Finally, the proposed RL guidance law's performance has been validated using numerical simulation examples. The proposed RL guidance law demonstrated improved performance compared to the classical true proportional navigation (TPN) method and the RL guidance policy using deep-Q-network (DQN).

A Guidance Law Based on Lyapunov Theory

A Research on Guidance Law Based on Variable Structure Control

Trajectory Prediction-Based Guidance Law

A New Nonlinear Terminal Guidance Law Design

A New Nonlinear H&#x221E; Terminal Guidance Law Design

An Optimal Guidance Law Based on Zero Miss-distance

Designing a New and Better Terminal Guidance Law Based on Nussbaum-Type Gain Technique

A new robust guidance design based on L2 gain method

A New Terminal Guidance Law Design with Finite Time Convergence

Design and Simulation of an Advanced Variable Structure Guidance Law

Design of H_∞ Control Based Nonlinear Terminal Guidance Law

Guidance Law Design under Impact Angle Constraint Based on Nussbaum-type Gain Technique

A New Discrete-time Guidance Law Base on Trajectory Learning and Prediction

A new nonlinear H∞ terminal guidance law design

An Integrated Guidance Law for Target Escapes with High Acceleration

Field-of-View and Impact Angle Constrained Guidance Law for Missiles with Time-Varying Velocities

Adaptive nonsingular guidance law against maneuvering targets

Design of Nonlinear H.INF. Guidance Law Considered the Effect of SNR

Design of H_∞ Guidance Law with Terminal Angle Constraint

Homing Guidance Law Design against Maneuvering Targets Based on DDPG

Augmented proportional guidance law design based on Lyapunov stability