Abstract:A reinforcement learning framework is constructed to handle the unknown dynamics and environmental disturbances and achieve the optimal control performance. Combining the reinforcement learning technique, we develop the reinforcement learning‐based finite‐time control strategy without the singularity issue, which exhibits good robustness and provides the system's states a finite‐time convergence, while obtaining the optimal performance of the controller. This study proposes a reinforcement learning‐based finite‐time cross‐media tracking control approach for a slender body cross‐media vehicle encountering unknown hydrodynamics, wind, and wave disturbances. Initially, a reinforcement learning framework consisting of the actor neural network and critic neural network is constructed. The critic neural network monitors the actions of the actor neural network and approximates the cost function, while the actor neural network estimates the unknown hydrodynamics and disturbances, minimising the cost function to optimise performance. Subsequently, the command filter featuring finite‐time convergence is formulated, effectively managing the corresponding filter error through a proposed error compensating signal. By integrating these techniques, a reinforcement learning‐based finite‐time control strategy is developed, circumventing the singularity issue inherent in traditional finite‐time backstepping strategies. Comparative analysis with existing methods demonstrates the strong robustness of the proposed scheme against unknown hydrodynamics and disturbances, ensuring finite‐time convergence of the system's states and optimising controller performance. Finally, simulations confirm the effectiveness and superiority of the presented approach.

Reinforcement Learning-Based Finite-Time Optimal Containment Control for Underactuated Surface Vehicles with Guaranteed Performance

Finite-time Containment Control for Autonomous Underwater Vehicles with Prescribed Performance

Adaptive Optimal Tracking Control of an Underactuated Surface Vessel Using Actor–Critic Reinforcement Learning

Reinforcement learning-based finite-time tracking control of an unknown unmanned surface vehicle with input constraints

Finite-time robust containment control for autonomous surface vehicle with input saturation constraint

Reinforcement learning-based close formation control for underactuated surface vehicle with prescribed performance and time-varying state constraints

Disturbance observer-based adaptive neural control for underactuated surface vehicle with constraint of input saturation

Model-Reference Reinforcement Learning Control of Autonomous Surface Vehicles with Uncertainties

Quasi-Infinite Horizon Model Predictive Control with Fixed-Time Disturbance Observer for Underactuated Surface Vessel Path Following

Learning-Based Neural Dynamic Surface Predictive Control for MMC

Data-Driven Performance-Prescribed Reinforcement Learning Control of an Unmanned Surface Vehicle

Continuous‐time receding‐horizon reinforcement learning and its application to path‐tracking control of autonomous ground vehicles

Adaptive Fixed-time Optimal Formation Control for Uncertain Nonlinear Multiagent Systems Using Reinforcement Learning

Adaptive optimal formation control for unmanned surface vehicles with guaranteed performance using actor‐critic learning architecture

Reinforcement learning‐based finite‐time cross‐media tracking control for a cross‐media vehicle under unknown dynamics and disturbances

Model-Based Safe Reinforcement Learning with Time-Varying State and Control Constraints: An Application to Intelligent Vehicles

Adaptive neural formation control of autonomous underactuated surface vessels based on disturbance observer with leader–follower strategy

Model-Based Safe Reinforcement Learning With Time-Varying Constraints: Applications to Intelligent Vehicles

Reinforcement learning control method for real‐time hybrid simulation based on deep deterministic policy gradient algorithm

Single degree of freedom control based on deep reinforcement learning for underwater unmanned vehicle

Model-Reference Reinforcement Learning for Collision-Free Tracking Control of Autonomous Surface Vehicles