Abstract:This paper addresses a learning-based path following control scheme for a biomimetic underwater vehicle (BUV) driven by undulatory fins. A dynamic line-of-sight (DLOS) guidance system is designed, which uses a virtual ball with a dynamic radius to detect the reference path. This DLOS system guides our BUV in the path following control and extracts essential information for the Markov decision process (MDP) of the control task. A deep reinforcement learning (DRL) algorithm, sample-observed soft actor-critic (SOSAC) is proposed. The can train out control policy with greater cumulative reward and higher success rate by using two tricks: sample observation and sample diversification. Based on the DLOS system, the MDP of the control task, and a multilayer perceptron (MLP) trained by the SOSAC, our control scheme is established. Experiments show that our BUV can successfully achieve path following control in an indoor pool environment by using this control scheme. Note to Practitioners—The motivation of this paper is to design a practical end-to-end path following control scheme for the BUV driven by undulatory fins, and verify this scheme in a real-world environment. Unlike common autonomous underwater vehicles (AUVs) using axial propellers, the BUVs apply biomimetic propellers such as the undulatory fin. Multimodel wave patterns can be implemented by the undulatory fin, which generates nonlinear thrust and lateral force simultaneously. This propulsive feature makes the driving force on different directions of the BUV to be strong coupled, and it is complicated to convert the outputs of a common controller into waveform parameters of the undulatory fins to control the BUV. Therefore, in this paper, we proposed an end-to-end learning-based path following controller, which observes environmental information and directly generates waveform parameters to control our BUV. Experiments suggest that our control scheme is practical and valid.

PELOS-based Path Following Control for Autonomous Underwater Vehicle with Input Saturation and Dead-Zone

Path Following of Autonomous Surface Vehicles with Line-of-sight and Nonlinear Model Predictive Control

Improved Line-of-sight Nonlinear Trajectory Tracking Control of Autonomous Underwater Vehicle Exposed to High Variable Speed Ocean Currents

A Path Following Control Method for Underactuated Unmanned Surface Vehicles Based on Output Redefinition

Path Following Based on Waypoints and Real-Time Obstacle Avoidance Control of an Autonomous Underwater Vehicle

Path Following with Prescribed Performance for Under-Actuated Autonomous Underwater Vehicles Subjects to Unknown Actuator Dead-Zone

Path Following Model Predictive Control of a Coupled Autonomous Underwater Vehicle

Adaptive Dynamic Model-Based Path Following Controller Design for an Unmanned Surface Vessel

Collision Avoidance and Path Point Tracking Control for Underactuated Unmanned Surface Vehicles with Unknown Model Nonlinearity

A Model Predictive Control Approach for USV Autonomous Cruising Via Disturbance Learning

Path-Following Control of an Auv Using Multi-Objective Model Predictive Control

Prescribed Performance Actuator-Tolerance Control for Path Following of Unmanned Surface Vessels Via the Triggered Adaptive Line-of-sight Guidance

A Control Method for Path Following of AUVs Considering Multiple Factors Under Ocean Currents

Adaptive path following control for Wave gliders in time-varying environment

Path-Following Control of an AUV: A Multiobjective Model Predictive Control Approach

Path Following Control for Marine Surface Vessel with Uncertainties and Input Saturation

Three‐dimensional path following control of underactuated autonomous underwater vehicles with nonzero roll dynamics: A novel line‐of‐sight‐guided approach

Model Predictive Control for an Auv with Dynamic Path Planning

Sample-Observed Soft Actor-Critic Learning for Path Following of a Biomimetic Underwater Vehicle

Adaptive path following control for underactuated surface vessels considering actuator saturation dynamics

Autonomous Underwater Vehicle (AUV) Motion Design: Integrated Path Planning and Trajectory Tracking Based on Model Predictive Control (MPC)