Abstract:The foot paddling of an underwater robot causes continuous changes of the water flow field, which results in the unbalanced hydrodynamic force to change the robot's posture continuously. As the water environment and robot swimming are nonlinear and strongly coupled systems, it is difficult to establish an accurate model. This paper presents an underwater robot, which adopts the synchronous and alternate swimming trajectory of a beaver. Its pitch stability control model is established by using deep reinforcement learning algorithm and its self-learning control system is constructed for stable control of pitch attitude. Experiments are conducted to show that the pitch attitude of the beaver-like underwater robot can be stabilized while maintaining a certain swimming speed. The control method does not need to establish a complex and high-order model of webbed paddling hydrodynamics, which provides a new idea for stable swimming control of underwater robots. This work aims to find an excellent control method for underwater bionic robots. The ocean has the richest natural resources and the most diverse species on Earth. The underwater environment is complex and variable, imposing higher demands on the performance of underwater robots. Increasingly, new concept marine equipment is being researched for scientific exploration, and among these, underwater robots designed based on bionic principles are a growing trend. Currently, most underwater robots still use propellers as their propulsion system. Propellers have advantages such as simple control, high mechanical efficiency, and powerful propulsion, but they also have drawbacks including severe water flow disturbance during operation, high noise, poor concealment, and limited adaptability in complex water environments. Finding a propulsion system with better overall performance is a crucial way to enhance the motion capabilities of underwater robots. Underwater robots often have complex structures, and there are numerous factors influencing their movement in the underwater environment, making fluid dynamics modeling and optimization challenging. Reinforcement learning, as an optimization algorithm, can circumvent the aforementioned difficulties.

Research on the Pitch Angle Attitude Control of Underwater Vehicles Based on a Novel Butterfly-Shaped Blocks Structure

Active disturbance rejection control for AUV pitch angle

A Self-Searching Optimal ADRC for the Pitch Angle Control of an Underwater Thermal Glider in the Vertical Plane Motion

ADRC-Based Underwater Navigation Control and Parameter Tuning of an Amphibious Multirotor Vehicle

Adaptive Integral Sliding Mode Control for Attitude Tracking of Underwater Robots With Large Range Pitch Variations in Confined Space

Research on Attitude Stability Control Method and Experiment of Underwater Vehicle under Water Flow Interference

Controller Design of an Autonomous Underwater Vehicle Using ELM-based Sliding Mode Control

Pitch Angle Control with Model Compensation Based on Active Disturbance Rejection Controller for Underwater Gliders

Low-level Control Technology of Micro Autonomous Underwater Vehicle Based on Intelligent Computing.

A Prototype of Newly Dynamic Underwater Vehicle Using Fuzzy PID Control

Adaptive PID control system for an autonomous underwater vehicle

Research on fractional-order PID control for underwater vehicle attitude angle

Design of a hybrid controller for heading control of an autonomous underwater vehicle

Study on the Control of Fractional-Order PID for Underwater Vehicle Attitude Angle

A Double Closed-loop Integral Sliding Mode Controller for Position and Attitude Tracking of Underwater Vehicle

A Novel Adaptive Backstepping Sliding Mode Control for a Lightweight Autonomous Underwater Vehicle with Input Saturation

Fixed-depth Control Based Fuzzy PID in Series of Bionic Underwater Vehicle Propelled by Multiple Undulatory Fins

Deep Reinforcement Learning-Based Pitch Attitude Control of a Beaver-Like Underwater Robot

Attitude Control of Autonomous Underwater Vehicle Based on Improved Firefly PID Method

Robust yaw control of autonomous underwater vehicle based on fractional-order PID controller

Underwater vehicle motion control based on high order sliding controller