Abstract:The fish-like robot is one of the typical underwater robots, which has the advantage of high maneuverability with low noise due to its bioinspired structure and biomimetic locomotion. However, it is challenging to efficiently design motion controllers for such robots to achieve satisfactory performance on specific control tasks in the real underwater environment, since the complex fluid-structure interaction exists during their swimming and exact dynamic models are absent. In this article, we propose a learning framework, incorporating a simulation system and a training methodology, to autonomously and fast train in simulation to create control policies that are capable of directly applying to a type of physical fish-like robots to perform motion control tasks. First, we construct a simulation system combining a data-driven environment and a computational fluid dynamics (CFD)-based environment, thus well balancing the simulation accuracy and the calculation speed. Second, we design a training methodology to train deep reinforcement learning (DRL)-based policies for the robot in our constructed simulation system to perform a specific control task. Then, we use two typical motion control tasks to verify our proposed framework. One is the path-following control task, which is a one-objective problem with dense rewards, while the other is the pose control task which is a two-objective problem with sparse rewards. For each task, the DRL-based control policy trained by our learning framework is directly deployed on the physical fish-like robot to perform the task in the real world. Experimental results show that the policies trained in simulation still work well in the real world, and perform even better in terms of control accuracy and stability compared with the traditional control methods, thus demonstrating the effectiveness of our learning framework.

Underwater Target Tracking Control of an Untethered Robotic Fish With a Camera Stabilizer

A Data-Driven Motion Control Approach for a Robotic Fish

Precise Speed Tracking Control of a Robotic Fish Via Iterative Learning Control

Closed-Loop Tracking-by-Detection for ROV-Based Multiple Fish Tracking

Speed Trajectory Tracking Of A Robotic Fish Based On Iterative Learning Control Approach

Design and implementation of a biomimetic robotic fish with 3D locomotion

Design and development of autonomous robotic fish for object detection and tracking

Motion Control For A Multi-Joint Robotic Fish With The Pectoral Fins Assistance

Motion control of a robotic fish via learning control approach with self-adaption

Motion Control of a Multi-Joint Robotic Fish Based on Biomimetic Learning

A Robust Underwater Multiclass Fish-School Tracking Algorithm

Underwater Target Following with a Vision-Based Autonomous Robotic Fish

An Effective Tracking Control For Robotic Fish: Implementation And Application

Vision-Based Target Tracking And Collision Avoidance For Two Autonomous Robotic Fish

Visual Tracking of Multiple Robotic Fish for Cooperative Control

Target-Following Control of a Biomimetic Autonomous System Based on Predictive Reinforcement Learning

Learning for Attitude Holding of a Robotic Fish: An End-to-End Approach With Sim-to-Real Transfer

Research on Target Tracking for Robotic Fish Based on Low-Cost Scarce Sensing Information Fusion

Trajectory Tracking and Obstacle Avoidance of Robotic Fish Based on Nonlinear Model Predictive Control

From Simulation to Reality: A Learning Framework for Fish-Like Robots to Perform Control Tasks