Abstract:Fish are capable of learning complex relations found in their surroundings, and harnessing their knowledge may help to improve the autonomy and adaptability of robots. Here, we propose a novel learning from demonstration framework to generate fish-inspired robot control programs with as little human intervention as possible. The framework consists of six core modules: (1) task demonstration, (2) fish tracking, (3) analysis of fish trajectories, (4) acquisition of robot training data, (5) generating a perception-action controller, and (6) performance evaluation. We first describe these modules and highlight the key challenges pertaining to each one. We then present an artificial neural network for automatic fish tracking. The network detected fish successfully in 85% of the frames, and in these frames, its average pose estimation error was less than 0.04 body lengths. We finally demonstrate how the framework works through a case study focusing on a cue-based navigation task. Two low-level perception-action controllers were generated through the framework. Their performance was measured using two-dimensional particle simulations and compared against two benchmark controllers, which were programmed manually by a researcher. The fish-inspired controllers had excellent performance when the robot was started from the initial conditions used in fish demonstrations (>96% success rate), outperforming the benchmark controllers by at least 3%. One of them also had an excellent generalisation performance when the robot was started from random initial conditions covering a wider range of starting positions and heading angles (>98% success rate), again outperforming the benchmark controllers by 12%. The positive results highlight the utility of the framework as a research tool to form biological hypotheses on how fish navigate in complex environments and design better robot controllers on the basis of biological findings.

Fish-inspired tracking of underwater turbulent plumes

Fish-inspired tracking of underwater turbulent plumes

Efficient Navigation of a Robotic Fish Swimming Across the Vortical Flow Field

Learning Efficient Navigation in Vortical Flow Fields

Dynamic robotic tracking of underwater targets using reinforcement learning

Underwater Target Tracking Control of an Untethered Robotic Fish With a Camera Stabilizer

Design and development of autonomous robotic fish for object detection and tracking

A reinforcement learning path planning approach for range-only underwater target localization with autonomous vehicles

Physics-informed reinforcement learning for motion control of a fish-like swimming robot

Oil Plume Mapping: Adaptive Tracking and Adaptive Sampling From an Autonomous Underwater Vehicle

Learning for Attitude Holding of a Robotic Fish: An End-to-End Approach With Sim-to-Real Transfer

A Local Sensory and Control Strategy for Following Hydrodynamic Signals

Ergodic Exploration for Adaptive Sampling of Water Columns Using Gliding Robotic Fish

Robot Programming from Fish Demonstrations

Online State Estimation of a Fin-Actuated Underwater Robot Using Artificial Lateral Line System

A Novel Closed-Loop Robotic Fish Experimental System Based on ROS

Bioinspired algorithm for autonomous sensor-driven guidance in turbulent chemical plumes

Visual identification of biological motion for underwater human–robot interaction

Estimating the Lateral Motion States of an Underwater Robot by Propeller Wake Sensing Using an Artificial Lateral Line

Path Following, Obstacle Detection and Obstacle Avoidance for Thrusted Underwater Snake Robots

Enhancing efficiency and propulsion in bio-mimetic robotic fish through end-to-end deep reinforcement learning