Abstract:Fish are capable of learning complex relations found in their surroundings, and harnessing their knowledge may help to improve the autonomy and adaptability of robots. Here, we propose a novel learning from demonstration framework to generate fish-inspired robot control programs with as little human intervention as possible. The framework consists of six core modules: (1) task demonstration, (2) fish tracking, (3) analysis of fish trajectories, (4) acquisition of robot training data, (5) generating a perception-action controller, and (6) performance evaluation. We first describe these modules and highlight the key challenges pertaining to each one. We then present an artificial neural network for automatic fish tracking. The network detected fish successfully in 85% of the frames, and in these frames, its average pose estimation error was less than 0.04 body lengths. We finally demonstrate how the framework works through a case study focusing on a cue-based navigation task. Two low-level perception-action controllers were generated through the framework. Their performance was measured using two-dimensional particle simulations and compared against two benchmark controllers, which were programmed manually by a researcher. The fish-inspired controllers had excellent performance when the robot was started from the initial conditions used in fish demonstrations (>96% success rate), outperforming the benchmark controllers by at least 3%. One of them also had an excellent generalisation performance when the robot was started from random initial conditions covering a wider range of starting positions and heading angles (>98% success rate), again outperforming the benchmark controllers by 12%. The positive results highlight the utility of the framework as a research tool to form biological hypotheses on how fish navigate in complex environments and design better robot controllers on the basis of biological findings.

Development of vision-based object tracking fish robot

Design and development of autonomous robotic fish for object detection and tracking

A Data-Driven Motion Control Approach for a Robotic Fish

Speed Trajectory Tracking Of A Robotic Fish Based On Iterative Learning Control Approach

Closed-Loop Tracking-by-Detection for ROV-Based Multiple Fish Tracking

Online Fish Tracking with Portable Smart Device for Ocean Observatory Network

Precise Speed Tracking Control of a Robotic Fish Via Iterative Learning Control

Design and implementation of a biomimetic robotic fish with 3D locomotion

MODELING AND CONTROL DESIGN OF AN ANGUILLIFORM ROBOTIC FISH

Motion Control For A Multi-Joint Robotic Fish With The Pectoral Fins Assistance

A Motion Control Approach for a Robotic Fish with Iterative Feedback Tuning

An Effective Tracking Control For Robotic Fish: Implementation And Application

Underwater Target Following with a Vision-Based Autonomous Robotic Fish

Vision-Based Target Tracking And Collision Avoidance For Two Autonomous Robotic Fish

Development of vision-based autonomous robotic fish and its application in water-polo-attacking task

Underwater Target Tracking Control of an Untethered Robotic Fish With a Camera Stabilizer

Visual Tracking of Multiple Robotic Fish for Cooperative Control

Robot Programming from Fish Demonstrations

Bioinspired Closed-loop CPG-based Control of a Robot Fish for Obstacle Avoidance and Direction Tracking

Finite-Time Line-of-Sight Guidance-Based Path-Following Control for a Wire-Driven Robot Fish

CFD Based Parameter Tuning for Motion Control of Robotic Fish.