Abstract:Fish are capable of learning complex relations found in their surroundings, and harnessing their knowledge may help to improve the autonomy and adaptability of robots. Here, we propose a novel learning from demonstration framework to generate fish-inspired robot control programs with as little human intervention as possible. The framework consists of six core modules: (1) task demonstration, (2) fish tracking, (3) analysis of fish trajectories, (4) acquisition of robot training data, (5) generating a perception-action controller, and (6) performance evaluation. We first describe these modules and highlight the key challenges pertaining to each one. We then present an artificial neural network for automatic fish tracking. The network detected fish successfully in 85% of the frames, and in these frames, its average pose estimation error was less than 0.04 body lengths. We finally demonstrate how the framework works through a case study focusing on a cue-based navigation task. Two low-level perception-action controllers were generated through the framework. Their performance was measured using two-dimensional particle simulations and compared against two benchmark controllers, which were programmed manually by a researcher. The fish-inspired controllers had excellent performance when the robot was started from the initial conditions used in fish demonstrations (>96% success rate), outperforming the benchmark controllers by at least 3%. One of them also had an excellent generalisation performance when the robot was started from random initial conditions covering a wider range of starting positions and heading angles (>98% success rate), again outperforming the benchmark controllers by 12%. The positive results highlight the utility of the framework as a research tool to form biological hypotheses on how fish navigate in complex environments and design better robot controllers on the basis of biological findings.

A Bionic Neural Network for Fish-Robot Locomotion

Design of an Artificial Bionic Neural Network to Control Fish-Robot's Locomotion

A GIM-Based Biomimetic Learning Approach for Motion Generation of a Multi-Joint Robotic Fish

Motion Control of a Multi-Joint Robotic Fish Based on Biomimetic Learning

Locomotion Learning for an Anguilliform Robotic Fish Using Central Pattern Generator Approach

Generation of robotic fish locomotion through biomimetic learning

Design and implementation of a biomimetic robotic fish with 3D locomotion

A Data-Driven Motion Control Approach for a Robotic Fish

Motion Controller Design for a Biomimetic Robotic Fish

Applying Central Pattern Generators to Control the Robofish with Oscillating Pectoral Fins.

Development of Multi-mode Biomimetic Robotic Fish Based on Central Pattern Generator

Design and Cpg-Based Control of Biomimetic Robotic Fish

Neural-based control of modular robotic fish with multiple propulsors

Back-Propagation Neural Network Based Predictive Control For Biomimetic Robotic Fish

CPGs Control Method Using a New Oscillator in Robotic Fish

Design and Application of a Novel Artificial Neural Oscillator

Neural Controller for Swimming Modes and Gait Transition on an Ostraciiform Fish Robot

Robot Programming from Fish Demonstrations

Electromyography-Based Biomechanical Cybernetic Control of a Robotic Fish Avatar

On Study of Intelligent Control Methods for a Bionic Dolphin Based on Sensory Feedback CPG Model

Using inverse learning for controlling bionic robotic fish with SMA actuators