Abstract:A rapidly growing field of aquatic bio-inspired soft robotics takes advantage of the underwater animals’ bio-mechanisms, where its applications are foreseen in a vast domain such as underwater exploration, environmental monitoring, search and rescue, oil-spill detection, etc. Improved maneuverability and locomotion of such robots call for designs with higher level of biomimicry, reduced order of complex modeling due to continuum elastic dynamics, and challenging robust nonlinear controllers. This paper presents a novel design of a soft robotic fish actively actuated by a newly developed kind of artificial muscles—super-coiled polymers (SCP) and passively propelled by a caudal fin. Besides SCP exhibiting several advantages in terms of flexibility, cost and fabrication duration, this design benefits from the SCP’s significantly quicker recovery due to water-based cooling. The soft robotic fish is approximated as a 3-link representation and mathematically modeled from its geometric and dynamic perspectives to constitute the combined system dynamics of the SCP actuators and hydrodynamics of the fish, thus realizing two-dimensional fish-swimming motion. The nonlinear dynamic model of the SCP driven soft robotic fish, ignoring uncertainties and unmodeled dynamics, necessitates the development of robust/intelligent control which serves as the motivation to not only mimic the bio-mechanisms, but also mimic the cognitive abilities of a real fish. Therefore, a learning-based control design is proposed to meet the yaw control objective and study its performance in path following via various swimming patterns. The proposed learning-based control design employs the use of deep-deterministic policy gradient (DDPG) reinforcement learning algorithm to train the agent. To overcome the limitations of sensing the soft robotic fish’s states by designing complex embedded sensors, overhead image-based observations are generated and input to convolutional neural networks (CNNs) to deduce the curvature dynamics of the soft robot. A linear quadratic regulator (LQR) based multi-objective reward is proposed to reinforce the learning feedback of the agent during training. The DDPG-based control design is simulated and the corresponding results are presented.

Repetitive Learning Control for Body Caudal Undulation with Soft Sensory Feedback

Motion Control Of A Soft Circular Crawling Robot Via Iterative Learning Control

Iterative Learning Control for Motion Trajectory Tracking of a Circular Soft Crawling Robot

Adaptive Locomotion Control of a Hexapod Robot Via Bio-Inspired Learning

Control of a muscle-like soft actuator via a bioinspired approach.

Motion Control Of A Snake Robot Via Cerebellum-Inspired Learning Control

A Soft Artificial Muscle Driven Robot with Reinforcement Learning

Reinforcement Learning of CPG-regulated Locomotion Controller for a Soft Snake Robot

Design, Modeling, and Visual Learning-Based Control of Soft Robotic Fish Driven by Super-Coiled Polymers

Adaptive Tracking Control of Soft Robots using Integrated Sensing Skin and Recurrent Neural Networks

Model-free control framework for multi-limb soft robots

Learning Control for Biomimetic Undulating Fins: an Experimental Study

Closed‐Loop Soft Robot Control Frameworks with Coordinated Policies Based on Reinforcement Learning and Proprioceptive Self‐Sensing

Learning-Based Control for Soft Robot–Environment Interaction with Force/Position Tracking Capability

Knowledge-based self-tuning of PID control gains for continuum soft robots

Proprioceptive Sensing of Soft Tentacles with Model Based Reconstruction for Controller Optimization

Residual Reinforcement Learning for Motion Control of a Bionic Exploration Robot—RoboDact

Model-based dynamic feedback control of a planar soft robot: trajectory tracking and interaction with the environment

Learning to Locomote with Deep Neural-Network and CPG-based Control in a Soft Snake Robot

An Advanced Adaptive Control of Lower Limb Rehabilitation Robot

Reinforcement Learning Controllers for Soft Robots using Learned Environments