Abstract:Controller design for soft robots is challenging due to nonlinear deformation and high degrees of freedom of flexible material. The data-driven approach is a promising solution to the controller design problem for soft robots. However, the existing data-driven controller design methods for soft robots suffer from two drawbacks: (i) they require excessively long training time, and (ii) they may result in potentially inefficient controllers. This paper addresses these issues by developing two memory-based controllers for soft robots that can be trained in a data-driven fashion: the finite memory controller (FMC) approach and the long short-term memory (LSTM) based approach. An FMC stores the tracking errors at different time instances and computes the actuation signal according to a weighted sum of the stored tracking errors. We develop three reinforcement learning algorithms for computing the optimal weights of an FMC using the Q-learning, soft actor-critic, and deterministic policy gradient (DDPG) methods. An LSTM-based controller is composed of an LSTM network where the inputs of the network are the robot's desired configuration and current configuration. The LSTM network computes the required actuation signal for the soft robot to follow the desired configuration. We study the performance of the proposed approaches in controlling a soft finger where, as benchmarks, we use the existing reinforcement learning (RL) based controllers and proportional-integral-derivative (PID) controllers. Our numerical results show that the training time of the proposed memory-based controllers is significantly shorter than that of the classical RL-based controllers. Moreover, the proposed controllers achieve a smaller tracking error compared with the classical RL algorithms and the PID controller.

A Hierarchical Autonomous Robot Controller for Learning and Memory: Adaptation in a Dynamic Environment.

A Spiking Neural Network With Dynamic Memory For A Real Autonomous Mobile Robot In Dynamic Environment

Adapting Real Mobile Robots to Complex Environments Using a Pattern Association Network Controller (PAN-C).

A Novel Hierarchical Constructive BackPropagation with Memory for Teaching a Robot the Names of Things

Cognitive Navigation by Neuro-Inspired Localization, Mapping, and Episodic Memory

A Neuro-Cognitive System and Its Application in Robotics

A Simple Aplysia-Like Spiking Neural Network to Generate Adaptive Behavior in Autonomous Robots

Cognitive Memory and Mapping in a Brain-Like System for Robotic Navigation

Autonomous Mobile Robot Control Algorithm Based on Hierarchical Fuzzy Behaviors in Unknown Environments

Hierarchical learning control for autonomous robots inspired by central nervous system

A neuro-cognitive robot for spatial navigation

A Neurobiologically Inspired Mapping and Navigating Framework for Mobile Robots

Spiking Reinforcement Learning with Memory Ability for Mapless Navigation

An Autonomous Developmental Cognitive Architecture Based on Incremental Associative Neural Network with Dynamic Audiovisual Fusion

Robotic Episodic Learning and Behaviour Control Integrated with Neuron Stimulation Mechanism

Memory-based Controllers for Efficient Data-driven Control of Soft Robots

A Tree-Type Memory Formation by Sensorimotor Feedback: A Possible Approach to the Development of Robotic Cognition

On-Line Affective Cognitive Learning And Decision-Making For Autonomous Navigation Of Mobile Robots

Exploring unknown environments: motivated developmental learning for autonomous navigation of mobile robots

Integrated model of cerebellal supervised learning and basal ganglia's reinforcement learning for mobile robot behavioral decision-making

Sensor-fusion in Spiking Neural Network That Generates Autonomous Behavior in Real Mobile Robot